Experience ride representation apparatus and method for real-sense media service based on multi-vision

• US 9,480,928 B2
• Filed: 05/12/2015
• Issued: 11/01/2016
• Est. Priority Date: 05/12/2014
• Status: Expired due to Fees

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Park, Sang-Wook, Jang, Jong-Hyun
• Primary Examiner(s): NGUYEN, KIEN T
• Application Number:
  US14/710,024
• Publication Number:
  US 20150321107A1
• Time in Patent Office: 539 Days
• Field of Search: 472 59- 61, 472/130, 434/247, 434/253, 463/42, 463/43
• US Class Current: 1/1
• CPC Class Codes: A63F 9/143 electric
• CPC Class Codes: A63G 31/16 creating illusions of travel
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

Disclosed herein are an experience ride representation apparatus and method for a real-sense media service based on a multi-vision. An experience ride representation apparatus for a real-sense media service based on a multi-vision in which a motion of a user is reflected so as to move in a plurality of screen units depending on a first signal received from the user, a second signal is transmitted to the user based on real-sense media contents reproduced on the screen unit, and metaverse contents are provided to a plurality of users when the screen unit is shared by the plurality of users.

Claims

1. An experience ride representation apparatus for a real-sense media service based on a multi-vision comprising a plurality of screen units for one or more users,

wherein one of the plurality of screen units reflects a motion of a user in response to a first signal of the user,

wherein a second signal is transmitted to the user based on real-sense media contents reproduced on the screen unit, and

wherein metaverse contents are provided to the screen unit, and the real-sense media contents are provided to a remaining screen unit when the screen unit is shared by a plurality of users.

2. An experience ride representation apparatus for a real-sense media service based on a multi-vision, comprising:

a content server providing real-sense media contents and real-sense effect data corresponding to the real-sense media contents;

a plurality of screen units reproducing the real-sense media contents;

a real-sense device providing a real-sense effect to a user based on the real-sense effect data;

a motion recognizing unit recognizing a motion of the user to generate motion information;

a motion processing unit reflecting the motion of the user in the screen unit based on the motion information;

a screen moving unit requesting the motion processing unit to reflect the motion of the user in the screen unit corresponding to a screen moving signal when the motion recognizing unit receives the screen moving signal from the user; and

a metaverse server providing metaverse contents shared by a plurality of users and metaverse real-sense effect data corresponding to the metaverse contents in the case in which motions of the plurality of users are reflected in the screen unit,

wherein metaverse contents are provided to the screen unit, and the real-sense media contents are provided to a remaining screen unit when motions of a plurality of users are reflected in the screen unit.

3. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 2, wherein the content server includes a content speed controlling unit controlling a reproduction speed of the real-sense media contents reproduced on the screen unit depending on the motion information of the user.

4. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 2, wherein the content server includes a content transmitting unit transmitting the real-sense media contents and the real-sense effect data to the screen unit through a communication network.

5. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 2, wherein the screen unit reflects the motion of the user as any one or more of an avatar and a character.

6. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 2, wherein the motion information recognized by the motion recognizing unit from the motion of the user includes:

pitch motion information on a motion ascending or descending based on a direction in which the user advances;

yaw motion information on a motion rotating to the left or the right based on the direction in which the user advances; and

roll motion information on a motion inclined to the left or the right based on the direction in which the user advances.

7. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 2, further comprising a screen connecting unit connecting real-sense media contents reproduced on the screen unit before the screen moving signal is received and real-sense media contents reproduced on the screen unit corresponding to the screen moving signal to each other, when the screen moving unit reflects the motion of the user in the screen unit corresponding to the screen moving signal.

8. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 2, further comprising a topographic information providing unit obtaining topographic information from any one of the real-sense media contents and the metaverse contents and requesting the motion processing unit to reflect a real-sense effect corresponding to the topographic information in the screen unit.

9. The experience ride representation apparatus for a real-sense media service based on a multi-vision of claim 8, wherein the topographic information providing unit requests the real-sense device to transfer a physical stimulus to the user through the real-sense device based on the topographic information.

10. An experience ride representation method for a real-sense media service based on a multi-vision, comprising:

receiving a first signal from a user;

reflecting a motion of the user in one of a plurality of screen units in response to the first signal;

transmitting a second signal to the user based on real-sense media contents reproduced on the screen unit; and

providing metaverse contents to the screen unit, and the real-sense media contents to a remaining screen unit when the screen unit is shared by a plurality of users.

11. An experience ride representation method for a real-sense media service based on a multi-vision, comprising:

providing, by a content server, real-sense media contents and real-sense effect data corresponding to the real-sense media contents to a screen unit;

reproducing, by the screen unit, the real-sense media contents;

providing, by a real-sense device, a real-sense effect to a user based on the real-sense effect data;

recognizing, by a motion recognizing unit, a motion of the user to generate motion information;

reflecting, by a motion processing unit, the motion of the user in the screen unit based on the motion information;

requesting, by a screen moving unit, the motion processing unit to reflect the motion of the user in the screen unit corresponding to a screen moving signal when the motion recognizing unit receives the screen moving signal from the user; and

providing, by a metaverse server, metaverse contents shared by a plurality of users and metaverse real-sense effect data corresponding to the metaverse contents in the case in which motions of the plurality of users are reflected in the screen unit,

wherein metaverse contents are provided to the screen unit, and the real-sense media contents are provided to a remaining screen unit when motions of a plurality of users are reflected in the screen unit.

12. The experience ride representation method for a real-sense media service based on a multi-vision of claim 11, further comprising controlling, by a content speed controlling unit, a reproduction speed of the real-sense media contents reproduced on the screen unit depending on the motion information of the user.

13. The experience ride representation method for a real-sense media service based on a multi-vision of claim 11, further comprising transmitting, by a content transmitting unit, the real-sense media contents and the real-sense effect data to the screen unit through a communication network.

14. The experience ride representation method for a real-sense media service based on a multi-vision of claim 11, further comprising connecting, by a screen connecting unit, real-sense media contents reproduced on the screen unit before the screen moving signal is received and real-sense media contents reproduced on the screen unit corresponding to the screen moving signal to each other, when the screen moving unit reflects the motion of the user in the screen unit corresponding to the screen moving signal.

15. The experience ride representation method for a real-sense media service based on a multi-vision of claim 11, further comprising:

obtaining, by a topographic information providing unit, topographic information from any one of the real-sense media contents and the metaverse contents and requesting the motion processing unit to reflect a real-sense effect corresponding to the topographic information in the screen unit; and

requesting, by the topographic information providing unit, the real-sense device to transfer a physical stimulus to the user through the real-sense device based on the topographic information.