SYSTEM AND METHOD FOR VIRTUAL TOUR EXPERIENCE

• US 20160260252A1
• Filed: 03/01/2016
• Published: 09/08/2016
• Est. Priority Date: 03/06/2015
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: KIM, Yong Sun, KIM, Yong Wan, KIM, Dae Hwan, KIM, Jin Ho, JO, Dong Sik, KIM, Ki Hong
• Application Number:
  US15/057,675
• Publication Number:
  US 20160260252A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: H04N 13/20 Image signal generators
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00

Abstract

A system and method for virtual tour experience are provided. The system includes an image output module configured to output an image of the content for virtual tour experience, a motion recognition module configured to recognize a physical motion of a user, a content running module configured to control motions of a plurality of objects included in the image of the content for virtual tour experience according to the physical motion recognized by the motion recognition module, and a user interface configured to provide to the user a tangible feedback about a geographic environment in the content for virtual tour experience and changes in the motions of the plurality of objects.

Claims

1. A system for virtual tour experience, comprising:

an image output module configured to output an image of content for virtual tour experience;

a motion recognition module configured to recognize a physical motion of a user;

a content running module configured to control motions of a plurality of objects included in the image of the content for virtual tour experience according to the physical motion recognized by the motion recognition module; and

a user interface configured to provide to the user a tangible feedback about a geographic environment in the content for virtual tour experience and changes in the motions of the plurality of objects.

4. The system of claim 1, wherein the motion recognition module recognizes the physical motion of the user using sensed data acquired from at least one of a motion sensor sensing a hand motion of the user and a motion of a whole body of the user and a tangible interface in contact with the body of the user to track a motion of an arm of the user.

5. The system of claim 1, wherein the content running module reflects a specific gesture of the user and a change in a line of sight of the user recognized by the motion recognition module in the content for virtual tour experience.

6. The system of claim 1, wherein the user interface includes:

an interface controller configured to control a motion of a motion platform having a form of a vehicle in which the user rides; and

a four-dimensional (4D) effect generator configured to provide physical effects produced according to a situation of the content for virtual tour experience to the user.

7. The system of claim 1, wherein the user interface generates the tangible feedback providing physical effects produced through interactions between the physical motion of the user and the plurality of objects in the content for virtual tour experience by the five senses.

2. The system of claim I, wherein the image output module includes at least one of a wide-viewing-angle head mounted display (HMD) covering a viewing angle of the user and a panoramic display device capable of playing a three-dimensional (3D) image and a predetermined distance away from the user.

3. The system of claim 2, wherein the image output module further includes a wide angle 3D camera capturing an actual environment in a direction of a line of sight of the user, and

the actual environment captured by the wide angle 3D camera is output on a screen through the wide-viewing-angle HMD.

8. A method for virtual tour experience using a system for virtual tour experience, the method comprising:

outputting an image of content for virtual tour experience;

recognizing a physical motion of a user participating in the virtual tour experience;

controlling motions of a plurality of objects included in the image of the content for virtual tour experience according to the physical motion; and

providing a tangible feedback to the user according to changes in the motions of the plurality of objects and a geographic environment in the content for virtual tour experience.

9. The method of claim 8, wherein the outputting of the image includes outputting the image on a screen in at least one of a form covering a viewing angle of the user and a three-dimensional (3D) panoramic form a predetermined distance away from the user.

10. The method of claim 8, wherein the outputting of the image includes capturing an actual environment in a direction of a line of sight of the user and outputting on a screen.

11. The method of claim 8, wherein the recognizing of the physical motion includes recognizing the physical motion of the user including at least one of a hand motion of the user, a motion of a whole body of the user, a motion of an arm of the user.

12. The method of claim 8, wherein the controlling of the motions includes reflecting a specific gesture of the user and a change in a line of sight of the user in the content for virtual tour experience output on a screen.

13. The method of claim 8, wherein the providing of the tangible feedback includes controlling a motion of a motion platform having a form of a vehicle in which the user rides or providing to the user physical effects produced according to a virtual environment of the content for virtual tour experience.

14. The method of claim 8, wherein the providing of the tangible feedback includes generating the tangible feedback so that the user feels physical effects produced through interactions between the physical motion of the user and the plurality of objects in the content for virtual tour experience by the five senses.