SYSTEM AND METHOD FOR PROVIDING SIMULATED ENVIRONMENT

• US 20180101990A1
• Filed: 09/27/2017
• Published: 04/12/2018
• Est. Priority Date: 10/07/2016
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: YANG, Hung-Yi, CHOI, Iok-Kan
• Granted Patent: US 10,896,544 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Present disclosure relates to a system for providing a simulated environment and a method thereof. The system comprises a first wearable device, a second wearable device and a computing device. The first wearable device is configured to output a scenario of the simulated environment and to output a first audio. The second wearable device is configured to collect an environmental sound around the second wearable device and send out the sound. The computing device is configured to merge the sound into the first audio according to an index and send the merged first audio to the first wearable device, wherein the index is determined by a relative distance and a relative direction between coordinates being assigned to the first wearable device and the second wearable device in the simulated environment.

Claims

1. A system for providing a simulated environment, comprising:

a first wearable device, configured to output a scenario of the simulated environment and to output a first audio;

a second wearable device, configured to collect an environmental sound around the second wearable device and send out the environmental sound; and

a computing device, configured to merge the environmental sound into the first audio according to an index and send the merged first audio to the first wearable device, wherein the index is determined by a relative distance and a relative direction between coordinates being assigned to the first wearable device and the second wearable device in the simulated environment.

2. The system of claim 1, wherein the second wearable device is further configured to retrieve a face characteristic and send the face characteristic to the computing device, and wherein the face characteristic is provided to illustrate a face pattern of an avatar in the scenario.

3. The system of claim 1, wherein the second wearable device is further configured to scan an object to generate scan information and send the scan information to the computing device, and wherein the scan information is provided to illustrate a virtual object having a contour corresponding to the object in the scenario.

4. The system of claim 1, wherein the first wearable device further comprises a detector, which is configured to track a spatial vector of the second wearable device with respect to the first wearable device, wherein the spatial vector is sent to the computing device for determining the relative distance and the relative direction.

5. The system of claim 4, wherein the detector comprises an optical detector, a resonance detector, a camera and a motion detector.

6. The system of claim 1, further comprising:

a detector, placed in a first space, provided to track a first spatial vector of the first wearable device with respect to the first space and to track a second spatial vector of the second wearable device with respect to the first space, wherein the first spatial vector and the second spatial vector are send to the computing device for determining the relative distance and the relative direction.

7. The system of claim 6, wherein the detector comprises an optical detector, a resonance detector, a camera and a motion detector.

8. The system of claim 1, further comprising:

a first detector, placed in a first space, provided to track a first spatial vector of the first wearable device with respect to the first space;

a second detector, placed in a second space, provided to track a second spatial vector of the second wearable device with respect to the first space;

wherein the first spatial vector and the second spatial vector are send to the computing device for determining the relative distance and the relative direction.

9. The system of claim 8, wherein the first detector and the second detector comprise an optical detector, a resonance detector, a camera and a motion detector.

10. The system of claim 1, wherein the sound is merged into the first audio based on HRTF (Head Related Transfer Function).

11. A method for providing a simulated environment, comprising:

outputting, by a first wearable device, a scenario of the simulated environment and a first audio;

collecting, by a second wearable device, an environmental sound around the second wearable device;

sending, by the second wearable device, the environmental sound to a computing device;

merging, by the computing device, the environmental sound into the first audio according to an index, wherein the index is determined by a relative distance and a relative direction between coordinates being assigned to the first wearable device and the second wearable device; and

sending, by the computing device, the merged first audio to the first wearable device.

12. The method of claim 11, further comprising:

retrieving, by the second wearable device, a face characteristic;

sending, by the second wearable device, the face characteristic to the computing device; and

illustrating, by the computing device, a face pattern of an avatar in the simulated environment according to the face characteristic.

13. The method of claim 11, further comprising:

scanning, by the second wearable device, a physical object to generate scan information;

sending, by the second wearable device, scan information to the computing device; and

illustrating, by the computing device, a virtual object having a contour corresponding to the physical object in the scenario according to the scan information.

14. The method of claim 11, further comprising:

tracking, by a detector configured in the first wearable device, a spatial vector of the second wearable device with respect to the first wearable device; and

sending, by the first wearable device, the spatial vector to the computing device for determining the relative distance and the relative direction.

15. The method of claim 14, wherein the detector comprises an optical detector, a resonance detector, a camera and a motion detector.

16. The method of claim 11, further comprising:

tracking, by a detector placed in a first space, a first spatial vector of the first wearable device with respect to the first space;

tracking, by the detector, a second spatial vector of the second wearable device with respect to the first space;

sending, by the detector, the first spatial vector and the second spatial vector to the computing device; and

determining, by the computing device, the relative distance and the relative direction according to the first spatial vector and the second spatial vector.

17. The method of claim 16, wherein the detector comprises an optical detector, a resonance detector, a camera and a motion detector.

18. The method of claim 11, further comprising:

tracking, by a first detector placed in a first space, a first spatial vector of the first wearable device with respect to the first space;

tracking, by a second detector placed in a second space, a second spatial vector of the second wearable device with respect to the second space;

sending, by the first detector, the first spatial vector to the computing device;

sending, by the second detector, the second spatial vector to the computing device; and

determining, by the computing device, the relative distance and the relative direction according to the first spatial vector and the second spatial vector.

19. The method of claim 18, wherein the first detector and the second detector comprise an optical detector, a resonance detector, a camera and a motion detector.

20. The method of claim 11, wherein the sound is merged into the first audio based on HRTF (Head Related Transfer Function).