AUGMENTED REALITY SYSTEM

• US 20120143361A1
• Filed: 12/02/2010
• Published: 06/07/2012
• Est. Priority Date: 12/02/2010
• Status: Active Grant

• Current Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Kurabayashi, Shuichi, Yoshida, Naofumi, Takano, Kosuke
• Granted Patent: US 8,660,679 B2
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G10H 2220/161 with 2D or x/y surface coordinates sensing graphical user interface or touchscreen input G10H2220/091; microtonal keyboard G10H2210/401
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S

Abstract

Technologies are generally described for a system for processing an augmented reality image. In some examples, an augmented reality system may include an augmented reality engine configured to provide an augmented reality image by integrating a real-world image and a virtual object, and a message processing unit configured to receive a message related to the virtual object and to translate spatial attributes of the virtual object into audio attributes of a sound file.

Claims

1. An augmented reality system comprising:

an augmented reality engine configured to provide an augmented reality image by integrating a real-world image and a virtual object; and

a message processing unit configured to receive a message related to the virtual object and to translate spatial attributes of the virtual object into audio attributes of a sound file.

2. The augmented reality system of claim 1, further comprising a sound player configured to play the sound file.

3. The augmented reality system of claim 1, wherein the spatial attributes comprise a first spatial component, a second spatial component, and a third spatial component of the virtual object,

wherein the audio attributes comprise a first audio component, a second audio component, and a third audio component of the sound file, and

wherein the message processing unit is further configured to translate the first spatial component, the second spatial component, and the third spatial component into the first audio component, the second audio component, and the third audio component, respectively.

4. The augmented reality system of claim 3, wherein the first spatial component, the second spatial component, and the third spatial component comprise an x-axis component, a y-axis component, and a z-axis component of the virtual object, respectively, and

wherein the first audio component, the second audio component, and the third audio component comprise a tone component, a pitch component, and a volume component of the sound file, respectively.

5. The augmented reality system of claim 1, wherein the spatial attributes comprise a first spatial component and a second spatial component of the virtual object,

wherein the audio attributes comprise a first audio component and a second audio component of the sound file, and

wherein the message processing unit is further configured to translate the first spatial component and the second spatial component into the first audio component and the second audio component, respectively.

6. The augmented reality system of claim 5, wherein the first spatial component and the second spatial component comprise an x-axis component and a z-axis component of the virtual object, respectively, and

wherein the first audio component and the second audio component comprise a pitch component and a volume component of the sound file, respectively.

7. The augmented reality system of claim 1, wherein the message comprises an active message generated from the virtual object and a passive message generated from a user input for the virtual object.

8. The augmented reality system of claim 7, further comprising:

a first sound file repository configured to store a first sound mapping table; and

a second sound file repository configured to store a second sound mapping table,

wherein the message processing unit is further configured to use the first sound mapping table to translate the spatial attributes of the virtual object related to the active message into the audio attributes, and to use the second sound mapping table to translate the spatial attributes of the virtual object related to the passive message into the audio attributes.

9. The augmented reality system of claim 1, further comprising:

a sound file repository configured to store a sound mapping table,

wherein the message processing unit is further configured to use the sound mapping table to translate the spatial attributes into the audio attributes.

10. The augmented reality system of claim 9, wherein the sound mapping table comprises a functional formula showing a relationship between one of the spatial attributes and one of the audio attributes.

11. The augmented reality system of claim 1, further comprising:

a depth recognition unit configured to recognize spatial attributes of the captured real-world image; and

a distance calculation unit configured to calculate a distance between a user and the virtual object based on the spatial attributes of the captured real-world image.

12. The augmented reality system of claim 1, further comprising:

a display unit configured to display the augmented reality image and the message.

13. The augmented reality system of claim 1, further comprising:

a user recognition unit configured to recognize a user'"'"'s behavior captured by an image capture unit.

14. A method performed under the control of an augmented reality system, the method comprising:

receiving a message related to a virtual object; and

translating spatial attributes of the virtual object into audio attributes of a sound file.

15. The method of claim 14, further comprising playing the sound file.

16. The method of claim 14, wherein the spatial attributes comprise a first spatial component, a second spatial component, and a third spatial component of the virtual object,

wherein the audio attributes comprise a first audio component, a second audio component, and a third audio component of the sound file, and

wherein the translating comprises translating the first spatial component, the second spatial component, and the third spatial component into the first audio component, the second audio component, and the third audio component, respectively.

17. The method of claim 14, wherein the message comprises an active message generated from the virtual object and a passive message generated from a user input for the virtual object.

18. The method of claim 14, wherein the translating comprises using a sound mapping table to translate the spatial attributes into the audio attributes.

19. A computer-readable storage medium whose contents cause a processor to:

receive a message related to a virtual object; and

translate spatial attributes of the virtual object into audio attributes of a sound file.

20. The computer-readable storage medium of claim 19, wherein the contents further cause the processor to play the sound file.

21. The computer-readable storage medium of claim 19, wherein the spatial attributes comprise a first spatial component, a second spatial component, and a third spatial component of the virtual object,

wherein the audio attributes comprise a first audio component, a second audio component, and a third audio component of the sound file, and

wherein the contents further cause the processor to translate the first spatial component, the second spatial component, and the third spatial component into the first audio component, the second audio component, and the third audio component, respectively.

22. The computer-readable storage medium of claim 19, wherein the message comprises an active message generated from the virtual object and a passive message generated from a user input for the virtual object.

23. The computer-readable storage medium of claim 19, wherein the contents further cause the processor to use a sound mapping table to translate the spatial attributes into the audio attributes.