Method and apparatus for creating sounds in a virtual world by simulating sound in specific locations in space and generating sounds as touch feedback

• US 5,587,936 A
• Filed: 10/05/1993
• Issued: 12/24/1996
• Est. Priority Date: 11/30/1990
• Status: Expired due to Term

• Current Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Original Assignee: VPL Research, Inc.
• Inventors: Degroot, Marc, Levitt, David A., Lanier, Jaron Z.
• Primary Examiner(s): Lim, Krisna
• Application Number:
  US08/141,203
• Time in Patent Office: 1,176 Days
• Field of Search: 395/500, 381/17, 381/77, 381/61, 364/578
• US Class Current: 703/6
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 9/22 including aircraft sound simulation
• CPC Class Codes: H04S 5/00 Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation

Abstract

A method and apparatus for creating sounds in a virtual world. The system provides signal processing capabilities to convert monaural sounds to fully spacialized sound sources. A user of the system wearing a pair of stereo headphones perceives live, computer generated, or recorded sounds as coming from specific locations in space, just a listener does in the real world.

Claims

1. An audio feedback system for use with a virtual reality system, comprising:

means for calculating a virtual world;

a sensor, connected to the means for calculating, for sensing information of a person'"'"'s hand;

an audio feedback determining means, connected to the means for calculating and the sensor, for determining if audio feedback is to be generated, using information of the virtual world and the information of the person'"'"'s hand; and

a sound generator for generating sound in response to the determination made by the audio feedback determining means.

2. A system according to claim 1, wherein the audio feedback determining means includes:

means for determining audio feedback is to be generated which indicates an object in the virtual world is grabbable using information of the virtual world and the information of the person'"'"'s hand.

3. A system according to claim 1, wherein the audio feedback determining means includes:

means for determining audio feedback is to be generated which indicates an object in the virtual world can be picked up using information of the virtual world and information of the person'"'"'s hand.

4. A system according to claim 1, wherein the audio feedback determining means includes:

means for determining audio feedback is to be generated which indicates an object which was held in the virtual world has been released using information of the virtual world and information of the person'"'"'s hand.

5. A system according to claim 1, wherein:

the audio feedback determining means operates without analyzing an orientation of the person'"'"'s head.

6. A system according to claim 1, wherein:

the sensor senses gestures made by the person'"'"'s hand.

7. A system according to claim 1, wherein the audio feedback determining means comprises:

means for determining a predetermined sound is to be generated using information of the virtual world and information of the person'"'"'s hand.

8. A method of generating audio feedback, comprising the steps of:

creating a virtual world;

sensing information of a person'"'"'s hand;

determining if audio feedback is to be generated using information of the virtual world and the information of the person'"'"'s hand; and

generating sound when the determining step determines that audio feedback is to be generated.

9. A method according to claim 8, wherein the step of determining if audio feedback is to be generated comprises:

determining audio feedback is to be generated which indicates an object in the virtual world is grabbable using information of the virtual world and the information of the person'"'"'s hand.

10. A method according to claim 8, wherein the step of determining if audio feedback is to be generated comprises:

determining audio feedback is to be generated which indicates an object in the virtual world can be picked up using information of the virtual world and the information of the person'"'"'s hand.

11. A method according to claim 8, wherein the step of determining if audio feedback is to be generated comprises:

determining audio feedback is to be generated which indicates an object in the virtual world which was held in the virtual world has been released using information of the virtual world and the information of the person'"'"'s hand.

12. A method according to claim 8, wherein the step of determining if audio feedback is to be generated comprises:

determining if audio feedback is to be generated without analyzing an orientation of the person'"'"'s head.

13. A method according to claim 8, wherein the sensing step comprises:

sensing gestures made by the person'"'"'s hand.

14. A method according to claim 8, wherein the determining step comprises:

determining a predetermined sound is to be generated using information of the virtual world and the information of the persons'"'"'s hand.

15. A method of generating audio feedback in a virtual world, comprising the steps of:

creating a virtual world include a virtual object;

sensing information of a person'"'"'s hand;

generating a first sound when the information sensed of the person'"'"'s hand and the virtual object make the object grabbable;

generating a second sound when the information sensed of the person'"'"'s hand and the virtual object indicate that the hand has intersected the virtual object; and

generating a third sound when the information sensed of the person'"'"'s hand and indicates that the object is released.

16. A method according to claim 15, wherein:

the steps of generating the first, second, and third sounds generate different sounds.