Virtual reality sound for advanced multi-media applications

• US 8,243,970 B2
• Filed: 08/11/2008
• Issued: 08/14/2012
• Est. Priority Date: 08/11/2008
• Status: Active Grant

• Current Assignee: Optis Wireless Technology, LLC (Brevet Capital)
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Dent, Paul Wilkinson
• Primary Examiner(s): Matthews, Colleen
• Assistant Examiner(s): YUSHINA, GALINA G
• Application Number:
  US12/189,525
• Publication Number:
  US 20100034404A1
• Time in Patent Office: 1,464 Days
• Field of Search: 381/1, 381/17, 381/18, 381/74, 381/306, 381/309, 381/310, 381/19, 700/94, 455/456, 370/18
• US Class Current: 381/310
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers

Abstract

The method and apparatus described herein generates realistic audio for a virtual reality simulation based on the position (location and orientation) of a participant'"'"'s head. The audio may be generated based on independent and dependent audio profiles. The independent audio profile represents the participant-independent propagation of sound from a virtual source to each of one or more virtual objects in the simulation. The dependent audio profile represents the propagation of the sound from each of the one or more virtual objects to the head or ears of the participant based on a position of the participant'"'"'s head or ears. An audio processor generates the desired audio signal at the head of the participant by combining the dependent and independent audio profiles to determine a total audio profile for the virtual source, and filtering an audio wave corresponding to the virtual source based on the total audio profile.

Claims

1. A method of generating virtual reality audio for a participant of a virtual reality simulation, the method comprising:

computing an independent audio profile representing participant-independent propagation of sound from a virtual source to each of one or more virtual objects in the virtual reality simulation;

determining a location and an orientation of a head of the participant, comprising;

receiving a CDMA signal transmitted from each of three antennas disposed on a headset worn by the participant, wherein each transmitted signal is assigned a different CDMA code,

measuring a code delay and an RF phase based on the received signals, and

determining the location and orientation of the head based on the measured code delay and RF phase;

computing a dependent audio profile representing participant-dependent propagation of the sound from the one or more virtual objects to the head of the participant based on the determined location and orientation of the head;

combining said dependent audio profile with said independent audio profile to determine a total audio profile for said virtual source; and

filtering said virtual source based on said total audio profile to generate said virtual reality audio associated with said virtual source at the head of the participant.

2. The method of claim 1 wherein determining the location and orientation of the head of the participant comprises:

receiving a different CDMA signal at each of three antennas disposed on a headset worn by the participant, wherein each signal is assigned a different CDMA code;

measuring a code delay and an RF phase based on the received signals; and

determining the location and orientation of the head based on the measured code delay and RF phase.

3. The method of claim 1 wherein the independent audio profile accounts for the reflection and absorption of the sound as the sound from the virtual source propagates to the one or more virtual objects in the virtual simulation, and wherein the dependent audio profile accounts for the reflection and absorption of the sound as the sound propagates from the one or more virtual objects to the head of the participant.

4. The method of claim 1 further comprising transmitting said generated virtual reality audio to a headset worn by the participant.

5. The method of claim 1:

wherein computing the dependent audio profile comprises computing a dependent audio profile for each of two or more participants, where the dependent audio profile represents the participant-dependent propagation of sound from the one or more virtual objects to a determined location and orientation of the head of the two or more participants;

wherein the combining step comprises combining each dependent audio profile with said independent audio profile to determine a participant-specific total audio profile for said virtual source; and

wherein the filtering step comprises filtering said virtual source based on each participant-specific total audio profile to generate said virtual reality sound for each participant.

6. The method of claim 1 wherein the location and orientation of the head is determined in a position processor disposed within a headset worn by the participant.

7. The method of claim 1 wherein the location and orientation of the head is determined in a position processor located remotely from the participant.

8. The method of claim 1 wherein the dependent audio profile is dynamically computed in an audio processor located remotely from the participant.

9. The method of claim 1 further comprising determining a location and orientation of an ear of the participant based on the determined location and orientation of the head, wherein computing the dependent audio profile comprises computing the dependent audio profile representing participant-dependent propagation of the sound from the one or more virtual objects to the at least one ear of the participant based on the determined location and orientation of the ear.

10. The method of claim 9 further comprising:

determining a location and an orientation of a second ear of the participant;

computing a second dependent audio profile representing the participant-dependent propagation of sound from the one or more virtual objects to the determined location and orientation of the second ear;

combining said second dependent audio profile with said independent audio profile to determine a second total audio profile for said virtual source; and

filtering said virtual source based on said second total audio profile to generate said virtual reality sound associated with said virtual source for said second ear.

11. The method of claim 10 further comprising transmitting said generated virtual reality sound to a headset worn by the participant.

12. A virtual reality system for generating virtual reality audio for a participant of a virtual reality simulation, the virtual reality system comprising:

a position processor configured to determine a location and orientation of a head of the participant;

a receiver system comprising a plurality of receivers, wherein each receiver is configured to receive a different CDMA signal transmitted from one of three antennas disposed on a headset worn by the participant, wherein each transmitted signal is assigned a different CDMA code, and wherein the position processor determines the location and orientation of the head of the participant by;

measuring a code delay and an RF phase based on the received signals, and

determining the location and orientation of the head based on the measured code delay and RF phase;

an audio processor configured to;

compute an independent audio profile representing participant-independent propagation of sound from a virtual source to each of one or more virtual objects in the virtual reality simulation;

compute a dependent audio profile representing participant-dependent propagation of the sound from the one or more virtual objects to the head of the participant based on the determined location and orientation of the head;

combine said dependent audio profile with said independent audio profile to determine a total audio profile for said virtual source; and

filter said virtual source based on said total audio profile to generate said virtual reality audio associated with said virtual source at the head of the participant.

13. The virtual reality system of claim 12 wherein the independent audio profile accounts for the reflection and absorption of the sound as the sound from the virtual source propagates to the one or more virtual objects in the virtual simulation, and wherein the dependent audio profile accounts for the reflection and absorption of the sound as the sound propagates from the one or more virtual objects to the head of the participant.

14. The virtual reality system of claim 12 further comprising a transmitter to transmit said generated virtual reality audio to a headset worn by the participant.

15. The virtual reality system of claim 12 wherein the audio processor:

computes the dependent audio profile by computing a dependent audio profile for each of two or more participants, where the dependent audio profile represents the participant-dependent propagation of sound from the one or more virtual objects to a determined location and orientation of the head of the two or more participants;

combines the dependent and independent audio profiles by combining each dependent audio profile with said independent audio profile to determine a participant-specific total audio profile for said virtual source; and

filters said virtual source by filtering said virtual source based on each participant-specific total audio profile to generate said virtual reality sound for each participant.

16. The virtual reality system of claim 12 wherein the position processor is further configured to determine a location and orientation of an ear of the participant based on the determined location and orientation of the head, and wherein the audio processor computes the dependent audio profile by computing the dependent audio profile representing participant-dependent propagation of the sound from the one or more virtual objects to the at least one ear of the participant based on the determined location and orientation of the ear.

17. The virtual reality system of claim 16 wherein the position processor is further configured to determine a location and an orientation of a second ear of the participant, and wherein the audio processor is further configured to:

compute a second dependent audio profile representing the participant-dependent propagation of sound from the one or more virtual objects to the determined location and orientation of the second ear;

combine said second dependent audio profile with said independent audio profile to determine a second total audio profile for said virtual source; and

filter said virtual source based on said second total audio profile to generate said virtual reality sound associated with said virtual source for said second ear.

18. The virtual reality system of claim 17 further comprising a transmitter to transmit said generated virtual reality sound to a headset worn by the participant.