Spatialized audio in a three-dimensional computer-based scene

• US 7,379,962 B1
• Filed: 01/19/2000
• Issued: 05/27/2008
• Est. Priority Date: 01/19/2000
• Status: Expired due to Fees

• Current Assignee: Computer Associates Think Inc. (Broadcom, Inc.)
• Original Assignee: Computer Associates Think Inc. (Broadcom, Inc.)
• Inventors: Matsuoka, Shinya
• Primary Examiner(s): DINH, KHANH Q
• Application Number:
  US09/487,593
• Time in Patent Office: 3,051 Days
• Field of Search: 379/202, 379/203, 379/88.13, 709/224, 709/229, 709/500, 709/220, 709/227, 709/245, 709/203, 348/15, 348/14, 707/205, 713/170
• US Class Current: 709/203
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30

Abstract

A system and method for enabling an audio conference server (ACS) to provide an application program with multi-point weight controllable audio conferencing. The ACS manages a plurality of audio conferences, receives audio data from a plurality of audio clients, mixes the audio data to provide distance-based attenuation according to decay characteristics for each sound, and delivers the mixed audio data to a plurality of audio clients. Audio clients include set-top box (STB) audio clients and point source audio (PSA) audio clients. The ACS mixes the audio data by identifying a decay factor. Pre-defined decay factors include an audio big decay factor, an audio small decay factor, an audio medium decay factor, and a constant decay factor. One can also develop a customized decay factor. A weighted value for a source audio client based on the identified decay factor and the distance between the source audio client and a target audio client is determined. A mix table is generated using the weighted values for each source/target audio client pair. Then an actual mix value for each target audio client is calculated using the mix table. The present invention also includes means for refining the actual mix value.

Claims

1. An audio conferencing method comprising:

receiving real-time audio data from a source audio client;

attenuating the received real-time audio data and stored audio data associated with a point source based on audio decay characteristics to simulate positions of the source audio client, the point source, and a target audio client, wherein each source audio client and each point source is assigned a respective selected decay function from a plurality of predefined decay functions; and

delivering the attenuated audio data to the target audio client;

wherein attenuating comprises;

calculating a weighted value for each source audio client and each point source based upon the particular decay functions respectively associated with each source audio client and each point source;

wherein each weighted value corresponds to a particular percentage of a maximum volume at which the attenuated audio data may be delivered to the target audio client, and

wherein delivering the attenuated audio data to the target audio client comprises delivering the portion of the attenuated audio data respectively associated with a particular source audio client or a particular point source only if the weighted value respectively associated the particular source audio client or particular point source exceeds a predetermined value.

2. The method of claim 1, wherein the target audio client is the same as the source audio client.

3. The method of claim 1, wherein the target audio client is different than the source audio client.

4. The method of claim 3, further comprising delivering the attenuated data to the source audio client.

5. The method of claim 1, wherein the source audio client, the target audio client, and the point source are displayed as points on a viewing screen from which sound seems to emanate.

6. The method of claim 1, wherein the point source includes audio data from a user input.

7. The method of claim 5, wherein the source audio client comprises a set-top box audio client that originates from an audio conferencing user.

8. The method of claim 7, wherein the set-top box audio client includes a set-top application for controlling audio data from a microphone or to a speaker.

9. The method of claim 5, wherein the target audio client comprises a set-top box audio client that originates from an audio conferencing user.

10. The method of claim 9, wherein the set-top box audio client includes a set-top application for controlling audio data from a microphone or to a speaker.

11. The method of claim 1, wherein a plurality of source audio clients and a plurality of target audio clients participate in an audio conference.

12. The method of claim 1, further comprising managing one or more audio conferences using an Interface Definition Language that creates and deletes conferences, adds and removes participants to and from the conferences, and changes a volume balance among participants in the conferences.

13. The method of claim 1, wherein attenuating comprises identifying a respective decay factor for each source audio client and for each point source.

14. The method of claim 13, wherein the decay factor is a customized decay factor.

15. The method of claim 13, wherein attenuating further comprises determining weighted respective values between the point source, the source audio client, and the target audio client based on the decay factors identified with the point source and the source audio client.

16. The method of claim 15, wherein attenuating further comprises calculating a mix for the point source, the source audio client, and the target audio client using the weighted values.

17. The method of claim 16, wherein attenuating further comprises refining the mix for the point source, the source audio client, and the target audio client by adjusting a plurality of audio data functions selected from a group consisting of gain control, fade in/fade out, floating point operation elimination, mixing adaption, mixing cut-off, and stream audio.

19. The method of claim 1, wherein the selected decay function comprises a selected decay factor.

20. The method of claim 1, wherein a plurality of point sources are present in an audio conference.

21. The method of claim 1, wherein at least a portion of the stored audio data is associated with the source audio client.

22. The method of claim 1, wherein the predetermined value is based upon an available amount of computer resources.

18. Computer software, stored on a computer-readable storage medium, comprising instructions for causing a computer processor to perform the following operations:

receive real-time audio data from a source audio client;

attenuate the received real-time audio data and stored audio data associated with a point source based on audio decay characteristics to simulate positions of the source audio client, the point source, and a target audio client, wherein each source audio client and each point source is assigned a respective selected decay function from a plurality of predefined decay functions; and

deliver the attenuated audio data to the target audio client;

wherein attenuating comprises;

calculating a weighted value for each source audio client and each point source based upon the particular decay functions respectively associated with each source audio client and each point source;

wherein each weighted value corresponds to a particular percentage of a maximum volume at which the attenuated audio data may be delivered to the target audio client, and

wherein delivering the attenuated audio data to the target audio client comprises delivering the portion of the attenuated audio data respectively associated with a particular source audio client or a particular point source only if the weighted value respectively associated the particular source audio client or particular point source exceeds a predetermined value.