System and method of adjusting the sound of multiple audio objects directed toward an audio output device

• US 8,897,466 B2
• Filed: 06/15/2012
• Issued: 11/25/2014
• Est. Priority Date: 08/25/2005
• Status: Active Grant

• Current Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Inventors: Ho, Chi Fai, Chiu, Shin Cheung Simon
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): Tran, Con P
• Application Number:
  US13/524,056
• Publication Number:
  US 20120250899A1
• Time in Patent Office: 893 Days
• Field of Search: 381/119, 381/104, 381/107, 381/94.1, 381/94.2, 381/98, 381/102, 381/101, 381/103, 381/150, 381/82, 381/687, 381/375, 381/94.7, 381/370, 381/182, 381/58, 455/63.1, 455/293, 455/280, 455/269, 455/401, 455/355, 455/219, 455/200.1, 455/513, 455/3.06, 455/414.4, 455/221, 455/222, 455/309, 700/94, 379/428.02, 379/375.01, 704/226, 704/233, 704/227, 704/228, 704/E21.002, 704/E21.014
• US Class Current: 381/119
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios

Abstract

Embodiments of the present invention include methods and apparatuses for adjusting audio content when more multiple audio objects are directed toward a single audio output device. The amplitude, white noise content, and frequencies can be adjusted to enhance overall sound quality or make content of certain audio objects more intelligible. Audio objects are classified by a class category, by which they are can be assigned class specific processing. Audio objects classes can also have a rank. The rank of an audio objects class is used to give priority to or apply specific processing to audio objects in the presence of other audio objects of different classes.

Claims

1. An audio system for a wireless telephone, comprising:

a first component classifying each audio object of a plurality of audio objects to be of a class that is ranked relative to at least two other classes based on a content type of the each audio object to generate a first audio object;

an audio output mixer monitoring audio representing sounds from an environment to generate a second audio object;

an audio output pacer within the wireless telephone, wherein the audio output pacer receives the plurality of audio objects, the plurality of audio objects comprising the first audio object representing incoming audio data of a telephone call, and the second audio object representing detected local environmental distress audio data, and wherein the audio output pacer attenuates the first audio object, and to set sound associated with the second audio object to a comfortable listening level the audio output pacer attenuates the second audio object; and

an audio output blender within the wireless telephone, wherein the audio object blender receives from the audio output pacer modified sounds of the plurality of audio objects, allocates a percentage of a total amplitude of the system to the first audio object depending on its class type, combines the modified sounds of the plurality of audio objects into an audio output, and sends the audio output to an audio output device coupled to the wireless telephone for rendering at the wireless telephone.

2. The system of claim 1, wherein the audio output device is one of:

a headset, headphones, and at least one speaker.

3. The system of claim 1, wherein the class is one of:

an announcement class, a conversation class, a music class, and an other class.

4. The system of claim 3, wherein the announcement class is ranked higher than the conversation class which is ranked higher than the music class which is ranked higher than the other class.

5. The system of claim 4, wherein one or more objects of the plurality of objects that are of a higher rank class than a respective class of one or more other objects are set at a higher amplitude relative to the other objects to give priority to content classified as speech type content over other types of content, and wherein the speech type content is rendered by the audio output pacer to be at an optimal output sound level and the other type content is rendered at a background sound level.

6. The system of claim 1, wherein the distress audio data is one of:

a siren, an alarm, a scream, a cry for help, a barking dog, and a screeching tire.

7. The system of claim 1 further comprising a white noise generator coupled to the audio blender and adding white noise at a defined amplitude to the audio output.

8. The system of claim 7, further comprising detecting a level of white noise in the first audio object and filtering out the white noise from the first audio object.

9. The system of claim 1, further comprising detecting a period of silence associated with the first audio object and increasing or decreasing the amplitude of the first audio object depending on a length of time of the period of silence.

10. The system of claim 1, further comprising analyzing a frequency pattern of each object of the plurality of objects to derive the class of the each object and encoding the class as an audio object attribute associated with the each object.

11. A method of adjusting sounds in a wireless telephone, comprising:

classifying each audio object of a plurality of audio objects to be of a class that is ranked relative to at least two other classes based on a content type of the each audio object to generate a first audio object;

monitoring audio representing sounds from an environment to generate a second audio object;

receiving within the wireless telephone the plurality of audio objects, the plurality of audio objects comprising the first audio object representing incoming audio data of a telephone call, and the second audio object representing detected local environmental distress audio data, wherein the first audio object is attenuated, and to set sound associated with the second audio object to a comfortable listening level the second audio object is attenuated;

receiving within the wireless telephone modified sounds of the plurality of audio objects;

allocating a percentage of a total amplitude of the system to the first audio object depending on its class type;

combining within the wireless telephone the modified sounds of the plurality of audio objects into an audio output; and

sending the audio output to an audio output device coupled to the wireless telephone for rendering at the wireless telephone.

12. The method of claim 11, wherein the audio output device is one of:

a headset, headphones, and at least one speaker.

13. The method of claim 11, wherein the class is one of:

an announcement class, a conversation class, a music class, and an other class.

14. The method of claim 13, wherein the announcement class is ranked higher than the conversation class which is ranked higher than the music class which is ranked higher than the other class.

15. The method of claim 14, wherein one or more objects of the plurality of objects that are of a higher rank class than a respective class of one or more other objects are set at a higher amplitude relative to the other objects to give priority to content classified as speech type content over other types of content, and wherein the speech type content is rendered by the audio output pacer to be at an optimal output sound level and the other type content is rendered at a background sound level.

16. The method of claim 11, wherein the distress audio data is one of:

a siren, an alarm, a scream, a cry for help, a barking dog, and a screeching tire.

17. The method of claim 11, further comprising a white noise generator coupled to the audio blender and adding white noise at a defined amplitude to the audio output.

18. The method of claim 17, further comprising detecting a level of white noise in the first audio object and filtering out the white noise from the first audio object.

19. The method of claim 11, further comprising detecting a period of silence associated with the first audio object and increasing or decreasing the amplitude of the first audio object depending on a length of time of the period of silence.

20. The method of claim 11, further comprising analyzing a frequency pattern of each object of the plurality of objects to derive the class of the each object and encoding the class as an audio object attribute associated with the each object.

21. A non-transitory computer program product comprising a computer useable non-transitory medium having a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

classify each audio object of a plurality of audio objects to be of a class that is ranked relative to at least two other classes based on a content type of the each audio object;

monitor audio representing sounds from an environment to generate a second audio object;

receive within a wireless telephone the plurality of audio objects, the plurality of audio objects comprising the first audio object representing incoming audio data of a telephone call, and the second audio object representing detected local environmental distress audio data, wherein the first audio object is attenuated, and to set sound associated with the second audio object to a comfortable listening level the second audio object is attenuated;

receive within the wireless telephone modified sounds of the plurality of audio objects;

allocate a percentage of a total amplitude of the system to the first audio object depending on its class type;

combine within the wireless telephone the modified sounds of the plurality of audio objects into an audio output; and

send the audio output to an audio output device coupled to the wireless telephone for rendering at the wireless telephone.

22. The product of claim 21, wherein the audio output device is one of:

a headset, headphones, and at least one speaker.

23. The product of claim 21, wherein the class is one of:

an announcement class, a conversation class, a music class, and an other class.

24. The product of claim 21, wherein the announcement class is ranked higher than the conversation class which is ranked higher than the music class which is ranked higher than the other class.

25. The product of claim 21, wherein the distress audio data is one of:

a siren, an alarm, a scream, a cry for help, a barking dog, and a screeching tire.

26. The product of claim 21, wherein the computer readable program further comprises code to generate white noise to be added at a defined amplitude to the audio output.

27. The product of claim 26, wherein the computer readable program further comprises code to detect a level of white noise in the first audio object and filter out the white noise from the first audio object.

28. The product of claim 21, wherein the computer readable program further comprises code to detect a period of silence associated with the first audio object and increase or decrease the amplitude of the first audio object depending on a length of time of the period of silence.

29. The product of claim 21, wherein one or more objects of the plurality of objects that are of a higher rank class than a respective class of one or more other objects are set at a higher amplitude relative to the other objects to give priority to content classified as speech type content over other types of content, and wherein the speech type content is rendered by the audio output pacer to be at an optimal output sound level and the other type content is rendered at a background sound level.

30. The product of claim 21, wherein the computer readable program further comprises code to analyze a frequency pattern of each object of the plurality of objects to derive the class of the each object and encoding the class as an audio object attribute associated with the each object.