Systems and methods for audio processing

• US 9,232,319 B2
• Filed: 09/23/2011
• Issued: 01/05/2016
• Est. Priority Date: 09/13/2005
• Status: Active Grant

• Current Assignee: DTS, Inc. (Adeia Inc.)
• Original Assignee: DTS, Inc. (Adeia Inc.)
• Inventors: Wang, Wen
• Primary Examiner(s): Lee, Ping
• Application Number:
  US13/244,043
• Publication Number:
  US 20120014528A1
• Time in Patent Office: 1,565 Days
• Field of Search: 381/17, 381/18, 381/303, 381/309
• US Class Current: 1/1
• CPC Class Codes: H04R 25/407 Circuits for combining signals of a plurality of transducers
• CPC Class Codes: H04S 1/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 1/005 For headphones
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

Systems and methods for audio signal processing are disclosed, where a discrete number of simple digital filters are generated for particular portions of an audio frequency range. Studies have shown that certain frequency ranges are particularly important for human ears'"'"' location-discriminating capability, while other ranges are generally ignored. Head-Related Transfer Functions (HRTFs) are examples response functions that characterize how ears perceive sound positioned at different locations. By selecting one or more “location-critical” portions of such response functions, one can construct simple filters that can be used to simulate hearing where location-discriminating capability is substantially maintained. Because the filters can be simple, they can be implemented in devices having limited computing power and resources to provide location-discrimination responses that form the basis for many desirable audio effects.

Claims

1. A method of processing audio based on spatial position information, the method comprising:

receiving one or more digital signals, each of said one or more digital signals having information about a spatial position of a sound source relative to a listener;

selecting a digital filter based on the spatial position information, the digital filter configured to approximate a head-related transfer function (HRTF), wherein the digital filter is selected from the following;

a first digital filter having a first frequency response comprising a first peak at a first frequency, a second peak at a second frequency higher than the first frequency, a single trough between the first peak and the second peak, a substantially flat response in a first frequency range from 30 Hz to 200 Hz, below a frequency of the first peak, an increasing response from 200 Hz until the first peak, and an attenuating response that attenuates a second frequency range from the second peak until a highest frequency of the first frequency response, and

a second digital filter having a second frequency response comprising a first trough at a third frequency, a second trough at a fourth frequency higher than the third frequency, a substantially flat response in a third frequency range from 30 Hz until 1100 Hz, below a frequency of the first trough, and an emphasizing response that emphasizes a fourth frequency range higher in frequency than the fourth frequency of the second trough; and

applying the selected digital filter to the one or more digital signals so as to produce a left filtered signal and a right filtered signal, each of the left and right filtered signals configured to have a simulated effect of the HRTF applied to the sound source.

2. The method of claim 1, wherein the selected digital filter is configured to use fewer computing resources than would be used by the HRTF to produce location-discriminating sound output to a listener.

3. The method of claim 1, wherein said selecting the digital filter comprises selecting the first or second digital filter based at least in part on a vertical angle of the sound source relative to a listener, wherein the vertical angle is included in the spatial position information.

4. The method of claim 3, wherein said selecting the digital filter comprises:

first selecting the first digital filter in response to determining that the spatial position of the sound source has a zero degree vertical angle or positive vertical angle with respect to a listener; and

selecting the second digital filter subsequent to selecting the first digital filter in response to determining that the spatial position of the sound source has changed to a negative vertical angle with respect to the listener.

5. The method of claim 1, further comprising:

emphasizing the left filtered signal over the right filtered signal in response to determining that the spatial position of the sound source is to the left of a listener; and

emphasizing the right filtered signal over the left filtered signal in response to determining that the spatial position of the sound source is to the right of the listener.

6. The method of claim 1, wherein said selecting the digital filter comprises selecting a version of the first digital filter where the second peak of the first digital filter has a lower magnitude than a magnitude of the first peak of the first digital filter in response to the spatial position of the sound source having a positive vertical angle with respect to the listener.

7. The method of claim 1, wherein said selecting the digital filter comprises selecting a version of the first digital filter where the second peak of the first digital filter has an at least approximately equal magnitude to a magnitude of the first peak of the first digital filter in response to the spatial position of the sound source having a zero degree vertical angle with respect to the listener.

8. The method of claim 1, wherein the first and second peaks of the first digital filter are configured to provide first location-critical frequencies for location discrimination of the sound source, and wherein the first and second troughs of the second digital filter are configured to provide second location-critical frequencies for location discrimination of the sound source.

9. The method of claim 1, wherein the first frequency of the first peak is between 3 kHz and 5 kHz and wherein the second frequency of the second peak is between 10 kHz and 11 kHz.

10. The method of claim 9, wherein the first frequency of the first peak is between 4 kHz and 5 kHz.

11. The method of claim 1, wherein the third frequency of the first trough is between 5 kHz and 7 kHz and wherein the fourth frequency of the second trough is between 10 kHz and 11 kHz.

12. A system for processing audio based on spatial position information, the system comprising:

a filter selection component configured to select a digital filter based on spatial position information of a sound source relative to a listener, the spatial position information being encoded in input audio, the selected digital filter configured to approximate a head-related transfer function (HRTF), wherein the selected digital filter is selected from the following;

a first digital filter having a first frequency response comprising a first peak at a first frequency, a second peak at a second frequency higher than the first frequency, a single trough between the first peak and the second peak, a substantially flat response from 30 Hz to 200 Hz, in a first frequency range below a frequency of the first peak, and an attenuating response that attenuates a second frequency range higher in frequency than the second frequency of the second peak, and

a second digital filter having a second frequency response comprising a first trough at a third frequency, a second trough at a fourth frequency higher than the third frequency, a single peak between the first trough and the second trough, a substantially flat response in a third frequency range from 30 Hz until 1100 Hz, below a frequency of the first trough, and an emphasizing response that emphasizes a fourth frequency range higher in frequency than the fourth frequency of the second trough; and

a filter application component configured to apply the selected digital filter to the input audio so as to produce a left filtered signal and a right filtered signal, each of the left and right filtered signals configured to have a simulated effect of the HRTF applied to the sound source.

13. The system of claim 12, wherein the selected digital filter is configured to use fewer computing resources than would be used by the HRTF to produce location-discriminating sound output to a listener.

14. The system of claim 12, wherein the filter selection component is further configured to select the digital filter by at least selecting the first or second digital filter based at least in part on a vertical angle of the sound source relative to a listener, wherein the vertical angle is included in the spatial position information.

15. The system of claim 14, wherein the filter selection component is further configured to select the digital filter by at least:

selecting the first digital filter in response to determining that the spatial position of the sound source has a zero degree vertical angle or positive vertical angle with respect to a listener; and

selecting the second digital filter in response to determining that the spatial position of the sound source has a negative vertical angle with respect to the listener.

16. The system of claim 12, wherein the filter selection component is further configured to select the digital filter by at least selecting a version of the first digital filter where the second peak of the first digital filter has a lower magnitude than a magnitude of the first peak of the first digital filter in response to the spatial position of the sound source having a positive vertical angle with respect to the listener.

17. The system of claim 12, wherein the filter selection component is further configured to select the digital filter by at least selecting a version of the first digital filter where the second peak of the first digital filter has an at least approximately equal magnitude to a magnitude of the first peak of the first digital filter in response to the spatial position of the sound source having a zero degree vertical angle with respect to the listener.

18. The system of claim 12, wherein the first and second peaks of the first digital filter are configured to provide first location-critical frequencies for location discrimination of the sound source, and wherein the first and second troughs of the second digital filter are configured to provide second location-critical frequencies for location discrimination of the sound source.

19. Non-transitory physical computer storage comprising instructions stored thereon for executing, in one or more processors, components for processing audio based on spatial position information, the components comprising:

a filter selection component configured to select a digital filter based on spatial position information of a sound source relative to a listener, the spatial position information being encoded in input audio, the selected digital filter configured to approximate a head-related transfer function (HRTF), wherein the selected digital filter is selected from the following;

a first digital filter having a first frequency response comprising a first peak at a first frequency, a second peak at a second frequency higher than the first frequency, a single trough between the first peak and the second peak, a substantially flat response in a first frequency range from 30 Hz to 200 Hz, below a frequency of the first peak, and an attenuating response that attenuates a second frequency range higher in frequency than the second frequency of the second peak, and

a second digital filter having a second frequency response comprising a first trough at a third frequency, a second trough at a fourth frequency higher than the third frequency, a single peak between the first trough and the second trough, a substantially flat response in a third frequency range from 30 Hz until 1100 Hz, below a frequency of the first trough, and an emphasizing response that emphasizes a fourth frequency range higher in frequency than the fourth frequency of the second trough; and

a filter application component configured to apply the selected digital filter to the input audio so as to produce a left filtered signal and a right filtered signal, each of the left and right filtered signals configured to have a simulated effect of the HRTF applied to the sound source.

20. The non-transitory physical computer storage of claim 19, wherein the selected digital filter is configured to use fewer computing resources than would be used by the HRTF to produce location-discriminating sound output to a listener.

21. The non-transitory physical computer storage of claim 19, wherein the filter selection component is further configured to select the digital filter by at least selecting the first or second digital filter based at least in part on a vertical angle of the sound source relative to a listener, wherein the vertical angle is included in the spatial position information.

22. The non-transitory physical computer storage of claim 21, wherein the filter selection component is further configured to select the digital filter by at least:

selecting the first digital filter in response to determining that the spatial position of the sound source has a zero degree vertical angle or positive vertical angle with respect to a listener; and

selecting the second digital filter in response to determining that the spatial position of the sound source has a negative vertical angle with respect to the listener.

23. The non-transitory physical computer storage of claim 19, wherein the filter selection component is further configured to select the digital filter by at least selecting a version of the first digital filter where the second peak of the first digital filter has a lower magnitude than a magnitude of the first peak of the first digital filter in response to the spatial position of the sound source having a positive vertical angle with respect to the listener.

24. The non-transitory physical computer storage of claim 19, wherein the filter selection component is further configured to select the digital filter by at least selecting a version of the first digital filter where the second peak of the first digital filter has an at least approximately equal magnitude to a magnitude of the first peak of the first digital filter in response to the spatial position of the sound source having a zero degree vertical angle with respect to the listener.

25. The non-transitory physical computer storage of claim 19, wherein the first and second peaks of the first digital filter are configured to provide first location-critical frequencies for location discrimination of the sound source, and wherein the first and second troughs of the second digital filter are configured to provide second location-critical frequencies for location discrimination of the sound source.