Method and apparatus for efficient presentation of high-quality three-dimensional audio including ambient effects

• US 5,802,180 A
• Filed: 01/17/1997
• Issued: 09/01/1998
• Est. Priority Date: 10/27/1994
• Status: Expired due to Term

• Current Assignee: Creative Technology Ltd.
• Original Assignee: Aureal Semiconductor, Inc.
• Inventors: Foster, Scott Haines, Abel, Jonathan Stuart
• Primary Examiner(s): Isen, Forester W.
• Application Number:
  US08/785,709
• Time in Patent Office: 592 Days
• Field of Search: 381/17, 381/63, 381/1, 381/18
• US Class Current: 381/17
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 5/00 Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

Spatialization of soundfields is accomplished by filtering audio signals using filters having unvarying frequency response characteristics and amplifying signals using amplifier gains adapted in response to signals representing sound source location and/or listener position. The filters are derived using a singular value decomposition process which finds the best set of component impulse responses to approximate a given target set of impulse responses corresponding to head related transfer functions. Efficient implementations for rendering reflection effects, air absorption losses and other ambient effects, and for spatializing multiple sound sources and/or generating multiple output signals are disclosed.

Claims

1. A method for providing an acoustic display of aural information comprising the steps of:

receiving a plurality of audio signals and a plurality of direction signals representing a plurality of sources of aural information, wherein said direction signals represent apparent directions of said sources,

receiving one or more ambient signals,

generating one or more first signals in response to said one or more audio signals, a respective first signal generated by combining said plurality of audio signals according to a respective set of weights adapted in response to said direction signals and said one or more ambient signals,

generating a plurality of filtered signals by filtering said first signals according to a plurality of filters having respective unvarying impulse responses which are substantially mutually orthogonal, and

generating one or more output signals in response to said filtered signals.

3. A method according to claim 1 or 2 wherein said one or more ambient signals represent ambient effects due to air absorption, source radiation patterns, source aspect angle, acoustic-transmission properties of materials, and/or acoustic-reflection properties of materials.

4. A method according to claim 1 or 2 wherein said plurality of filters have unvarying impulse responses such that weighted sums of said unvarying impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said plurality of filters is less than the number of impulse responses in said target set.

5. A method according to claim 4 wherein said target set comprises impulse responses that are functions of direction and one or more ambient effects, and wherein at least some of said impulse responses in said target set are deemphasized according to relative importance to accurate spatialization.

6. A method according to claim 1 or 2 wherein said plurality of filters have unvarying impulse responses such that weighted sums of said unvarying impulse responses provide substantially optimum approximations to each impulse response in two or more target sets of impulse responses, and wherein the number of said plurality of filters is less than the number of impulse responses in each of said target sets.

7. A method according to claim 6 wherein each of said target sets comprises impulse responses corresponding to a particular distance.

8. A method according to claim 6 wherein one of said target sets comprises impulse responses corresponding to even functions of direction, and wherein another of said target sets comprises impulse responses corresponding to odd functions of direction.

2. A method for providing an acoustic display of aural information comprising the steps of:

receiving one or more audio signals and one or more direction signals representing one or more sources of aural information, wherein said direction signals represent apparent directions of said sources,

receiving one or more ambient signals,

generating one or more first signals in response to said one or more audio signals,

generating a plurality of filtered signals by filtering said first signals according to a plurality of filters having respective unvarying impulse responses which are substantially mutually orthogonal, and

generating a plurality of output signals in response to said filtered signals, a respective output signal generated by combining said plurality of filtered signals according to a respective set of weights adapted in response to said direction signals and said one or more ambient signals.

9. An acoustic display of aural information comprising:

first terminals receiving one or more audio signals and one or more direction signals representing one or more sources of aural information, wherein said direction signals represent apparent directions of said sources,

one of more second terminals receiving one or more ambient signals,

first network means coupled to said first terminals for generating one or more first signals in response to said one or more audio signals,

filter means coupled to said first network means for generating a plurality of filtered signals by filtering said first signals according to a plurality of filters having respective unvarying impulse responses which are substantially mutually orthogonal, and

second network means coupled to said filter means for generating one or more output signals in response to said filtered signals,

wherein

said first terminals receive a plurality of audio signals, said first network means generates a respective first signal by combining said plurality of audio signals according to a respective set of weights adapted in response to said direction signals and said one or more ambient signals,

and/or wherein

said second network means generates a plurality of output signals, a respective output signal generated by combining said plurality of filtered signals according to a respective set of weights adapted in response to said direction signals and said one or more ambient signals.

10. An apparatus for providing an acoustic display of a plurality of audio sources, wherein each of said plurality of audio sources provides aural information at an audio output and provides apparent location information at a location output, said system comprising:

a terminal receiving one or more ambient signals representing ambient effects,

a plurality of amplifier groups, each comprising a plurality of amplifiers each having an input coupled to a respective audio output and comprising a gain control coupled to a respective location output, wherein at least some of said amplifiers have a respective gain control also coupled to said terminal,

a plurality of first combining circuits each having a plurality of inputs, each of said first combining circuits having a respective input coupled to an output of an amplifier in a respective amplifier group,

a plurality of filters each having an input coupled to an output of a respective first combining circuit of said plurality of first combining circuits and each filter having a respective unvarying impulse response in a plurality of impulse responses, wherein said plurality of impulse responses are substantially mutually orthogonal,

a second combining circuit having a plurality of inputs, a respective input coupled to an output of a respective filter of said plurality of filters, and

an output terminal coupled to an output of said second combining circuit.

12. An apparatus according to claim 9, 10 or 11 wherein said one or more ambient signals represent ambient effects due to air absorption, source radiation patterns, source aspect angle, acoustic-transmission properties of materials, and/or acoustic-reflection properties of materials.

13. An apparatus according to claim 9, 10 or 11 wherein said plurality of filters have unvarying impulse responses such that weighted sums of said unvarying impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said plurality of filters is less than the number of impulse responses in said target set.

14. An apparatus according to claim 13 wherein said target set comprises impulse responses that are functions of direction and one or more ambient effects, and wherein at least some of said impulse responses in said target set are deemphasized according to relative importance to accurate spatialization.

15. An apparatus according to claim 9, 10 or 11 wherein said plurality of filters have unvarying impulse responses such that weighted sums of said unvarying impulse responses provide substantially optimum approximations to each impulse response in two or more target sets of impulse responses, and wherein the number of said plurality of filters is less than the number of impulse responses in each of said target sets.

16. An apparatus according to claim 15 wherein each of said target sets comprises impulse responses corresponding to a particular distance.

17. An apparatus according to claim 15 wherein one of said target sets comprises impulse responses corresponding to even functions of direction, and wherein another of said target sets comprises impulse responses corresponding to odd functions of direction.

11. An apparatus for providing an acoustic display of an audio source, wherein said audio source provides aural information at an audio output and provides apparent location information at a location output, said system comprising:

a terminal receiving one or more ambient signals representing ambient effects,

a plurality of filters each having an input coupled to said audio output and each having a respective impulse response in a plurality of impulse responses, wherein said plurality of impulse responses are substantially mutually orthogonal,

a plurality of amplifier groups, each comprising a plurality of amplifiers each having an input coupled to an output of a respective filter of said plurality of filters and comprising a gain control coupled to said location output, wherein at least some of said amplifiers have a respective gain control also coupled to said terminal,

a plurality of combining circuits, a respective combining circuit having a plurality of inputs coupled to outputs of amplifiers in a respective one of said plurality of amplifier groups, and

a plurality of output terminals, each coupled to an output of a respective combining circuit of said plurality of combining circuits.