Method and apparatus for efficient presentation of high-quality three-dimensional audio

• US 5,596,644 A
• Filed: 10/27/1994
• Issued: 01/21/1997
• Est. Priority Date: 10/27/1994
• Status: Expired due to Term

• Current Assignee: Creative Technology Ltd.
• Original Assignee: Aureal Semiconductor, Inc.
• Inventors: Foster, Scott H., Abel, Jonathan S.
• Primary Examiner(s): Isen, Forester W.
• Application Number:
  US08/330,240
• Time in Patent Office: 817 Days
• Field of Search: 381/17, 381/18, 381/1, 381/63
• US Class Current: 381/17
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 5/00 Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

Spatialization of soundfields is accomplished by filtering audio signals using filters having unvarying frequency response characteristics and amplifying signals using amplifier gains adapted in response to signals representing sound source location and/or listener position. The filters are derived using a singular value decomposition process which finds the best set of component impulse responses to approximate a given set of head related transfer functions. Efficient implementations for rendering reflection effects, and for spatializing multiple sound sources and/or generating multiple output signals are disclosed.

Claims

1. A method for providing an acoustic display of aural information conveying apparent location, said method comprising the steps of:

receiving an audio signal representing said aural information and receiving one or more location signals representing apparent location for a source of said aural information,

generating a plurality of filtered signals by applying a plurality of filters to said audio signal, wherein said plurality of filters have impulse responses which are substantially mutually orthogonal, and

for each respective filtered signal, generating a plurality of amplified signals by amplifying said respective filtered signal using a plurality of amplifiers, each of said amplifiers using a respective gain adapted in response to a respective location signal of said one or more location signals,

generating a plurality of output signals, wherein a respective output signal is generated by combining a plurality of said amplified signals.

2. A method according to claim 1 wherein said method further comprises receiving a position signal representing a position of a listener, wherein said respective gain is adapted in response to said position signal.

3. A method according to claim 1 wherein said respective gain is adapted in response to a signal representing aural localization characteristics of a listener.

4. A method according to claim 1 wherein one or more of said output signals are delayed in response to a signal representing aural localization characteristics of a listener.

5. A method according to claim 1 wherein said respective gain is adapted in response to one or more signals representing ambient reflection characteristics.

6. A method according to claim 1 wherein said plurality of filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said plurality of filters is less than the number of impulse responses in said target set.

7. A method according to claim 6 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.

8. A method for providing an acoustic display of a plurality of sources of aural information conveying apparent location, said method comprising the steps of:

receiving for a respective source of said plurality of sources a respective audio signal and one or more location signals representing apparent location for said respective source,

for each respective source, generating a plurality of amplified signals by amplifying said respective audio signal using a plurality of amplifiers, each of said amplifiers using a respective gain adapted in response to a respective location signal of said one or more location signals,

generating a plurality of intermediate signals, wherein a respective intermediate signal is generated by combining a plurality of said amplified signals,

generating a plurality of filtered signals by applying a respective filter of a plurality of filters to each of said plurality of intermediate signals, wherein said plurality of filters have impulse responses which are substantially mutually orthogonal, and

generating one or more output signals by combining said plurality of filtered signals.

9. A system according to claim 8 wherein said method further comprises receiving a position signal representing a position of a listener, wherein said respective gain is adapted in response to said position signal.

10. A method according to claim 8 wherein said respective gain is adapted in response to a signal representing aural localization characteristics of a listener.

11. A method according to claim 8 wherein, for each said respective source, said plurality of amplified signals are delayed in response to a signal representing aural localization characteristics of a listener.

12. A method according to claim 8 wherein said respective gain is adapted in response to one or more signals representing ambient reflection characteristics.

13. A method according to claim 8 wherein said plurality of filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said plurality of filters is less than the number of impulse responses in said target set.

14. A method according to claim 13 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.

15. A method for providing an acoustic display of aural information conveying apparent location, said method comprising the steps of:

receiving an audio signal representing said aural information and receiving a location signal representing an apparent location for a source of said aural information,

generating a first filtered signal by applying a first filter to said audio signal, said first filter having variable frequency response characteristics adapted in response to said location signal,

generating one or more second filtered signals, each of said second filtered signals generated by filtering using a respective unvarying frequency response characteristic of a plurality of response characteristics and by amplifying using a respective gain adapted in response to said location signal, wherein said plurality of response characteristics correspond to a plurality of filter impulse responses which are substantially mutually orthogonal, and

generating an output signal by combining said first filtered signal and said one or more second filtered signals.

16. A method according to claim 15 wherein said method further comprises receiving a position signal representing a position of a listener, wherein said respective gain is adapted in response to said position signal.

17. A method according to claim 15 wherein said variable frequency response characteristics and said respective gain are adapted in response to a signal representing aural localization characteristics of a listener.

18. A method according to claim 15 wherein said output signal is delayed in response to a signal representing aural localization characteristics of a listener.

19. A method according to claim 15 wherein said respective gain is adapted in response to one or more signals representing ambient reflection characteristics.

20. A method according to claim 15 wherein said plurality of impulse responses are derived such that weighted sums of said filter impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said filter impulse responses is less than the number of impulse responses in said target set.

21. A method according to claim 20 wherein said filter impulse responses are derived by singular value decomposition of said target set of impulse responses.

22. A method according to claim 15 wherein a respective one of said second filtered signals is generated by applying a second filter having said respective unvarying frequency response characteristic to said audio signal and amplifying the output of said second filter using an amplifier having said respective gain.

23. A method according to claim 15 wherein a respective one of said second filtered signals is generated by amplifying said audio signal using an amplifier having said respective gain and filtering the output of said amplifier using a second filter having said respective unvarying frequency response characteristic.

24. A method for providing an acoustic display of aural information conveying apparent location, said method comprising the steps of:

receiving an audio signal representing said aural information and receiving a location signal representing apparent location for a source of said aural information, and

filtering said audio signal by applying a linear combination of filters, each filter having a respective unvarying frequency response characteristic from a plurality of response characteristics, wherein said linear combination is adapted in response to said location signal and said plurality of response characteristics correspond to a plurality of impulse responses which are substantially mutually orthogonal.

25. A method according to claim 24 wherein said plurality of impulse responses are derived by singular value decomposition of a target set of impulse responses.

26. A method for providing an acoustic display of aural information conveying apparent location, said method comprising the steps of:

receiving an audio signal representing said aural information and receiving a location signal representing apparent location for a source of said aural information, and

filtering said audio signal by applying a a linear combination of a filters, each filter having a respective unvarying frequency response characteristic from a plurality of response characteristics, wherein said linear combination is adapted in response to said location signal and said plurality of response characteristics correspond to a plurality of impulse responses derived such that weighted sums of said plurality of impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said plurality of impulse responses is less than the number of impulse responses in said target set.

27. A method according to claim 26 wherein said plurality of impulse responses are derived by singular value decomposition of said target set of impulse responses.

28. A system for providing an acoustic display of a plurality of audio sources conveying apparent location to one or more listeners, wherein each of said plurality of audio sources provides aural information at an audio output and provides apparent location information at a location output, and wherein position information for each of said one or more listeners is provided at one or more position outputs, said system comprising:

a plurality of first amplifier groups, each comprising a plurality of first amplifiers each having an input coupled to a respective audio output and comprising a gain control coupled to a respective location output,

a plurality of first combining circuits each having a plurality of inputs, each of said first combining circuits having a respective input coupled to an output of a first amplifier in a respective first amplifier group,

a plurality of filters each having an input coupled to an output of a respective first combining circuit of said plurality of first combining circuits,

a plurality of second amplifier groups, each comprising a plurality of second amplifiers each having an input coupled to an output of a respective filter of said plurality of filters and comprising a gain control coupled to a respective position output,

a plurality of second combining circuits, a respective second combining circuit having a plurality of inputs coupled to outputs of second amplifiers in a respective one of said plurality of second amplifier groups, and

a plurality of output terminals, each coupled to an output of a respective second combining circuit of said plurality of second combining circuits.

40. A system according to claim 28 wherein said plurality of filters have impulse responses which are substantially mutually orthogonal.

41. A system according to claim 28 wherein said plurality of filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said filters is less than the number of impulse responses in said target set.

42. A system according to claim 41 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.

50. A system according to claim 28 wherein, in response to a configuration signal, said first amplifier groups, said first combining circuits, said second amplifier groups, and/or said second combining circuits are adapted to configure said plurality of filters into one or more sets of filters, thereby providing for a variable number of audio sources and/or providing a variable number of output terminals.

29. A system for providing an acoustic display of an audio source conveying apparent location, wherein said audio source provides aural information at an audio output and provides apparent location information at a location output, said system comprising:

a plurality of filters each having an input coupled to said audio output and each having a respective impulse response in a plurality of impulse responses, wherein said plurality of impulse responses are substantially mutually orthogonal,

a plurality of amplifier groups, each comprising a plurality of amplifiers each having an input coupled to an output of a respective filter of said plurality of filters and comprising a gain control coupled to said location output,

a plurality of combining circuits, a respective combining circuit having a plurality of inputs coupled to outputs of amplifiers in a respective one of said plurality of amplifier groups, and

a plurality of output terminals, each coupled to an output of a respective combining circuit of said plurality of combining circuits.

30. A system according to claim 29 further comprising one or more position sensors for one or more listeners, wherein said gain control for a respective amplifier group is coupled to a respective position sensor.

43. A system according to claim 29 wherein said plurality of filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said filters is less than the number of impulse responses in said target set.

44. A system according to claim 43 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.

31. A system for providing an acoustic display of a plurality of audio sources conveying apparent location, wherein each of said plurality of audio sources provides aural information at an audio output and provides apparent location information at a location output, said system comprising:

a plurality of amplifier groups, each comprising a plurality of amplifiers each having an input coupled to a respective audio output and comprising a gain control coupled to a respective location output,

a plurality of first combining circuits each having a plurality of inputs, each of said first combining circuits having a respective input coupled to an output of an amplifier in a respective amplifier group,

a plurality of filters each having an input coupled to an output of a respective first combining circuit of said plurality of first combining circuits and each filter having a respective impulse response in a plurality of impulse responses, wherein said plurality of impulse responses are substantially mutually orthogonal,

a second combining circuit having a plurality of inputs, a respective input coupled to an output of a respective filter of said plurality of filters, and

an output terminal coupled to an output of said second combining circuit.

32. A system according to claim 31 further comprising a position sensor for a listener, wherein said gain control for a respective amplifier group is coupled to said position sensor.

45. A system according to claim 31 wherein said plurality of filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said filters is less than the number of impulse responses in said target set.

46. A system according to claim 45 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.

33. A system for providing an acoustic display of aural information conveying apparent location, wherein an audio source provides said aural information at an audio output and provides apparent location information at a location output, said system comprising:

a first filter having an input coupled to said audio output, an output coupled to a first output terminal, and having a frequency response control coupled to said location output,

one or more delay elements having inputs coupled to said audio output,

a plurality of amplifier groups, each group comprising a plurality of amplifiers each having an input coupled to an output of said one or more delay elements and a gain control coupled to said location output,

a plurality of first combining circuits each having a plurality of inputs, each of said first combining circuits having a respective input coupled to an output of an amplifier in a respective amplifier group,

a plurality of second filters each having an input coupled to an output of a respective first combining circuit,

one or more second combining circuits each having a plurality of inputs, a respective input coupled to an output of a respective second filter, and

one or more second output terminals, each coupled to an output of a respective second combining circuit.

34. A system according to claim 33 wherein said plurality of second filters have impulse responses which are substantially mutually orthogonal.

35. A system according to claim 33 wherein said plurality of second filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said second filters is less than the number of impulse responses in said target set.

36. A system according to claim 35 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.

37. A system for providing an acoustic display of an audio source conveying apparent location and ambient effects, wherein said audio source provides aural information at an audio output and provides apparent location information at a location output, and wherein an ambient signal describing ambient characteristics is provided at an ambient output, said system comprising:

a first filter having an input coupled to said audio output, an output coupled to a first output terminal, and having a frequency response control coupled to said location output,

a plurality of second filters each having an input coupled to said audio output,

a plurality of amplifier groups, each comprising a plurality of amplifiers each having an input coupled to an output of a respective filter of said plurality of filters and having a gain control coupled to said location output,

a plurality of first combining circuits, a respective combining circuit having a plurality of inputs coupled to outputs of amplifiers in a respective one of said plurality of amplifier groups,

a plurality of delay elements each having an input coupled to an output of a respective first combining circuit,

a plurality of second combining circuits each having a plurality of inputs, a respective input coupled to an output of a respective delay element of said plurality of said delay elements, and

a plurality of second output terminals, each coupled to an output of a

respective second combining circuit of said plurality of second combining circuits.

38. A system according to claim 37 wherein said delay elements comprise a delay control coupled to said location signal.

39. A system according to claim 37 wherein said delay elements comprise a delay control coupled to said ambient output.

47. A system according to claim 37 wherein said plurality of second filters have impulse responses which are substantially mutually orthogonal.

48. A system according to claim 37 wherein said plurality of second filters have impulse responses derived such that weighted sums of said impulse responses provide substantially optimum approximations to each impulse response in a target set of impulse responses, and wherein the number of said filters is less than the number of impulse responses in said target set.

49. A system according to claim 48 wherein said impulse responses are derived by singular value decomposition of said target set of impulse responses.