IMMERSIVE AUDIO REPRODUCTION SYSTEMS

• US 20170325043A1
• Filed: 05/05/2017
• Published: 11/09/2017
• Est. Priority Date: 05/06/2016
• Status: Abandoned Application

• Current Assignee: DTS, Inc. (Xperi Inc.)
• Original Assignee: DTS, Inc. (Xperi Inc.)
• Inventors: Jot, Jean-Marc, Noh, Daekyoung, Cassidy, Ryan James, Katsianos, Themis George, Walker, Oveal
• Application Number:
  US15/587,903
• Publication Number:
  US 20170325043A1
• Time in Patent Office: Days
• CPC Class Codes: H04S 1/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/03 Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 H04S2400/01 takes precedence
• CPC Class Codes: H04S 2400/07 Generation or adaptation of the Low Frequency Effect [LFE] channel, e.g. distribution or signal processing
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 3/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 5/005 of the pseudo five- or more-channel type, e.g. virtual surround
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

Systems and methods can provide an elevated, virtual loudspeaker source in a three-dimensional soundfield using loudspeakers in a horizontal plane. In an example, a processor circuit can receive at least one height audio signal that includes information intended for reproduction using a loudspeaker that is elevated relative to a listener, and optionally offset from the listener'"'"'s facing direction by a specified azimuth angle. A first virtual height filter can be selected for use based on the specified azimuth angle virtualized audio signal can be generated by applying the first virtual height filter to the at least one height audio signal. When the virtualized audio signal is reproduced using one or more loudspeakers in the horizontal plane, the virtualized audio signal can be perceived by the listener as originating from an elevated loudspeaker source that corresponds to the azimuth angle.

Claims

1. A system comprising:

means for receiving a height audio information signal configured for use in audio reproduction using a loudspeaker that is outside of a first plane of a listener;

means for receiving localization information corresponding to the at least one height audio signal, the localization information including an azimuth parameter;

means for selecting a virtualized height filter using the azimuth parameter; and

means for generating a virtualized height audio information signal using the selected virtualized height filter and the received height audio information signal, and for storing the virtualized height audio information signal on a non-transitory computer-readable medium, wherein the virtualized height audio information signal is configured for use in audio reproduction using a loudspeaker provided in the first plane of the listener.

2. The system of claim 1, wherein the virtualized height audio information signal is configured for use in audio reproduction using the loudspeaker in the first plane of the listener to provide an audio image that extends vertically upward or downward from a horizontal plane of the loudspeaker used in the audio reproduction to a second plane.

3. The system of claim 1, wherein the virtualized height audio information signal is configured for use in audio reproduction using the loudspeaker in the first plane of the listener to provide an audio image that originates from a location that is offset vertically upward or downward from a horizontal plane of the loudspeaker used in the audio reproduction.

4. The system of claim 1, further comprising means for applying horizontal-plane virtualization to the height audio information signal prior to generating the virtualized height audio information signal.

5. The system of claim 1, further comprising means for combining the virtualized height audio information signal with one or more other signals to be concurrently reproduced using the loudspeaker in the first plane of the listener.

6. The system of claim 1, further comprising means for decorrelating multiple channels of audio information in the height audio information signal to provide multiple decorrelated signals;

wherein the means for generating the virtualized height audio information signal includes means for generating the virtualized height audio information signal using the selected virtualized height filter and at least one of the multiple decorrelated signals.

7. The system of claim 1, wherein the means for selecting the virtualized height filter using the azimuth parameter includes means for selecting the virtualized height filter using an altitude parameter.

8. The system of Maim 1, further comprising means for generating the virtualized height filter using information about a head-related transfer function.

9. An audio signal processing system configured to provide virtualized audio information in a three-dimensional soundfield using loudspeakers in a horizontal plane, wherein the virtualized audio information is perceived by a listener as including audible information in other than the horizontal plane, the system comprising:

an audio signal input configured to receive at least one height audio signal, the at least one height audio signal including audio signal information that is intended for reproduction using a loudspeaker that is elevated relative to a listener;

a localization signal input configured to receive localization information about the at least one height audio signal, the localization information including a first azimuth parameter;

a memory circuit including one or more virtual height filters, wherein each of the virtual height filters is associated with one or more azimuth parameters; and

an audio signal processor circuit configured to;

retrieve a first virtual height filter from the memory circuit using the first azimuth parameter; and

generate a virtualized audio signal by applying the first virtual height filter to the at least one height audio signal, wherein when the virtualized audio signal is reproduced using one or more loudspeakers in the horizontal plane, the virtualized audio signal is perceived by the listener as including audible information in other than the horizontal plane.

10. The system of claim 9, further comprising a decorrelation circuit coupled to the audio signal input and configured to receive the at least one height audio signal, wherein the decorrelation circuit is configured to apply a decorrelation filter to one or more audio channels included in the height audio signal.

11. The system of claim 9, further comprising a horizontal-plane virtualization processor circuit configured to apply horizontal-plane virtualization to at least one of the height audio signal and the virtualized audio signal.

12. The system of claim 9, further comprising a mixer circuit configured to combine the virtualized audio signal with one or more other signals to be concurrently reproduced using the same loudspeakers.

13. The system of claim 9, wherein the audio signal processor circuit includes a head-related transfer function derivation circuit configured to derive the first virtual height filter based on ipsilateral and contralateral head-related transfer function information corresponding to the listener.

14. A method for providing virtualized audio information in a three-dimensional soundfield using loudspeakers arranged in a first plane, wherein the virtualized audio information is perceived by a listener as including audible information in other than the first plane, the method comprising:

receiving, using a first processor circuit, at least one height audio signal, the at least one height audio signal configured for use in audio reproduction using a loudspeaker that is offset from the first plane;

receiving, using the first processor circuit, localization information corresponding to the at least one height audio signal, the localization information including an azimuth parameter;

selecting, using the first processor circuit, a first virtual height filter using information about the azimuth parameter; and

generating a virtualized audio signal, including using the first processor circuit to apply the first virtual height filter to the at least one height audio signal, wherein the virtualized audio signal is configured for use in audio reproduction using one or more loudspeakers in the first plane, and wherein when the virtualized audio signal is reproduced using the one or more loudspeakers it is perceived by a listener as including audible information in other than the first plane.

15. The method of claim 14, wherein the generating the virtualized audio signal includes generating the signal such that when the virtualized audio signal is reproduced using the one or more loudspeakers, the virtualized audio signal is perceived by the listener as including audible information that extends vertically upward or downward from a horizontal plane of the loudspeakers to a second plane.

16. The method of claim 14, wherein the generating the virtualized audio signal includes generating the signal such that when the virtualized audio signal is reproduced using the one or more loudspeakers, the virtualized audio signal is perceived by the listener as originating from an elevated or lowered source relative to a horizontal plane of the loudspeakers.

17. The method of claim 14, wherein the generating the virtualized audio signal includes applying horizontal-plane virtualization to the at least one height audio signal prior to applying the first virtual height filter.

18. The method of claim 14, further comprising, using an audio signal mixer circuit, combining the virtualized audio signal with one or more other signals to be concurrently reproduced using the one or more loudspeakers in the first plane.

19. The method of claim 14, wherein the receiving the at least one height audio signal includes receiving information about first and second height audio channels intended fur reproduction using different loudspeakers that are elevated relative to the first plane, wherein the first plane is a horizontal plane of the listener;

wherein the receiving the localization information includes receiving respective azimuth parameters for the first and second height audio channels;

wherein the selecting includes selecting different respective first and second virtual height filters using information about the respective azimuth parameters; and

wherein the generating includes using the first processor circuit to apply the first and second virtual height filters to the first and second height audio channels, respectively, to provide respective first and second virtualized audio signals, wherein when the first and second virtualized audio signals are reproduced using loudspeakers in the horizontal plane, the reproduced signals are perceived by the listener as including audible information in other than the horizontal plane.

20. The method of claim 19, wherein the generating includes decorrelating the first and second height audio signals before applying the first and second virtual height filters.