Method and apparatus for conversion between multi-channel audio formats

• US 8,908,873 B2
• Filed: 02/01/2008
• Issued: 12/09/2014
• Est. Priority Date: 03/21/2007
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Herre, Juergen, Pulkki, Ville
• Primary Examiner(s): Mei, Xu
• Application Number:
  US12/530,645
• Publication Number:
  US 20100166191A1
• Time in Patent Office: 2,503 Days
• Field of Search: 381/1, 381 17- 19, 381/22, 381/23, 381/310, 381/92, 381/119
• US Class Current: 381/19
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/173 Transcoding, i.e. converting between two coded representations avoiding cascaded coding-decoding
• CPC Class Codes: H04S 2420/11 Application of ambisonics in stereophonic audio systems
• CPC Class Codes: H04S 3/02 of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other

Abstract

An input multi-channel representation is converted into a different output multi-channel representation of a spatial audio signal, in that an intermediate representation of the spatial audio signal is derived, the intermediate representation having direction parameters indicating a direction of origin of a portion of the spatial audio signal; and in that the output multi-channel representation of the spatial audio signal is generated using the intermediate representation of the spatial audio signal.

Claims

1. Apparatus for conversion of an input multi-channel representation into a different output multi-channel representation of a spatial audio signal, comprising:

a simulator for simulating a recording of a number of audio channels corresponding to loudspeakers associated to the input multi-channel representation to obtain simulated microphone signals;

an analyzer for deriving, from the simulated microphone signals, an intermediate representation of the spatial audio signal, the intermediate representation comprising direction parameters indicating a direction of origin of a portion of the spatial audio signal; and

a signal composer for generating the output multi-channel representation of the spatial audio signal using the intermediate representation of the spatial audio signal.

2. Apparatus in accordance with claim 1, in which the analyzer is operative to derive direction parameters depending on a virtual correlation of the audio channels associated to the input multi-channel representation.

3. Apparatus in accordance with claim 1, in which the analyzer is operative to derive direction parameters preserving the relative phase information of the audio channels associated to the input multi-channel representation.

4. Apparatus in accordance with claim 1, in which the analyzer is operative to derive different direction parameters for finite width frequency portions of the spatial audio signal.

5. Apparatus in accordance with claim 1, in which the analyzer is operative to derive different direction parameters for finite length time portions of the spatial audio signal.

6. Apparatus in accordance with claim 4, in which the analyzer is operative to derive the different direction parameters for finite length time portions of the spatial audio signal associated to the frequency portions, wherein the length of a first time portion associated to a first frequency portion differs from the length of a second time portion association to a second, different frequency portion of the spatial audio signal.

7. Apparatus in accordance with claim 1, in which the analyzer is operative to derive direction parameters describing a vector pointing to the direction of origin of the portion of the spatial audio signal.

8. Apparatus in accordance with claim 1, in which the analyzer is additionally operative to derive one or more audio channels associated to the intermediate representation.

9. Apparatus in accordance with claim 8, in which the analyzer is operative to derive audio channels corresponding to loudspeakers associated to the input multi-channel representation.

10. Apparatus in accordance with claim 8, in which the analyzer is operative to derive one downmix channel as the sum of the audio channels corresponding to loudspeakers associated to the input multi-channel representation.

11. Apparatus in accordance with claim 8, in which the analyzer is operative to derive at least one audio channel associated to the direction of an axis of a Cartesian Coordinate System.

12. Apparatus in accordance with claim 11, in which the analyzer is operative to derive the at least one audio channel building the weighted sum of the audio channels corresponding to the loudspeakers associated to the input multi-channel representation.

13. Apparatus in accordance with claim 11, in which the analyzer is operative such that the deriving of the at least one audio channel X associated to the direction V of an axis of the Cartesian Coordinate System can be described by a combination of n audio channels C_n corresponding to the n loudspeakers associated to the input multi-channel representation and directed in a direction L_n, according to the following formula:

14. Apparatus in accordance with claim 1, in which the analyzer is further operative to derive a diffuseness parameter indicating a diffuseness of the direction of origin of the portion of the spatial audio signal.

15. Apparatus in accordance with claim 1, in which the signal composer is operative to distribute the portion of the spatial audio signal to a number of channels corresponding to a number of loudspeakers associated to the output multi-channel representation.

16. Apparatus in accordance with claim 15, in which the signal composer is operative such that the portion of the spatial audio signal is distributed with greater intensity to a channel corresponding to a loudspeaker closer to the direction indicated by the direction parameters than to a channel corresponding to a loudspeaker further away from that direction.

17. Apparatus in accordance with claim 14, in which the signal composer is operative such that the portion of the spatial audio signal is distributed with more uniform intensity to channels corresponding to loudspeakers associated to the output multi-channel representation when the diffuseness parameter indicates higher diffuseness than when the diffuseness parameter indicates lower diffuseness.

18. Apparatus in accordance with claim 1 further comprising:

an input interface for receiving the input multi-channel representation.

19. Apparatus in accordance with claim 15, in which the signal composer further comprises an output channel encoder for deriving the output multi-channel representation based on the audio channels corresponding to the loudspeakers associated to the output channel representation.

20. Apparatus in accordance with claim 1 further comprising an output interface for providing the output multi-channel representation.

21. Method for conversion of an input multi-channel representation into a different output multi-channel representation of a spatial audio signal, the method comprising:

simulating a recording of a number of audio channels corresponding to loudspeakers associated to the input multi-channel representation to obtain simulated microphone signals;

deriving, from the simulated microphone signals, an intermediate representation of the spatial audio signal, the intermediate representation comprising direction parameters indicating a direction of origin of a portion of the spatial audio signal; and

generating the output multi-channel representation of the spatial audio signal using the intermediate representation of the spatial audio signal.

22. A non-transitory storage medium having stored thereon a computer program for, when running on a computer, implementing the method for conversion of a multi-channel representation into a different output multi-channel representation of a spatial audio signal, the method comprising:

simulating a recording of a number of audio channels corresponding to loudspeakers associated to the input multi-channel representation to obtain simulated microphone signals;

deriving, from the simulated microphone signals, an intermediate representation of the spatial audio signal, the intermediate representation comprising direction parameters indicating a direction of origin of a portion of the spatial audio signal; and

generating the output multi-channel representation of the spatial audio signal using the intermediate representation of the spatial audio signal.