Complex cross-correlation parameters for multi-channel audio

• US 8,190,425 B2
• Filed: 01/20/2006
• Issued: 05/29/2012
• Est. Priority Date: 01/20/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mehrotra, Sanjeev, Chen, Wei-Ge
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US11/336,403
• Publication Number:
  US 20070172071A1
• Time in Patent Office: 2,321 Days
• Field of Search: 704/203, 704500-504
• US Class Current: 704/203
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

An audio encoder encodes a combined channel (e.g., a sum channel) for a group of plural physical audio channels. The encoder determines plural parameters for representing individual physical channels of the group as modified versions of the encoded combined channel. The plural parameters comprise ratios of power in each individual channel to power in the combined channel (e.g., a ratio of the power of a right channel to the power of the combined channel, and a ratio of the power of the left channel to the power of the combined channel). The plural parameters can include a complex parameter. The combined channel and the plural parameters facilitate reconstruction at the audio decoder of source channels. An audio decoder performs a forward complex transform on the multi-channel audio data and reconstructs plural channels from the multi-channel audio data. The decoder can maintain second-order statistics for the source channels.

Claims

1. In an audio encoder, a computer-implemented method comprising:

encoding a combined channel for a group of plural physical audio channels; and

determining plural parameters for representing individual physical channels of the group as modified versions of the encoded combined channel, wherein the plural parameters comprise;

ratios of power in each of at least two of the individual channels to power in the combined channel; and

a cross-correlation parameter representing a cross-correlation ratio, the cross-correlation ratio representable at a decoder by an imaginary number component and a real number component, the cross-correlation parameter representing cross-correlation between channels, wherein the imaginary number component comprises an imaginary number component of a correlation matrix.

2. The method of claim 1 wherein the encoding a combined channel and the determining plural parameters is performed selectively on a frequency-band basis.

3. The method of claim 1 wherein a decoder uses the encoded combined channel and the plural parameters in reconstruction of at least two of the plural physical channels.

4. The method of claim 1 wherein the combined channel is a sum channel.

5. The method of claim 1 wherein the cross-correlation parameter is a complex parameter.

6. The method of claim 1 wherein the cross-correlation ratio is an imaginary-to-real ratio representing cross-channel correlation.

7. The method of claim 1 wherein the plural parameters are sufficient for an audio decoder to derive a normalized power correlation matrix for representing individual physical channels of the group as modified versions of the encoded combined channel.

22. The method of claim 1, the power ratios comprising:

for a first channel of the individual physical channels, a ratio of power of the first channel over power of the encoded combined channel; and

for a second channel of the individual physical channels, a ratio of power of the second channel over the power of the encoded combined channel.

23. The method of claim 22 wherein the first channel is a left channel, and wherein the second channel is a right channel.

27. The method of claim 1 wherein the cross-correlation ratio is determined on a per-band basis.

28. The method of claim 27 wherein the ratios of power are determined on a per-band basis.

8. A computer-readable storage device storing computer-executable instructions for causing a computer programmed thereby to perform the method comprising:

encoding a combined channel for a group of plural physical audio channels; and

determining plural parameters for representing individual physical channels of the group as modified versions of the encoded combined channel, wherein the plural parameters comprise;

ratios of power in each of at least two of the individual channels to power in the combined channel; and

a cross-correlation parameter representing a cross-correlation ratio, the cross-correlation ratio representable at a decoder by an imaginary number component and a real number component, the cross-correlation parameter representing cross-correlation between channels, wherein the imaginary number component comprises an imaginary number component of a correlation matrix.

9. In an audio encoder, a computer-implemented method comprising:

receiving multi-channel audio data, the multi-channel audio data comprising a group of plural channels;

encoding a combined channel for the group;

determining plural parameters for representing individual source channels of the group as modified versions of the encoded combined channel, wherein the plural parameters comprise at least one cross-correlation parameter representing a ratio that is representable at the audio decoder by an imaginary number component and a real number component, wherein the imaginary number component comprises an imaginary number component of a correlation matrix; and

sending the encoded combined channel and the plural parameters to the audio decoder;

wherein the encoded combined channel and the plural parameters facilitate reconstruction at the audio decoder of at least two of the plural source channels.

10. The method of claim 9 wherein the at least one cross-correlation parameter comprises a complex parameter derived at the audio encoder using a forward complex transform.

11. The method of claim 9 wherein:

the plural parameters comprise a power ratio for each of the plural source channels, where the power ratio comprises for each of the plural source channels, a ratio of power in the source channel to power in the encoded combined channel.

12. The method of claim 9 wherein the plural parameters are determined on a per-band basis.

13. The method of claim 9 wherein the plural parameters vary by time and are interpolated between different time instances.

14. The method of claim 13 wherein the interpolation is selectively applied.

15. The method of claim 9 wherein the ratio is a ratio of an imaginary component to a real component.

24. The method of claim 11 further comprising:

jointly quantizing the power ratios.

16. A computer-readable storage device storing computer-executable instructions for causing a computer programmed thereby to perform the method comprising:

receiving multi-channel audio data, the multi-channel audio data comprising a group of plural channels;

encoding a combined channel for the group;

determining plural parameters for representing individual source channels of the group as modified versions of the encoded combined channel, wherein the plural parameters comprise at least one cross-correlation parameter representing a ratio that is representable at the audio decoder by an imaginary number component and a real number component, wherein the imaginary number component comprises an imaginary number component of a correlation matrix; and

sending the encoded combined channel and the plural parameters to the audio decoder;

wherein the encoded combined channel and the plural parameters facilitate reconstruction at the audio decoder of at least two of the plural source channels.

17. In an audio decoder, a computer-implemented method comprising:

receiving encoded multi-channel audio data, the encoded multi-channel audio data comprising an encoded combined channel and plural parameters for representing individual source channels of the group as modified versions of the encoded combined channel, wherein the plural parameters comprise at least one cross-correlation parameter representing a ratio that is representable by an imaginary component and a real component, the ratio representing cross- channel correlation, wherein the imaginary component comprises an imaginary component of a correlation matrix; and

decoding the encoded multi-channel audio data, wherein the decoding comprises;

performing a forward complex transform on the multi-channel audio data; and

reconstructing plural channels from the multi-channel audio data.

18. The method of claim 17 wherein the performing the forward complex transform comprises deriving spectral coefficients for the encoded combined channel.

19. The method of claim 18 further comprising:

scaling the derived spectral coefficients using complex scale factors.

21. The method of claim 17 wherein the ratio is a ratio of an imaginary component to a real component.

20. A computer-readable storage device storing computer-executable instructions for causing a computer programmed thereby to perform the method comprising:

receiving encoded multi-channel audio data, the encoded multi-channel audio data comprising an encoded combined channel and plural parameters for representing individual source channels of the group as modified versions of the encoded combined channel, wherein the plural parameters comprise at least one cross-correlation parameter representing a ratio that is representable by an imaginary component and a real component, the ratio representing cross- channel correlation, wherein the imaginary component comprises an imaginary component of a correlation matrix; and

decoding the encoded multi-channel audio data, wherein the decoding comprises;

performing a forward complex transform on the multi-channel audio data; and

reconstructing plural channels from the multi-channel audio data.

25. In an audio decoder, a computer-implemented method comprising:

receiving encoded multi-channel audio data in a bitstream, the encoded multi-channel audio data comprising channel extension coding data, wherein the channel extension coding data comprises a combined channel for the plural audio channels and plural parameters for representing individual channels of the plural audio channels as modified versions of the combined channel;

determining based on bitstream syntax whether the plural parameters comprise (a) normalized correlation matrix parameters, or (b) plural power ratios and a complex parameter representing a ratio comprising an imaginary component and a real component of cross-correlation between two of the plural audio channels, wherein the imaginary component comprises an imaginary component of a correlation matrix;

based on the determining, decoding the plural parameters; and

reconstructing plural audio channels using the channel extension coding data.

26. A computer-readable storage device storing computer-executable instructions for causing a computer programmed thereby to perform the method of claim 25.