Channel extension coding for multi-channel source

• US 8,249,883 B2
• Filed: 10/26/2007
• Issued: 08/21/2012
• Est. Priority Date: 10/26/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mehrotra, Sanjeev, Kotteri, Kishore
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): COLUCCI, MICHAEL C
• Application Number:
  US11/925,733
• Publication Number:
  US 20090112606A1
• Time in Patent Office: 1,761 Days
• Field of Search: 704/205, 704/226, 704/233, 704/200.1, 704/219, 704/229, 704/230, 704/246, 704/273, 704/500, 704/501, 341/155, 345/424, 375/141, 375/148, 375/240, 375/240.1, 375/240.12, 381/310, 381/63, 455/63.1, 455/72
• US Class Current: 704/501
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing

Abstract

A multi-channel audio decoder reconstructs multi-channel audio of more than two physical channels from a reduced set of coded channels based on correlation parameters that specify a full power cross-correlation matrix of the physical channels, or merely preserve a partial correlation matrix (such as power of the physical channels, and some subset of cross-correlations between the physical channels, or cross-correlations of the physical channels with coded or virtual channels).

Claims

1. A method of reconstructing multi-channel audio from a compressed bitstream, the method comprising:

receiving the compressed bitstream, the compressed bitstream containing a plurality of coded channels and power correlation parameters, the number of coded channels being fewer than a number of physical channels of the multi-channel audio, the power correlation parameters characterizing a full power correlation matrix;

decoding a vector of coded audio channel coefficients and power correlation parameters from the received bitstream for a frequency band;

forming a virtual audio channel coefficients vector for the frequency band comprising the decoded vector of coded audio channel coefficients and coefficients of decorrelated versions of the coded audio channels;

determining the full power correlation matrix for the frequency band from the power correlation parameters;

constructing a linear transform for multi-channel audio reconstruction relating the virtual audio channel coefficients vector to a reconstructed multi-channel audio coefficients vector;

applying the linear transform to the virtual audio channel coefficients vector to produce the reconstructed multi-channel audio coefficients vector; and

with a processing unit, applying an inverse time-frequency transform to the reconstructed multi-channel audio coefficients vector to reproduce the multi-channel audio.

2. The method of claim 1 wherein the act of constructing the linear transform for multi-channel audio reconstruction comprises:

calculating an inverse Karhunen-Loeve Transform of the virtual audio channel coefficients vector; and

constructing the linear transform for multi-channel audio reconstruction based on the inverse Karhunen-Loeve Transform of the virtual audio channel coefficients vector and further based on the Karhunen-Loeve Transform obtained from the full power correlation matrix of the physical channels for the frequency band.

3. The method of claim 1 wherein the act of constructing the linear transform for multi-channel audio reconstruction comprises:

calculating a power correlation matrix of the virtual audio channel coefficients vector using a linear channel transform of the full power correlation matrix of the physical channels for the frequency band, the linear channel transform relating the coded channels to the physical channels of the multi-channel audio; and

constructing the linear transform for multi-channel audio reconstruction from the power correlation matrix of the virtual audio channel coefficients.

4. The method of claim 1 wherein the power correlation parameters encode a non-coded channel components portion of a correlation matrix of a second channel coefficients vector related by a second linear channel transform to the physical channels of the multi-channel audio, and the method further comprises:

decoding the non-coded channel components portion of the correlation matrix of the second channel coefficients vector from the channel correlation parameters of the compressed bitstream;

combining the decoded portion of the correlation matrix of the second channel coefficients vector with a coded channel power correlation matrix to form the full power correlation matrix;

reconstructing the second channel coefficients vector from the coded audio channel coefficients vector;

performing an inverse of the second linear channel transform of the reconstructed second channel coefficients vector to produce the reconstructed multi-channel audio coefficients vector.

5. The method of claim 1 further comprising:

computing the coded channel power correlation matrix from the coded audio channels coefficients vector.

6. The method of claim 1 wherein the coded channel power correlation matrix is a spherical power correlation matrix and the channel correlation parameters specify a normalized version of the non-coded channel components portion of the correlation matrix of the second channel coefficients vector.

7. A method of reconstructing multi-channel audio from a compressed bitstream, the method comprising:

receiving the compressed bitstream, the compressed bitstream containing a plurality of coded channels and power correlation parameters, the number of coded channels being fewer than a number of physical channels of the multi-channel audio, the power correlation parameters characterizing at least a partial power correlation matrix;

decoding a vector of coded audio channel coefficients and power correlation parameters from the received bitstream for a frequency band;

producing a vector of coefficient of a plurality of virtual audio channels for the frequency band as a linear transform of the coded audio channel coefficients vector;

producing a decorrelated version of the virtual audio channel coefficients vector for the frequency band;

calculating weighting factors for preserving power of the physical channels and cross-correlation between the physical channels;

reconstructing a multi-channel audio coefficients vector for the frequency band as a sum of products of the weighting factors and the versions of the virtual audio channel coefficients vector; and

with a processing unit, applying an inverse time-frequency transform to the reconstructed multi-channel audio coefficients vector to reproduce the multi-channel audio.

8. The method of claim 7 wherein the power correlation parameters relate to power of the physical channels and cross-correlation between the physical channels and the virtual audio channels and weighting factors are computed for preserving power of the physical channels and cross-correlation between the physical channels and the virtual audio channels.

9. The method of claim 8 wherein the power correlation parameters specify magnitude and not phase of the cross-correlation between the physical channels and the virtual audio channels.

10. The method of claim 7 wherein the power correlation parameters specify magnitude and not phase of the cross-correlation between the physical channels.

11. The method of claim 7 wherein the power correlation parameters comprise:

a first parameter corresponding to a square root of a ratio of a power of the physical channels to a power of the virtual audio channels; and

a second parameter corresponding to a ratio of a cross-correlation between the physical channels and the virtual audio channels to a square root of a product of the power of the physical channels and the virtual audio channels.

12. The method of claim 7 wherein the power correlation parameters comprise:

a first parameter corresponding to a square root of a ratio of a power of the physical channels to a power of the virtual audio channels; and

a second parameter corresponding to a magnitude of a ratio of a cross-correlation between the physical channels and the virtual audio channels to a square root of a product of the power of the physical channels and the virtual audio channels, and wherein an angle of said ratio is not contained in the power correlation parameters.

13. The method of claim 7 wherein the power correlation parameters relate to a cross-correlation between physical channels that contribute to each of the coded audio channels, and wherein the power correlation parameters comprise:

a first parameter corresponding to a square root of a ratio of a power of a first of two out of the physical channels that contribute to the respective virtual audio channels to the power of the respective virtual audio channels;

a second parameter corresponding to a square root of a ratio of a power of a second of the two out of the physical channels that contribute to the respective virtual audio channels to the power of the respective virtual audio channels; and

a third parameter corresponding to a ratio of the cross-correlation between the two out of the physical channels to a square root of a product of the power of the two out of the physical channels.

14. A method of reproducing multi-channel audio from a compressed bitstream, the method comprising:

receiving the compressed bitstream, the compressed bitstream containing a plurality of coded channels and power correlation parameters, the number of coded channels being fewer than a number of physical channels of the multi-channel audio, the power correlation parameters characterizing at least a partial power correlation matrix;

decoding a vector of coded audio channel coefficients and power correlation parameters from the received bitstream for a frequency band;

producing a virtual audio channel coefficients vector corresponding to a plurality of virtual channels for the frequency band based on the coded audio channel coefficients vector;

deriving reconstruction parameters from the power correlation parameters that preserve at least partially a power cross-correlation matrix of the physical channels;

reconstructing a multi-channel audio coefficients vector for the frequency band as a function of the virtual audio channel coefficients and reconstruction parameters; and

with a processing unit, applying an inverse time-frequency transform to the reconstructed multi-channel audio coefficients vector to reproduce the multi-channel audio.

15. The method of claim 14 wherein the power correlation parameters comprise a full power cross-correlation matrix of the physical channels.

16. The method of claim 14 wherein the power correlation parameters comprise a cross-correlation matrix for a non-coded channels part of the virtual channels and a cross-correlation matrix between the coded channels and the non-coded channels part of the virtual channels.

17. The method of claim 14 wherein the power correlation parameters comprise a normalized power cross-correlation matrix of at least a non-coded channels part of the virtual channels.

18. The method of claim 14 wherein the power correlation parameters relate to power of the physical channels and cross correlation between the physical channels and the coded channels.

19. The method of claim 18 wherein the power correlation parameters are modified based on a scale factor for adjusting power of the virtual channels to reduce a post-echo effect.

20. The method of claim 14 wherein the power correlation parameters relate to power of the physical channels and cross correlation between the physical channels that contribute to each of the coded channels.