MDCT-based complex prediction stereo coding

• US 9,378,745 B2
• Filed: 04/06/2011
• Issued: 06/28/2016
• Est. Priority Date: 04/09/2010
• Status: Active Grant

• Current Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Inventors: Purnhagen, Heiko, Carlsson, Pontus, Villemoes, Lars
• Primary Examiner(s): Baker, Matthew
• Application Number:
  US13/638,901
• Publication Number:
  US 20130030817A1
• Time in Patent Office: 1,910 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/06 Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 25/12 the extracted parameters being prediction coefficients
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

The invention provides methods and devices for stereo encoding and decoding using complex prediction in the frequency domain. In one embodiment, a decoding method, for obtaining an output stereo signal from an input stereo signal encoded by complex prediction coding and comprising first frequency-domain representations of two input channels, comprises the upmixing steps of: (i) computing a second frequency-domain representation of a first input channel; and (ii) computing an output channel on the basis of the first and second frequency-domain representations of the first input channel, the first frequency-domain representation of the second input channel and a complex prediction coefficient. The method comprises applying independent bandwidth limits for the input channels.

Claims

1. A decoder system for providing a stereo signal by complex prediction stereo coding, the decoder system comprising:

an upmix stage adapted to generate the stereo signal based on first frequency domain representations of a downmix signal and a residual signal, each of the first frequency-domain representations comprising first spectral components representing spectral content of the corresponding signal expressed in a first subspace of a multidimensional space, the upmix stage comprising;

a module for computing a second frequency-domain representation of the downmix signal based on the first frequency-domain representation thereof, the second frequency-domain representation comprising second spectral components representing spectral content of the signal expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace;

a weighted summer for computing a side signal on the basis of the first and second frequency-domain representations of the downmix signal, the first frequency-domain representation of the residual signal and a complex prediction coefficient encoded in the bit stream signal; and

a sum-and-difference stage for computing the stereo signal on the basis of the first frequency-domain representation of the downmix signal and the side signal,

wherein the upmix stage is adapted to apply independent bandwidth limits for the downmix signal and the residual signal.

2. The decoder system of claim 1, wherein the bandwidth limits to be applied are signaled by two data fields, indicating for each of the signals a highest frequency band to be decoded.

3. The decoder system of claim 2, adapted to receive an MPEG bit stream in which each of said data fields is encoded as a value of a max_sfb parameter of the MPEG bit stream.

4. The decoder system of claim 1, further comprising:

a dequantization stage arranged upstream of the upmix stage, for providing said first frequency-domain representations of the downmix signal and residual signal based on a bit stream signal.

5. The decoder system of claim 1, wherein:

the first spectral components have real values expressed in the first subspace; and

the second spectral components have imaginary values expressed in the second subspace.

6. The decoder of claim 5, wherein:

the downmix signal is partitioned into successive time frames, each associated with a value of the complex prediction coefficient; and

the module for computing a second frequency-domain representation of the downmix signal is adapted to deactivate itself, responsive to the absolute value of the imaginary part of the complex prediction coefficient being smaller than a predetermined tolerance for a time frame, so that it generates no output for that time frame.

7. The decoder system of claim 1, wherein the first spectral components are obtainable by one of the following:

a discrete cosine transform, DCT,

a modified discrete cosine transform, MDCT.

8. The decoder system of claim 1, wherein the second spectral components are obtainable by one of the following:

a discrete sine transform, DST,

a modified discrete sine transform, MDST.

9. The decoder system of claim 1, further comprising at least one temporal noise shaping, TNS, module arranged upstream of the upmix stage;

and

at least one further TNS module arranged downstream of the upmix stage; and

a selector arrangement for selectively activating either;

(a) said TNS module(s) upstream of the upmix stage, or

(b) said further TNS module(s) downstream of the upmix stage.

10. The decoder system of claim 1, wherein the module for computing a second frequency-domain representation of the downmix signal comprises:

an inverse transform stage for computing a time-domain representation of the downmix signal and/or the side signal on the basis of the first frequency-domain representation of the respective signal in the first subspace of the multidimensional space; and

a transform stage for computing the second frequency-domain representation of the respective signal on the basis of the time-domain representation of the signal.

11. The decoder system of claim 1, wherein:

the first spectral components are transform coefficients arranged in one or more time frames of transform coefficients, each block generated by application of a transform to a time segment of a time-domain signal; and

the module for computing a second frequency-domain representation of the downmix signal is adapted to;

derive one or more first intermediate components from at least some of the first spectral components;

form a combination of said one or more first spectral components according to at least a portion of one or more impulse responses to obtain one or more second intermediate components; and

derive said one or more second spectral components from said one or more second intermediate components.

12. The decoder system of claim 11, wherein the module for computing a second frequency-domain representation of the downmix signal is adapted to obtain each time frame of second spectral components based on one of the following:

(a) a contemporaneous time frame of first spectral components;

(b) a contemporaneous and a preceding time frame of first spectral components; and

(c) a contemporaneous, a preceding and a subsequent time frame of first spectral components.

13. The decoder system of claim 1, wherein the module for computing a second frequency-domain representation of the downmix signal is adapted to compute an approximate second spectral representation comprising approximate second spectral components determined by combination of at least two temporally adjacent and/or frequency-adjacent first spectral components.

14. The decoder system of claim 1, said stereo signal being represented in the time domain and the decoder system further comprising:

a switching assembly arranged between said dequantization stage and said upmix stage, operable to function as either;

(a) a pass-through stage, or

(b) a sum-and-difference stage,

thereby enabling switching between directly and jointly coded stereo input signals;

an inverse transform stage adapted to compute a time-domain representation of the stereo signal; and

a selector arrangement arranged upstream of the inverse transform stage, adapted to selectively connect this to either;

(a) a point downstream of the upmix stage, whereby the stereo signal obtained by complex prediction is supplied to the inverse transform stage;

or

(b) a point downstream of the switching assembly and upstream of the upmix stage, whereby a stereo signal obtained by direct stereo coding is supplied to the inverse transform stage.

15. The method of claim 10 wherein the inverse transform stage performs an inverse modified discrete cosine transform, MDCT, and the transform stage performs a modified discrete sine transform, MDST.

16. The decoder system of claim 15, said stereo signal being represented in the time domain and the decoder system further comprising:

a switching assembly arranged between said dequantization stage and said upmix stage, operable to function as either;

(a) a pass-through stage, for use in joint stereo coding;

or

(b) a sum-and-difference stage, for use in direct stereo coding;

a further inverse transform stage arranged in the upmix stage, for computing a time-domain representation of the side signal;

a selector arrangement arranged upstream of the inverse transform stages, adapted to selectively connect these to either;

(a) a further sum-and-difference stage which is in turn connected to a point downstream of the switching assembly and upstream of the upmix stage;

or

(b) a downmix signal obtained from the switching assembly and a side signal obtained from the weighted summer.

17. A decoding method for upmixing an input stereo signal by complex prediction stereo coding into an output stereo signal, wherein:

said input stereo signal comprises first frequency-domain representations of a downmix channel and a residual channel and a complex prediction coefficient; and

each of said first frequency-domain representations comprises first spectral components representing spectral content of the corresponding signal expressed in a first subspace of a multidimensional space,

the method being performed by an upmix stage and including the steps of;

computing a second frequency-domain representation of the downmix channel based on the first frequency-domain representation thereof, the second frequency-domain representation comprising second spectral components representing spectral content of the signal expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace; and

computing the side channel on the basis of the first and second frequency-domain representations of the downmix signal, the first frequency-domain representation of the residual signal and the complex prediction coefficient,

wherein independent bandwidth limits are applied for the downmix signal and the residual signal.

18. A computer-program product comprising a non-transitory computer-readable medium storing instructions which when executed by a general-purpose computer perform the method set forth in claim 17.