MDCT-based complex prediction stereo coding

• US 9,111,530 B2
• Filed: 04/06/2011
• Issued: 08/18/2015
• Est. Priority Date: 04/09/2010
• Status: Active Grant

• Current Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Original Assignee: Dolby International AB (Dolby Laboratories Incorporated)
• Inventors: Purnhagen, Heiko, Carlsson, Pontus, Villemoes, Lars
• Primary Examiner(s): Jamal, Alexander
• Application Number:
  US13/638,898
• Publication Number:
  US 20130028426A1
• Time in Patent Office: 1,595 Days
• Field of Search: 381/22, 381/23, 704/500, 704/501
• US Class Current: 1/1
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/06 Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 25/12 the extracted parameters being prediction coefficients
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

The invention provides methods and devices for stereo encoding and decoding using complex prediction in the frequency domain. In one embodiment, a decoding method, for obtaining an output stereo signal from an input stereo signal encoded by complex prediction coding and comprising first frequency-domain representations of two input channels, comprises the upmixing steps of: (i) computing a second frequency-domain representation of a first input channel; and (ii) computing an output channel on the basis of the first and second frequency-domain representations of the first input channel, the first frequency-domain representation of the second input channel and a complex prediction coefficient. The upmixing can be suspended responsive to control data.

Claims

1. A decoder system for providing a stereo signal by complex prediction stereo coding, the decoder system comprising:

an upmix stage adapted to generate the stereo signal based on first frequency-domain representations of a downmix signal and a residual signal, each of the first frequency-domain representations comprising first spectral components representing spectral content of the corresponding signal expressed in a first subspace of a multidimensional space, the upmix stage comprising;

a module for computing a second frequency-domain representation of the downmix signal based on the first frequency-domain representation thereof, the second frequency-domain representation comprising second spectral components representing spectral content of the signal expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace;

a weighted summer for computing a side signal on the basis of the first and second frequency-domain representations of the downmix signal, the first frequency-domain representation of the residual signal and a complex prediction coefficient encoded in a bit stream signal received by the decoder system; and

a sum-and-difference stage for computing the stereo signal on the basis of the first frequency-domain representation of the downmix signal and the side signal,

wherein the upmix stage is further operable in a pass-through mode, in which said downmix and residual signals are supplied to the sum-and-difference stage directly.

2. The decoder system of claim 1, wherein said downmix signal and residual signal are segmented into time frames,

said upmix stage being further adapted to receive, for each time frame, a two-bit data field associated with that frame and to operate, responsive to the value of the data field, in its active mode or its pass-through mode.

3. The decoder system of claim 1, wherein said downmix and residual signal are segmented into time frames,

said upmix stage being further adapted to receive in an MPEG bit stream, for each time frame, an ms_mask_present field associated with that frame and to operate, responsive to the value of the ms_mask_present field, in its active mode or its pass-through mode.

4. The decoder system of claim 1, wherein:

the first spectral components have real values expressed in the first subspace; and

the second spectral components have imaginary values expressed in the second subspace;

optionally, the first spectral components are obtainable by one of the following;

a discrete cosine transform, DCT, or

a modified discrete cosine transform, MDCT,

and, optionally, the second spectral components are obtainable by one of the following;

a discrete sine transform, DST, or

a modified discrete sine transform, MDST.

5. The decoder system of claim 1, further comprising at least one temporal noise shaping, TNS, module arranged upstream of the upmix stage;

at least one further TNS module arranged downstream of the upmix stage; and

a selector arrangement for selectively activating either;

(a) said TNS module(s) upstream of the upmix stage, or

(b) said further TNS module(s) downstream of the upmix stage.

6. The decoder of claim 4, wherein:

the downmix signal is partitioned into successive time frames, each associated with a value of the complex prediction coefficient; and

the module for computing a second frequency-domain representation of the downmix signal is adapted to deactivate itself, responsive to the absolute value of the imaginary part of the complex prediction coefficient being smaller than a predetermined tolerance for a time frame, so that it generates no output for that time frame.

7. The decoder of claim 6, wherein the downmix signal time frames are further partitioned into frequency bands, each accompanied by a value of the complex prediction coefficient;

and

the module for computing a second frequency-domain representation of the downmix signal is adapted to deactivate itself, responsive to the absolute value of the imaginary part of the complex prediction coefficient being smaller than a predetermined tolerance for a frequency band of a time frame, so that it generates no output for that frequency band.

8. The decoder system of claim 1, wherein:

the first spectral components are transform coefficients arranged in one or more time frames of transform coefficients, each block generated by application of a transform to a time segment of a time-domain signal; and

the module for computing a second frequency-domain representation of the downmix signal is adapted to;

derive one or more first intermediate components from at least some of the first spectral components;

form a combination of said one or more first spectral components according to at least a portion of one or more impulse responses to obtain one or more second intermediate components; and

derive said one or more second spectral components from said one or more second intermediate components.

9. The decoder system of claim 8, wherein the module for computing a second frequency-domain representation of the downmix signal is adapted to obtain each time frame of second spectral components based on one of the following:

(a) a contemporaneous time frame of first spectral components;

(b) a contemporaneous and a preceding time frame of first spectral components; and

(c) a contemporaneous, a preceding and a subsequent time frame of first spectral components.

10. The decoder system of claim 1, wherein the module for computing a second frequency-domain representation of the downmix signal is adapted to compute an approximate second spectral representation comprising approximate second spectral components determined by combination of at least two temporally adjacent and/or frequency-adjacent first spectral components.

11. The decoder system of claim 1, said stereo signal being represented in the time domain and the decoder system further comprising:

a switching assembly arranged upstream of said upmix stage, operable to function as either;

(a) a pass-through stage, or

(b) a sum-and-difference stage,

thereby enabling switching between directly and jointly coded stereo input signals;

an inverse transform stage adapted to compute a time-domain representation of the stereo signal; and

a selector arrangement arranged upstream of the inverse transform stage, adapted to selectively connect this to either;

(a) a point downstream of the upmix stage, whereby the stereo signal obtained by complex prediction is supplied to the inverse transform stage;

or

(b) a point downstream of the switching assembly and upstream of the upmix stage, whereby a stereo signal obtained by direct stereo coding is supplied to the inverse transform stage.

12. An encoder system for encoding a stereo signal using complex prediction as a signal comprising downmix and residual channels and a complex prediction coefficient, wherein the downmix and residual channels are segmented into time frames, said system including:

an estimator for estimating a complex prediction coefficient;

a coding stage operable;

(a) to transform the stereo signal into a frequency-domain representation of a downmix and a residual signal, in a relationship determined by the value of the complex prediction coefficient; and

(b) to act as a pass-through stage, thereby supplying as output the stereo signal to be encoded,

the encoder system further comprising a switch for selecting, for each time segment, whether to encode the stereo signal in this time segment by at least one of the following options;

direct stereo coding,

joint stereo coding, and

complex-prediction stereo coding,

wherein, if direct stereo coding is selected, the coding stage is configured to transform the stereo signal into a frequency-domain representation of a left channel and a right channel, which are encoded as a bit stream;

and wherein, if joint stereo coding is selected, the coding stage is configured to transform the stereo signal into a frequency-domain representation of a downmix and side channel, which are encoded as a bit stream.

13. The encoder system of claim 12, wherein, in a time segment for which complex-prediction stereo coding is employed to encode the stereo signal:

the stereo signal comprises downmix and side channels;

the coding stage is adapted to receive a first frequency-domain representation of the stereo signal, the first frequency-domain representation comprising first spectral components representing spectral content of the corresponding channels expressed in a first subspace of a multidimensional space;

the coding stage further comprises;

a module for computing a second frequency-domain representation of said downmix channel based on the first frequency-domain representation thereof, the second frequency-domain representation comprising second spectral components representing spectral content of the downmix channel expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace; and

a weighted summer for computing a residual signal on the basis of the first and second frequency-domain representations of the downmix channel, the first frequency-domain representation of the side channel and the complex prediction coefficient; and

the estimator is adapted to receive the downmix and side channels and determine the complex prediction coefficient in order to minimize, over a time interval, the power of the residual signal or to minimize an average power of the residual signal.

14. The encoder system of claim 12, wherein:

the coding stage comprises;

a sum-and-difference stage for converting the stereo signal into a jointly coded stereo signal, comprising downmix and side channels;

a transform stage for providing an oversampled frequency-domain representation of the downmix channel and a critically sampled frequency-domain representation of the side channel, wherein the oversampled frequency-domain representation optionally comprises complex spectral components; and

a weighted summer for computing a residual signal on the basis of said oversampled frequency-domain representation of the downmix channel, said critically sampled frequency-domain representation of the side channel and the complex prediction coefficient;

and

the estimator receives the residual signal and determines the complex prediction coefficient in order to minimize the power of the residual signal or to minimize an average power of the residual signal,

wherein, optionally, the transform stage comprises a modified discrete cosine transform, MDCT, stage arranged in parallel with a modified discrete sine transform, MDST, stage for together providing said oversampled frequency-domain representation of the downmix channel.

15. A decoding method implemented in a decoder system for providing a stereo signal by complex prediction stereo coding, the method comprising the steps of:

receiving first frequency-domain representations of a downmix signal and a residual signal, each of the first frequency-domain representations comprising first spectral components representing spectral content of the corresponding signal expressed in a first subspace of a multidimensional space;

receiving a control signal; and

responsive to the value of said control signal;

(a) upmixing said downmix and residual signals, using an upmix stage, to obtain said stereo signal, by performing the sub-steps of;

computing a second frequency-domain representation of the downmix signal based on the first frequency-domain representation thereof, the second frequency-domain representation comprising second spectral components representing spectral content of the signal expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace;

computing a side signal on the basis of the first and second frequency-domain representations of the downmix signal, the first frequency-domain representation of the residual signal and a complex prediction coefficient encoded in a bit stream signal received by the decoder system; and

computing said stereo signal by applying a sum-and-difference transform to the first frequency-domain representation of the downmix signal and the side signal,

or

(b) suspending upmixing.

16. The decoding method of claim 15, wherein:

the first spectral components have real values expressed in the first subspace;

the second spectral components have imaginary values expressed in the second subspace;

optionally, the first spectral components are obtainable by one of the following;

a discrete cosine transform, DCT, or

a modified discrete cosine transform, MDCT,

and, optionally, the second spectral components are obtainable by one of the following;

a discrete sine transform, DST, or

a modified discrete sine transform, MDST.

17. The decoding method of claim 16, wherein:

the downmix signal is partitioned into successive time frames, each associated with a value of the complex prediction coefficient; and

said computing a second frequency-domain representation of the downmix signal is suspended responsive to the absolute value of the imaginary part of the complex prediction coefficient being smaller than a predetermined tolerance for a time frame, so that no output is generated for that time frame.

18. The decoding method of claim 17, wherein:

the downmix signal time frames are further partitioned into frequency bands, each accompanied by a value of the complex prediction coefficient; and

said computing a second frequency-domain representation of the downmix signal is suspended responsive to the absolute value of the imaginary part of the complex prediction coefficient being smaller than a predetermined tolerance for a frequency band of a time frame, so that no output is generated for that frequency band.

19. The decoding method of claim 16, wherein:

the first spectral components are transform coefficients arranged in one or more time frames of transform coefficients, each block generated by application of a transform to a time segment of a time-domain signal; and

said computing a second frequency-domain representation of the downmix signal comprises the sub-steps of;

deriving one or more first intermediate components from at least some of the first spectral components;

forming a combination of said one or more first spectral components according to at least a portion of one or more impulse responses to obtain one or more second intermediate components; and

deriving said one or more second spectral components from said one or more second intermediate components.

20. The decoding method of claim 19, wherein said computing a second-frequency-domain representation uses as input, to obtain each time frame of second spectral components, one of the following:

(a) a contemporaneous time frame of first spectral components;

(b) a contemporaneous and a preceding time frame of first spectral components; and

(c) a contemporaneous, a preceding and a subsequent time frame of first spectral components.

21. The decoding method of claim 15, wherein said computing a second frequency-domain representation of the downmix signal includes computing an approximate second spectral representation comprising approximate second spectral components determined by combination of at least two temporally adjacent and/or frequency-adjacent first spectral components.

22. The decoding method of claim 15, further comprising:

omitting, responsive to said bit stream signal being coded by direct stereo coding or joint stereo coding, said step of upmixing; and

inversely transforming said bit stream signal to obtain a time-domain representation of said stereo signal.

23. The decoding method of claim 22, further comprising the step of:

omitting, responsive to said bit stream signal being coded by direct stereo coding or joint stereo coding, said steps of transforming said time-domain representation of the downmix signal and of computing a side signal; and

inversely transforming the frequency-domain representations of each of the channels encoded by the bit stream signal to obtain a time-domain representation of said stereo signal.

29. A non-transitory storage medium having stored thereon a computer-program product comprising code for instructing a computer to perform the method of claim 15.

24. An encoding method for encoding a stereo signal by a bit stream signal by complex prediction stereo coding, the method comprising the steps of:

determining a complex prediction coefficient;

transforming the stereo signal into a first frequency-domain representation of a downmix channel and a residual channel, in a relationship determined by the complex prediction coefficient, the first frequency-domain representation comprising first spectral components representing spectral content of the corresponding signal expressed in a first subspace of a multidimensional space; and

encoding the downmix and residual channels and the complex prediction coefficient as said bit stream signal, the downmix and residual channels being segmented into time frames,

said method further comprising;

selecting, for each time segment, whether to encode the stereo signal in this time segment by at least one of the following options;

direct stereo coding,

joint stereo coding, and

complex-prediction stereo coding,

wherein, if direct stereo coding is selected, the stereo signal is transformed into a frequency-domain representation of a left channel and a right channel, which are encoded as said bit stream signal;

and wherein, if joint stereo coding is selected, the stereo signal is transformed into a frequency-domain representation of a downmix and side channel, which are encoded as said bit stream signal.

25. The encoding method of claim 24, wherein that option is selected which provides a highest quality according to a predefined psychoacoustic model.

26. The encoding method of claim 24,

wherein, in a time segment for which complex-prediction stereo coding is employed to encode the stereo signal:

the stereo signal comprises downmix and side channels; and

said step of transforming the stereo signal into a first frequency-domain representation of a downmix channel and a residual channel comprises the sub-steps of;

computing a second frequency-domain representation of the downmix channel based on the first frequency-domain representation thereof, the second frequency-domain representation comprising second spectral components representing spectral content of the downmix channel expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace; and

forming a residual signal on the basis of the first and second frequency-domain representations of the downmix channel, the first frequency-domain representation of the side channel and the complex prediction coefficient,

and

said step of determining a complex prediction coefficient is effected for one time frame at a time, by minimizing a power of average power of the residual signal in each time frame.

27. The encoding method of claim 24, further comprising the steps of:

converting the stereo signal into a jointly coded stereo signal comprising downmix and side channels;

transforming the downmix channel into an oversampled frequency-domain representation, preferably comprising complex spectral components;

transforming the side channel into a critically sampled, preferably real, frequency-domain representation; and

computing a residual signal on the basis of said oversampled frequency-domain representation of the downmix channel, said critically sampled frequency-domain representation of the side channel and the complex prediction coefficient, wherein said determination of the complex prediction coefficient is effected by feedback control with respect to the residual signal thus computed and in order to minimize power of the residual signal or an average power of the residual signal.

28. The encoding method of claim 27, wherein:

said transformation of the downmix channel into an oversampled frequency-domain representation is effected by applying a MDCT and a MDST and concatenating outputs from these.

30. A non-transitory storage medium having stored thereon a computer-program product comprising code for instructing a computer to perform the method of claim 24.