Enhanced joint stereo coding method using temporal envelope shaping

• US 5,812,971 A
• Filed: 03/22/1996
• Issued: 09/22/1998
• Est. Priority Date: 03/22/1996
• Status: Expired due to Term

• Current Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Herre, Juergen Heinrich
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): EDOUARD, PATRICK NESTOR
• Application Number:
  US08/621,762
• Time in Patent Office: 914 Days
• Field of Search: 395/2.2, 395/2.21, 395/2.14, 395/2.18, 395/2.28, 395/2.29, 395/2.38, 395/2.39, 381/1-2
• US Class Current: 704/230
• CPC Class Codes: G10L 25/12 the extracted parameters being prediction coefficients
• CPC Class Codes: H04B 1/665 using psychoacoustic properties of the ear, e.g. masking effect
• CPC Class Codes: H04H 20/88 Stereophonic broadcast systems multiplex system in general H04J

Abstract

A method and apparatus for performing joint stereo coding of multi-channel audio signals using intensity stereo coding techniques. In particular, predictive filtering techniques are applied to the spectral coefficient data, thereby preserving the time structure of the output signal of each channel, while maintaining the benefit of the high bit rate savings offered by intensity stereo coding. In one illustrative embodiment of the invention, the input signal is decomposed into spectral coefficients by a high-resolution filterbank/transform; the time-dependent masking threshold of the signal is estimated using a perceptual model; a filter performing linear prediction in frequency is applied at the filterbank outputs for each channel; intensity stereo coding techniques are applied for coding both residual signals into one carrier signal; the spectral values of the carrier signal are quantized and coded according to the precision corresponding to the masking threshold estimate; and all relevant information (i.e., the coded spectral values, intensity scaling data and prediction filter data for each channel, as well as the additional side information) is packed into a bitstream and transmitted to the decoder.

Claims

1. A method of performing joint stereo coding of a multi-channel audio signal to generate an encoded signal, the method comprising the steps of:

(a) performing a spectral decomposition of a first audio channel signal into a plurality of first spectral component signals;

(b) generating a first prediction signal representative of a prediction of one of said first spectral component signals, said prediction based on one or more other ones of said first spectral component signals;

(c) comparing the first prediction signal with said one of said first spectral component signals to generate a first prediction error signal;

(d) performing a spectral decomposition of a second audio channel signal into a plurality of second spectral component signals;

(e) performing joint stereo coding of said one of said first spectral component signals and one of said second spectral component signals to generate a jointly coded spectral component signal, said coding based on the first prediction error signal; and

(f) generating the encoded signal based on the jointly coded spectral component signal.

2. The method of claim 1 further comprising the steps of:

(g) generating a second prediction signal representative of a prediction of said one of said second spectral component signals, said prediction based on one or more other ones of said second spectral component signals; and

(h) comparing the second prediction signal with said one of said second spectral component signals to generate a second prediction error signal;

and wherein the step of performing joint stereo coding of said one of said first spectral component signals and said one of said second spectral component signals is further based on said second prediction error signal.

3. The method of claim 1 wherein the step of performing joint stereo coding of said one of said first spectral component signals and said one of said second spectral component signals comprises performing intensity stereo coding of said one of said first spectral component signals and said one of said second spectral component signals.

4. The method of claim 1 wherein the step of generating the encoded signal based on the jointly coded spectral component signal comprises quantizing the jointly coded spectral component signal.

5. The method of claim 4 wherein said quantization of the jointly coded spectral component signal is based on a perceptual model.

6. A method of decoding an encoded signal to generate a reconstructed multi-channel audio signal, the encoded signal comprising a joint stereo coding of an original multi-channel audio signal, the method comprising the steps of:

(a) performing joint stereo decoding of the encoded signal to generate a plurality of decoded channel signals, each decoded channel signal comprising a plurality of decoded spectral component prediction error signals;

(b) generating a first spectral component signal based on one or more of said spectral component prediction error signals comprised in a first one of said decoded channel signals;

(c) generating a first prediction signal representative of a prediction of a second spectral component signal, said prediction based on said first spectral component signal;

(d) generating the second spectral component signal based on the first prediction signal and on one or more of said spectral component prediction error signals comprised in the first one of said decoded channel signals; and

(e) generating a first channel of the reconstructed multi-channel audio signal based on the first and second spectral component signals.

7. The method of claim 6 further comprising the steps of:

(f) generating a third spectral component signal based on one or more of said spectral component prediction error signals comprised in a second one of said decoded channel signals;

(g) generating a second prediction signal representative of a prediction of a fourth spectral component signal, said prediction based on said third spectral component signal;

(h) generating the fourth spectral component signal based on the second prediction signal and on one or more of said spectral component prediction error signals comprised in the second one of said decoded channel signals; and

(i) generating a second channel of the reconstructed multi-channel audio signal based on the third and fourth spectral component signals.

8. The method of claim 6 wherein the step of performing joint stereo decoding of the encoded signal comprises performing intensity stereo decoding of the encoded signal.

9. An encoder for performing joint stereo coding of a multi-channel audio signal to generate an encoded signal, the encoder comprising:

(a) a first filterbank which performs a spectral decomposition of a first audio channel signal into a plurality of first spectral component signals;

(b) a first prediction filter which generates a first prediction signal representative of a prediction of one of said first spectral component signals, said prediction filter responsive to one or more other ones of said first spectral component signals;

(c) a first comparator which compares the first prediction signal with said one of said first spectral component signals to generate a first prediction error signal;

(d) a second filterbank which performs a spectral decomposition of a second audio channel signal into a plurality of second spectral component signals;

(e) a joint stereo coder which performs joint stereo coding of said one of said first spectral component signals and one of said second spectral component signals to generate a jointly coded spectral component signal, said coding based on the first prediction error signal; and

(f) a coder which generates the encoded signal based on the jointly coded spectral component signal.

10. The encoder of claim 9 further comprising:

(g) a second prediction filter which generates a second prediction signal representative of a prediction of said one of said second spectral component signals, said prediction based on one or more other ones of said second spectral component signals; and

(h) a second comparator which compares the second prediction signal with said one of said second spectral component signals to generate a second prediction error signal;

and wherein the joint stereo coder performs joint stereo coding further based on said second prediction error signal.

11. The encoder of claim 9 wherein the joint stereo coder comprises an intensity stereo coder which performs intensity stereo coding of said one of said first spectral component signals and said one of said second spectral component signals.

12. The encoder of claim 9 wherein the coder which generates the encoded signal based on the jointly coded spectral component signal comprises a quantizer which quantizes the jointly coded spectral component signal.

13. The encoder of claim 12 wherein the quantizer is based on a perceptual model.

14. A decoder for decoding an encoded signal to generate a reconstructed multi-channel audio signal, the encoded signal comprising a joint stereo coding of an original multi-channel audio signal, the method comprising:

(a) a joint stereo decoder which performs joint stereo decoding of the encoded signal to generate a plurality of decoded channel signals, each decoded channel signal comprising a plurality of decoded spectral component prediction error signals;

(b) means for generating a first spectral component signal based on one or more of said spectral component prediction error signals comprised in a first one of said decoded channel signals;

(c) a first prediction filter which generates a first prediction signal representative of a prediction of a second spectral component signal, said prediction based on said first spectral component signal;

(d) means for generating the second spectral component signal based on the first prediction signal and on one or more of said spectral component prediction error signals comprised in the first one of said decoded channel signals; and

(e) a first filterbank which generates a first channel of the reconstructed multi-channel audio signal based on the first and second spectral component signals.

15. The decoder of claim 14 further comprising:

(f) means for generating a third spectral component signal based on one or more of said spectral component prediction error signals comprised in a second one of said decoded channel signals;

(g) a second prediction filter which generates a second prediction signal representative of a prediction of a fourth spectral component signal, said prediction based on said third spectral component signal;

(h) means for generating the fourth spectral component signal based on the second prediction signal and on one or more of said spectral component prediction error signals comprised in the second one of said decoded channel signals; and

(i) a second filterbank which generates a second channel of the reconstructed multi-channel audio signal based on the third and fourth spectral component signals.

16. The decoder of claim 14 wherein the joint stereo decoder comprises an intensity stereo decoder which performs intensity stereo decoding of the encoded signal.

17. A storage medium having an encoded signal recording thereon, the encoded signal having been generated from a multi-channel audio signal by an encoding method comprising the steps of:

(a) performing a spectral decomposition of a first audio channel signal into a plurality of first spectral component signals;

(b) generating a first prediction signal representative of a prediction of one of said first spectral component signals, said prediction based on one or more other ones of said first spectral component signals;

(c) comparing the first prediction signal with said one of said first spectral component signals to generate a first prediction error signal;

(d) performing a spectral decomposition of a second audio channel signal into a plurality of second spectral component signals;

(e) performing joint stereo coding of said one of said first spectral component signals and one of said second spectral component signals to generate a jointly coded spectral component signal, said coding based on the first prediction error signal; and

(f) generating the encoded signal based on the jointly coded spectral component signal.

18. The storage medium of claim 17 wherein the encoding method which generated the encoded signal stored thereon further comprises the steps of:

(g) generating a second prediction signal representative of a prediction of said one of said second spectral component signals, said prediction based on one or more other ones of said second spectral component signals; and

(h) comparing the second prediction signal with said one of said second spectral component signals to generate a second prediction error signal;

and wherein the step of performing joint stereo coding of said one of said first spectral component signals and said one of said second spectral component signals comprised in said encoding method is further based on said second prediction error signal.

19. The storage medium of claim 17 wherein the step of performing joint stereo coding of said one of said first spectral component signals and said one of said second spectral component signals comprised in said encoding method comprises performing intensity stereo coding of said one of said first spectral component signals and said one of said second spectral component signals.

20. The storage medium of claim 17 wherein the step of generating the encoded signal based on the jointly coded spectral component signal comprised in said encoding method comprises quantizing the jointly coded spectral component signal.

21. The storage medium of claim 20 wherein said quantization of the jointly coded spectral component signal comprised in said encoding method is based on a perceptual model.

22. The storage medium of claim 17 wherein the storage medium comprises a compact disc.

23. The storage medium of claim 17 wherein the storage medium comprises a digital audio tape.

24. The storage medium of claim 17 wherein the storage medium comprises a semiconductor memory.