Adding second enhancement layer to CELP based core layer

• US 8,515,742 B2
• Filed: 09/15/2009
• Issued: 08/20/2013
• Est. Priority Date: 09/15/2008
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Gao, Yang
• Primary Examiner(s): JACKSON, JAKIEDA R
• Application Number:
  US12/559,562
• Publication Number:
  US 20100070269A1
• Time in Patent Office: 1,435 Days
• Field of Search: 704/207
• US Class Current: 704/207
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Abstract

In an embodiment, a method of transmitting an input audio signal is disclosed. A first coding error of the input audio signal with a scalable codec having a first enhancement layer is encoded, and a second coding error is encoded using a second enhancement layer after the first enhancement layer. Encoding the second coding error includes coding fine spectrum coefficients of the second coding error to produce coded fine spectrum coefficients, and coding a spectral envelope of the second coding error to produce a coded spectral envelope. The coded fine spectrum coefficients and the coded spectral envelope are transmitted.

Claims

1. A method of transmitting an input audio signal, the method comprising:

encoding a first coding error of the input audio signal with a scalable codec having a first enhancement layer;

encoding a second coding error by using a second enhancement layer after the first enhancement layer, encoding the second coding error comprising coding fine spectrum coefficients of the second coding error to produce coded fine spectrum coefficients, and coding a spectral envelope of the second coding error to produce a coded spectral envelope;

transmitting the coded fine spectrum coefficients and the coded spectral envelope;

wherein;

the first coding error and the second coding error are in a same band;

the first coding error represents a distortion of an output of an inner core layer codec; and

the first coding error is a weighted difference between an original reference input and a decoded output of the inner core layer codec; and

the second coding error is a weighted difference between a quantized output of the first enhancement layer and unquantized coefficients of the first coding error.

2. The method of claim 1, wherein the scalable codec comprises an inner core layer of code-excited linear prediction (CELP) codec.

3. The method of claim 2, wherein:

the first coding error represents a distortion of an output of the CELP codec; and

the first coding error is a weighted difference between an original reference input and a decoded output of the CELP codec.

4. The method of claim 1, wherein:

the first enhancement layer comprises a first modified discrete cosine transform (MDCT) enhancement layer; and

the second enhancement layer comprises a second MDCT enhancement layer.

5. The method of claim 4, further comprising compensating missing subbands of the first MDCT enhancement layer at high scalable layers before encoding the second coding error using the second MDCT enhancement layer.

6. The method of claim 4, wherein

the second coding error is determined by a frequency domain expression:

DD_LB^w(k)=D_LB^w(k)−

{circumflex over (D)}_LB^w(k);

{circumflex over (D)}_LB^w(k) comprises a quantized output of the first MDCT enhancement layer in a weighted domain; and

D_LB^w(k) comprises unquantized MDCT coefficients of the first coding error.

7. The method of claim 1, wherein coding the spectral envelope of the second coding error comprises coding subband energies of a second coding error spectrum in a log domain, a linear domain or a weighted domain.

8. The method of claim 1, wherein coding fine spectrum coefficients of the second coding error comprises:

performing additional spectral vector quantization (VQ) coding of the second coding error after normalizing spectral energy based on the coded spectral envelope of the second coding error.

9. The method of claim 1, further comprising:

receiving the coded fine spectrum coefficients and the coded spectral envelope of the second enhancement layer at a decoder; and

forming an output audio signal based on the coded fine spectrum coefficients and the coded spectral envelope.

10. The method of claim 9, further comprising driving a loudspeaker with the output audio signal.

11. The method of claim 1, wherein transmitting comprises transmitting over a voice over internet protocol (VOIP) network.

12. The method of claim 1, wherein transmitting comprises transmitting over a cellular telephone network.

13. A method of transmitting an input audio signal, the method comprising:

encoding a first coding error of the input audio signal with a scalable codec having a first modified discrete cosine transform (MDCT) enhancement layer;

determining if a second MDCT enhancement layer is needed; and

if the second MDCT enhancement layer is needed based on the determining, encoding a second coding error by using the second MDCT enhancement layer after the first MDCT enhancement layer, wherein

the first coding error and the second coding error are in a same band,

the first coding error represents a distortion of an output of an inner core layer codec,

the first coding error is a weighted difference between an original reference input and a decoded output of the inner core layer codec,

the second coding error is a weighted difference between a quantized output of the first MDCT enhancement layer and an unquantized coefficients of the first coding error, and

the determining is based on at least one of the following parameters includes relative coding error energy, relative weighted coding error energy, coding error energy relative to other bands, and weighted coding error energy relative to other bands, a pitch gain, a pitch correlation, a voicing ratio representing signal periodicity, a spectral sharpness measuring based on a ratio between an average energy level and a maximum energy level, a spectral tilt measurement in a time domain or a frequency domain, and/or a spectral envelope stability measurement on a relative spectrum energy differences over time.

14. The method of claim 13, wherein determining if the second MDCT enhancement layer is needed comprises analyzing relative energies in different spectral subbands of the first coding error in a log domain, a linear domain or a perceptual domain.

15. The method of claim 13, wherein determining if the second MDCT enhancement layer is needed comprises analyzing relative energies in different spectral subbands of the second coding error in a log domain, a linear domain or a perceptual domain.

16. The method of claim 13, wherein:

the scalable codec comprises an inner core layer of code-excited linear prediction (CELP) codec; and

determining if the second MDCT enhancement layer is needed comprises checking if a transmitted pitch lag is different from a real pitch lag while the real pitch lag is out of range limitations defined in the CELP codec.

17. The method of claim 13, wherein the spectral envelope stability measurement is expressed as:

18. A system for transmitting an input audio signal, the system comprising:

a transmitter comprising an audio coder, the audio coder comprising

a code-excited linear prediction (CELP) codec,

a first modified discrete cosine transform (MDCT) enhancement layer configured to encode a first coding error, and

a second MDCT enhancement layer configured to encode a second coding error,

encode fine spectrum coefficients of the second coding error, and

encode a spectral envelope of the second coding error;

wherein;

the first coding error and the second coding error are in a same band;

the first coding error represents a distortion of an output of an inner core layer codec; and

the first coding error is a weighted difference between an original reference input and a decoded output of the inner core layer codec; and

the second coding error is a weighted difference between a quantized output of the first MDCT enhancement layer and an unquantized coefficients of the first coding error.

19. The system of claim 18, wherein the audio coder is configured to determine if the second MDCT enhancement layer is needed based on analyzing the input audio signal.

20. The system of claim 18, wherein the system is configured to operate over a voice over internet protocol (VOIP) system.

21. The system of claim 18, wherein the system is configured to operate over a cellular telephone network.