Audio coding method and apparatus

• US 10,553,227 B2
• Filed: 10/23/2018
• Issued: 02/04/2020
• Est. Priority Date: 03/14/2014
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Norvell, Erik, Grancharov, Volodya
• Primary Examiner(s): Zhu, Richard Z
• Application Number:
  US16/167,831
• Publication Number:
  US 20190057707A1
• Time in Patent Office: 469 Days
• Field of Search: None
• CPC Class Codes: G10L 19/002 Dynamic bit allocation for perceptual audio coders G10L19/032
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/028 Noise substitution, i.e. substituting non-tonal spectral components by noisy source comfort noise for discontinuous speech transmission G10L19/012
• CPC Class Codes: G10L 19/038 Vector quantisation, e.g. TwinVQ audio
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 25/06 the extracted parameters being correlation coefficients
• CPC Class Codes: G10L 25/21 the extracted parameters being power information
• CPC Class Codes: G10L 25/51 for comparison or discrimination

Abstract

An audio signal, having first and second regions of frequency spectrum, is coded. Spectral peaks in the first region are encoded by a first coding method. For a segment of the audio signal, a relation between energy of bands in the first and second regions is determined. A relation between the energy of the band in the second region and energy of neighboring bands in the second region is determined. A determination is made whether available bits are sufficient for encoding at least one non-peak segment of the first region and the band in the second region. Responsive to first and second relations fulfilling a respective predetermined criterion and a sufficient number of bits, encoding the band in the second region using a second coding method different from the first coding method, and otherwise, subjecting the band in the second region to BandWidth Extension (BWE) or noise fill.

Claims

1. A method for encoding an audio signal, wherein a frequency spectrum of the audio signal is divided into at least a first and a second region, wherein at least the second region comprises a number of bands, the method comprising:

encoding spectral peak segments in the first region using a first coding method;

encoding at least one non-peak segment in the first region using a second coding method different from the first coding method;

determining a first relation between an energy of a band in the second region and energies of the spectral peaks in the first region;

determining a second relation between the energy of the band in the second region and an average energy of the second region;

responsive to encoding the spectral peak segments and the at least one non-peak segment in the first region, determining an available number of bits out of a bit budget for encoding the audio signal is sufficient for encoding the band in the second region;

responsive to determining the first and second relations fulfil a predetermined criterion and determining the number of bits out of the bit budget for encoding the audio signal is sufficient, encoding the band in the second region using the second coding method.

2. The method according to claim 1, wherein the first coding method is a peak based coding method.

3. The method according to claim 1, wherein the determining the available number of bits is sufficient comprises reserving a sufficient number of bits for encoding a defined most relevant region.

4. The method according to claim 1, wherein the determining the number of bits is sufficient comprises determining the number of bits is sufficient for encoding the band in the second region based on a minimum number of bits required to encode at least one coefficient of the band in the second region.

5. The method according to claim 4, wherein encoding the second region comprises encoding the at least one coefficient of the band in the second region within the number of bits that are available.

6. The method according to claim 1, wherein the first region is a lower part of the frequency spectrum than the second region.

7. The method according to claim 1, wherein the second coding method comprises vector quantization or pyramid vector quantization.

8. The method according to claim 1, wherein encoding the band in the second region using a second coding method comprises gain shape coding the band in the second region.

9. The method according to claim 1, wherein encoding the at least one non-peak segment in the first region using the second coding method comprises gain shape coding the at least one non-peak segment of the first region.

10. The method according to claim 1, wherein the first coding method is a peak-based coding method comprising encoding of a peak position, an amplitude and sign of the peak position, and a shape vector representing neighbouring Modified Discrete Cosine Transform (MDCT) bins.

11. The method of claim 1, wherein the first coding method is not used to encode the band in the second region.

12. The method of claim 1, the method further comprising:

determining the first relation fulfils the predetermined criterion based on a comparison of the first relation to a first threshold; and

determining the second relation fulfils the predetermined criterion based on a comparison of the second relation to a second threshold.

13. The method of claim 12, wherein the first threshold defines a first threshold difference of the energy of the band in the second region and the energies of the spectral peaks in the first region;

and

wherein the second threshold defines a second threshold difference of the energy of the band in the second region to the average energy of the second region.

14. The method of claim 1, further comprising:

responsive to determining the first and second relations do not fulfil the predetermined criterion or determining the available number of bits is not sufficient for encoding the band in the second region, transmitting parameters toward a decoding apparatus to subject the band in the second region to BandWidth Extension (BWE) or noise fill during decoding.

15. The method of claim 14, wherein the parameters comprise at least one of a gain and an envelope energy of the band in second region.

16. The method of claim 1, further comprising:

responsive to encoding the band in the second region, encoding one of an energy envelope or gain of the second region to represent the non-coded bands of the second region.

17. An apparatus for encoding an audio signal, wherein a frequency spectrum of the audio signal is divided into at least a first and a second region, wherein at least the second region comprises a number of bands, and the apparatus being further configured to perform operations comprising:

encoding spectral peak segments in the first region using a first coding method;

encoding at least one non-peak segment in the first region using a second coding method different from the first coding method;

determining a first relation between an energy of a band in the second region and energies of the spectral peaks in the first region;

determining a second relation between the energy of the band in the second region and an average energy of the second region;

responsive to encoding the spectral peak segments and the at least one non-peak segment in the first region, determining an available number of bits out of a bit budget for encoding the audio signal is sufficient for encoding the band in the second region;

responsive to determining the first and second relations fulfil a predetermined criterion and determining the number of bits out of the bit budget for encoding the audio signal is sufficient, encoding the band in the second region using the second coding method.

18. The apparatus according to claim 17, wherein the first coding method is a peak based coding method.

19. The apparatus according to claim 17, wherein the determining the available number of bits is sufficient comprises reserving a sufficient number of bits for encoding a defined most relevant region.

20. The apparatus according to claim 17, wherein the determining the number of bits is sufficient comprises determining the number of bits is sufficient for encoding the band in the second region based on a minimum number of bits required to encode at least one coefficient of the band in the second region.

21. The apparatus according to claim 20, wherein encoding the second region comprises encoding the at least one coefficient of the band in the second region within the number of bits that are available.

22. The apparatus according to claim 17, wherein the first region is a lower part of the frequency spectrum than the second region.

23. The apparatus according to claim 17, wherein the first coding method is a peak-based coding method comprising encoding of a peak position, an amplitude and sign of the peak position, and a shape vector representing neighbouring Modified Discrete Cosine Transform (MDCT) bins.

24. The apparatus according to claim 17, wherein the second coding method comprises vector quantization or pyramid vector quantization.

25. The apparatus according to claim 17, wherein encoding the band in the second region using a second coding method comprises gain shape coding the band in the second region.

26. The apparatus according to claim 17, wherein encoding the at least one non-peak segment in the first region using the second coding method comprises gain shape coding the at least one non-peak segment of the first region.

27. The apparatus according to claim 17, wherein the apparatus is configured to operate as an encoder to encode the audio signal.

28. The apparatus according to claim 17, wherein the apparatus is configured to operate as an audio codec for the audio signal.

29. The apparatus according to claim 17, wherein the apparatus is configured to operate as a communication device.

30. The apparatus of claim 17, wherein the apparatus is further configured to perform operations comprising:

determining the first relation fulfils the predetermined criterion based on a comparison of the first relation to a first threshold; and

determining the second relation fulfils the predetermined criterion based on a comparison of the second relation to a second threshold.

31. The apparatus of claim 30, wherein the first threshold defines a first threshold difference of the energy of the band in the second region and the energies of the spectral peaks in the first region;

and

wherein the second threshold defines a second threshold difference of the energy of the band in the second region to the average energy of the second region.

32. The apparatus of claim 17, wherein the apparatus is further configured to perform operations comprising:

responsive to determining the first and second relations do not fulfil the predetermined criterion or determining the available number of bits is not sufficient for encoding the band in the second region, transmitting parameters toward a decoding apparatus to subject the band in the second region to BandWidth Extension (BWE) or noise fill during decoding.

33. The apparatus of claim 32, wherein the parameters comprise at least one of a gain and an envelope energy of the band in second region.

34. A computer program product comprising a non-transitory computer readable storage medium storing instructions which, when executed by at least one processor of an apparatus, causes the processor to perform operations comprising:

encoding spectral peak segments in the first region using a first coding method;

encoding at least one non-peak segment in the first region using a second coding method different from the first coding method;

determining a first relation between an energy of a band in the second region and energies of the spectral peaks in the first region;

determining a second relation between the energy of the band in the second region and an average energy of the second region;

responsive to encoding the spectral peak segments and the at least one non-peak segment in the first region, determining an available number of bits out of a bit budget for encoding the audio signal is sufficient for encoding the band in the second region;

responsive to determining the first and second relations fulfil a predetermined criterion and determining the number of bits out of the bit budget for encoding the audio signal is sufficient, encoding the band in the second region using the second coding method.