Spectrum flatness control for bandwidth extension

• US 10,339,938 B2
• Filed: 05/22/2015
• Issued: 07/02/2019
• Est. Priority Date: 07/19/2010
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Gao, Yang
• Primary Examiner(s): Baker, Matthew H
• Application Number:
  US14/719,693
• Publication Number:
  US 20150255073A1
• Time in Patent Office: 1,502 Days
• CPC Class Codes: G10L 19/002 Dynamic bit allocation for perceptual audio coders G10L19/032
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G10L 21/038 using band spreading techniques
• CPC Class Codes: G10L 21/0388 Details of processing therefor
• CPC Class Codes: G10L 25/18 the extracted parameters being spectral information of each sub-band

Abstract

In accordance with an embodiment, a method of decoding an encoded audio bitstream at a decoder includes receiving the audio bitstream, decoding a low band bitstream of the audio bitstream to get low band coefficients in a frequency domain, and copying a plurality of the low band coefficients to a high frequency band location to generate high band coefficients. The method further includes processing the high band coefficients to form processed high band coefficients. Processing includes modifying an energy envelope of the high band coefficients by multiplying modification gains to flatten or smooth the high band coefficients, and applying a received spectral envelope decoded from the received audio bitstream to the high band coefficients. The low band coefficients and the processed high band coefficients are then inverse-transformed to the time domain to obtain a time domain output signal.

Claims

1. A method of decoding an encoded audio bitstream at a decoder, the method comprising:

receiving, by a processor in the decoder, the audio bitstream from the network, the audio bitstream comprising a low band bitstream;

decoding, by the processor in the decoder, the low band bitstream to get low band coefficients in a frequency domain;

copying, by the processor in the decoder, a plurality of the low band coefficients to a high frequency band location to generate high band coefficients;

evaluating, by the processor in the decoder, modification gains through following equation;

Gain(k)=(C0+C1·

√

{square root over (Mean_HB/F_energy_dec[k])}), k=Start_HB, . . . ,End_HB−

1,

wherein {Gain(k), k=Start_HB, . . . , End_HB−

1} are the modification gains, F_energy_dec[k] is an energy distribution at each frequency location index k of a copied high band, Start_HB and End_HB define a high band range, C0 and C1 satisfying C0+C1=1 are pre-determined constants, and Mean_HB is a mean energy value obtained by averaging energies of the high band coefficients;

modifying, by the processor in the decoder, an energy envelope of the high band coefficients to flatten and smooth the high band coefficients by multiplying modification gains with the high band coefficients in the frequency domain to form processed high band coefficients, wherein the processed high band coefficients have an energy closer to the mean energy value;

applying, by the processor in the decoder, a received spectral envelope to the high band coefficients, the received spectral envelope being decoded from the received audio bitstream; and

inverse-transforming, by the processor in the decoder, the low band coefficients and the processed high band coefficients to a time domain to obtain a time domain audio output signal.

2. The method of claim 1, wherein:

the received bitstream comprises a high-band side bitstream; and

the method further comprises decoding the high-band side bitstream to get side information, and using Spectral Band Replication (SBR) techniques to generate the high band with the side information.

3. The method of claim 1, wherein the modification gains are switchable or variable according to a spectrum flatness classification received by the decoder from an encoder.

4. The method of claim 3, further comprising determining the spectrum flatness classification is based on a plurality of spectrum sharpness parameters, each of the plurality of spectrum sharpness parameter being defined by dividing a mean energy by a maximum energy on a sub-band of an original high frequency band.

5. The method of claim 3, wherein the classification is based on a speech/music decision.

6. The method of claim 1, wherein decoding the low band bitstream comprises:

decoding the low band bitstream to get a low band signal; and

transforming the low band signal into the frequency domain to obtain the low band coefficients.

7. The method of claim 1, wherein modifying the energy envelope comprises flattening or smoothing the energy envelope.

8. A post-processing method of generating a decoded speech/audio signal at a decoder and improving spectrum flatness of a generated high frequency band, the method comprising:

generating, by a processor in the decoder, high band coefficients from low band coefficients in a frequency domain using a BandWidth Extension (BWE) high band coefficient generation method;

flattening and smoothing, by the processor in the decoder, an energy envelope of the high band coefficients in the frequency domain by multiplying flattening and smoothing gains to the high band coefficients, wherein the flattening and smoothing gains are used to generate an energy of modified high band coefficients being closer to a mean energy value obtained by averaging energies of the high band coefficients, and wherein each of the flattening and smoothing gains is individually calculated by the processor in the decoder based on the mean energy value and a value of a corresponding one of the high band coefficients;

shaping and determining, by the processor in the decoder, the energies of the high band coefficients by using a BWE shaping and determining method; and

inverse-transforming, by the processor in the decoder, the low band coefficients and the high band coefficients to a time domain to obtain a time domain output speech/audio signal.

9. The method of claim 8, further comprising evaluating the flattening and smoothing gains by analyzing, examining, using and flattening and smoothing the high band coefficients or the low band coefficients to be copied to a high band location.

10. The method of claim 9, wherein the flattening and smoothing gains are switchable or variable according to a spectrum flatness classification transmitted from an encoder to the decoder.

11. The method of claim 10, wherein the classification is based on a speech/music decision.

12. The method of claim 8, wherein:

the BWE high band coefficient generation method comprises a Spectral Band Replication (SBR) high band coefficient generation method; and

the BWE shaping and determining method comprises a SBR shaping and determining method.

13. A system for receiving an encoded audio signal, comprising:

a memory storage comprising instructions; and

one or more processors in communication with the memory, wherein the one or more processors execute the instructions to;

transform a low band portion of the encoded audio signal into frequency domain low band coefficients at an output of a low-band block;

generate high band coefficients by copying a plurality of the low band coefficients to a high frequency band location;

evaluate modification gains through following equation;

Gain(k)=(C0+C1·

√

{square root over (Mean_HB/F_energy_dec[k])}), k=Start_HB, . . . ,End_HB−

1,

wherein {Gain(k), k=Start_HB, . . . , End_HB−

1} are the modification gains, F_energy_dec[k] is an energy distribution at each frequency location index k of a copied high band, Start_HB and End_HB define a high band range, C0 and C1 satisfying C0+C1=1 are pre-determined constants, and Mean_HB is a mean energy value obtained by averaging energies of the high band coefficients;

generate shaped high band coefficients by multiplying the modification gains with the high band coefficients in the frequency domain to form processed high band coefficients, wherein the processed high band coefficients have an energy closer to the mean energy value, and apply a received spectral envelope to the high band coefficients, the received spectral envelope being decoded from the encoded audio signal; and

produce a time domain audio output signal.

14. The system of claim 13, wherein the one or more processors further execute the instructions to produce the received spectral envelope from a high band side bitstream of the encoded audio signal.

15. The system of claim 13, wherein the one or more processors further execute the instructions to:

decode a low band bitstream of the encoded audio signal into a decoded low band signal; and

produce the frequency domain low band coefficients from the decoded low band signal.

16. The system of claim 13, wherein the one or more processors further execute the instructions to

evaluate the modification gains by analyzing, examining, using and modifying the high band coefficients or the low band coefficients to be copied to a high band location.