GENERATION OF A COMFORT NOISE WITH HIGH SPECTRO-TEMPORAL RESOLUTION IN DISCONTINUOUS TRANSMISSION OF AUDIO SIGNALS

• US 20150287415A1
• Filed: 06/19/2015
• Published: 10/08/2015
• Est. Priority Date: 12/21/2012
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: LOMBARD, Anthony, DIETZ, Martin, WILDE, Stephan, RAVELLI, Emmanuel, MULTRUS, Markus, SETIAWAN, Panji
• Granted Patent: US 9,583,114 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 19/002 Dynamic bit allocation for perceptual audio coders G10L19/032
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Abstract

The invention provides an audio decoder being configured for decoding a bitstream so as to produce therefrom an audio output signal, the bitstream including at least an active phase followed by at least an inactive phase, wherein the bitstream has encoded therein at least a silence insertion descriptor frame which describes a spectrum of a background noise, the audio decoder including: a silence insertion descriptor decoder configured to decode the silence insertion descriptor frame; a decoding device configured to reconstruct the audio output signal from the bitstream during the active phase; a spectral converter configured to determine a spectrum of the audio output signal; a noise estimator device configured to determine a first spectrum of the noise of the audio output signal; a resolution converter configured to establish a second spectrum of the noise of the audio output signal; a comfort noise spectrum estimation device; and a comfort noise generator.

Claims

1. Audio decoder for decoding a bitstream so as to produce therefrom an audio output signal, the bitstream comprising at least an active phase followed by at least an inactive phase, wherein the bitstream has encoded therein at least a silence insertion descriptor frame which describes a spectrum of a background noise, the audio decoder comprising:

a silence insertion descriptor decoder configured to decode the silence insertion descriptor frame so as to reconstruct the spectrum of the background noise;

a decoding device configured to reconstruct the audio output signal from the bitstream during the active phase;

a spectral converter configured to determine a spectrum of the audio output signal;

a noise estimator device configured to determine a first spectrum of the noise of the audio output signal based on the spectrum of the audio output signal provided by the spectral converter, wherein the first spectrum of the noise of the audio output signal comprises a higher spectral resolution than the spectrum of the background noise;

a resolution converter configured to establish a second spectrum of the noise of the audio output signal based on the first spectrum of the noise of the audio output signal, wherein the second spectrum of the noise of the audio output signal comprises a same spectral resolution as the spectrum of the background noise;

a comfort noise spectrum estimation device comprising a scaling factor computing device configured to compute scaling factors for a spectrum for a comfort noise based on the spectrum of the background noise as provided by the silence insertion descriptor decoder and based on the second spectrum of the noise of the audio output signal as provided by the resolution converter and comprising a comfort noise spectrum generator configured to compute the spectrum for a comfort noise based on the scaling factors; and

a comfort noise generator configured to produce the comfort noise during the inactive phase based on the spectrum for the comfort noise.

2. Audio decoder according to claim 1, wherein the spectral analyzer comprises a fast Fourier transformation device.

3. Audio decoder according to claim 1, wherein the noise estimator device comprises a converter device configured to convert the spectrum of the audio output signal into a converted spectrum of the audio output signal which comprises same or lower spectral resolution than the spectrum of the output audio signal and a higher spectral resolution than the spectrum of the background noise.

4. Audio decoder according to claim 3, wherein the noise estimator device comprises a noise estimator configured to determine the first spectrum of the noise of the audio output signal based on the converted spectrum of the audio output signal provided by the converter device.

5. Audio decoder according to claim 1, wherein the scaling factor computing device is configured to compute the scaling factors according to the formula

6. Audio decoder according to claim 1, wherein the comfort noise spectrum generator is configured to compute the spectrum of the comfort noise based on the scaling factors and based on the first spectrum of the noise of the audio output signal as provided by the noise estimation device.

7. Audio decoder according to claim 1, wherein the comfort noise spectrum generator is configured to compute the spectrum of the comfort noise according to the formula {circumflex over (N)}^FR(k)=Ŝ

^LR(i). {circumflex over (N)}_dec^HR(k), wherein {circumflex over (N)}^FR(k) denotes a level of a frequency band k of the spectrum of the comfort noise, wherein Ŝ

^LR(i) denotes a scaling factor of a frequency band group i of the spectrum of the background noise and of the second spectrum of the noise of the audio output signal, wherein {circumflex over (N)}_dec^LR(k) denotes a level of a frequency band k of the first spectrum of the noise of the audio output signal, wherein k=b^LR(i), . . . , b^LR(i+1)−

1, wherein b^LR(i) is a first frequency band of one of the frequency band groups, wherein i=0, . . . , L^LR−

1, wherein L^LR is the number of frequency band groups of the spectrum of the background noise and of the second spectrum of the noise of the audio output signal.

8. Audio decoder according to claim 1, wherein the resolution converter comprises a first converter stage configured to establish a third spectrum of the noise of the audio output signal based on the first spectrum of the noise of the audio output signal, wherein the spectral resolution of the third spectrum of the noise of the audio output signal is same or higher as the spectral resolution of the first spectrum of the noise of the audio output signal, and wherein the resolution converter comprises a second converter stage configured to establish the second spectrum of the noise of the audio output signal.

9. Audio decoder according to claim 1, wherein the comfort noise spectrum generator is configured to compute the spectrum of the comfort noise based on the scaling factors and based on the third spectrum of the noise of the audio output signal as provided by the first converter stage of the resolution converter.

10. Audio decoder according to claim 8, wherein the comfort noise spectrum generator is configured to compute the spectrum of the comfort noise according to the formula {circumflex over (N)}^FR(k)=Ŝ

^LR(i). {circumflex over (N)}_dec^FR (k), wherein {circumflex over (N)}^FR(k) denotes a level of a frequency band k of the spectrum of the comfort noise, wherein Ŝ

^LR(i) denotes a scaling factor of a frequency band group i of the spectrum of the background noise and of the second spectrum of the noise of the audio output signal, wherein {circumflex over (N)}_dec^HR(k) denotes a level of a frequency band k of the third spectrum of the noise of the audio output signal, wherein k=b^LR(i), . . . , b^LR(i+1)−

1, wherein b^LR(i) is a first frequency band of a frequency band group, wherein i=0, . . . , L^LR−

1, wherein L^LR is the number of frequency band groups of the spectrum of the background noise and of the second spectrum of the noise of the audio output signal.

11. Audio decoder according to claim 1, wherein the comfort noise generator comprises a first fast Fourier converter configured to adjust levels of frequency bands of the comfort noise in a fast Fourier transformation domain and a second fast Fourier converter to produce at least a part of the comfort noise based on an output of the first fast Fourier converter.

12. Audio decoder according to claim 1, wherein the decoding device comprises a core decoder configured to produce the audio output signal during the active phase.

13. Audio decoder according to claim 1, wherein the decoding device comprises a core decoder configured to produce an audio signal and a bandwidth extension module configured to produce the audio output signal based on the audio signal as provided by the core decoder.

14. Audio decoder according to claim 13, wherein the bandwidth extension module comprises a spectral band replication decoder, a quadrature mirror filter analyzer, and/or a quadrature mirror filter synthesizer.

15. Audio decoder according to claim 13, wherein the comfort noise as provided by the fast Fourier synthesizer is fed to the bandwidth extension module.

16. Audio decoder according to claim 13, wherein the comfort noise generator comprises a quadrature mirror filter adjuster device configured to adjust levels of frequency bands of the comfort noise in a quadrature mirror filter domain, wherein an output of the quadrature mirror filter synthesizer is fed to the bandwidth extension module.

17. A system comprising a decoder and an encoder, wherein the decoder is designed according to claim 1.

18. A method of decoding an audio bitstream so as to produce therefrom an audio output signal, the bitstream comprising at least an active phase followed by at least an inactive phase, wherein the bitstream has encoded therein at least a silence insertion descriptor frame which describes a spectrum of a background noise, the method comprising:

decoding the silence insertion descriptor frame so as to reconstruct the spectrum of the background noise;

reconstructing the audio output signal from the bitstream during the active phase;

determining a spectrum of the audio output signal;

determining a first spectrum of the noise of the audio output signal based on the spectrum of the audio output signal, wherein the first spectrum of the noise of the audio output signal comprises a higher spectral resolution than the spectrum of the background noise;

establishing a second spectrum of the noise of the audio output signal based on the first spectrum of the noise of the audio output signal, wherein the second spectrum of the noise of the audio output signal comprises a same spectral resolution as the spectrum of the background noise;

computing scaling factors for a spectrum for a comfort noise based on the spectrum of the background noise and based on the second spectrum of the noise of the audio output signal; and

producing the comfort noise during the inactive phase based on the spectrum for the comfort noise.

19. Computer program for performing, when running on a computer or a processor, the method of claim 18.