Noise filling concept

• US 10,410,642 B2
• Filed: 09/07/2017
• Issued: 09/10/2019
• Est. Priority Date: 01/29/2013
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Disch, Sascha, Gayer, Marc, Helmrich, Christian, Markovic, Goran, Luis Valero, Maria
• Primary Examiner(s): Han, Qi
• Application Number:
  US15/698,442
• Publication Number:
  US 20170372712A1
• Time in Patent Office: 733 Days
• Field of Search: 704500, 704501, 704502
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/028 Noise substitution, i.e. substituting non-tonal spectral components by noisy source comfort noise for discontinuous speech transmission G10L19/012
• CPC Class Codes: G10L 19/04 using predictive techniques

Abstract

Noise filling of a spectrum of an audio signal is improved in quality with respect to the noise filled spectrum so that the reproduction of the noise filled audio signal is less annoying, by performing the noise filling in a manner dependent on a tonality of the audio signal.

Claims

1. An apparatus configured to perform a method, comprising:

performing noise filling on a spectrum of an audio signal in a manner dependent on a tonality of the audio signal by filling a contiguous spectral zero-portion of the audio signal'"'"'s spectrum with noise spectrally shaped by one of;

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting an absolute slope of the function'"'"'s outwardly falling edges negatively depending on the tonality,

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting a spectral width of the function positively depending on the tonality, and

using a unimodal function having a local maximum surrounded by two outwardly falling flanks and adjusting the unimodal function depending on the tonality such that an integral of the unimodal function, normalized to an integral of 1, over outer quarters of the contiguous spectral zero-portion negatively depends on the tonality; and

dequantizing the spectrum, as derived by the noise-filling, using

a spectrally varying and signal-adaptive quantization step size controlled via a linear prediction spectral envelope signaled via linear prediction coefficients in a data stream into which the spectrum is coded, or

scale factors relating to scale factor bands, signaled in the data stream into which the spectrum is coded;

wherein the apparatus comprises any of a microprocessor, an electronic circuit, or a programmable computer.

2. Apparatus according to claim 1, wherein the apparatus is configured to scale the noise with which the contiguous spectral zero-portions are filled using a scalar global noise level signaled in the data stream into which the spectrum is coded in a spectrally global manner.

3. Apparatus according to claim 1, wherein the apparatus is configured to generate the noise with which the contiguous spectral zero-portions are filled, using a random or pseudo-random process or using patching.

4. Apparatus according to claim 1, wherein the apparatus is configured to derive the tonality from a coding parameter coded within the data stream so that the dependency on the tonality involves a dependency on the coding parameter.

5. Apparatus according to claim 4, wherein the apparatus is configured such that the coding parameter is one of:

an LTP (long-term prediction) flag or gain,

a TNS (temporal noise shaping) enablement flag or gain, and

a spectrum rearrangement enablement flag signalling a coding option according to which quantized spectral values are spectrally re-arranged with additionally transmitting within the data stream the rearrangement prescription.

6. Apparatus according to claim 1, wherein the apparatus is configured to confine the performance of the noise filling onto a high-frequency spectral portion of the audio signal'"'"'s spectrum.

7. Apparatus according to claim 6,

wherein the apparatus is configured to set a low-frequency starting position of the high-frequency spectral portion corresponding to an explicit signaling in the data stream.

8. Apparatus according to claim 1, wherein the apparatus is configured to, in performing the noise filling, fill contiguous spectral zero-portions of the spectrum with noise a level of which exhibits a decrease from low to high frequencies, approximating a spectral low-pass filter'"'"'s transfer function so as to counteract a spectral tilt caused by a pre-emphasis used to code the audio signal'"'"'s spectrum.

9. Apparatus according to claim 8, wherein the apparatus is configured to adapt a steepness of the decrease to a pre-emphasis factor of the pre-emphasis.

10. Apparatus according to claim 1, wherein the apparatus is configured to identify contiguous spectral zero-portions of the audio signal'"'"'s spectrum and to fill the contiguous spectral zero-portions with functions set dependent on a respective contiguous spectral zero-portion'"'"'s width so that the function is confined to the respective contiguous spectral zero-portion, and dependent on the tonality of the audio signal so that, if the tonality of the audio signal increases, the function gets increasingly more compact in the inner of the respective contiguous spectral zero-portion and distanced from the respective contiguous spectral zero-portion'"'"'s edges and, additionally, dependent on the respective contiguous spectral zero-portion'"'"'s spectral position so that a scaling of the function depends on the respective contiguous spectral zero-portion'"'"'s spectral position.

11. Audio decoder supporting noise filling, comprising:

an apparatus according to claim 1.

12. Perceptual transform audio decoder, comprising:

an apparatus configured to perform noise filling on a spectrum of an audio signal according to claim 1; and

a frequency domain noise shaper configured to subject the noise filled spectrum to spectral shaping using a spectral perceptual weighting function.

13. Audio encoder supporting noise filling, comprising:

an apparatus according to claim 1, the audio encoder being configured to use a spectrum filled with noise by the apparatus, for analysis-by-synthesis.

14. Audio encoder configured to perform a method for noise filling, the method comprising:

quantizing and coding a spectrum of an audio signal into a data stream;

setting and coding into the data stream, a spectrally global noise filling level for performing noise filling on the spectrum of the audio signal, by spectrally shaping, dependent on the tonality of the audio signal, contiguous spectral zero-portions of the audio signal'"'"'s spectrum by one of;

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting an absolute slope of the function'"'"'s outwardly falling edges negatively depending on the tonality,

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting a spectral width of the function positively depending on the tonality, and

using a unimodal function having a local maximum surrounded by two outwardly falling flanks and adjusting the unimodal function depending on the tonality such that an integral of the unimodal function, normalized to an integral of 1, over outer quarters of the contiguous spectral zero-portion negatively depends on the tonality, and tonality; and

measuring a level of the audio signal within the contiguous spectral zero-portions of the spectrum having been spectrally shaped dependent on the tonality of the audio signal;

wherein the audio encoder comprises any of a microprocessor, an electronic circuit, or a programmable computer.

15. Audio encoder according to claim 14, wherein the measure is a root mean square.

16. Audio encoder according to claim 14, wherein the audio encoder is configured to quantize the spectrum using a spectrally varying and signal-adaptive quantization step size according to a linear prediction spectral envelope, signal the linear prediction spectral envelope via linear prediction coefficients in the data stream and encode the spectrum into the data stream.

17. Audio encoder according to claim 14, wherein the audio encoder is configured to quantize the spectrum using a spectrally varying and signal-adaptive quantization step size according to scale factors relating to scale factor bands, signal the scale factors in the data stream and encode the spectrum into the data stream.

18. Audio encoder according to claim 14, wherein the audio encoder is configured to derive the tonality from a coding parameter used to code the audio signal'"'"'s spectrum.

19. Method comprising:

performing noise filling on a spectrum of an audio signal in a manner dependent on a tonality of the audio signal by filling a contiguous spectral zero-portion of the audio signal'"'"'s spectrum with noise spectrally shaped by one of;

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting an absolute slope of the function'"'"'s outwardly falling edges negatively depending on the tonality,

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting a spectral width of the function positively depending on the tonality, and

using a unimodal function having a local maximum surrounded by two outwardly falling flanks and adjusting the unimodal function depending on the tonality such that an integral of the unimodal function, normalized to an integral of 1, over outer quarters of the contiguous spectral zero-portion negatively depending on the tonality; and

dequantizing the spectrum, as derived by the noise-filling, using;

a spectrally varying and signal-adaptive quantization step size controlled via a linear prediction spectral envelope signaled via linear prediction coefficients in a data stream into which the spectrum is coded, or

scale factors relating to scale factor bands, signaled in the data stream into which the spectrum is coded.

21. Non-transitory computer-readable storage medium having stored thereon a computer program comprising a program code for performing, when running on a computer, the method according to claim 19.

20. Method for audio encoding supporting noise filling, the method comprising:

quantizing and coding a spectrum of an audio signal into a data stream;

setting and coding into the data stream, a spectrally global noise filling level for performing noise filling on the spectrum of the audio signal, by;

spectrally shaping, dependent on the tonality of the audio signal,

contiguous spectral zero-portions of the audio signal'"'"'s spectrum by one of;

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting an absolute slope of the function'"'"'s outwardly falling edges negatively depending on the tonality,

using a function assuming a maximum in an inner of the contiguous spectral zero-portion, and comprising outwardly falling edges and setting a spectral width of the function positively depending on the tonality, and

using a unimodal function having a local maximum surrounded by two outwardly falling flanks and adjusting the unimodal function depending on the tonality such that an integral of the unimodal function, normalized to an integral of 1, over outer quarters of the contiguous spectral zero-portion negatively depends on the tonality; and

measuring of a level of the audio signal within the contiguous spectral zero-portions of the spectrum having been spectrally shaped dependent on the tonality of the audio signal.

22. Non-transitory computer-readable storage medium having stored thereon a computer program comprising a program code for performing, when running on a computer, the method according to claim 20.

23. Method according to claim 20, further comprising:

storing an audio signal encoded by the method within a digital storage medium.