Time warp activation signal provider, audio signal encoder, method for providing a time warp activation signal, method for encoding an audio signal and computer programs

• US 9,646,632 B2
• Filed: 11/11/2014
• Issued: 05/09/2017
• Est. Priority Date: 07/11/2008
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Bayer, Stefan, Disch, Sascha, Geiger, Ralf, Fuchs, Guillaume, Neuendorf, Max, Schuller, Gerald, Edler, Bernd
• Primary Examiner(s): PULLIAS, JESSE SCOTT
• Application Number:
  US14/538,756
• Publication Number:
  US 20150066490A1
• Time in Patent Office: 910 Days
• Field of Search: 704200-232, 704500-504
• CPC Class Codes: G10L 19/002 Dynamic bit allocation for perceptual audio coders G10L19/032
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/025 Detection of transients or attacks for time/frequency resolution switching
• CPC Class Codes: G10L 19/028 Noise substitution, i.e. substituting non-tonal spectral components by noisy source comfort noise for discontinuous speech transmission G10L19/012
• CPC Class Codes: G10L 19/032 Quantisation or dequantisation of spectral components
• CPC Class Codes: G10L 19/265 Pre-filtering, e.g. high frequency emphasis prior to encoding
• CPC Class Codes: G10L 21/04 Time compression or expansion
• CPC Class Codes: G10L 21/043 by changing speed
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals

Abstract

An audio encoder has a window function controller, a windower, a time warper with a final quality check functionality, a time/frequency converter, a TNS stage or a quantizer encoder, the window function controller, the time warper, the TNS stage or an additional noise filling analyzer are controlled by signal analysis results obtained by a time warp analyzer or a signal classifier. Furthermore, a decoder applies a noise filling operation using a manipulated noise filling estimate depending on a harmonic or speech characteristic of the audio signal.

Claims

1. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the energy compaction information provider is configured to provide a measure of spectral flatness describing the time warp transformed spectrum representation of the audio signal as the energy compaction information.

2. The time warp activation signal provider according to claim 1, wherein the energy compaction information provider is configured to compute a quotient of a geometric mean of the time warp transformed power spectrum of the audio signal and an arithmetic mean of the time warp transformed power spectrum of the audio signal to acquire the measure of spectral flatness.

3. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the energy compaction information provider is configured to emphasize a higher-frequency portion of the time warp transformed spectrum representation when compared to a lower frequency portion of the time warp transformed spectrum representation to acquire the energy compaction information.

4. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the energy compaction information provider is configured to acquire a plurality of band-wise measures of spectral flatness, and to compute an average of the plurality of band-wise measures of spectral flatness to acquire the energy compaction information.

5. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the energy compaction information provider is configured to provide a measure of perceptual entropy describing the time warp transformed spectrum representation of the audio signal as the energy compaction information.

6. The time warp activation signal provider according to claim 5, wherein the energy compaction information provider is configured to compute an estimated number of non-zero lines for one or more a scale factor bands of the time warp transformed spectral representation of the audio signal on the basis of a form factor information) of the scale factor band, and to compute the measure of perceptual entropy for a scale factor band under consideration using a multiplication of the estimated number of non-zero lines and an energy measure of the scale factor band under consideration.

7. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the energy compaction information provider is configured to provide an autocorrelation measure describing an autocorrelation of a time warped time domain representation of the audio signal as the energy compaction information.

8. The time warp activation signal provider according to claim 7, wherein the energy compaction information provider is configured to determine a sum of absolute values of a normalized autocorrelation function of the time warped representation of the audio signal to acquire the energy compaction information.

9. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the time warp activation signal provider comprises a reference value calculator configured to compute the reference value on the basis of an unwarped spectrum representation of the audio signal or on the basis of an unwarped time domain representation of the audio signal; and

wherein the comparator is configured to form a ratio value using the energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal and the reference value, and to compare the ratio value with one or more threshold values to acquire the time warp activation signal as the result of the comparison.

10. A time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising:

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal; and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison;

wherein the time warp activation signal provider comprises a reference value calculator configured to compute the reference value on the basis of a time warped representation of the input signal, time warped using a standard time warp contour information; and

wherein the comparator is configured to form a ratio value using the energy compaction information describing a compaction of energy in a time warped representation of the audio signal and the reference value, and to compare the ratio value with one or more threshold values to acquire the time warp activation signal as the result of the comparison.

11. An audio signal encoder for encoding an input audio signal to acquire an encoded representation of the input audio signal, the audio signal encoder comprising:

a time warp transformer configured to provide a time warp transformed spectral representation on the basis of the input audio signal using a time warp contour;

a time warp activation signal provider for providing a time warp activation signal on the basis of a representation of an audio signal, the time warp activation signal provider comprising;

an energy compaction information provider configured to provide an energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal, and

a comparator configured to compare the energy compaction information with a reference value, and to provide the time warp activation signal in dependence on a result of the comparison

wherein the time warp activation signal provider is configured to receive the input audio signal and to provide the time warp activation signal; and

a controller configured to selectively provide, in dependence on the time warp activation signal, a newly found time warp contour information, describing a non-constant time warp contour portion, or a standard time warp contour information, describing a constant time warp contour portion, to the time warp transformer to describe the time warp contour used by the time warp transformer.

12. The audio signal encoder according to claim 11, wherein the audio signal encoder comprises an output interface configured to comprise the time warp transformed spectral representation into the encoded representation of the audio signal, and

to selectively comprise, in dependence on the time warp activation signal, a time warp contour information into the encoded representation of the audio signal.

13. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein a measure of spectral flatness describing the time warp transformed spectrum representation of the audio signal is provided as the energy compaction information.

14. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 13.

15. A method for encoding an input audio signal to acquire an encoded representation of the input audio signal, the method comprising:

providing a time warp activation signal on the basis of an audio signal, the method comprising;

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison,

wherein the energy compaction information describes a compaction of energy in a time warp transformed spectrum representation of the input audio signal; and

selectively providing, in dependence on the time warp activation signal, a description of the time warp transformed spectral representation of the input audio signal or description of a non-time-warp-transformed spectral representation of the input audio signal for inclusion into the encoded representation of the input audio signal.

16. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 15.

17. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein a higher-frequency portion of the time warp transformed spectrum representation is emphasized when compared to a lower frequency portion of the time warp transformed spectrum representation to acquire the energy compaction information.

23. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 17.

18. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein a plurality of band-wise measures of spectral flatness is acquired, and wherein an average of the plurality of band-wise measures of spectral flatness is computed to acquire the energy compaction information.

24. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 18.

19. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein a measure of perceptual entropy describing the time warp transformed spectrum representation of the audio signal is provided as the energy compaction information.

25. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 19.

20. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein an autocorrelation measure describing an autocorrelation of a time warped time domain representation of the audio signal is provided as the energy compaction information.

26. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 20.

21. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein the reference value is computed on the basis of an unwarped spectrum representation of the audio signal or on the basis of an unwarped time domain representation of the audio signal; and

wherein a ratio value is formed using the energy compaction information describing a compaction of energy in a time warp transformed spectrum representation of the audio signal and the reference value, and wherein the ratio value is compared with one or more threshold values to acquire the time warp activation signal as the result of the comparison.

27. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 21.

22. A method for providing a time warp activation signal on the basis of an audio signal, the method comprising:

providing an energy compaction information describing a compaction of energy in a time warp transformed spectral representation of the audio signal;

comparing the energy compaction information with a reference value; and

providing the time warp activation signal in dependence on the result of the comparison;

wherein the reference value is computed on the basis of a time warped representation of the input signal, time warped using a standard time warp contour information; and

wherein a ratio value is formed using the energy compaction information describing a compaction of energy in a time warped representation of the audio signal and the reference value, and wherein the ratio value is compared with one or more threshold values to acquire the time warp activation signal as the result of the comparison.

28. A non-transitory digital storage medium comprising a computer program comprising program code for performing, when running on a computer, the method of claim 22.