Time warp contour calculator, audio signal encoder, encoded audio signal representation, methods and computer program

• US 9,299,363 B2
• Filed: 07/01/2009
• Issued: 03/29/2016
• Est. Priority Date: 07/11/2008
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Bayer, Stefan, Disch, Sascha, Geiger, Ralf, Fuchs, Guillaume, Neuendorf, Max, Schuller, Gerald, Edler, Bernd
• Primary Examiner(s): Chawan, Vijay B
• Assistant Examiner(s): Estes, Ernest
• Application Number:
  US12/935,731
• Publication Number:
  US 20110161088A1
• Time in Patent Office: 2,463 Days
• Field of Search: 704500-504, 704/211, 704/241
• US Class Current: 1/1
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/032 Quantisation or dequantisation of spectral components
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 21/04 Time compression or expansion

Abstract

A time warp contour calculator for use in an audio signal decoder receives an encoded warp ratio information, derives a sequence of warp ratio values from the encoded warp ratio information, and obtains warp contour node values starting from a time warp contour start value. Ratios between the time warp contour node values and the time warp contour starting value are determined by the warp ratio values. The time warp contour calculator computes a time warp contour node value of a given time warp contour node, on the basis of a product-formation having a ratio between the time warp contour node values of the intermediate time warp contour node and the time warp contour starting value and a ratio between the time warp contour node values of the given time warp contour node and of the intermediate time warp contour node as factors.

Claims

1. A time warp contour calculator apparatus for use in an audio signal decoder for providing a decoded audio signal representation on the basis of an encoded audio signal representation, comprising:

a warp ratio decoder that includes a mechanism for receiving an input signal including encoded warp ratio information; and

a warp node value calculator in communication with the warp ratio decoder;

wherein the warp ratio decoder is configured to process the encoded warp ratio information to derive a sequence of warp ratio values,

wherein the warp node value calculator is configured to process the sequence of warp ratio values to acquire, starting with a time warp start value, warp contour node values,

wherein ratios between the time warp contour node values and the time warp contour starting value associated with a time warp contour start node are determined by the warp ratio values; and

wherein the warp node value calculator is configured to compute a time warp contour node value of a given time warp contour node,

wherein the given time warp contour node is spaced from the time warp contour starting node with an intermediate time warp contour node in between on the basis of a product-formation,

wherein the product-formation comprises as factors a ratio between the time warp contour node value of the intermediate time warp contour node and the time warp contour starting value and a ratio between the time warp contour node value of the given time warp contour node and the time-warp contour node value of the intermediate time warp contour node;

wherein the warp node value calculator includes a mechanism for outputting an output signal that includes the warp contour node values.

2. The time warp contour calculator according to claim 1, wherein the time warp contour calculator is configured to periodically restart from the time warp contour starting value.

3. The time warp contour calculator according to claim 1, wherein the warp ratio decoder is configured to map the encoded warp ratio information onto a sequence of warp ratio values using a mapping rule,

wherein the mapping rule describes a mapping of a plurality of warp ratio Codebook indices onto corresponding warp ratio values,

wherein the mapping rule is chosen such that the mapping rule comprises a plurality of pairs of reciprocal warp ratio values, such that product of two warp ratio values of a pair of at least approximately reciprocal warp ratio values lies between 0.9997 and 1.0003.

4. The time warp contour calculator according to claim 1, wherein the warp ratio decoder is configured to map the encoded warp ratio information onto a sequence of warp ratio values using a mapping rule,

wherein the mapping rule describes a mapping of a plurality of warp ratio codebook indices onto corresponding warp ratio values,

wherein the mapping rule is chosen such that the warp ratio values, onto which the warp ratio codebook indices are mapped, are within a range between 0.97 and 1.03.

5. The time warp contour calculator according to claim 1, wherein the warp ratio is configured to map the encoded warp ratio information onto a sequence of warp ratio values using a mapping rule,

wherein the mapping rule describes a mapping of a plurality of warp ratio Codebook indices onto corresponding warp ratio values,

wherein the mapping rule is chosen asymmetrically such that a range of ascending warp ratio values is larger than a range of descending warp ratio values.

6. The time warp contour calculator according to claim 1, wherein the time warp contour calculator is configured to receive a side information indicating a non-varying time warp contour or a varying time warp contour for a given frame of the encoded audio signal representation, and, in dependence on the side information indicating a non-varying time warp contour or a varying time warp contour, to acquire the time warp contour node values for the given frame on the basis of the encoded warp ratio information, or to set the time warp contour node values for the given frame to the warp contour start value.

7. The time warp contour calculator according to claim 1, wherein the time warp contour calculator is configured to linearly interpolate between the time warp contour node values, to acquire time warp contour values of a new time warp contour portion.

8. The time warp contour calculator according to claim 1, wherein the warp node value calculator is configured to iteratively acquire a sequence of time warp contour node values, wherein the time warp contour calculator is configured to acquire a subsequent time warp contour node value from a present time warp contour node value by multiplying the present time warp contour node value with a corresponding time warp ratio value.

9. An audio signal encoder apparatus for providing an encoded representation of an audio signal, the audio signal encoder comprising:

an input mechanism for receiving the audio signal;

a mechanism for obtaining time warp contour information;

a time warp contour encoder in communication with the mechanism for obtaining the time warp contour information, wherein the time warp contour encoder is configured to

receive the time warp contour information associated with the received audio signal,

compute ratios between pairs of subsequent node values of a time warp contour, and

encode the ratios between subsequent node values of the time warp contour; and

a time warping signal encoder in communication with the input mechanism, wherein the time warping signal encoder is configured to

acquire an encoded representation of a spectrum of the received audio signal, taking into account a time warp described by the time warp contour information;

wherein the encoded representation of the received audio signal comprises the encoded ratios and the encoded representation of the spectrum;

wherein the node values are sample values of the time warp contour described by the time warp contour information; and

an output mechanism in communication with the time warp contour encoder and with the time warping signal encoder, for outputting an output signal that includes the encoded representation of the audio signal.

10. The audio signal encoder according to claim 9, wherein the time warp contour encoder is configured to check, whether a non-flat time warp contour is available for a given frame of the audio signal, and to set a flag within the encoded representation of the audio signal to indicate the absence of a varying time warp contour if a varying time warp contour is not available for the given frame of the audio signal, and

to omit an inclusion of encoded ratio values into the encoded representation of the audio signal if a varying time warp contour is not available for the given frame of the audio signal.

11. A method for providing a decoded audio signal representation on the basis of an encoded audio signal representation, the method comprising:

receiving an input signal that includes encoded warp ratio information;

processing the encoded warp ratio information to derive a sequence of warp ratio values; and

processing the sequence of warp ratio values, to acquire, starting from a time warp contour start value, a plurality of time warp contour node values,

wherein ratios between the time warp contour node values and the time warp contour starting value associated with the time warp contour starting node are determined by the warp ratio values;

wherein a time warp contour node value of a given time warp contour node, which given time warp contour node is spaced from the time warp contour starting node with an intermediate time warp contour node in between, is computed on the basis of a product- formation, comprising as factors

a ratio between the time warp contour node value of the intermediate time warp contour node and the time warp contour starting value, and

a ratio between the time warp contour node value of the given time warp contour node and the time warp contour node value of the intermediate time warp contour node; and

outputting an output signal that includes the resultant decoded audio signal representation.

12. A method for providing an encoded representation of an audio signal, the method comprising:

with an input mechanism, receiving the audio signal;

receiving a time warp contour information associated with the audio signal;

computing ratios between pairs of subsequent node values of a time warp contour;

encoding the ratios between subsequent node values of the time warp contour; and

acquiring an encoded representation of a spectrum of the audio signal, taking into account a time warp described by the time warp contour information;

wherein the encoded representation of the audio signal comprises the encoded ratios and the encoded representation of the spectrum;

wherein the node values are sample values of the time warp contour described by the time warp contour information; and

with an output mechanism, outputting an output signal that includes the encoded representation of the audio signal.

13. A non-transitory computer readable medium comprising a computer program for performing, when executed by a computer, a method for providing a decoded audio signal representation on the basis of an encoded audio signal representation, the method comprising:

receiving an input signal, wherein the input signal includes encoded warp ratio information;

processing the encoded warp ratio information to derive a sequence of warp ratio values;

processing the sequence of warp ratio values, to acquire, starting with a time warp contour start value, a plurality of time warp contour node values, and

outputting an output signal that includes the resultant decoded audio signal representation;

wherein ratios between the time warp contour node values and the time warp contour starting value associated with the time warp contour starting node are determined by the warp ratio values;

wherein a time warp contour node value of a given time warp contour node, which given time warp contour node is spaced from the time warp contour starting node with an intermediate time warp contour node in between, is computed on the basis of a product- formation, comprising as factors

a ratio between the time warp contour node value of the intermediate time warp contour node and the time warp contour starting value, and

a ratio between the time warp contour node value of the given time warp contour node and the time warp contour node value of the intermediate time warp contour node.

14. A non-transitory computer readable medium comprising a computer program for performing, when executed by a computer, a method for providing an encoded representation of an audio signal, the method comprising:

receiving the audio signal;

receiving a time warp contour information associated with the audio signal;

determining, on the basis of the received time warp contour information, ratios between pairs of subsequent node values of a time warp contour;

encoding the determined ratios between subsequent node values of the time warp contour;

acquiring an encoded representation of a spectrum of the received audio signal, taking into account a time warp described by the received time warp contour information; and

outputting an output signal that includes the encoded representation of the received audio signal;

wherein the encoded representation of the received audio signal comprises the encoded ratios and the encoded representation of the spectrum;

wherein the node values are sample values of the time warp contour described by the time warp contour information.

15. An audio signal decoder, wherein the audio signal decoder is configured to provide a decoded audio signal representation on the basis of an encoded audio signal representation, the audio signal decoder comprising:

a mechanism for receiving an input signal that includes encoded warp ratio information;

a time warp contour calculator that includes a warp ratio decoder and a warp node value calculator;

the warp ratio decoder for processing the received encoded warp ratio information to derive a sequence of warp ratio values, and

the warp node value calculator for processing the derived sequence of warp ratio values, to acquire, starting from a time warp contour start value, warp contour node values,

wherein ratios between the time warp contour node values and the time warp contour starting value associated with a time warp contour start node are determined by the warp ratio values; and

wherein the warp node value calculator is configured to compute a time warp contour node value of a given time warp contour node, which given time warp contour node is spaced from the time warp contour starting node with an intermediate time warp contour node in between, on the basis of a product-formation comprising as factors

a ratio between the time warp contour node value of the intermediate time warp contour node and the time warp contour starting value, and

a ratio between the time warp contour node value of the given time warp contour node and the time-warp contour node value of the intermediate time warp contour node;

wherein the audio signal decoder comprises a warp decoder configured to perform a resampling in dependence on the warp contour node values; and

a mechanism for outputting an output signal that includes the decoded audio signal representation.