Apparatus and method for encoding and decoding an audio signal using an aligned look-ahead portion

• US 9,047,859 B2
• Filed: 08/14/2013
• Issued: 06/02/2015
• Est. Priority Date: 02/14/2011
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Ravelli, Emmanuel, Geiger, Ralf, Schnell, Markus, Fuchs, Guillaume, Ruoppila, Vesa, Baeckstroem, Tom, Grill, Bernhard, Helmrich, Christian
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/966,666
• Publication Number:
  US 20130332148A1
• Time in Patent Office: 657 Days
• Field of Search: 704/219, 704/223, 704/222, 704/208, 704/233, 704/254, 704/220, 704/225, 704/217, 704/221, 704/207, 704/205, 704/203
• US Class Current: 1/1
• CPC Class Codes: G10K 11/16 Methods or devices for protecting against, or for damping, noise or other acoustic waves in general G10K11/36 takes precedence
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/025 Detection of transients or attacks for time/frequency resolution switching
• CPC Class Codes: G10L 19/03 Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: G10L 19/107 Sparse pulse excitation, e.g. by using algebraic codebook
• CPC Class Codes: G10L 19/12 the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 19/22 Mode decision, i.e. based on audio signal content versus external parameters
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: G10L 25/06 the extracted parameters being correlation coefficients
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

An apparatus for encoding an audio signal having a stream of audio samples has: a windower for applying a prediction coding analysis window to the stream of audio samples to obtain windowed data for a prediction analysis and for applying a transform coding analysis window to the stream of audio samples to obtain windowed data for a transform analysis, wherein the transform coding analysis window is associated with audio samples within a current frame of audio samples and with audio samples of a predefined portion of a future frame of audio samples being a transform-coding look-ahead portion, wherein the prediction coding analysis window is associated with at least the portion of the audio samples of the current frame and with audio samples of a predefined portion of the future frame being a prediction coding look-ahead portion, wherein the transform coding look-ahead portion and the prediction coding look-ahead portion are identically to each other or are different from each other by less than 20%; and an encoding processor for generating prediction coded data or for generating transform coded data.

Claims

1. An apparatus for encoding an audio signal comprising a stream of audio samples, comprising:

a windower for applying a prediction coding analysis window to the stream of audio samples to acquire windowed data for a prediction analysis and for applying a transform coding analysis window to the stream of audio samples to acquire windowed data for a transform analysis,

wherein the transform coding analysis window is associated with audio samples within a current frame of audio samples and with audio samples of a predefined portion of a future frame of audio samples being a transform-coding look-ahead portion,

wherein the prediction coding analysis window is associated with at least the portion of the audio samples of the current frame and with audio samples of a predefined portion of the future frame being a prediction coding look-ahead portion,

wherein the transform coding look-ahead portion and the prediction coding look-ahead portion are identical to each other or are different from each other by less than 20% of the prediction coding look-ahead portion or less than 20% of the transform coding look-ahead portion; and

an encoding processor for generating prediction coded data for the current frame using the windowed data for the prediction analysis or for generating transform coded data for the current frame using the windowed data for the transform analysis.

2. The apparatus of claim 1, wherein the transform coding analysis window comprises a non-overlapping portion extending in the transform-coding look-ahead portion.

3. The apparatus of claim 1, wherein the transform coding analysis window comprises a further overlapping portion starting at the beginning of the current frame and ending at the beginning of the non-overlapping portion.

4. The apparatus of claim 1, in which the windower is configured to only use a start window for the transition from prediction coding to transform coding from a frame to the next frame, wherein the start window is not used for a transition from transform coding to prediction coding from one frame to the next frame.

5. The apparatus in accordance with claim 1, further comprising:

an output interface for outputting an encoded signal for the current frame; and

an encoding mode selector for controlling the encoding processor to output either prediction coded data or transform coded data for the current frame,

wherein the encoding mode selector is configured to only switch between either prediction coding or transform coding for the whole frame so that the encoded signal for the whole frame either comprises prediction coded data or transform coded data.

6. The apparatus in accordance with claim 1,

wherein the windower uses, in addition to the prediction coding analysis window, a further prediction coding analysis window being associated with audio samples being placed at the beginning of the current frame, and wherein the prediction coding analysis window is not associated with audio samples being placed at the beginning of the current frame.

7. The apparatus in accordance with claim 1,

wherein the frame comprises a plurality of subframes, wherein the prediction analysis window is centered to a center of a subframe, and wherein the transform coding analysis window is centered to a border between two subframes.

8. The apparatus in accordance with claim 7,

wherein the prediction analysis window is centered at the center of the last subframe of the frame, wherein the further analysis window is centered at a center of the second subframe of the current frame, and wherein the transform coding analysis window is centered at a border between the third and the fourth subframe of the current frame, wherein the current frame is subdivided into four subframes.

9. The apparatus in accordance with claim 1, wherein a further prediction coding analysis window does not comprise a look-ahead portion in the future frame and is associated with samples of the current frame.

10. The apparatus in accordance with claim 1, in which the transform coding analysis window additionally comprises a zero portion before a beginning of the window and a zero portion subsequent to an end of the window so that a full length in time of the transform coding analysis window is twice the length in time of the current frame.

11. The apparatus in accordance with claim 10, wherein, for a transition from the prediction coding mode to the transform coding mode from one frame to the next frame, a transition window is used by the windower,

wherein the transition window comprises a first non-overlap portion starting at the beginning of the frame and an overlap portion starting at the end of the non-overlap portion and extending into the future frame,

wherein the overlap portion extending into the future frame comprises a length which is identical to the length of the transform coding look-ahead portion of the analysis window.

12. The apparatus in accordance with claim 1, wherein a length in time of the transform coding analysis window is greater than a length in time of the prediction coding analysis window.

13. The apparatus in accordance with claim 1, further comprising:

an output interface for outputting an encoded signal for the current frame; and

an encoding mode selector for controlling the encoding processor to output either prediction coded data or transform coded data for the current frame,

wherein the window is configured to use a further prediction coding window located in the current frame before the prediction coding window, and

wherein the encoding mode selector is configured to control the encoding processor to only forward prediction coding analysis data derived from the prediction coding window, when the transform coded data is output to the output interface and not to forward the prediction coding analysis data derived from the further prediction coding window, and

wherein the encoding mode selector is configured to control the encoding processor to forward prediction coding analysis data derived from the prediction coding window and to forward the prediction coding analysis data derived from the further prediction coding window, when the prediction coded data is output to the output interface.

14. The apparatus in accordance with claim 1, wherein the encoding processor comprises:

a prediction coding analyzer for deriving prediction coding data for the current frame from the windowed data for a prediction analysis;

a prediction coding branch comprising;

a filter stage for calculating filter data from the audio samples for the current frame using the prediction coding data; and

a prediction coder parameter calculator for calculating prediction coding parameters for the current frames; and

a transform coding branch comprising;

a time-spectral converter for converting the window data for the transform coding algorithm into a spectral representation;

a spectral weighter for weighting the spectral data using weighted weighting data derived from the prediction coding data to acquire weighted spectral data; and

a spectral data processor for processing the weighted spectral data to acquire transform coded data for the current frame.

15. A method of encoding an audio signal comprising a stream of audio samples, comprising:

applying a prediction coding analysis window to the stream of audio samples to acquire windowed data for a prediction analysis and applying a transform coding analysis window to the stream of audio samples to acquire windowed data for a transform analysis,

wherein the transform coding analysis window is associated with audio samples within a current frame of audio samples and with audio samples of a predefined portion of a future frame of audio samples being a transform-coding look-ahead portion,

wherein the prediction coding analysis window is associated with at least the portion of the audio samples of the current frame and with audio samples of a predefined portion of the future frame being a prediction coding look-ahead portion,

wherein the transform coding look-ahead portion and the prediction coding look-ahead portion are identical to each other or are different from each other by less than 20% of the prediction coding look-ahead portion or less than 20% of the transform coding look-ahead portion; and

generating prediction coded data for the current frame using the windowed data for the prediction analysis or for generating transform coded data for the current frame using the windowed data for the transform analysis.

25. A computer program comprising a program code for performing, when running on a computer, the method of encoding an audio signal of claim 15.

16. An audio decoder for decoding an encoded audio signal, comprising:

a prediction parameter decoder for performing a decoding of data for a prediction coded frame from the encoded audio signal;

a transform parameter decoder for performing a decoding of data for a transform coded frame from the encoded audio signal,

wherein the transform parameter decoder is configured for performing a spectral-time transform and for applying a synthesis window to transformed data to acquire data for the current frame and a future frame, the synthesis window comprising a first overlap portion, an adjacent second non-overlapping portion and an adjacent third overlap portion, the third overlap portion being associated with audio samples for the future frame and the non-overlap portion being associated with data of the current frame; and

an overlap-adder for overlapping and adding synthesis windowed samples associated with the third overlap portion of a synthesis window for the current frame and synthesis windowed samples associated with the first overlap portion of a synthesis window for the future frame to acquire a first portion of audio samples for the future frame, wherein a rest of the audio samples for the future frame are synthesis windowed samples associated with the second non-overlapping portion of the synthesis window for the future frame acquired without overlap-adding, when the current frame and the future frame comprise transform-coded data.

17. The audio decoder of claim 16, wherein the current frame of the encoded audio signal comprises transform coded data and the future frame comprises prediction coded data, wherein the transform parameter decoder is configured to perform a synthesis windowing using the synthesis window for the current frame to acquire windowed audio samples associated with the non-overlap portion of the synthesis window, wherein the synthesis windowed audio samples associated with the third overlap portion of the synthesis window for the current frame are discarded, and

wherein audio samples for the future frame are provided by the prediction parameter decoder without data from the transform parameter decoder.

18. The audio decoder of claim 16,

wherein the current frame comprises prediction coding data and the future frame comprises transform coding data,

wherein the transform parameter decoder is configured for using a transition window being different from the synthesis window,

wherein the transition window comprises a first non-overlap portion at the beginning of the future frame and an overlap portion starting at an end of the future frame and extending into the frame following the future frame in time, and

wherein the audio samples for the future frame are generated without an overlap and audio data associated with the second overlap portion of the window for the future frame are calculated by the overlap-adder using the first overlap portion of the synthesis window for the frame following the future frame.

19. The audio decoder of claim 16,

in which the transform parameter calculator comprises:

a spectral weighter for weighting decoded transform spectral data for the current frame using prediction coding data; and

an prediction coding weighting data calculator for calculating the prediction coding data by combining a weighted sum of prediction coding data derived from a past frame and prediction coding data derived from the current frame to acquire interpolated prediction coding data.

20. The audio decoder in accordance with claim 19,

wherein the prediction coding weighting data calculator is configured to convert the prediction coding data into a spectral representation comprising a weighting value for each frequency band, and

wherein the spectral weighter is configured to weight all spectral values in a band by the same weighting value for this band.

21. The audio decoder of claim 16, wherein the synthesis window is configured to comprise a total time length less than 50 ms and greater than 25 ms, wherein the first and the third overlap portions comprise the same length and wherein the third overlap portion comprises a length smaller than 15 ms.

22. The audio decoder of claim 16,

wherein the synthesis window comprises a length of 30 ms without zero padded portions, the first and third overlap portions each comprise a length of 10 ms and the non-overlapping portion comprises a length of 10 ms.

23. The audio decoder of claim 16,

wherein the transform parameter decoder is configured to apply, for the spectral-time transform, a DCT transform comprising a number of samples corresponding to a frame length, and a defolding operation for generating a number of time values being twice the number of time values before the DCT, and

to apply the synthesis window to a result of the defolding operation, wherein the synthesis window comprises, before the first overlap portion and subsequent to the third overlap portion zero portions comprising a length being half the length of the first and third overlap portions.

24. A method of decoding an encoded audio signal, comprising:

performing a decoding of data for a prediction coded frame from the encoded audio signal;

performing a decoding of data for a transform coded frame from the encoded audio signal,

wherein performing a decoding of data for a transform coded frame comprises performing a spectral-time transform and applying a synthesis window to transformed data to acquire data for the current frame and a future frame, the synthesis window comprising a first overlap portion, an adjacent second non-overlapping portion and an adjacent third overlap portion, the third overlap portion being associated with audio samples for the future frame and the non-overlap portion being associated with data of the current frame; and

overlapping and adding synthesis windowed samples associated with the third overlap portion of a synthesis window for the current frame and synthesis windowed samples associated with the first overlap portion of a synthesis window for the future frame to acquire a first portion of audio samples for the future frame, wherein a rest of the audio samples for the future frame are synthesis windowed samples associated with the second non-overlapping portion of the synthesis window for the future frame acquired without overlap-adding, when the current frame and the future frame comprise transform-coded data.

26. A computer program comprising a program code for performing, when running on a computer, the method of decoding an audio signal of claim 24.