Apparatus and method for error concealment in low-delay unified speech and audio coding

• US 9,384,739 B2
• Filed: 08/14/2013
• Issued: 07/05/2016
• Est. Priority Date: 02/14/2011
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V., Technische Universitã¤T Ilmenau
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V., Technische Universitã¤T Ilmenau
• Inventors: Lecomte, Jeremie, Dietz, Martin, Schnabel, Michael, Sperschneider, Ralph
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US13/966,536
• Publication Number:
  US 20130332152A1
• Time in Patent Office: 1,056 Days
• Field of Search: 704/200, 704/205, 704/206, 704/207, 704/208, 704/219, 704/225, 704/211, 704500-504
• US Class Current: 1/1
• CPC Class Codes: G10K 11/16 Methods or devices for protecting against, or for damping, noise or other acoustic waves in general G10K11/36 takes precedence
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/025 Detection of transients or attacks for time/frequency resolution switching
• CPC Class Codes: G10L 19/03 Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: G10L 19/107 Sparse pulse excitation, e.g. by using algebraic codebook
• CPC Class Codes: G10L 19/12 the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 19/22 Mode decision, i.e. based on audio signal content versus external parameters
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: G10L 25/06 the extracted parameters being correlation coefficients
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

An apparatus for generating spectral replacement values for an audio signal has a buffer unit for storing previous spectral values relating to a previously received error-free audio frame. Moreover, the apparatus includes a concealment frame generator for generating the spectral replacement values, when a current audio frame has not been received or is erroneous. The previously received error-free audio frame has filter information, the filter information having associated a filter stability value indicating a stability of a prediction filter. The concealment frame generator is adapted to generate the spectral replacement values based on the previous spectral values and based on the filter stability value.

Claims

1. An apparatus for generating spectral replacement values for an audio signal comprising:

a buffer unit for storing previous spectral values relating to a previously received error-free audio signal frame, and

a concealment frame generator for generating the spectral replacement values when a current audio signal frame has not been received or is erroneous, wherein the previously received error-free audio signal frame comprises filter information, the filter information comprising an associated filter stability value indicating a stability of a prediction filter, and wherein the concealment frame generator is adapted to generate the spectral replacement values based on the previous spectral values and based on the filter stability value,

wherein during a playback of the audio signal, at a receiver, the current audio signal frame that has not been received in time or is erroneous is replaced with a synthesized representation of the generated spectral replacement values,

wherein the apparatus is implemented using a hardware apparatus or a computer or a combination of a hardware apparatus and a computer.

2. The apparatus according to claim 1, wherein the concealment frame generator is adapted to generate the spectral replacement values by randomly flipping the sign of the previous spectral values.

3. The apparatus according to claim 1, wherein the concealment frame generator is configured to generate the spectral replacement values by multiplying each of the previous spectral values by a first gain factor when the filter stability value comprises a first value, and by multiplying each of the previous spectral values by a second gain factor, being smaller than the first gain factor, when the filter stability value comprises a second value being smaller than the first value.

4. The apparatus according to claim 1, wherein the concealment frame generator is adapted to generate the spectral replacement values based on the filter stability value, wherein the previously received error-free audio signal frame comprises first predictive filter coefficients of the prediction filter, wherein a predecessor frame of the previously received error-free audio signal frame comprises second predictive filter coefficients, and wherein the filter stability value depends on the first predictive filter coefficients and on the second predictive filter coefficients.

5. The apparatus according to claim 4, wherein the concealment frame generator is adapted to determine the filter stability value based on the first predictive filter coefficients of the previously received error-free audio signal frame and based on the second predictive filter coefficients of the predecessor frame of the previously received error-free audio signal frame.

6. The apparatus according to claim 4, wherein the concealment frame generator is adapted to generate the spectral replacement values based on the filter stability value, wherein the filter stability value depends on a distance measure LSF_dist, and wherein the distance measure LSF_dist is defined by the formula:

7. The apparatus according to claim 1, wherein the concealment frame generator is adapted to generate the spectral replacement values furthermore based on frame class information relating to the previously received error-free audio signal frame.

8. The apparatus according to claim 7, wherein the concealment frame generator is adapted to generate the spectral replacement values based on the frame class information, wherein the frame class information indicates that the previously received error-free audio signal frame is classified as “

artificial onset”

, “

onset”

, “

voiced transition”

, “

unvoiced transition”

, “

unvoiced”

or “

voiced”

.

9. The apparatus according to claim 1, wherein the concealment frame generator is adapted to generate the spectral replacement values furthermore based on a number of consecutive frames that did not arrive at a receiver or that were erroneous, since a last error-free audio signal frame had arrived at the receiver, wherein no other error-free audio signal frames arrived at the receiver since the last error-free audio signal frame had arrived at the receiver.

10. The apparatus according to claim 9,

wherein the concealment frame generator is adapted to calculate a fade out factor, based on the filter stability value and based on the number of consecutive frames that did not arrive at the receiver or that were erroneous, and

wherein the concealment frame generator is adapted to generate the spectral replacement values by multiplying the fade out factor by at least some of the previous spectral values, or by at least some values of a group of intermediate values, wherein each one of the intermediate values depends on at least one of the previous spectral values.

11. The apparatus according to claim 1, wherein the concealment frame generator is adapted to generate the spectral replacement values based on the previous spectral values, based on the filter stability value and also based on a prediction gain of a temporal noise shaping.

12. An audio signal decoder comprising:

an apparatus for decoding spectral audio signal values, and

an apparatus for generating spectral replacement values according to claim 1,

wherein the apparatus for decoding spectral audio signal values is adapted to decode spectral values of an audio signal based on a previously received error-free audio signal frame, wherein the apparatus for decoding spectral audio signal values is furthermore adapted to store the spectral values of the audio signal in the buffer unit of the apparatus for generating spectral replacement values, and

wherein the apparatus for generating spectral replacement values is adapted to generate the spectral replacement values based on the spectral values stored in the buffer unit, when a current audio signal frame has not been received or is erroneous,

wherein the apparatus for decoding spectral audio signal values is implemented using a hardware apparatus or a computer or a combination of a hardware apparatus and a computer.

13. An audio signal decoder, comprising:

a decoding unit for generating first intermediate spectral values based on a received error-free audio signal frame,

a temporal noise shaping unit for conducting temporal noise shaping on the first intermediate spectral values to acquire second intermediate spectral values,

a prediction gain calculator for calculating a prediction gain of the temporal noise shaping depending on the first intermediate spectral values and depending on the second intermediate spectral values,

an apparatus according to claim 1, for generating spectral replacement values when a current audio signal frame has not been received or is erroneous, and

a values selector for storing the first intermediate spectral values in the buffer unit of the apparatus for generating spectral replacement values, if the prediction gain is greater than or equal to a threshold value, or for storing the second intermediate spectral values in the buffer unit of the apparatus for generating spectral replacement values, if the prediction gain is smaller than the threshold value;

wherein the decoding unit, the temporal noise shaping unit, the prediction gain calculator, and the values selector are implemented using a hardware apparatus or a computer or a combination of a hardware apparatus and a computer.

14. An audio signal decoder, comprising:

a first decoding module for generating generated spectral values based on a received error-free audio signal frame,

an apparatus for generating spectral replacement values according to claim 1, and

a processing module for processing the generated spectral values by conducting temporal noise shaping, applying noise-filling or applying a global gain, to acquire spectral audio values of the decoded audio signal,

wherein the apparatus for generating spectral replacement values is adapted to generate spectral replacement values and to feed them into the processing module, when a current frame has not been received or is erroneous; and

wherein the first decoding module and the processing module are implemented using a hardware apparatus or a computer or a combination of a hardware apparatus and a computer.

15. A method for generating spectral replacement values for an audio signal comprising:

storing previous spectral values relating to a previously received error-free audio signal frame, and

generating the spectral replacement values when a current audio signal frame has not been received or is erroneous, wherein the previously received error-free audio signal frame comprises filter information, the filter information comprising an associated filter stability value indicating a stability of a prediction filter defined by the filter information, wherein the spectral replacement values are generated based on the previous spectral values and based on the filter stability value,

wherein during a playback of the audio signal, at a receiver, the current audio signal frame that has not been received in time or is erroneous is replaced with a synthesized representation of the generated spectral replacement values,

wherein the method is performed using a hardware apparatus or a computer or a combination of a hardware apparatus and a computer.

16. A non-transitory computer-readable medium comprising a computer program for implementing the method of claim 15, when the computer program is executed by a computer or signal processor.