Audio frame loss concealment

• US 9,847,086 B2
• Filed: 01/22/2014
• Issued: 12/19/2017
• Est. Priority Date: 02/05/2013
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Bruhn, Stefan
• Primary Examiner(s): Mishra, Richa
• Application Number:
  US14/764,318
• Publication Number:
  US 20150371642A1
• Time in Patent Office: 1,427 Days
• Field of Search: None
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 25/69 for evaluating synthetic or decoded voice signals

Abstract

Concealing a lost audio frame of a received audio signal by performing a sinusoidal analysis of a part of a previously received or reconstructed audio signal, wherein the sinusoidal analysis involves identifying frequencies of sinusoidal components of the audio signal, applying a sinusoidal model on a segment of the previously received or reconstructed audio signal, wherein said segment is used as a prototype frame in order to create a substitution frame for a lost audio frame, and creating the substitution frame for the lost audio frame by time-evolving sinusoidal components of the prototype frame, up to the time instance of the lost audio frame, in response to the corresponding identified frequencies.

Claims

1. A method of approximating a lost audio frame of a received audio signal in a decoding device comprising a processor, the method comprising the following operations performed by the processor:

extracting a segment from a previously received or reconstructed audio signal, as a prototype frame;

transforming the prototype frame into a frequency domain representation;

generating a phase-adjusted frequency spectrum of the prototype frame by;

performing a sinusoidal analysis of the segment from a previously received or reconstructed audio signal, wherein the sinusoidal analysis involves identifying frequencies of sinusoidal components of the audio signal;

changing first spectral coefficients of the prototype frame included in an interval M_k around a sinusoid k by a phase shift proportional to the sinusoidal frequency f_k and to a time difference between the lost audio frame and the prototype frame and retaining, without attenuation, magnitudes of the first spectral coefficients; and

changing a phase of a second spectral coefficient of the prototype frame by a random value, and retaining, without attenuation, a magnitude of the second spectral coefficient;

generating a substitution frame for the lost audio frame by performing an inverse frequency domain transformation of the phase-adjusted frequency spectrum of the prototype frame comprising the unattenuated first and second spectral coefficients; and

providing by the processor a decoded and reconstructed audio signal through output circuitry of the decoding device for speaker playback, wherein the decoded and reconstructed audio signal is provided using the previously received or reconstructed audio signal and the substitution frame for the lost audio frame.

2. The method of claim 1, wherein said performing a sinusoidal analysis of the segment from a previously received or reconstructed audio signal comprises performing a sinusoidal analysis of the frequency domain representation of the prototype frame.

3. The method of claim 1, wherein said identifying frequencies of sinusoidal components of the audio signal comprises identifying frequencies in vicinities of peaks of the frequency domain representation of the prototype frame.

4. The method of claim 3, wherein said identifying frequencies of sinusoidal components of the audio signal is performed at a higher resolution than a frequency resolution of a frequency domain transform used during said transforming the prototype frame into a frequency domain representation.

5. The method of claim 4, wherein said identifying frequencies of sinusoidal components of the audio signal comprises performing an interpolation.

6. The method of claim 5, wherein the interpolation is of a parabolic type.

7. The method of claim 1, wherein said extracting a segment from a previously received or reconstructed audio signal comprises extracting a segment from a previously received or reconstructed audio signal using a window function.

8. The method of claim 7, wherein said using a window function comprises approximating a window function spectrum such that a phase-adjusted frequency spectrum is composed of strictly non-overlapping portions of the approximated window function spectrum.

16. A computer program product comprising a non-transitory computer readable storage medium storing instructions which, when run by a processor, causes the processor to perform a method according to claim 1.

9. A decoding device configured to conceal a lost audio frame of a received audio signal, said decoding device comprising;

a processor; and

memory communicatively coupled to the processor, said memory comprising instructions executable by the processor, which cause the processor to;

extract a segment from a previously received or reconstructed audio signal, as a prototype frame;

transform the prototype frame into a frequency domain representation;

generate a phase-adjusted frequency spectrum of the prototype frame by;

performing a sinusoidal analysis of the segment from a previously received or reconstructed audio signal, wherein the sinusoidal analysis involves identifying frequencies of sinusoidal components of the audio signal;

changing first spectral coefficients of the prototype frame included in an interval M_k around a sinusoid k by a phase shift proportional to the sinusoidal frequency f_k and to a time difference between the lost audio frame and the prototype frame and retaining, without attenuation, magnitudes of the first spectral coefficients; and

changing a phase of a second spectral coefficient of the prototype frame by a random value, and retaining, without attenuation, a magnitude of the second spectral coefficient;

generate a substitution frame for the lost audio frame by performing an inverse frequency domain transformation of the phase-adjusted frequency spectrum of the prototype frame comprising the unattenuated first and second spectral coefficients; and

provide a decoded and reconstructed audio signal through output circuitry of the decoding device for speaker playback, wherein the decoded and reconstructed audio signal is provided using the previously received or reconstructed audio signal and the substitution frame for the lost audio frame.

10. The decoding device of claim 9, wherein said identifying frequencies of sinusoidal components of the audio signal comprises identifying frequencies in vicinities of peaks of the frequency domain representation of the prototype frame.

11. The decoding device of claim 10, wherein said identifying frequencies of sinusoidal components of the audio signal comprises performing a parabolic interpolation.

12. The decoding device of claim 9, wherein said extracting a segment from a previously received or reconstructed audio signal comprises extracting a segment from a previously received or reconstructed audio signal using a window function.

13. The decoding device of claim 12, wherein said using a window function comprises approximating a window function spectrum such that a phase-adjusted frequency spectrum is composed of strictly non-overlapping portions of the approximated window function spectrum.

15. A receiver comprising a decoding device according to claim 9.

14. A decoding device configured to approximate a lost audio frame of a received audio signal, said decoding device comprising:

input circuitry configured to receive an encoded audio signal; and

frame loss approximation circuitry connected to the input circuitry, said frame loss approximation circuitry configured to;

extract a segment from a previously received or reconstructed audio signal, as a prototype frame;

transform the prototype frame into a frequency domain representation;

generate a phase-adjusted frequency spectrum of the prototype frame by;

performing a sinusoidal analysis of the segment from a previously received or reconstructed audio signal, wherein the sinusoidal analysis involves identifying frequencies of sinusoidal components of the audio signal;

changing first spectral coefficients of the prototype frame included in an interval M_k around a sinusoid k by a phase shift proportional to the sinusoidal frequency f_k and to a time difference between the lost audio frame and the prototype frame and retaining, without attenuation, magnitudes of the first spectral coefficients; and

changing a phase of a second spectral coefficient of the prototype frame by a random value, and retaining, without attenuation, a magnitude of the second spectral coefficient;

generate a substitution frame for the lost audio frame by performing an inverse frequency domain transformation of the phase-adjusted frequency spectrum of the prototype frame comprising the unattenuated first and second spectral coefficients; and

provide a decoded and reconstructed audio signal through output circuitry of the decoding device for speaker playback, wherein the decoded and reconstructed audio signal is provided using the previously received or reconstructed audio signal and the substitution frame for the lost audio frame.