Audio frame loss concealment

• US 10,339,939 B2
• Filed: 11/10/2017
• Issued: 07/02/2019
• Est. Priority Date: 02/05/2013
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Bruhn, Stefan
• Primary Examiner(s): Mishra, Richa
• Application Number:
  US15/809,493
• Publication Number:
  US 20180096691A1
• Time in Patent Office: 599 Days
• Field of Search: None
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 25/69 for evaluating synthetic or decoded voice signals

Abstract

Concealing a lost audio frame of a received audio signal by performing a sinusoidal analysis of a part of a previously received or reconstructed audio signal, wherein the sinusoidal analysis involves identifying frequencies of sinusoidal components of the audio signal, applying a sinusoidal model on a segment of the previously received or reconstructed audio signal, wherein said segment is used as a prototype frame in order to create a substitution frame for a lost audio frame, and creating the substitution frame for the lost audio frame by time-evolving sinusoidal components of the prototype frame, up to the time instance of the lost audio frame, in response to the corresponding identified frequencies.

Claims

1. A frame loss concealment method, wherein a segment from a previously received or reconstructed audio signal is used as a prototype frame in order to create a substitution frame for a lost audio frame, the method comprising:

transforming the prototype frame into a frequency domain;

applying a sinusoidal model to the prototype frame in the frequency domain to identify frequencies of sinusoidal components of the audio signal;

calculating a phase shift θ

_kfor the identified sinusoidal components;

phase shifting the identified sinusoidal components of the prototype frame by the phase shift θ

_k; and

creating the substitution frame by performing an inverse frequency transform of a frequency spectrum of the prototype frame after phase shifting the identified sinusoidal components of the prototype frame;

wherein phase shifting the identified sinusoidal components comprises shifting a phase of all spectral coefficients in the prototype frame included in an interval M_k around a sinusoid k by the phase shift θ

_k;

wherein phases of spectral coefficients that are not phase shifted are randomized and the spectral coefficients that are not phase shifted include spectral coefficients in a gap outside the interval M_k; and

wherein a magnitude of the spectral coefficients is kept unchanged while the phases of the spectral coefficients are shifted.

2. The frame loss concealment method according to claim 1, wherein the phase shift θ

_k depends on the sinusoidal frequency f_k and a time shift between the prototype frame and the lost frame.

3. The frame loss concealment method according to claim 1, wherein at least one of transforming, applying, calculating, phase shifting, and/or creating is performed by a processor, the method further comprising:

providing by the processor an audio signal for speaker playback, wherein the audio signal is provided using the substitution frame.

17. The frame loss concealment method according to claim 1 further comprising:

using the substitution frame in place of the lost audio frame to reduce audible impact of the audio signal from the lost audio frame.

18. The frame loss concealment method according to claim 1 further comprising:

providing a decoded and reconstructed audio signal for speaker playback, wherein the decoded and reconstructed audio signal is provided using the substitution frame and the previously received or reconstructed audio signal; and

transmitting the audio signal through output circuitry towards a speaker for the speaker playback.

19. The frame loss concealment method according to claim 1 further comprising:

playing the substitution frame that is created through a loudspeaker device.

20. The frame loss concealment method according to claim 1 further comprising:

receiving the segment from the previously received or reconstructed audio signal through an input circuit, and

output the substitution frame through an output circuit toward an electronic device have a loudspeaker for playback through the loudspeaker.

21. The frame loss concealment method according to claim 1 further comprising:

replace the lost audio frame with the substation frame in the previously received or reconstructed audio signal,

output the substitution frame and the previously received or reconstructed audio signal towards storage.

4. An apparatus for creating a substitution frame for a lost audio frame, the apparatus comprising:

a processor; and

memory communicatively coupled to the processor, said memory comprising instructions executable by the processor, which cause the processor to;

generate a prototype frame from a segment of a previously received or reconstructed audio signal;

transform the prototype frame into a frequency domain;

apply a sinusoidal model to the prototype frame in the frequency domain to identify frequencies of sinusoidal components of the audio signal;

calculate a phase shift θ

_k for the identified sinusoidal components;

phase shift the identified sinusoidal components of the prototype frame by the phase shift θ

_k; and

create the substitution frame by performing an inverse frequency transform of a frequency spectrum of the prototype frame after phase shifting the identified sinusoidal components of the prototype frame;

wherein phase shifting the identified sinusoidal components comprises shifting a phase of all spectral coefficients in the prototype frame included in an interval M_k around a sinusoid k by θ

_k;

wherein phases of spectral coefficients that are not phase shifted are randomized and the spectral coefficients that are not phase shifted include spectral coefficients in one or more gaps between intervals in the interval M_k; and

wherein a magnitude of the spectral coefficients is kept unchanged while the phases of the spectral coefficients are shifted.

5. The apparatus according the claim 4, wherein the phase shift θ

_k depends on the sinusoidal frequency f_k and a time shift between the prototype frame and the lost frame.

6. An audio decoder comprising the apparatus according to claim 4.

22. The apparatus according to claim 4, further comprising:

a loudspeaker,

wherein the instructions comprise further instructions to play the substitution frame that is created through the loudspeaker.

23. The apparatus according to claim 4, further comprising:

an input circuit; and

an output circuit,

wherein the processor is operated to receive the segment from the previously received audio signal through the input circuit, and to output the substitution frame through the output circuit toward a device having a loudspeaker for playback through the loudspeaker.

7. A frame loss concealment method, wherein a segment of a previously synthesized audio signal is used as a prototype frame in order to create a substitution frame for a lost audio frame, the method comprising:

transforming the prototype frame into a frequency domain;

applying a sinusoidal model to the prototype frame in the frequency domain to identify a frequency of a sinusoidal component of the audio signal;

calculating a phase shift θ

_k for the sinusoidal component;

phase shifting the sinusoidal component by the phase shift θ

_k; and

creating the substitution frame by performing an inverse frequency transform of a frequency spectrum of the prototype frame after phase shifting the sinusoidal component of the prototype frame;

wherein phase shifting the sinusoidal component comprises shifting a phase of all spectral coefficients in the prototype frame included in an interval M_k around a sinusoid k by the phase shift θ

_k;

wherein phases of spectral coefficients that are not phase shifted are randomized and the spectral coefficients that are not phase shifted include spectral coefficients in a gap outside the interval M_k; and

wherein a magnitude of the spectral coefficients is kept unchanged while the phases of the spectral coefficients are shifted.

8. The frame loss concealment method according to claim 7, wherein the phase shift θ

_k depends on the sinusoidal frequency f_k and a time shift between the prototype frame and the lost frame.

9. The frame loss concealment method according to claim 7, wherein the identifying of the frequency of a sinusoidal component further involves identifying frequencies in the vicinity of peaks of the spectrum related to a used frequency domain transform.

10. The frame loss concealment method according to claim 7, wherein the identifying of the frequency of a sinusoidal component is performed with higher resolution than the frequency resolution of the used frequency domain transform.

11. The frame loss concealment method according to claim 7, wherein at least one of transforming, applying, calculating, phase shifting, and/or creating is performed by a processor, the method further comprising:

providing by the processor an audio signal for speaker playback, wherein the audio signal is provided using the substitution frame.

12. An apparatus for creating a substitution frame for a lost audio frame, the apparatus comprising:

a processor; and

memory communicatively coupled to the processor, said memory comprising instructions executable by the processor, which cause the processor to;

generate a prototype frame from a segment of a previously synthesized audio signal;

transform the prototype frame into a frequency domain;

apply a sinusoidal model to the prototype frame in the frequency domain to identify a frequency of a sinusoidal component of the audio signal;

calculate a phase shift θ

_k for the sinusoidal component;

phase shift the sinusoidal component of the prototype frame by the phase shift θ

_k; and

create the substitution frame by performing an inverse frequency transform of a frequency spectrum of the prototype frame after phase shifting the sinusoidal component of the prototype frame;

wherein phase shifting the sinusoidal component comprises shifting a phase of all spectral coefficients in the prototype frame included in an interval M_k around a sinusoid k by the phase shift θ

_k;

wherein phases of spectral coefficients that are not phase shifted are randomized and the spectral coefficients that are not phase shifted includes spectral coefficients in a gap outside the interval M_k; and

wherein a magnitude of the spectral coefficients is kept unchanged while the phases of the spectral coefficients are shifted.

13. The apparatus according the claim 12, wherein the phase shift θ

_k depends on the sinusoidal frequency f_k and a time shift between the prototype frame and the lost frame.

14. The apparatus according to claim 12, wherein the identifying of the frequency of a sinusoidal component further involves identifying frequencies in the vicinity of peaks of the spectrum related to a used frequency domain transform.

15. The apparatus according to claim 12, wherein the identifying of the frequency of a sinusoidal component is performed with higher resolution than the frequency resolution of the used frequency domain transform.

16. An audio decoder comprising the apparatus according to claim 12.