Position-dependent hybrid domain packet loss concealment

• US 9,514,755 B2
• Filed: 09/27/2013
• Issued: 12/06/2016
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Huang, Shen, Sun, Xuejing
• Primary Examiner(s): AZAD, ABUL K
• Application Number:
  US14/431,256
• Publication Number:
  US 20150255079A1
• Time in Patent Office: 1,166 Days
• Field of Search: 704200-230, 704500-504
• US Class Current: 1/1
• CPC Class Codes: G10L 19/0017 Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error G10L19/24 takes precedence
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm

Abstract

The present document relates to audio signal processing in general, and to the concealment of artifacts that result from loss of audio packets during audio transmission over a packet-switched network, in particular. A method (200) for concealing one or more consecutive lost packets is described. A lost packet is a packet which is deemed to be lost transform-based audio decoder. Each of the one or more lost packets comprises a set of transform coefficients. A set of transform coefficients is used by the transform-based audio decoder to generate a corresponding frame of a time domain audio signal. The method (200) comprises determining (205) for a current lost packet of the one or more lost packets a number of preceding lost packets from the one or more lost packets; wherein the determined number is referred to as a loss position. Furthermore, the method comprises determining a packet loss concealment, referred to as PLC, scheme based on the loss position of the current packet; and determining (204, 207, 208) an estimate of a current frame of the audio signal using the determined PLC scheme (204, 207, 208); wherein the current frame corresponds to the current lost packet.

Claims

1. A method for concealing one or more consecutive lost packets;

wherein a lost packet is a packet which is deemed to be lost by a transform-based audio decoder;

wherein the transform-based audio decoder applies an overlapped transform;

wherein each of the one or more lost packets comprises a set of transform coefficients;

wherein each set of transform coefficients comprises N transform coefficients, with N>

1;

wherein for each set of transform coefficients, the overlapped transform generates a corresponding aliased intermediate frame of 2N samples;

wherein for each received packet, wherein the overlapped transform generates the corresponding frame of the audio signal, based on a first half of the corresponding aliased intermediate frame and based on a second half of the aliased intermediate frame of a packet which precedes the received packet; and

wherein a set of transform coefficients is used by the transform-based audio decoder to generate a corresponding frame of a time domain audio signal;

the method comprising;

determining a last received packet comprising a last received set of transform coefficients;

wherein the last received packet is directly preceding the one or more lost packets;

determining contents of a first buffer based on a last received frame of the audio signal;

wherein the last received frame corresponds to the last received packet;

determining contents of a second buffer based on the second half of the aliased intermediate frame of the last received packet;

determining for a current lost packet of the one or more lost packets a number of preceding lost packets from the one or more lost packets;

wherein the determined number is referred to as a loss position;

determining a packet loss concealment, referred to as PLC, scheme based on the loss position of the current packet; and

determining an estimate of a current frame of the audio signal using the determined PLC scheme;

wherein the current frame corresponds to the current lost packet.

2. The method of claim 1, wherein

the transform-based audio decoder is a modified discrete cosine transform, referred to as MDCT, based audio decoder;

and

the set of transform coefficients is a set of MDCT coefficients.

3. The method of claim 1, wherein

the first buffer comprises N samples of the last received frame;

and

the second buffer comprises N samples of the second half of the aliased intermediate frame of the last received packet.

4. The method of claim 1, further comprising determining a pitch period W based on the first buffer and the second buffer.

5. The method of claim 1, further comprising

determining a diffused set of transform coefficients based on the set of transform coefficients of the last received packet;

determining a diffused aliased intermediate frame based on the diffused set of transform coefficients; and

determining a third buffer based on the diffused aliased intermediate frame.

6. The method of claim 5, wherein determining a diffused set of transform coefficients comprises

low pass filtering the absolute values of the set of transform coefficients of the last received packet;

and

randomizing some or all of the signs of the set of transform coefficients of the last received packet.

7. The method of claim 5, wherein the third buffer comprises the first half of the diffused aliased intermediate frame.

8. The method of claim 5, wherein

the PLC scheme is determined from a set of pre-determined PLC schemes;

the set of pre-determined PLC schemes comprises one or more of;

a time domain PLC scheme;

de-correlated PLC scheme.

9. The method of claim 8, wherein determining the estimate of the current frame using the de-correlated PLC scheme comprises:

cross-fading the second half of the aliased intermediate frame and the first half of the diffused aliased intermediate frame using a fade-out window and a fade-in window, respectively.

10. The method of claim 8, wherein determining the estimate of the current frame using the time domain PLC scheme comprises:

determining a pitch period buffer based on the samples of the last received frame;

wherein the pitch period buffer has a length corresponding to the pitch period W;

determining a periodical waveform extrapolation, referred to as PWE, component by concatenation of one or more pitch period buffers; and

determining the estimate of the current frame based on the PWE component.

11. The method of claim 10, wherein determining the estimate of the current frame using the time domain PLC scheme comprises:

determining an aliased component based on the second half of the aliased intermediate signal; and

determining the estimate of the current frame also based on the aliased component.

12. The method of claim 11, wherein determining the estimate of the current frame using the time domain PLC scheme comprises:

determining a diffused last received frame based on the first half of the diffused intermediate frame;

determining a diffused pitch period buffer based on the samples of the diffused last received frame;

wherein the diffused pitch period buffer has a length corresponding to the pitch period W;

determining a diffused component by concatenation of one or more diffused pitch period buffers; and

determining the estimate of the current frame also based on the diffused component.

13. The method of claim 12, wherein determining the estimate of the current frame using the time domain PLC scheme comprises:

applying a third window to the PWE component;

applying a fourth window to the aliased component;

applying a fifth window to the diffused component;

determining the estimate of the current frame based on the windowed PWE, aliased and diffused components.

14. The method of claim 13, wherein

the current lost packet is directly preceded by a previous lost packet;

if for the previous lost packet the third window is a fade-in window, then for the current lost packet the third window is a fade-out window, and vice versa;

if for the previous lost packet the fifth window is a fade-out window, then for the current lost packet the fifth window is a fade-in window, and vice versa; and

if for the current lost packet the fifth window is a fade-in window, the third window is a fade-out window, and vice versa.

15. The method of claim 1, wherein determining the estimate of the current frame using the determined PLC scheme comprises:

applying a long-term attenuation to the estimate of the current frame;

wherein the long-term attenuation depends on the loss position.

16. The method of claim 1, wherein determining the estimate of the current frame using the determined PLC scheme comprises:

if the current lost packet is the first lost packet, cross-fading a frame derived using the determined PLC scheme with the second half of the aliased intermediate frame to yield the estimate of the current frame.

17. The method of claim 1, wherein determining the estimate of the current frame using the determined PLC scheme comprises:

if the current lost packet is not the first lost packet, taking the frame derived using the determined PLC scheme as the estimate of the current frame.

18. A system configured to conceal one or more consecutive lost packets;

wherein a lost packet is a packet which is deemed to be lost by a transform-based audio decoder;

wherein the transform-based audio decoder applies an overlapped transform;

wherein each of the one or more lost packets comprises a set of transform coefficients;

wherein each set of transform coefficients comprises N transform coefficients, with N>

1;

wherein for each set of transform coefficients, the overlapped transform generates a corresponding aliased intermediate frame of 2N samples;

wherein for each received packet, wherein the overlapped transform generates the corresponding frame of the audio signal, based on a first half of the corresponding aliased intermediate frame and based on a second half of the aliased intermediate frame of a packet which precedes the received packet; and

wherein a set of transform coefficients is used by the transform-based audio decoder to generate a corresponding frame of a time domain audio signal;

the system comprising;

means for determining a last received packet comprising a last received set of transform coefficients;

wherein the last received packet is directly preceding the one or more lost packets;

means for determining contents of a first buffer based on a last received frame of the audio signal;

wherein the last received frame corresponds to the last received packet;

means for determining contents of a second buffer based on the second half of the aliased intermediate frame of the last received packet;

a lost position detector configured to determine for a current lost packet of the one or more lost packets a number of preceding lost packets from the one or more lost packets;

wherein the determined number is referred to as a loss position;

a decision unit configured to determine a packet loss concealment, referred to as PLC, scheme based on the loss position of the current packet; and

a PLC unit configured to determine an estimate of a current frame of the audio signal using the determined PLC scheme;

wherein the current frame corresponds to the current lost packet.

19. A method for concealing one or more consecutive lost packets;

wherein a lost packet is a packet which is deemed to be lost by a transform-based audio decoder;

wherein each of the one or more lost packets comprises a set of transform coefficients;

wherein a set of transform coefficients is used by the transform-based audio decoder to generate a corresponding frame of a time domain audio signal;

wherein the transform-based audio decoder applies an overlapped transform;

wherein each set of transform coefficients comprises N transform coefficients, with N>

1;

wherein for each set of transform coefficients, the overlapped transform generates a corresponding aliased intermediate frame of 2N samples;

wherein for each received packet, the overlapped transform generates the corresponding frame of the audio signal, based on a first half of the corresponding aliased intermediate frame and based on a second half of the aliased intermediate frame of a packet which precedes the received packet;

the method comprising

determining a last received packet comprising a last received set of transform coefficients;

wherein the last received packet is directly preceding the one or more lost packets; and

determining contents of a first buffer based on a last received frame of the audio signal;

wherein the last received frame corresponds to the last received packet;

determining contents of a second buffer based on the second half of the aliased intermediate frame of the last received packet;

determining contents of a third buffer in which one or more frames of a decoded and decorrelated signal, corresponding with the last received packet, are stored; and

determining, based on the contents of at least one of the first buffer or the second buffer whether to use the contents of the third buffer to conceal the current lost packet.

20. A non-transitory medium having software stored thereon, the software including instructions for controlling one or more devices to perform a method for concealing one or more consecutive lost packets;

wherein a lost packet is a packet which is deemed to be lost by a transform-based audio decoder;

wherein the transform-based audio decoder applies an overlapped transform;

wherein each of the one or more lost packets comprises a set of transform coefficients;

wherein each set of transform coefficients comprises N transform coefficients, with N>

1;

wherein for each set of transform coefficients, the overlapped transform generates a corresponding aliased intermediate frame of 2N samples;

wherein for each received packet, wherein the overlapped transform generates the corresponding frame of the audio signal, based on a first half of the corresponding aliased intermediate frame and based on a second half of the aliased intermediate frame of a packet which precedes the received packet; and

wherein a set of transform coefficients is used by the transform-based audio decoder to generate a corresponding frame of a time domain audio signal;

the method comprising;

determining a last received packet comprising a last received set of transform coefficients;

wherein the last received packet is directly preceding the one or more lost packets;

determining contents of a first buffer based on a last received frame of the audio signal;

wherein the last received frame corresponds to the last received packet;

determining contents of a second buffer based on the second half of the aliased intermediate frame of the last received packet;

determining for a current lost packet of the one or more lost packets a number of preceding lost packets from the one or more lost packets;

wherein the determined number is referred to as a loss position;

determining a packet loss concealment, referred to as PLC, scheme based on the loss position of the current packet; and

determining an estimate of a current frame of the audio signal using the determined PLC scheme;

wherein the current frame corresponds to the current lost packet.