Apparatus and method for audio frame loss recovery

• US 9,123,328 B2
• Filed: 09/26/2012
• Issued: 09/01/2015
• Est. Priority Date: 09/26/2012
• Status: Expired due to Fees

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Mittal, Udar, Ashley, James P.
• Primary Examiner(s): ROBERTS, SHAUN A
• Application Number:
  US13/626,938
• Publication Number:
  US 20140088974A1
• Time in Patent Office: 1,070 Days
• Field of Search: 704/205, 704/211, 704/228, 704/500, 704/219
• US Class Current: 1/1
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes

Abstract

A method and apparatus provides for frame loss recovery following a loss of a frame in an audio codec. The lost frame is identified. Estimated linear predictive coefficients of a previous transform frame are generated based on a decoded audio of the previous transform frame. An estimated residual of the previous transform frame is generated based on the estimated linear predicative coefficients and the decoded audio. A pitch delay is determined from frame error recovery parameters received with the previous transform frame. An extended residual is generated based on the pitch delay and the estimated residual. A first synthesized signal is generated based on the extended residual and the linear predicative coefficients. A decoded audio output of at least the lost frame is generated based on the first synthesized signal. The frame error recovery parameters are generated by an encoder.

Claims

1. A method implemented on at least one processor for generating a decoded frame in response to a loss of a frame in an audio codec, comprising:

identifying that a frame is lost;

generating a set of estimated linear predictive coefficients corresponding to a previous transform frame based on a decoded set of audio samples from the previous transform frame;

generating an estimated residual of the previous transform frame based on the set of estimated linear predicative coefficients and the decoded set of audio samples;

determining a pitch delay from a set of frame error recovery parameters received with the previous transform frame;

generating an extended residual based on the pitch delay and the estimated residual;

generating a first synthesized signal based on the extended residual and the set of linear predicative coefficients;

receiving a plurality of coded parameters for a next good frame following the lost frame, wherein the next good frame is a successfully decoded frame;

generating a second synthesized signal for the next good frame further based on the plurality of coded parameters; and

generating a decoded audio output of the next good frame based on a first weighted sum of the first synthesized signal and the second synthesized signal

wherein the first weighted sum comprises at least two weight boundaries, and wherein the at least two weight boundaries are determined based on a pitch epoch of the first synthesized signal, a pitch epoch of decoded audio of the next good frame, and the pitch delay.

2. The method of claim 1, wherein the plurality of coded parameters are transform coefficients.

3. The method of claim 1, wherein the plurality of coded parameters are LPC and excitation parameters.

4. The method of claim 1, further comprising:

determining that the next good frame is a time domain frame;

generating an extended decoded audio output by extending the length of the decoded audio output of the at least one lost frame by a quantity of samples that is predetermined based on a bandwidth of an audio signal being conveyed by the frame;

coupling the extended decoded audio output to a CELP state generator; and

generating the decoded audio for the next good frame based at least upon the output of the CELP state generator.

5. An apparatus for generating a decoded frame following a loss of a frame, wherein the frames are a sequence of encoded audio frames, comprising:

a receiver that receives the sequence of audio frames; and

at least one processor that executes program instructions stored in memory, wherein the executed program instructions

identify that a frame is lost,

generate a set of estimated linear predictive coefficients corresponding to a previous transform frame based on a decoded set of audio samples from the previous transform frame,

generate an estimated residual of the previous transform frame based on the set of estimated linear predicative coefficients and the decoded set of audio samples,

determine a pitch delay from frame error recovery parameters received with the previous transform frame,

generate an extended residual based on the pitch delay and estimated residual,

generate a first synthesized signal based on the extended residual and the linear predicative coefficients,

receive a plurality of coded parameters for a next good frame following the lost frame, wherein the next good frame is a successfully decoded frame;

generate a second synthesized signal for the next good frame further based on the plurality of coded parameters; and

generate a decoded audio output of the next good frame based on a first weighted sum of the first synthesized signal and the second synthesized signal,

wherein the first weighted sum comprises at least two weight boundaries, and wherein the at least two weight boundaries are determined based on a pitch epoch of the first synthesized signal, a pitch epoch of decoded audio of the next good frame, and the pitch delay.

6. The apparatus according to claim 5, wherein the executed program instructions further:

determine that the next good frame is a time domain frame;

generate an extended decoded audio output by extending the length of the decoded audio output of the at least one lost frame by a quantity of samples that is predetermined based on a bandwidth of an audio signal being conveyed by the frame;

couple the extended decoded audio output to a CELP state generator; and

generate the decoded audio for the next good frame based at least upon the output of the CELP state generator.