Method and apparatus for recovering lost frames

• US 10,529,351 B2
• Filed: 04/26/2019
• Issued: 01/07/2020
• Est. Priority Date: 06/25/2014
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Wang, Bin, Liu, Zexin, Miao, Lei
• Primary Examiner(s): Yen, Eric
• Application Number:
  US16/396,253
• Publication Number:
  US 20190251980A1
• Time in Patent Office: 256 Days
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/083 the excitation function being an excitation gain G10L25/90 takes precedence
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 2025/932 Decision in previous or following frames
• CPC Class Codes: G10L 21/038 using band spreading techniques
• CPC Class Codes: G10L 21/0388 Details of processing therefor
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

The present disclosure relates methods and apparatus for recovering a lost frame in a received audio signal. One example method includes obtaining an initial high-frequency band signal of a current lost frame in the received audio signal, calculating a ratio R, where the ratio R is a ratio of a high frequency excitation energy of a previous frame of the current lost frame to a high frequency excitation energy of the current lost frame, obtaining a global gain of the current lost frame according to the ratio R and a global gain of the previous frame of the current lost frame, and recovering a high-frequency band signal of the current lost frame according to the initial high-frequency band signal of the current lost frame and the global gain of the current lost frame.

Claims

1. A method for recovering lost frames in an audio signal, performed by an audio signal decoder, comprising:

receiving and decoding a bit stream to obtain the audio signal, wherein the audio signal is transmitted in consecutive frames, and wherein at least one frame of the audio signal is lost;

obtaining an initial high-frequency band signal of a current lost frame of the audio signal;

calculating a ratio R, wherein the ratio R is a ratio of a high frequency excitation energy of a previous frame of the current lost frame to a high frequency excitation energy of the current lost frame;

obtaining a global gain of the current lost frame according to the ratio R and a global gain of the previous frame of the current lost frame;

obtaining a high-frequency band signal of the current lost frame according to the initial high-frequency band signal of the current lost frame and the global gain of the current lost frame;

reconstructing the current lost frame of the audio signal according to the high-frequency band signal of the current lost frame; and

outputting the audio signal including the reconstructed current lost frame.

2. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, wherein G is the global gain of the previous frame of the current lost frame, wherein α

is a weighting factor, and wherein α

is greater than or equal to 0 and smaller than 1.

3. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, wherein G is the initial gain, wherein α

is a weighting factor, and wherein α

is greater than or equal to 0 and smaller than 1.

4. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

one of;

if the ratio R is greater than two times of the initial gain and less than or equal to four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

if the ratio R is greater than four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or

if the ratio R is less than or equal to two times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and wherein G is the initial gain.

5. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises one of:

if the ratio R is greater than two times and less than or equal to four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

if the ratio R is greater than four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or

if the ratio R is less than or equal to two times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and wherein G is the global gain of the previous frame of the current lost frame.

6. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=min((0.5×

R+0.5×

G),4×

G),

where G′

is the global gain of the current lost frame, and where G is the global gain of the previous frame of the current lost frame.

7. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min((0.5×

R+0.5×

G),4×

G),

where G′

is the global gain of the current lost frame, and where G is the initial gain.

8. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min((0.8×

R+0.2×

G),4×

G),

where G′

is the global gain of the current lost frame, and where G is the initial gain.

9. An audio signal decoding apparatus, comprising:

at least one processor; and

a storage medium storing programming instructions which, when executed by the at least one processor, cause the audio signal decoding apparatus to perform a process of recovering lost frames in an audio signal, and wherein the process comprises;

receiving and decoding a bit stream to obtain the audio signal, wherein the audio signal is transmitted in consecutive frames, and wherein at least one frame of the audio signal is lost;

obtaining an initial high-frequency band signal of a current lost frame of the audio signal;

calculating a ratio R, wherein the ratio R is a ratio of a high frequency excitation energy of a previous frame of the current lost frame to a high frequency excitation energy of the current lost frame;

obtaining a global gain of the current lost frame according to the ratio R and a global gain of the previous frame of the current lost frame;

obtaining a high-frequency band signal of the current lost frame according to the initial high-frequency band signal of the current lost frame and the global gain of the current lost frame;

reconstructing the current lost frame of the audio signal according to the high-frequency band signal of the current lost frame; and

outputting the audio signal including the reconstructed current lost frame.

10. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, wherein G is the global gain of the previous frame of the current lost frame, wherein α

is a weighting factor, and wherein α

is greater than or equal to 0 and smaller than 1.

11. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, wherein G is the initial gain, wherein α

is a weighting factor, and wherein α

is greater than or equal to 0 and smaller than 1.

12. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

one of;

if the ratio R is greater than two times of the initial gain and less than or equal to four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

if the ratio R is greater than four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or

if the ratio R is less than or equal to two times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and wherein G is the initial gain.

13. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises one of:

if the ratio R is greater than two times and less than or equal to four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

if the ratio R is greater than four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or

if the ratio R is less than or equal to two times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and wherein G is the global gain of the previous frame.

14. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=min((0.5×

R+0.5×

G),4×

G),

where G′

is the global gain of the current lost frame, and wherein G is the global gain of the previous frame of the current lost frame.

15. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min((0.5×

R+0.5×

G),4×

G),

where G′

is the global gain of the current lost frame, and wherein G is the initial gain.

16. The apparatus according to claim 9, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame of the current lost frame comprises:

obtaining an initial gain according to the global gain of the previous frame of the current lost frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min((0.8×

R+0.2×

G),4×

G),

where G′

is the global gain of the current lost frame, and wherein G is the initial gain.