Method and apparatus for recovering lost frames

• US 10,311,885 B2
• Filed: 11/20/2017
• Issued: 06/04/2019
• Est. Priority Date: 06/25/2014
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Wang, Bin, Liu, Zexin, Miao, Lei
• Primary Examiner(s): Yen, Eric
• Application Number:
  US15/817,296
• Publication Number:
  US 20180075853A1
• Time in Patent Office: 561 Days
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/083 the excitation function being an excitation gain G10L25/90 takes precedence
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 2025/932 Decision in previous or following frames
• CPC Class Codes: G10L 21/038 using band spreading techniques
• CPC Class Codes: G10L 21/0388 Details of processing therefor
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

A method for recovering a lost frame in a received audio signal includes: obtaining an initial high-frequency band signal of a current lost frame in the received audio signal; calculating a ratio R, wherein the ratio R is a ratio of a high frequency excitation energy of a previous frame of the current lost frame to a high frequency excitation energy of the current lost frame; obtaining a global gain of the current lost frame according to the ratio R and a global gain of the previous frame of the current lost frame; and recovering a high-frequency band signal of the current lost frame according to the initial high-frequency band signal of the current lost frame and the global gain of the current lost frame. The method can be used in an audio signal decoding process for low-loss recovery of lost frames of the audio signal.

Claims

1. A method for recovering lost frames in an audio signal, performed by an audio signal decoder, comprising:

receiving and decoding a bit stream to obtain the audio signal, wherein the audio signal is transmitted in consecutive frames, and at least one frame of the audio signal is lost;

obtaining an initial high-frequency band signal of a current lost frame of the audio signal, wherein the initial high-frequency band signal is obtained according to a global gain, a subframe gain, and an encoding type of a previous frame of the current lost frame;

calculating a ratio R, wherein the ratio R is a ratio of a high frequency excitation energy of the previous frame to a high frequency excitation energy of the current lost frame, wherein the high frequency excitation energy of the current lost frame is obtained according to a low-frequency band signal energy of the current lost frame;

obtaining a global gain of the current lost frame according to the ratio R and the global gain of the previous frame;

obtaining a high-frequency band signal of the current lost frame according to the initial high-frequency band signal of the current lost frame and the global gain of the current lost frame;

reconstructing the current lost frame according to the high-frequency band signal of the current lost frame; and

outputting the audio signal including the reconstructed current lost frame.

2. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, G is the global gain of the previous frame, and α

is a weighting factor,

wherein α

is greater than or equal to 0 and smaller than 1.

3. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, G is the initial gain, and α

is a weighting factor,

wherein α

is greater than or equal to 0 and smaller than 1.

4. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

if the ratio R is greater than two times of the initial gain and less than or equal to four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

or if the ratio R is greater than four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or if the ratio R is less than or equal to two times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and G is the initial gain.

5. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

if the ratio R is greater than two times and less than or equal to four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

or if the ratio R is greater than four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or if the ratio R is less than or equal to two times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and G is the global gain of the previous frame of the current lost frame.

6. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=min ((0.5×

R+0.5×

G), 4×

G),

where G′

is the global gain of the current lost frame, and G is the global gain of the previous frame.

7. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min ((0.5×

R+0.5×

G), 4×

G),

where G′

is the global gain of the current lost frame, and G is the initial gain.

8. The method according to claim 1, wherein obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min ((0.8×

R+0.2×

G), 4×

G),

where G′

is the global gain of the current lost frame, and G is the initial gain.

9. An audio signal decoding apparatus, comprising:

a processor, and a storage medium storing programming instructions for execution by the processor,

wherein the programming instructions, when executed by the processor, cause the decoding apparatus to perform a process of recovering lost frames in an audio signal,

wherein the process comprises;

receiving and decoding a bit stream to obtain the audio signal, wherein the audio signal is transmitted in consecutive frames, and at least one frame of the audio signal is lost;

obtaining an initial high-frequency band signal of a current lost frame of the audio signal, wherein the initial high-frequency band signal is obtained according to a global gain, a subframe gain, and an encoding type of a previous frame of the current lost frame;

calculating a ratio R, wherein the ratio R is a ratio of a high frequency excitation energy of the previous frame to a high frequency excitation energy of the current lost frame, wherein the high frequency excitation energy of the current lost frame is obtained according to a low-frequency band signal energy of the current lost frame;

obtaining a global gain of the current lost frame according to the ratio R and the global gain of the previous frame;

obtaining a high-frequency band signal of the current lost frame according to the initial high-frequency band signal of the current lost frame and the global gain of the current lost frame;

reconstructing the current lost frame according to the high-frequency band signal of the current lost frame; and

outputting the audio signal including the reconstructed current lost frame.

10. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, G is the global gain of the previous frame, and α

is a weighting factor,

wherein α

is greater than or equal to 0 and smaller than 1.

11. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=α

×

R+(1−

α

)×

G,

where G′

is the global gain of the current lost frame, G is the initial gain, and α

is a weighting factor,

wherein α

is greater than or equal to 0 and smaller than 1.

12. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

if the ratio R is greater than two times of the initial gain and less than or equal to four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

or if the ratio R is greater than four times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or if the ratio R is less than or equal to two times of the initial gain, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and G is the initial gain.

13. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

if the ratio R is greater than two times and less than or equal to four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.4×

R+0.6×

G;

or if the ratio R is greater than four times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.8×

R+0.2×

G;

or if the ratio R is less than or equal to two times of the global gain of the previous frame, obtaining the global gain of the current lost frame according to the following formula;

G′

=0.2×

R+0.8×

G;

wherein G′

is the global gain of the current lost frame, and G is the global gain of the previous frame.

14. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining the global gain of the current lost frame according to the following formula;

G′

=min ((0.5×

R+0.5×

G), 4×

G),

where G′

is the global gain of the current lost frame, and G is the global gain of the previous frame.

15. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min ((0.5×

R+0.5×

G), 4×

G),

where G′

is the global gain of the current lost frame, and G is the initial gain.

16. The apparatus according to claim 9, wherein the process of obtaining the global gain of the current lost frame according to the ratio R and the global gain of the previous frame comprises:

obtaining an initial gain according to the global gain of the previous frame; and

obtaining the global gain of the current lost frame according to the following formula;

G′

=min ((0.8×

R+0.2×

G), 4×

G),

where G′

is the global gain of the current lost frame, and G is the initial gain.