Recovering high frequency band signal of a lost frame in media bitstream according to gain gradient

• US 10,614,817 B2
• Filed: 07/24/2018
• Issued: 04/07/2020
• Est. Priority Date: 07/16/2013
• Status: Active Grant

• Current Assignee: Crystal Clear Codec, LLC
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Wang, Bin, Miao, Lei, Liu, Zexin
• Primary Examiner(s): Roberts, Shaun
• Application Number:
  US16/043,880
• Publication Number:
  US 20180330738A1
• Time in Patent Office: 623 Days
• Field of Search: 704205, 704208, 704500
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/0208 Subband vocoders
• CPC Class Codes: G10L 2025/937 Signal energy in various frequency bands
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

A method for recovering lost frame in a media bitstream, where when a frame loss event occurs, a decoder obtains a synthesized high frequency band signal of a current lost frame, and recovery information related to the current lost frame, determines a global gain gradient of the current lost frame, and determines a global gain of the current lost frame according to the global gain gradient and a global gain of each frame in previous M frames of the current lost frame. A high frequency band signal of the current lost frame is obtained by adjusting the synthesized high frequency band signal of the current lost frame according to the global gain and a subframe gain of the current lost frame. Hence, the method enables natural and smooth transitions of the high frequency band signal between the frames, and attenuates noises in the high frequency band signal.

Claims

1. A method for recovering a lost frame of a media bitstream, comprising:

obtaining a synthesized high frequency band signal of a current lost frame;

obtaining recovery information related to the current lost frame, wherein the recovery information comprises a coding mode of a previous frame and a frame class of a last frame received before the current lost frame;

determining a global gain gradient of the current lost frame according to the recovery information;

determining a global gain of the current lost frame according to the global gain gradient and a global gain of each frame in previous M frames of the current lost frame, wherein M is a positive integer;

determining a subframe gain of the current lost frame; and

adjusting the synthesized high frequency band signal of the current lost frame according to the global gain of the current lost frame and the subframe gain of the current lost frame to obtain a high frequency band signal of the current lost frame.

2. The method of claim 1, wherein the global gain gradient of the current lost frame is determined according to a quantity of continuously lost frames, the coding mode of the previous frame, and the frame class of the last frame received before the current lost frame.

3. The method of claim 2, wherein the global gain gradient of the current lost frame is determined to be one when:

a coding mode of the current lost frame is the same as the coding mode of the previous frame, and the quantity of continuously lost frames is less than or equal to three;

or

a frame class of the current lost frame is the same as the frame class of the last frame received before the current lost frame, and the quantity of continuously lost frames is less than or equal to three.

4. The method of claim 2, wherein the global gain gradient of the current lost frame is determined to be less than or equal to a preset first threshold and greater than zero when it cannot be determined whether a coding mode of the current lost frame is the same as the coding mode of the previous frame or whether a frame class of the current lost frame is the same as the frame class of the last frame received before the frame loss, wherein the last frame received before the current lost frame comprises an unvoiced frame or a voiced frame, and wherein the quantity of continuously lost frames is less than or equal to three.

5. The method of claim 1, wherein the global gain gradient of the current lost frame is determined to be greater than a preset first threshold and smaller than one when the last frame received before the current lost frame comprises an onset frame of a voiced frame, an audio frame, or a silent frame.

6. The method of claim 1, wherein the global gain gradient of the current lost frame is determined to be less than or equal to a preset first threshold and greater than zero when the last frame received before the current lost frame comprises an onset frame of an unvoiced frame.

7. The method of claim 1, wherein the subframe gain gradient of the current lost frame is determined according to a quantity of continuously lost frames, the coding mode of the previous frame, and the frame class of the last frame received before the current lost frame, wherein the subframe gain of the current lost frame is determined according to the subframe gain gradient and a subframe gain of each frame in previous N frames of the current lost frame, wherein N is a positive integer.

8. The method of claim 7, wherein the subframe gain gradient of the current lost frame is determined to be less than or equal to a preset second threshold and greater than zero when it cannot be determined whether a coding mode of the current lost frame is the same as the coding mode of the previous frame or whether a frame class of the current lost frame is the same as the frame class of the last frame received before the current lost frame, the last frame received before the current lost frame comprises an unvoiced frame, and the quantity of continuously lost frames is less than or equal to three.

9. The method of claim 7, wherein the subframe gain gradient of the current lost frame is determined to be greater than a preset second threshold when the last frame received before the current lost frame comprises an onset frame of a voiced frame.

10. A method for recovering a lost frame of a media bitstream, comprising:

obtaining a synthesized high frequency band signal of a current lost frame;

obtaining recovery information related to the current lost frame, wherein the recovery information comprises a coding mode of a previous frame and a frame class of a last frame received before the current lost frame;

determining a subframe gain gradient of the current lost frame according to the recovery information;

determining a subframe gain of the current lost frame according to the subframe gain gradient and a subframe gain of each frame in previous N frames of the current lost frame, wherein N is a positive integer;

determining a global gain of the current lost frame; and

adjusting the synthesized high frequency band signal of the current lost frame according to the subframe gain of the current lost frame and the global gain of the current lost frame to obtain a high frequency band signal of the current lost frame.

11. The method of claim 10, wherein the subframe gain gradient of the current lost frame is determined according to a quantity of continuously lost frames, the coding mode of the previous frame, and the frame class of the last frame received before the current lost frame, and wherein the subframe gain gradient of the current lost frame is determined to be less than or equal to a preset threshold and greater than zero when it cannot be determined whether a coding mode of the current lost frame is the same as the coding mode of the previous frame or whether a frame class of the current lost frame is the same as the frame class of the last frame received before the current lost frame, and the last frame received before the current lost frame comprises an unvoiced frame, and the quantity of continuously lost frames is less than or equal to three.

12. The method of claim 10, wherein the subframe gain gradient of the current lost frame is determined to be greater than a preset threshold when the last frame received before the current lost frame comprises an onset frame of a voiced frame.

13. A decoder, comprising:

a memory storing program codes; and

a processor coupled to the memory, the program codes causing the processor to be configured to;

obtain a synthesized high frequency band signal of a current lost frame;

obtain recovery information related to the current lost frame, wherein the recovery information comprises a coding mode of a previous frame and a frame class of a last frame received before the current lost frame;

determine a global gain gradient of the current lost frame according to the recovery information;

determine a global gain of the current lost frame according to the global gain gradient and a global gain of each frame in previous M frames of the current lost frame, wherein M is a positive integer;

determine a subframe gain of the current lost frame; and

adjust the synthesized high frequency band signal of the current lost frame according to the global gain of the current lost frame and the subframe gain of the current lost frame to obtain a high frequency band signal of the current lost frame.

14. The decoder of claim 13, wherein the global gain gradient of the current lost is determined according to a quantity of continuously lost frames, the coding mode of the previous frame, and the frame class of the last frame received before the current lost frame.

15. The decoder of claim 14, wherein the global gain gradient of the current lost frame is determined to be one when:

a coding mode of the current lost frame is the same as the coding mode of the previous frame, and the quantity of continuously lost frames is less than or equal to three;

or

a frame class of the current lost frame is the same as the frame class of the last frame received before the current lost frame, and the quantity of continuously lost frames is less than or equal to three.

16. The decoder of claim 14, wherein the global gain gradient of the current lost frame is determined to be less than or equal to a preset first threshold and greater than zero when it cannot be determined whether a coding mode of the current lost frame is the same as the coding mode of the previous frame or whether a frame class of the current lost frame is the same as the frame class of the last frame received before the current lost frame, wherein the last frame received before the current lost frame comprises an unvoiced frame or a voiced frame, and wherein the quantity of continuously lost frames is less than or equal to three.

17. The decoder of claim 13, wherein the global gain gradient of the current lost frame is determined to be greater than a preset first threshold and smaller than one when the last frame received before the current lost frame comprises an onset frame of a voiced frame, an audio frame, or a silent frame.

18. The decoder of claim 13, wherein the global gain gradient of the current lost frame is determined to be less than or equal to a preset first threshold and greater than zero when the last frame received before the current lost frame comprising an onset frame of an unvoiced frame.

19. The decoder of claim 13, wherein the subframe gain gradient of the current lost frame is determined according to a quantity of continuously lost frames and the coding mode of the previous frame and the frame class of the last frame received before the current lost frame, wherein the subframe gain of the current lost frame is determined according to the subframe gain gradient and a subframe gain of each frame in previous N frames of the current lost frame, and wherein N is a positive integer.

20. The decoder of claim 19, wherein the subframe gain gradient of the current lost frame is determined to be less than or equal to a preset second threshold and greater than zero when it cannot be determined whether a coding mode of the current lost frame is the same as the coding mode of the previous frame or whether a frame class of the current lost frame is the same as the frame class of the last frame received before the current lost frame, the last frame received before the current lost frame comprises an unvoiced frame, and the quantity of continuously lost frames is less than or equal to three.

21. The decoder of claim 19, wherein the subframe gain gradient of the current lost frame is determined to be greater than a preset second threshold when the last frame received before the current lost frame comprises an onset frame of an unvoiced frame.

22. A decoder, comprising:

a memory storing program codes; and

a processor coupled to the memory, the program codes causing the processor to be configured to;

obtain a synthesized high frequency band signal of a current lost frame;

obtain recovery information related to the current lost frame, wherein the recovery information comprises a coding mode of a previous frame and a frame class of a last frame received before the current lost frame;

determine a subframe gain gradient of the current lost frame according to the recovery information;

determine a subframe gain of the current lost frame according to the subframe gain gradient and a subframe gain of each frame in previous N frames of the current lost frame, wherein N is a positive integer;

determine a global gain of the current lost frame; and

adjust the synthesized high frequency band signal of the current lost frame according to the subframe gain of the current lost frame and the global gain of the current lost frame to obtain a high frequency band signal of the current lost frame.