Systems and methods of communicating redundant frame information

• US 10,614,816 B2
• Filed: 10/08/2014
• Issued: 04/07/2020
• Est. Priority Date: 10/11/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Atti, Venkatraman S., Rajendran, Vivek, Krishnan, Venkatesh
• Primary Examiner(s): Hang, Vu B
• Application Number:
  US14/509,817
• Publication Number:
  US 20150106106A1
• Time in Patent Office: 2,008 Days
• CPC Class Codes: G10L 19/0017 Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error G10L19/24 takes precedence
• CPC Class Codes: G10L 19/002 Dynamic bit allocation for perceptual audio coders G10L19/032
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 2019/0001 Codebooks
• CPC Class Codes: H04L 1/0014 by adapting the source coding
• CPC Class Codes: H04L 1/0075 Transmission of coding parameters to receiver H04L1/0023 takes precedence
• CPC Class Codes: H04L 1/08 by repeating transmission, e.g. Verdan system H04L1/1858 and H04L1/189 take precedence

Abstract

A method includes receiving a second audio frame at a decoder. The second audio frame follows a first audio frame in an audio signal and includes a first number of bits allocated to primary coding information associated with the second audio frame, a second number of bits allocated to redundant coding information associated with the first audio frame, and an indicator of a frame type of the first audio frame. In response to a frame erasure condition associated with the first audio frame, the second number of bits is determined based on the indicator and used to decode the first audio frame. In clean channel conditions, the first audio frame is received and decoded based on primary coding bits in the first audio frame, and the first number of bits is determined based on the indicator and used to decode the second audio frame.

Claims

1. A method of decoding a frame, the method comprising:

receiving a second audio frame at a decoder of a computing device, wherein the second audio frame follows a first audio frame in an audio signal, wherein the second audio frame includes a first number of bits allocated to primary coding information associated with the second audio frame, a second number of bits allocated to redundant coding information associated with the first audio frame, and an indicator of a frame type of the first audio frame, wherein the redundant coding information includes a high-band line spectral pair (LSP) indicator associated with high-band LSPs of the first audio frame, and wherein the high-band LSP indicator includes one or more bits having a particular value that indicates a particular operation for the decoder to perform to generate the high-band LSPs of the first audio frame;

in response to a frame erasure condition associated with the first audio frame, determining, based on the indicator at the decoder of the computing device, the second number of bits of the second audio frame that are allocated to the redundant coding information associated with the first audio frame; and

synthesizing, at the decoder of the computing device, a signal corresponding to the first audio frame based on the redundant coding information.

2. The method of claim 1, further comprising decoding the second audio frame based on the primary coding information, wherein synthesizing the signal corresponding to the first audio frame based on the redundant coding information and decoding the second audio frame based on the primary coding information are performed at a single decoding path of the decoder.

3. The method of claim 1, further comprising retrieving the redundant coding information from the second audio frame based on the second number of bits.

4. The method of claim 1, wherein the frame erasure condition corresponds to a determination that the decoder is unable to decode at least a portion of the first audio frame or that the computing device did not receive the portion of the first audio frame, and wherein synthesizing the signal includes regenerating the portion of the first audio frame at the computing device based on the redundant coding information.

5. The method of claim 1, wherein the primary coding information includes an encoded low-band core of the second audio frame and high-band parameters of the second audio frame.

6. The method of claim 1, wherein the redundant coding information also includes a gain shape indicator associated with a high-band gain shape of the first audio frame, the method further comprising, in response to determining that the gain shape indicator has a first value, using a high-band gain shape of the second audio frame as an estimation of the high-band gain shape of the first audio frame.

7. The method of claim 1, wherein the redundant coding information also includes a gain shape indicator associated with a high-band gain shape of the first audio frame, the method further comprising, in response to determining that the gain shape indicator has a second value, using a constant gain shape as an estimation of the high-band gain shape of the first audio frame.

8. The method of claim 1, wherein the redundant coding information also includes a high-band gain frame indicator associated with a high-band gain frame of the first audio frame, and wherein the high-band gain frame indicator represents a codebook index.

9. The method of claim 1, wherein the redundant coding information also includes a high-band gain frame indicator associated with a high-band gain frame of the first audio frame, and wherein the high-band gain frame indicator indicates whether the high-band gain frame of the first audio frame corresponds to a codebook index in a first portion of a codebook corresponding to high codebook indexes or in a second portion of the codebook corresponding to low codebook indexes.

10. The method of claim 1, further comprising, in response to determining that the one or more bits of the high-band LSP indicator indicate a first value, using high-band LSPs of the second audio frame as an estimation of the high-band LSPs of the first audio frame.

11. The method of claim 1, further comprising, in response to determining that the one or more bits of the high-band LSP indicator indicate a second value, determining an estimation of the high-band LSPs of the first audio frame based on:

interpolation of high-band LSPs of the second audio frame and high-band LSPs of at least one audio frame that precedes the first audio frame;

or

extrapolation of high-band LSPs of a plurality of audio frames that precede the first audio frame.

12. The method of claim 1, wherein the one or more bits of the high-band LSP indicator indicate a difference between the high-band LSPs of the first audio frame and high-band LSPs of the second audio frame.

33. The method of claim 1, wherein the second frame is separated from the first frame by a frame offset, the frame offset corresponding to a positive integer that is greater than zero, and wherein the frame offset is selected by an encoder based on a network condition associated with a network used to receive the second frame.

35. The method of claim 1, wherein the second audio frame further includes high-band LSPs associated with the second audio frame, and wherein the high-band LSP indicator is distinct from the high-band LSPs of the first audio frame and the high-band LSPs of the second audio frame.

36. The method of claim 1, wherein the redundant coding information also includes:

a gain shape indicator associated with a high-band gain shape of the first audio frame, and a high-band gain frame indicator associated with a high-band gain frame of the first audio frame.

13. An apparatus comprising:

a receiver configured to receive a second audio frame that follows a first audio frame in an audio signal, wherein the second audio frame includes a first number of bits allocated to primary coding information associated with the second audio frame, a second number of bits allocated to redundant coding information associated with the first audio frame, high-band line spectral pairs (LSPs) associated with the second audio frame, and an indicator of a frame type of the first audio frame, wherein the redundant coding information includes one or more of a gain shape indicator associated with a high-band gain shape of the first audio frame, a high-band gain frame indicator associated with a high-band gain frame of the first audio frame, or a high-band line spectral pair (LSP) indicator associated with high-band LSPs of the first audio frame, and wherein the high-band LSP indicator is distinct from the high-band LSPs of the first audio frame and the high-band LSPs of the second audio frame; and

a decoder configured to;

in response to a frame erasure condition associated with the first audio frame, determine, based on the indicator, the second number of bits of the second audio frame that are allocated to the redundant coding information associated with the first audio frame; and

synthesize a signal corresponding to the first audio frame based on the redundant coding information.

14. The apparatus of claim 13, wherein the decoder comprises a single decoding path configured to decode the primary coding information associated with the second audio frame and the redundant coding information associated with the first audio frame.

15. The apparatus of claim 13, further comprising a de-jitter buffer configured to store audio frames received by the receiver.

19. The apparatus of claim 13, wherein the frame erasure condition corresponds to a determination that the decoder is unable to decode at least a portion of the first audio frame or that the receiver did not receive the portion of the first audio frame.

20. The apparatus of claim 13, wherein the decoder is further configured to, in response to determining that the gain shape indicator has a first value, synthesize the signal corresponding to the first audio frame using a high-band gain shape of the second audio frame as an estimation of the high-band gain shape of the first audio frame.

21. The apparatus of claim 20, wherein the decoder is further configured to, in response to determining that the gain shape indicator has a second value, synthesize the signal corresponding to the first audio frame using a constant gain shape as the estimation of the high-band gain shape of the first audio frame.

22. The apparatus of claim 13, wherein the high-band gain frame indicator represents a codebook index.

23. The apparatus of claim 13, wherein the high-band gain frame indicator indicates whether the high-band gain frame of the first audio frame corresponds to a codebook index in a first portion of a codebook corresponding to high codebook indexes or in a second portion of the codebook corresponding to low codebook indexes.

24. The apparatus of claim 13, wherein the decoder is further configured to, in response to determining that the high-band LSP indicator has a first value, use high-band LSPs of the second audio frame as an estimation of the high-band LSPs of the first audio frame.

25. The apparatus of claim 24, wherein the decoder is further configured to, in response to determining that the high-band LSP indicator has a second value, determine the estimation of the high-band LSPs of the first audio frame based on:

interpolation of the high-band LSPs of the second audio frame and high-band LSPs of at least one audio frame that precedes the first audio frame;

or

extrapolation of high-band LSPs of a plurality of audio frames that precede the first audio frame.

26. The apparatus of claim 24, wherein the high-band LSP indicator indicates a difference between the high-band LSPs of the first audio frame and the high-band LSPs of the second audio frame.

27. The apparatus of claim 13, further comprising an antenna coupled to the receiver and configured to receive a signal that includes the first audio frame and the second audio frame.

28. The apparatus of claim 27, further comprising a mobile device, wherein the decoder, the receiver, and the antenna are integrated into the mobile device.

34. The apparatus of claim 13, wherein the high-band LSP indicator includes one or more bits having a particular value that indicates a particular operation for the decoder to perform to generate the high-band LSPs of the first audio frame.

16. A computer-readable storage device comprising instructions to decode a frame, the instructions executable to cause a computer to:

receive a second audio frame at a decoder of a computing device, wherein the second audio frame follows a first audio frame in an audio signal, wherein the second audio frame includes a first number of bits allocated to primary coding information associated with the second audio frame, a second number of bits allocated to redundant coding information associated with the first audio frame, and an indicator of a frame type of the first audio frame, and wherein the redundant coding information includes a gain shape indicator associated with a high-band gain shape of the first audio frame, a high-band gain frame indicator associated with a high-band gain frame of the first audio frame, and a high-band line spectral pair (LSP) indicator associated with high-band LSPs of the first audio frame;

in response to a frame erasure condition associated with the first audio frame, determine, based on the indicator, the second number of bits of the second audio frame that are allocated to the redundant coding information associated with the first audio frame; and

synthesize a signal corresponding to the first audio frame based on the redundant coding information.

17. The computer-readable storage device of claim 16, wherein the instructions are further executable to cause the computer to, in response to determining that the gain shape indicator has a first value, synthesize the signal corresponding to the first audio frame using a high-band gain shape of the second audio frame as an estimation of the high-band gain shape of the first audio frame.

18. The computer-readable storage device of claim 17, wherein the instructions are further executable to cause the computer to, in response to determining that the gain shape indicator has a second value, synthesize the signal corresponding to the first audio frame using a constant gain shape as the estimation of the high-band gain shape of the first audio frame.

29. An apparatus, comprising:

means for receiving a second audio frame, wherein the second audio frame follows a first audio frame in an audio signal, wherein the second audio frame includes a first number of bits allocated to primary coding information associated with the second audio frame, a second number of bits allocated to redundant coding information associated with the first audio frame, high-band line spectral pairs (LSPs) associated with the second audio frame, and an indicator of a frame type of the first audio frame, and wherein the redundant coding information includes one or more of a gain shape indicator associated with a high-band gain shape of the first audio frame, a high-band gain frame indicator associated with a high-band gain frame of the first audio frame, or a high-band line spectral pair (LSP) indicator associated with high-band LSPs of the first audio frame, wherein the high-band LSP indicator is distinct from the high-band LSPs of the first audio frame and the high-band LSPs of the second audio frame; and

means for synthesizing a signal corresponding to the first audio frame based on the redundant coding information and further based on identifying, in response to the indicator, the second number of bits of the second audio frame that are allocated to the redundant coding information associated with the first audio frame.

30. The apparatus of claim 29, wherein the means for receiving and the means for synthesizing are integrated into a mobile device.

31. An apparatus comprising:

a receiver configured to receive a signal associated with a first audio frame and a second audio frame, the second audio frame including a first number of bits allocated to primary coding information associated with the second audio frame, a second number of bits allocated to redundant coding information associated with the first audio frame, and an indicator of a frame type of the first audio frame, wherein the primary coding information includes a second encoded low-band portion of the second audio frame and second high-band parameters of the second audio frame, wherein the redundant coding information includes a high-band line spectral pair (LSP) indicator associated with high-band LSPs of the first audio frame, and wherein the high-band LSP indicator includes one or more bits having a particular value that indicates a particular operation for a decoder to perform to generate the high-band LSPs of the first audio frame; and

the decoder configured to determine, in response to a frame erasure condition associated with the first audio frame and based on the indicator, the second number of bits of the second audio frame that are allocated to the redundant coding information associated with the first audio frame, to synthesize a signal corresponding to the first audio frame by regenerating the first audio frame based on the redundant coding information, and to provide the synthesized signal to a device that includes a speaker.

32. The apparatus of claim 31, wherein the indicator specifies that the first audio frame has an all-predictive frame type, a noise-excited linear prediction frame type, a generic frame type, a no-predictive frame type, or a frame type carrying no redundant coding information.