Sub-band voice codec with multi-stage codebooks and redundant coding

• US 7,734,465 B2
• Filed: 10/09/2007
• Issued: 06/08/2010
• Est. Priority Date: 05/31/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Sun, Xiaoqin, Khalil, Hosam A., Chen, Wei-Ge, Koishida, Kazuhito, Wang, Tian
• Primary Examiner(s): ABEBE, DANIEL DEMELASH
• Application Number:
  US11/973,690
• Publication Number:
  US 20080040121A1
• Time in Patent Office: 973 Days
• Field of Search: 704/219, 704/500, 714/746, 375/243
• US Class Current: 704/219
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/12 the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
• CPC Class Codes: G10L 2019/0005 Multi-stage vector quantisation

Abstract

Techniques and tools related to coding and decoding of audio information are described. For example, redundant coded information for decoding a current frame includes signal history information associated with only a portion of a previous frame. As another example, redundant coded information for decoding a coded unit includes parameters for a codebook stage to be used in decoding the current coded unit only if the previous coded unit is not available. As yet another example, coded audio units each include a field indicating whether the coded unit includes main encoded information representing a segment of an audio signal, and whether the coded unit includes redundant coded information for use in decoding main encoded information.

Claims

1. One or more computer-readable storage media storing computer-executable instructions for performing a method for processing audio data, the method comprising:

at an audio processing tool, processing a bit stream for an audio signal, wherein the bit stream comprises;

main coded information encoded according to a coding technique for a current frame that references a segment of a previous frame to be used in decoding the current frame; and

redundant coded information for decoding the current frame according to the coding technique, the redundant coded information comprising signal history information associated with the referenced segment of the previous frame and selected in order to support decoding of the current frame according to the coding technique with reference to the signal history information; and

outputting a result.

2. The computer-readable storage media of claim 1, wherein the audio processing tool is a real-time speech encoder and the result is encoded speech.

3. The computer-readable storage media of claim 1, wherein the signal history information comprises excitation history for the referenced segment but not excitation history for one or more non-referenced segments of the previous frame.

4. The computer-readable storage media of claim 1, wherein the audio processing tool is a speech decoder, and wherein the processing comprises using the redundant coded information in decoding the current frame whether or not the previous frame is available to the decoder.

5. The computer-readable storage media of claim 1, wherein the audio processing tool is a speech decoder, and wherein the processing comprises using the redundant coded information in decoding the current frame only if the previous frame is not available to the decoder.

6. The computer-readable storage media of claim 1, wherein the signal history information is coded at a quality level set depending at least in part on likelihood of use of the redundant coded information in decoding the current frame.

7. The computer-readable storage media of claim 1, wherein the audio processing tool is a speech decoder, and wherein the processing comprises using the redundant coded information in decoding the previous frame when the previous frame is unavailable to the decoder.

8. One or more computer-readable storage media storing computer-executable instructions for performing a method for processing audio data, the method comprising:

at an audio processing tool, processing a bit stream for an audio signal, wherein the bit stream comprises;

main coded information for a current coded unit that references a segment of a previous coded unit to be used in decoding the current coded unit; and

redundant coded information for decoding the current coded unit, the redundant coded information comprising one or more parameters for one or more extra codebook stages to be used in decoding the current coded unit only if the previous coded unit is not available; and

outputting a result.

9. The computer-readable storage media of claim 8, wherein the main coded information for the current coded unit comprises residual signal parameters representing one or more differences between a reconstruction for the current coded unit and a prediction for the current coded unit.

10. The computer-readable storage media of claim 8, wherein:

the audio processing tool is an audio encoder; and

processing the bit stream comprises generating the redundant coded information, wherein generating the redundant coded information comprises determining the one or more parameters for the one or more extra codebook stages in a closed-loop encoder search that assumes no excitation information for the previous coded unit.

11. The computer-readable storage media of claim 8, wherein:

the audio processing tool is a speech decoder;

if the previous coded unit is not available to the decoder, then the one or more parameters for the one or more extra codebook stages are used by the decoder in decoding the current coded unit; and

if the previous coded unit is available to the decoder, then the one or more parameters for the one or more extra codebook stages are not used by the decoder in decoding the current coded unit.

12. The computer-readable storage media of claim 8, wherein one or more parameters for the one or more extra codebook stages are for a fixed codebook in a fixed codebook stage following an adaptive codebook stage, and wherein the one or more parameters for the one or more extra codebook stages include a codebook index and a gain.

13. The computer-readable storage media of claim 12, wherein one or more parameters for an adaptive codebook in the adaptive codebook stage represent an excitation signal for the current coded unit with reference to excitation history for the previous coded unit, but wherein the one or more parameters for the fixed codebook represent the excitation signal without reference to the excitation history.

14. The computer-readable storage media of claim 8, wherein:

the audio processing tool is an audio decoder; and

processing the bit stream comprises;

if the previous coded unit is not available, then using at least some of the main coded information and the one or more parameters for the one or more extra codebook stages in decoding the current coded unit; and

if the previous coded unit is available, then using the main coded information, but not the one or more parameters for the one or more extra codebook stages, in decoding the current coded unit.

15. A system comprising an audio processing tool configured to process a bit stream for an audio signal comprising a plurality of coded audio units, wherein each coded unit of the plurality of coded units comprises a field indicating:

whether the coded unit comprises main encoded information representing a segment of the audio signal; and

whether the coded unit comprises redundant coded information representing the segment of the audio signal and which can be used in decoding corresponding main encoded information for the segment.

16. The system of claim 15, wherein the field for each coded unit indicates whether the coded unit comprises:

both main encoded information and redundant coded information;

main encoded information, but no redundant coded information;

or

redundant coded information, but no main encoded information.

17. The system of claim 15, wherein the processing includes packetizing at least some of the plurality of coded units, wherein each packetized coded unit that comprises redundant coded information for decoding corresponding main encoded information but that does not comprise the corresponding main encoded information is included in a packet with the corresponding main encoded information.

18. The system of claim 15, wherein the processing includes determining whether redundant coded information in a current coded unit of the plurality of coded units is optional.

19. The system of claim 18, wherein the processing further includes determining whether to packetize the redundant coded information in the current coded unit if the redundant coded information in the current coded unit is optional.

20. The system of claim 15, wherein if a current coded unit of the plurality of coded units comprises redundant coded information, then the field for the current coded unit indicates a classification of the redundant coded information for the current coded unit.