Bitstream syntax for multi-process audio decoding

• US 7,885,819 B2
• Filed: 06/29/2007
• Issued: 02/08/2011
• Est. Priority Date: 06/29/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: He, Chao, Chen, Wei-Ge, Koishida, Kazuhito, Mehrotra, Sanjeev
• Primary Examiner(s): Jackson; Jakieda R
• Application Number:
  US11/772,091
• Publication Number:
  US 20090006103A1
• Time in Patent Office: 1,320 Days
• Field of Search: 704/500
• US Class Current: 704/500
• CPC Class Codes: G10L 19/002 Dynamic bit allocation for perceptual audio coders G10L19/032
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/03 Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4
• CPC Class Codes: G10L 19/038 Vector quantisation, e.g. TwinVQ audio
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Abstract

An audio decoder provides a combination of decoding components including components implementing base band decoding, spectral peak decoding, frequency extension decoding and channel extension decoding techniques. The audio decoder decodes a compressed bitstream structured by a bitstream syntax scheme to permit the various decoding components to extract the appropriate parameters for their respective decoding technique.

Claims

1. A method of decoding a compressed audio bitstream containing syntax elements conforming to a bitstream syntax, the bitstream syntax defining a base coding layer and a base plus coding layer for coding a base band spectrum region of audio content, the method comprising:

reading the base plus coding layer of the compressed audio bitstream;

parsing a first syntax element from the base plus coding layer specifying a coding mode of the base plus coding layer from among at least an exclusive mode and an overlay mode;

in case of the exclusive mode, processing coded audio content of the base plus coding layer alone to reconstruct the base band spectrum region portion of an output audio signal;

in case of the overlay mode, processing coded audio content of the base coding layer and the base plus coding layer to reconstruct the base band spectrum region portion of an output audio signal, wherein the coded audio content of the base plus coding layer is combined to fill spectral holes in the coded audio content of the base coding layer; and

playing the output audio signal.

2. The method of claim 1 wherein the coding mode of the base plus coding layer is from among choices further comprising an extend mode, and the method further comprises:

in case of the extend mode, processing coded audio content of the base coding layer and the base plus coding layer to reconstruct portions of an output audio signal comprising the base band spectrum region and an extended spectrum region above an upper bound of the base band spectrum region, wherein the coded audio content of the base plus coding layer is used to fill the extended spectrum region.

3. The method of claim 2 wherein the parameters for the exclusive mode comprise a scale factor, an entropy coding scheme, and tool box set of coding features used in coding the audio content of the base plus coding layer.

4. The method of claim 2 wherein the tool box set of coding features specify a combination of a predictor, interleave period, and shift parameters used in coding the audio content of the base plus coding layer.

5. The method of claim 1 further comprising, in the case of the extend mode:

reading a plurality of syntax elements specifying parameters for processing the coded audio content of the base plus coding layer in the extend mode; and

processing the coded audio content of the base plus coding layer using the parameters.

6. The method of claim 1 further comprising, in the case of the exclusive mode:

reading a plurality of syntax elements specifying parameters for processing the coded audio content of the base plus coding layer in the exclusive mode; and

processing the coded audio content of the base plus coding layer using the parameters.

7. The method of claim 1 further comprising, in the case of the overlay mode:

reading a plurality of syntax elements specifying parameters for processing the coded audio content of the base plus coding layer in the overlay mode; and

processing the coded audio content of the base plus coding layer using the parameters.

8. The method of claim 7 wherein the parameters for the overlay mode comprise a weight factor and power of a coded channel of the audio content in the base plus coding layer.

9. The method of claim 7 wherein the parameters for the overlay mode comprise a hole width, a hole of a coded channel of the audio content in the base plus coding layer.

10. The method of claim 1, wherein the bitstream syntax further defines a base peak coding layer for coding a portion of audio content using a sparse spectral peak coding, the method further comprising:

parsing a plurality of syntax elements from the base peak coding layer specifying parameters used in the sparse spectral peak coding; and

processing coded audio content of the base peak coding layer to reconstruct the portion of audio content in an output audio signal.

11. The method of claim 10 wherein the parameters comprise:

a coded peak type from among at least a choice of no peak data, intra-frame coded peak, and inter-frame coded peak;

in the case of an intra-frame coded peak, a zero run length and subsequent two coefficient levels; and

in the case of an inter-frame coded peak, a shift from a predicted position of the peak and two coefficient levels.

12. The method of claim 1, wherein, the bitstream syntax further defines a frequency extension coding layer for coding a portion of audio content using a frequency extension coding, the method further comprising:

reading the frequency extension coding layer of the compressed audio bitstream;

parsing a plurality of syntax elements from the frequency extension coding layer specifying parameters used in the frequency extension coding, wherein the parameters comprise parameters specifying frequency extension coding using a different transform window size than a base coding layer; and

processing coded audio content of the frequency extension coding layer to reconstruct the portion of audio content in an output audio signal.

13. The method of claim 12 wherein the parameters comprise parameters identifying tiles coded using frequency extension coding with a different transform window size than a based coding layer.

14. The method of claim 12 wherein the parameters comprise dynamic band configuration parameters specifying spectral band locations where frequency extension coding is applied.

15. The method of claim 12 wherein said dynamic band configuration parameters specify start and end positions of spectral bands coded using vector quantization techniques.

16. The method of claim 12 wherein the parameters comprise displacement vector search range, step size for displacement vector quantization, scale factor and codeword modifications.

17. The method of claim 1, wherein the bitstream syntax further defines a channel extension coding layer for coding a portion of audio content using a channel extension coding, the method further comprising:

reading the channel extension coding layer of the compressed audio bitstream;

parsing a plurality of syntax elements from the channel extension coding layer specifying parameters used in the channel extension coding; and

processing coded audio content of the channel extension coding layer to reconstruct the portion of audio content in an output audio signal.

18. The method of claim 17 wherein the parameters comprise a band configuration parameterization, which comprises a number of bands, a size relation among bands, and a starting band of the channel extension coding.

19. The method of claim 17 wherein the parameters comprise reverb control parameters, which comprise a scaling of an effect signal, and filter tap at which the effect signal is generated.

20. The method of claim 17 wherein the parameters comprise channel correlation parameters, which comprise choice of an LMRM parameterization or normalized correlation matrix parameterization from which a channel correlation matrix is derived.

21. The method of claim 17 wherein the parameters to control an automatic scale adjustment.

22. The method of claim 17 wherein the parameters comprise a prediction type from among no prediction, prediction across time and prediction across frequency.

23. The method of claim 17 wherein the parameters comprise a coded channel type from among sum, and difference.