Audio encoding using adaptive codebook application ranges

• US 9,361,894 B2
• Filed: 05/15/2013
• Issued: 06/07/2016
• Est. Priority Date: 09/17/2004
• Status: Active Grant

• Current Assignee: Digital Rise Technology Co., Ltd.
• Original Assignee: Digital Rise Technology Co., Ltd.
• Inventors: You, Yuli
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US13/895,256
• Publication Number:
  US 20130253938A1
• Time in Patent Office: 1,119 Days
• Field of Search: 704/200, 704/201, 704/211, 704/212, 704/222, 704/229, 704/230, 704/500, 704/503, 375/240.22, 375/240, 375/240.25
• US Class Current: 1/1
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/0208 Subband vocoders
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/025 Detection of transients or attacks for time/frequency resolution switching
• CPC Class Codes: G10L 19/035 Scalar quantisation
• CPC Class Codes: G10L 19/038 Vector quantisation, e.g. TwinVQ audio
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Abstract

A low bit rate digital audio coding system includes an encoder which assigns codebooks to groups of quantization indexes based on their local properties resulting in codebook application ranges that are independent of block quantization boundaries. The invention also incorporates a resolution filter bank, or a tri-mode resolution filter bank, which is selectively switchable between high and low frequency resolution modes or high, low and intermediate modes such as when detecting transient in a frame. The result is a multichannel audio signal having a significantly lower bit rate for efficient transmission or storage. The decoder is essentially an inverse of the structure and methods of the encoder, and results in a reproduced audio signal that cannot be audibly distinguished from the original signal.

Claims

1. A method of encoding a digital audio signal, comprising:

processing input samples of the digital audio signal by using an analysis filter bank so as to transform the input audio samples into subband samples that represent the audio signal in a frequency domain;

creating quantization indexes by quantizing the subband samples;

dividing the quantization indexes into granules, each containing a plurality of quantization indexes;

assigning codebooks to individual granules, with each range of contiguous granules that have the same codebook index being an application range for said codebook;

replacing codebooks assigned to identified application ranges with the codebook assigned to an immediate neighbor application range, thereby expanding the application ranges of said immediate neighbor codebooks;

encoding the quantization indexes using the codebooks applicable within the respective application ranges, including changes made in said replacing step;

creating an encoded data stream, including the encoded quantization indexes, indexes for the codebooks and the respective codebook application ranges; and

at least one of storing or transmitting the encoded data stream.

2. The method of claim 1, wherein the processing step includes a step of using a variable-resolution filter bank, selectively switchable between high and low frequency resolution modes.

3. The method of claim 2, wherein the processing step also includes a step of detecting transients, wherein when no transient is detected the high frequency resolution mode is used, and wherein when a transient is detected the variable-resolution filter bank is switched to the low frequency resolution mode.

4. The method of claim 3, wherein upon switching the variable-resolution filter bank to the low frequency resolution mode, subband samples are segmented into stationary segments.

5. The method of claim 4, further including a step of applying to corresponding subband samples in individual ones of the stationary segments an arbitrary resolution filter bank or adaptive differential pulse code modulation (ADPCM).

6. The method of claim 5, wherein the variable-resolution filter bank is configured to include a long window that is capable of bridging a transition from a short window immediately to another short window so as to handle transients that are spaced apart by only a single long window.

7. The method of claim 1, wherein the processing step includes a step of using a variable-resolution filter bank, selectively switchable between high, low and intermediate frequency resolution modes, such that multiple resolutions can be applied in a single frame when a transient is detected.

8. The method of claim 1, wherein the creating quantization indexes step includes a step of using a step size supplied by a bit allocator that allocates bit resources into groups of subband samples such that the quantization noise power is below a masking threshold.

9. The method of claim 1, further including a step of rearranging quantization indexes when a transient is present in a frame to reduce the total number of bits.

10. The method of claim 1, further including a step of using a run-length encoder to encode application boundaries of the entropy codebooks.

11. The method of claim 1, further including a step of applying a transient segmentation algorithm when a transient is detected.

12. The method of claim 1, wherein the creating an encoded data stream step is performed using a multiplexer.

13. The method of claim 1, wherein the codebook application ranges are independent of block quantization boundaries that define different quantization units, and wherein all subband samples within any given quantization unit are quantized using the same step size.

14. The method of claim 1, wherein the codebook application ranges are based solely on the quantization indexes.

15. The method of claim 1, further comprising a step of encoding the codebook indexes and their respective codebook application ranges prior to including them within the encoded data stream.

16. The method of claim 1, wherein the processing step includes processing across input channels.

17. The method of claim 16, wherein the processing across input channels includes generating a sum channel and a difference channel from left and right input channels.

18. A non-transitory computer-readable medium storing computer-executable process steps for encoding a digital audio signal, said process steps comprising steps for:

processing input samples of the digital audio signal by using an analysis filter bank so as to transform the input audio samples into subband samples that represent the audio signal in a frequency domain;

creating quantization indexes by quantizing the subband samples;

dividing the quantization indexes into granules, each containing a plurality of quantization indexes;

assigning codebooks to individual granules, with each range of contiguous granules that have the same codebook index being an application range for said codebook;

replacing codebooks assigned to identified application ranges with the codebook assigned to an immediate neighbor application range, thereby expanding the application ranges of said immediate neighbor codebooks;

encoding the quantization indexes using the codebooks applicable within the respective application ranges, including changes made in said replacing step;

creating an encoded data stream, including the encoded quantization indexes, indexes for the codebooks and the respective codebook application ranges; and

at least one of storing or transmitting the encoded data stream.

19. An apparatus for encoding a digital audio signal, comprising:

means for processing input samples of the digital audio signal by using an analysis filter bank so as to transform the input audio samples into subband samples that represent the audio signal in a frequency domain;

means for creating quantization indexes by quantizing the subband samples;

means for dividing the quantization indexes into granules, each containing a plurality of quantization indexes;

means for assigning codebooks to individual granules, with each range of contiguous granules that have the same codebook index being an application range for said codebook;

means for replacing codebooks assigned to identified application ranges with the codebook assigned to an immediate neighbor application range, thereby expanding the application ranges of said immediate neighbor codebooks;

means for encoding the quantization indexes using the codebooks applicable within the respective application ranges, including changes made by said means for replacing;

means for creating an encoded data stream, including the encoded quantization indexes, indexes for the codebooks and the respective codebook application ranges; and

means for at least one of storing or transmitting the encoded data stream.