Audio coding system using spectral hole filling

• US 7,447,631 B2
• Filed: 06/17/2002
• Issued: 11/04/2008
• Est. Priority Date: 06/17/2002
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Truman, Michael Mead, Vinton, Mark Stuart, Robinson, Charles Quito, Davidson, Grant Allen, Fellers, Matthew Conrad, Watson, Matthew Aubrey
• Primary Examiner(s): Wozniak; James S
• Application Number:
  US10/174,493
• Publication Number:
  US 20030233234A1
• Time in Patent Office: 2,332 Days
• Field of Search: 704/200.1, 704/205, 704/211, 704/258, 704/262, 704/267, 704/268, 704/500, 704224-225, 704229-230
• US Class Current: 704/230
• CPC Class Codes: G10L 19/035 Scalar quantisation
• CPC Class Codes: G10L 21/038 using band spreading techniques

Abstract

Audio coding processes like quantization can cause spectral components of an encoded audio signal to be set to zero, creating spectral holes in the signal. These spectral holes can degrade the perceived quality of audio signals that are reproduced by audio coding systems. An improved decoder avoids or reduces the degradation by filling the spectral holes with synthesized spectral components. An improved encoder may also be used to realize further improvements in the decoder.

Claims

1. A method for generating audio information, wherein the method comprises:

receiving an input signal and obtaining therefrom a set of subband signals each having one or more spectral components representing spectral content of an audio signal;

identifying within the set of subband signals a particular subband signal in which one or more spectral components have a non-zero value and in which one or more of the spectral components have a zero value;

deriving a scaling envelope from the one or more spectral components that have non-zero values, wherein the scaling envelope varies at a rate substantially equal to a rate of roll off of spectral leakage between adjacent subband signals of a synthesis filterbank;

generating one or more synthesized spectral components that correspond to zero-valued spectral components in the particular subband signal and that are scaled according to the scaling envelope;

generating a modified set of subband signals by substituting the synthesized spectral components for corresponding zero-valued spectral components in the particular subband signal; and

generating the audio information by applying the synthesis filterbank to the modified set of subband signals.

2. The method of claim 1 wherein the synthesis filterbank is implemented by a block transform and the method comprises:

applying a frequency-domain filter to one or more spectral components in the set of subband signals; and

deriving the scaling envelope from an output of the frequency-domain filter.

3. The method of claim 2 that comprises varying a response of the frequency-domain filter us a function of frequency.

4. The method of claim 1 that comprises:

obtaining a measure of tonality of the audio signal represented by the set of subband signals; and

adapting the scaling envelope in response to the measure of tonality.

5. The method of claim 1 that comprises:

obtaining a sequence of sets of subband signals from the input signal;

identifying a common subband signal in the sequence of sets of subband signals where one or more spectral components have a zero value;

scaling the one or more synthesized spectral components that correspond to the one or more zero-valued spectral components according to the scaling envelope, wherein the scaling envelope extends from set to set in the sequence;

generating a sequence of modified sets of subband signals by substituting the synthesized spectral components for the corresponding zero-valued spectral components in the sets; and

generating the audio information by applying the synthesis filterbank to the sequence of modified sets of subband signals.

6. The method of claim 1 wherein the synthesized spectral components are generated by spectral translation of other spectral components in the set of subband signals.

7. The method of claim 1 wherein the scaling envelope varies according to human auditory temporal masking characteristics.

8. The method according to claim 1 that obtains scaling control information from the input signal, wherein values of the synthesized components are scaled also in response to the scaling control information.

9. An apparatus for generating audio information, wherein the apparatus comprises:

a deformatter that receives an input signal and obtains therefrom a sec of subband signals each having one or more spectral components representing spectral content of an audio signal;

a decoder coupled to the deformatter that identifies within the set of subband signals a particular subband signal in which one or more spectral components have a non-zero value and in which one or more of the spectral components have a zero value, that derives a scaling envelope from the one or more spectral components that have non-zero values, wherein the scaling envelope varies at a rate substantially equal to a rate of roll off of spectral leakage between adjacent subband signals of a synthesis filterbank, that generates one or more synthesized spectral components that correspond to zero-valued spectral components in the particular subband signal and are scaled according to the scaling envelope, and that generates a modified set of subband signals by substituting the synthesized spectral components for corresponding zero-valued spectral components in the particular subband signal; and

the synthesis filterbank coupled to the decoder that generates the audio information in response to the modified set of subband signals.

10. The apparatus of claim 9 wherein the synthesis filterbank is implemented by a block transform and the decoder:

applies a frequency-domain filter to one or more spectral components in the set of subband signals; and

derives the scaling envelope from an output of the frequency-domain filter.

11. The apparatus of claim 10 wherein the decoder varies a response of the frequency-domain filter as a function of frequency.

12. The apparatus of claim 9 wherein the decoder:

obtains a measure of tonality of the audio signal represented by the set of subband signals; and

adapts the scaling envelope in response to the measure of tonality.

13. The apparatus of claim 9 wherein:

the deformatter obtains a sequence of sets of subband signals from the input signal;

the decoder identifies a common subband signal in the sequence of sets of subband signals where one or more spectral components have a zero value, scales the one or more synthesized spectral components that correspond to the one or more zero-valued spectral components according to the scaling envelope, wherein the scaling envelope extends from set to set in the sequence; and

generates a sequence of modified sets of subband signals by substituting the synthesized spectral components for the corresponding zero-valued spectral components in the sets; and

the synthesis filterbank generates the audio information in response to the sequence of modified sets of subband signals.

14. The apparatus of claim 9 wherein the synthesized spectral components are generated by spectral translation of other spectral components in the set of subband signals.

15. The apparatus of claim 9 wherein the scaling envelope varies according to human auditory temporal masking characteristics.

16. The apparatus according to claim 9 that obtains scaling control information from the input signal, wherein values of the synthesized components are scaled also in response to the scaling control information.

17. A computer-readable storage medium recording a program of instructions that is readable by a processor for executing the program of instructions to perform a method for generating audio information, wherein the method comprises:

receiving an input signal and obtaining therefrom a set of subband signals each having one or more spectral components representing spectral content of an audio signal;

identifying within the set of subband signals a particular subband signal in which one or more spectral components have a non-zero value and in which one or more of the spectral components have a zero value;

deriving a scaling envelope from the one or more spectral components that have non-zero values, wherein the scaling envelope varies at a rate substantially equal to a rate roll off of spectral leakage between adjacent subband signals of a synthesis filterbank;

generating one or more synthesized spectral components that correspond to zero-valued spectral components in the particular subband signal and that are scaled according to the scaling envelope;

generating a modified set of subband signals by substituting the synthesized spectral components for corresponding zero-valued spectral components in the particular subband signal; and

generating the audio information by applying the synthesis filterbank to the modified set of subband signals.

18. The medium of claim 17 wherein the synthesis filterbank is implemented by a block transform and the method comprises:

applying a frequency-domain filter to one or more spectral components in the set of subband signals; and

deriving the scaling envelope from an output of the frequency-domain filter.

19. The medium of claim 18 wherein the method comprises varying a response of the frequency-domain filter as a function of frequency.

20. The medium of claim 17 wherein the method comprises:

obtaining a measure of tonality of the audio signal represented by the set of subband signals; and

adapting the scaling envelope in response to the measure of tonality.

21. The medium of claim 17 wherein the method comprises:

obtaining a sequence of sets of subband signals from the input signal;

identifying a common subband signal in the sequence of sets of subband signals where one or more spectral components have a zero value;

scaling the one or more synthesized spectral components that correspond to the one or more zero-valued spectral components according to the scaling envelope, wherein the scaling envelope extends from set to set in the sequence;

generating a sequence of modified sets of subband signals by substituting the synthesized spectral components for the corresponding zero-valued spectral components in the sets; and

generating the audio information by applying the synthesis filterbank to the sequence of modified sets of subband signals.

22. The medium of claim 17 wherein the synthesized spectral components are generated by spectral translation of other spectral components in the set of subband signals.

23. The medium of claim 17 wherein the scaling envelope varies according to human auditory temporal masking characteristics.

24. The medium according to claim 17 wherein the method obtains scaling control information from the input signal, wherein values of the synthesized components are scaled also in response to the scaling control information.