Apparatus and method for processing a decoded audio signal in a spectral domain

• US 9,583,110 B2
• Filed: 08/14/2013
• Issued: 02/28/2017
• Est. Priority Date: 02/14/2011
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Fuchs, Guillaume, Geiger, Ralf, Schnell, Markus, Ravelli, Emmanuel, Doehla, Stefan
• Primary Examiner(s): Neway, Samuel G
• Application Number:
  US13/966,570
• Publication Number:
  US 20130332151A1
• Time in Patent Office: 1,294 Days
• US Class Current: 1/1
• CPC Class Codes: G10K 11/16 Methods or devices for protecting against, or for damping, noise or other acoustic waves in general G10K11/36 takes precedence
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm
• CPC Class Codes: G10L 19/012 Comfort noise or silence coding
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/022 Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
• CPC Class Codes: G10L 19/025 Detection of transients or attacks for time/frequency resolution switching
• CPC Class Codes: G10L 19/03 Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: G10L 19/107 Sparse pulse excitation, e.g. by using algebraic codebook
• CPC Class Codes: G10L 19/12 the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
• CPC Class Codes: G10L 19/18 Vocoders using multiple modes
• CPC Class Codes: G10L 19/22 Mode decision, i.e. based on audio signal content versus external parameters
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: G10L 25/06 the extracted parameters being correlation coefficients
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

An apparatus for processing a decoded audio signal including a filter for filtering the decoded audio signal to obtain a filtered audio signal, a time-spectral converter stage for converting the decoded audio signal and the filtered audio signal into corresponding spectral representations, each spectral representation having a plurality of subband signals, a weighter for performing a frequency selective weighting of the filtered audio signal by a multiplying subband signals by respective weighting coefficients to obtain a weighted filtered audio signal, a subtractor for performing a subband-wise subtraction between the weighted filtered audio signal and the spectral representation of the decoded audio signal, and a spectral-time converter for converting the result audio signal or a signal derived from the result audio signal into a time domain representation to obtain a processed decoded audio signal.

Claims

1. Apparatus for processing a decoded audio signal, comprising:

a filter for filtering the decoded audio signal to acquire a filtered audio signal;

a time-spectral converter stage for converting the decoded audio signal and the filtered audio signal into corresponding spectral representations, each spectral representation comprising a plurality of subband signals;

a weighter for performing a frequency selective weighting of the spectral representation of the filtered audio signal by multiplying subband signals by respective weighting coefficients to acquire a weighted filtered audio signal;

a subtractor for performing a subband-wise subtraction between the weighted filtered audio signal and the spectral representation of the decoded audio signal to acquire a result audio signal; and

a spectral-time converter for converting the result audio signal or a signal derived from the result audio signal into a time domain representation to acquire a processed decoded audio signal.

2. Apparatus according to claim 1, further comprising a bandwidth enhancement decoder or a mono-stereo or a mono-multichannel decoder to calculate the signal derived from the result audio signal,

wherein the spectral-time converter is configured for not converting the result audio signal but the signal derived from the result audio signal into the time domain so that all processing by the bandwidth enhancement decoder or the mono-stereo or mono-multichannel decoder is performed in the same spectral domain as defined by the time-spectral converter stage.

3. Apparatus according to claim 1,

wherein the decoded audio signal is an ACELP-decoded output signal, and

wherein the filter is a long term prediction filter controlled by pitch information.

4. Apparatus according to claim 1,

wherein the weighter is configured for weighting the filtered audio signal so that lower frequency subbands are less attenuated or not attenuated than higher frequency subbands so that the frequency-selective weighting impresses a low pass characteristic to the filtered audio signal.

5. Apparatus according to claim 1,

wherein the time-spectral converter stage and the spectral-time converter are configured to implement a QMF analysis filterbank and a QMF synthesis filterbank, respectively.

6. Apparatus according to claim 1,

wherein the subtractor is configured for subtracting a subband signal of the weighted filtered audio signal from the corresponding subband signal of the audio signal to acquire a subband of the result audio signal, the subbands belonging to the same filterbank channel.

7. Apparatus according to claim 1,

wherein the filter is configured to perform a weighted combination of the decoded audio signal and at least the decoded audio signal shifted in time by a pitch period.

8. Apparatus according to claim 7,

wherein the filter is configured for performing the weighted combination by only combining the decoded audio signal and the decoded audio signal existing at earlier time instants.

9. Apparatus according to claim 1,

wherein the spectral-time converter comprises a different number of input channels with respect to the time-spectral converter stage so that a sample-rate conversion is acquired, wherein an upsampling is acquired, when the number of input channels into the spectral-time converter is higher than the number of output channels of the time-spectral converter stage and wherein a downsampling is performed, when the number of input channels into the spectral-time converter is smaller than the number of output channels from the time-spectral converter stage.

10. Apparatus according to claim 1, further comprising:

a first decoder for providing the decoded audio signal in a first time portion;

a second decoder for providing a further decoded audio signal in a different second time portion;

a first processing branch connected to the first decoder and the second decoder;

a second processing branch connected to the first decoder and the second decoder,

wherein the second processing branch comprises the filter and the weighter and, additionally, comprises a controllable gain stage and a controller, wherein the controller is configured for setting a gain of the gain stage to a first value for the first time portion and to a second value or to zero for the second time portion, which is lower than the first value.

11. Apparatus according to claim 1, further comprising a pitch tracker for providing a pitch lag and for setting the filter based on the pitch lag as the pitch information.

12. Apparatus according to claim 10, wherein the first decoder is configured for providing the pitch information or a part of the pitch information for setting the filter.

13. Apparatus according to claim 10, wherein an output of the first processing branch and an output of the second processing branch are connected to inputs of the subtractor.

14. Apparatus according to claim 1, wherein the decoded audio signal is provided by an ACELP decoder comprised in the apparatus, and

wherein the apparatus further comprises a further decoder implemented as a TCX decoder.

15. Method of processing a decoded audio signal, comprising:

filtering the decoded audio signal to acquire a filtered audio signal;

converting the decoded audio signal and the filtered audio signal into corresponding spectral representations, each spectral representation comprising a plurality of subband signals;

performing a frequency selective weighting of the filtered audio signal by multiplying subband signals by respective weighting coefficients to acquire a weighted filtered audio signal;

performing a subband-wise subtraction between the weighted filtered audio signal and the spectral representation of the decoded audio signal to acquire a result audio signal; and

converting the result audio signal or a signal derived from the result audio signal into a time domain representation to acquire a processed decoded audio signal.

16. A non-transitory computer-readable medium comprising a computer program which comprises a program code for performing, when running on a computer, the method of processing a decoded audio signal according to claim 15.