METHOD AND DEVICE FOR SPECTRAL BAND REPLICATION, AND METHOD AND SYSTEM FOR AUDIO DECODING

• US 20130006644A1
• Filed: 06/30/2011
• Published: 01/03/2013
• Est. Priority Date: 06/30/2011
• Status: Abandoned Application

• Current Assignee: ZTE Corporation
• Original Assignee: ZTE Corporation
• Inventors: Jiang, Dongping, Yuan, Hao, Chen, Guoming, Peng, Ke, Li, Jiali
• Application Number:
  US13/173,085
• Publication Number:
  US 20130006644A1
• Time in Patent Office: Days
• US Class Current: 704/500
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/028 Noise substitution, i.e. substituting non-tonal spectral components by noisy source comfort noise for discontinuous speech transmission G10L19/012
• CPC Class Codes: G10L 21/038 using band spreading techniques

Abstract

The present invention relates to a method and device for spectral band replication, and a method and system for audio decoding, and the method for spectral band replication comprises: A. searching for the position of a certain tone of an audio signal in MDCT frequency domain coefficients; B. according to the tone position, determining a spectral band replication period which is a bandwidth from a 0 frequency point to a frequency point of tone position, and a source frequency segment which is a frequency segment from a frequency point of the 0 frequency point shifting copyband_offset frequency points backwards to a frequency point of the frequency point of the tone position shifting the copyband_offset frequency points backwards, wherein said offset copyband_offset is greater than or equal to 0; and C. according to the spectral band replication period, carrying out spectral band replication on zero bit encoding subbands.

Claims

1. A method for spectral band replication, comprising:

A. searching for a position of a certain tone of an audio signal in MDCT frequency domain coefficients;

B. according to the position of the tone, determining a spectral band replication period and a source frequency segment, this spectral band replication period being a bandwidth from a 0 frequency point to a frequency point of the tone position, and this source frequency segment being a frequency segment from a frequency point of the 0 frequency point shifting copyband_offset frequency points backwards to a frequency point of the frequency point of the tone position shifting the copyband_offset frequency points backwards, wherein said offset copyband_offset is greater than or equal to 0;

C. according to the spectral band replication period, carrying out the spectral band replication on zero bit encoding subbands.

2. The method as claimed in claim 1, wherein in step A, the following method is adopted to search for the position of the certain tone:

taking absolute values or square values of frequency domain coefficients of a first frequency segment and carrying out smoothing filtering; and

according to a result of the smoothing filtering, searching for a position of a maximum extreme value of filtering outputs of the first frequency segment, and taking the position of this maximum extreme value as the position of the certain tone.

3. The method as claimed in claim 2, wherein

an operation formula of taking the absolute values of the frequency domain coefficients of the first frequency segment to carry out the smoothing filtering is as follows:

X_amp_i(k)=μ

X_amp_i-1(k)+(1−

μ

)X_i(k)|

or an operation formula of taking the square values of the frequency domain coefficients of the first frequency segment to carry out the smoothing filtering is as follows;

X_amp_i(k)=μ

X_amp_i-1(k−

1)+(1μ

)X_i(k)²

wherein μ

is a smoothing filtering coefficient, X_amp_i(k) denotes the filtering output of the kth frequency point of the ith frame, and X_i(k) is the MDCT coefficient after decoding of the kth frequency point of the ith frame, and when i=0, X_amp_i-1 (k)=0.

4. The method as claimed in claim 2, wherein said first frequency segment is a frequency segment of low frequencies, of which energy is relatively centralized, determined according to spectrum statistic characteristic, wherein the low frequencies refer to spectrum components less than half of a total bandwidth of a signal.

5. The method as claimed in claim 2, wherein the following method is adopted to determine the maximum extreme value of the filtering outputs:

directly searching for an initial maximum value in filtering outputs of the frequency domain coefficients corresponding to the first frequency segment, and taking this maximum value as the maximum extreme value of the filtering outputs of the first frequency segment.

6. The method as claimed in claim 2, wherein the following method is adopted to determine the maximum extreme value of the filtering outputs:

taking a segment in the first frequency segment as a second frequency segment, and searching for an initial maximum value in the filtering outputs of the frequency domain coefficients corresponding to the second frequency segment, and according to a position of the frequency domain coefficient corresponding to this initial maximum value, carrying out different processes;

a. if this initial maximum value is the filtering output of the frequency domain coefficient of the lowest frequency of the second frequency segment, comparing this filtering output of the frequency domain coefficient of the lowest frequency of the second frequency segment with the filtering output of the frequency domain coefficient of a former lower frequency in the first frequency segment, and comparing forwards in sequence, until the filtering output of a current frequency domain coefficient is greater than the filtering output of a former frequency domain coefficient, then the filtering output of the current frequency domain coefficient being a finally determined maximum extreme value, or, comparing until the filtering output of the frequency domain coefficient of the lowest frequency of the first frequency segment is greater than the filtering output of a latter frequency domain coefficient, then the filtering output of the frequency domain coefficient of the lowest frequency of the first frequency segment being the finally determined maximum extreme value;

b. if this initial maximum value is the filtering output of the frequency domain coefficient of the highest frequency of the second frequency segment, comparing this filtering output of the frequency domain coefficient of the highest frequency of the second frequency segment with the filtering output of the frequency domain coefficient of a latter higher frequency in the first frequency segment, and comparing backwards in sequence, until the filtering output of a current frequency domain coefficient is greater than the filtering output of a latter frequency domain coefficient, then the filtering output of the current frequency domain coefficient being the finally determined maximum extreme value, or, comparing until the filtering output of the frequency domain coefficient of the highest frequency of the first frequency segment is greater than the filtering output of a former frequency domain coefficient, then the filtering output of the frequency domain coefficient of the highest frequency of the first frequency segment being the finally determined maximum extreme value;

c. if this initial maximum value is the filtering output of a frequency domain coefficient between the lowest frequency and the highest frequency in the second frequency segment, then the frequency domain coefficient corresponding to this initial maximum value being the tone position, that is, this initial maximum value being the finally determined maximum extreme value.

7. The method as claimed claim 1, wherein in step C, when the spectral band replication is carried out for a zero bit encoding subband, firstly a source frequency segment replication starting sequence number of this zero bit encoding subband is calculated according to the source frequency segment and a starting sequence number of the zero bit encoding subband which requires the spectral band replication, and then starting from the source frequency segment replication starting sequence number, the frequency domain coefficients of the source frequency segment are periodically replicated to the zero bit encoding subband, with the spectral band replication period being a period.

8. The method as claimed in claim 7, wherein in the step C, a method for calculating the source frequency segment replication starting sequence number of the zero bit encoding subband is:

obtaining a sequence number of a frequency point of a start MDCT frequency domain coefficient of the zero bit encoding subband which requires reconstructing frequency domain coefficients, the sequence number being denoted as fillband_start_freq, and a sequence number of a frequency point corresponding to the tone being denoted as Tonal_pos, the spectral band replication period being denoted as copy_period, of which the value is equal to Tonal_pos plus 1, and a spectral band replication offset being denoted as copyband_offset, subtracting the copy_period from the value of the fillband_start_freq circularly, until this value falls into a value range of the sequence numbers of the source frequency segment, then this value being the source frequency segment replication starting sequence number, which is denoted as copy_pos_mod.

9. The method as claimed in claim 7, wherein in the step C, a method for starting from the source frequency segment replication starting sequence number, replicating the frequency domain coefficients of the source frequency segment periodically to the zero bit encoding subband with the spectral band replication period being a period is:

replicating frequency domain coefficients starting from the source frequency segment replication starting sequence number backwards in sequence to the zero bit encoding subband starting from fillband_start_freq, until a frequency point of the source frequency segment replication reaches a frequency point of Tonal_pos+copyband_offset, continually replicating frequency domain coefficients starting from the copyband_offset th frequency point backwards to the zero bit encoding subband, and so forth, until completing the spectral band replication of all frequency domain coefficients of the current zero bit encoding subband.

10. A device for spectral band replication, comprising:

a tone position searching module, a period and source frequency segment calculating module, a source frequency segment replication starting sequence number calculating module and a spectral band replicating module connected in sequence, wherein

the tone position searching module is for searching for a position of a certain tone of an audio signal in MDCT frequency domain coefficients;

the period and source frequency segment calculating module is for determining a spectral band replication period and a source frequency segment for the replication according to the position of the tone, this spectral band replication period being a bandwidth from a 0 frequency point to a frequency point of the tone position, and said source frequency segment being a frequency segment from a frequency point of the 0 frequency point shifting copyband_offset frequency points backwards to a frequency point of the frequency point of the tone position shifting the copyband_offset frequency points backwards;

the source frequency segment replication starting sequence number calculating module is for calculating a source frequency segment replication starting sequence number of a zero bit encoding subband according to the source frequency segment and a starting sequence number of this zero bit encoding subband which requires the spectral band replication;

said spectral band replicating module is for starting from the source frequency segment replication starting sequence number, periodically replicating frequency domain coefficients of the source frequency segment to the zero bit encoding subband, with the spectral band replication period being a period.

11. The device as claimed in claim 10, wherein said tone position searching module directly searches for an initial maximum value in the filtering outputs of frequency domain coefficients corresponding to the first frequency segment, and takes this maximum value as the maximum extreme value of the filtering outputs of the first frequency segment.

12. The device as claimed in claim 10, wherein when said tone position searching module determines the maximum extreme value of filtering outputs, a segment in the first frequency segment is taken as a second frequency segment, and an initial maximum value is searched in the filtering outputs of the frequency domain coefficients corresponding to the second frequency segment, and according to a position of the frequency domain coefficient corresponding to this initial maximum value, different processes are carried out:

a. if this initial maximum value is the filtering output of the frequency domain coefficient of the lowest frequency of the second frequency segment, comparing this filtering output of the frequency domain coefficient of the lowest frequency of the second frequency segment with the filtering output of the frequency domain coefficient of a former lower frequency in the first frequency segment, and comparing forwards in sequence, until the filtering output of a current frequency domain coefficient is greater than the filtering output of a former frequency domain coefficient, then the filtering output of the current frequency domain coefficient being a finally determined maximum extreme value, or, comparing until the filtering output of the frequency domain coefficient of the lowest frequency of the first frequency segment is greater than the filtering output of a latter frequency domain coefficient, then the filtering output of the frequency domain coefficient of the lowest frequency of the first frequency segment being the finally determined maximum extreme value;

b. if this initial maximum value is the filtering output of the frequency domain coefficient of the highest frequency of the second frequency segment, comparing this filtering output of the frequency domain coefficient of the highest frequency of the second frequency segment with the filtering output of the frequency domain coefficient of a latter higher frequency in the first frequency segment, and comparing backwards in sequence, until the filtering output of a current frequency domain coefficient is greater than the filtering output of a latter frequency domain coefficient, then the filtering output of the current frequency domain coefficient being the finally determined maximum extreme value, or, comparing until the filtering output of the frequency domain coefficient of the highest frequency of the first frequency segment is greater than the filtering output of a former frequency domain coefficient, then the filtering output of the frequency domain coefficient of the highest frequency of the first frequency segment being the finally determined maximum extreme value;

c. if this initial maximum value is the filtering output of a frequency domain coefficient between the lowest frequency and the highest frequency in the second frequency segment, then the frequency domain coefficient corresponding to this initial maximum value being the tone position, that is, this initial maximum value being the finally determined maximum extreme value.

13. The device as claimed in claim 10, wherein

a process of said source frequency segment replication starting sequence number calculating module calculating the source frequency segment replication starting sequence number of the zero bit encoding subband which requires the spectral band replication comprises:

obtaining a sequence number of a start frequency point of the zero bit encoding subband which requires reconstructing frequency domain coefficients currently, the sequence number being denoted as fillband_start_freq, and a sequence number of a frequency point corresponding to the tone being denoted as Tonal_pos, the spectral band replication period being denoted as copy_period, of which the value is equal to Tonal_pos plus 1, and a source frequency segment starting sequence number being denoted as copyband_offset, subtracting the copy_period from the value of the fillband_start_freq circularly, until this value falls into a value range of the sequence numbers of the source frequency segment, then this value being the source frequency segment replication starting sequence number, which is denoted as copy_pos_mod.

14. The device as claimed in claim 10, wherein

when said spectral band replicating module carries out the spectral band replication, frequency domain coefficients starting from the source frequency segment replication starting sequence number are replicated backwards in sequence to the zero bit encoding subband starting from fillband_start_freq, until a frequency point of the source frequency segment replication reaches a frequency point of Tonal_pos+copyband_offset, frequency domain coefficients starting from the copyband_offset th frequency point are continually replicated backwards to the zero bit encoding subband, and so forth, until completing the replication of all frequency domain coefficients of the current zero bit encoding subband.

15. A method for audio decoding, comprising:

A. carrying out decoding and inverse quantization on each amplitude envelop encoded bit in a bit stream to be decoded to obtain an amplitude envelop of each encoding subband;

B. carrying out bit allocation on each encoding subband, and carrying out decoding and inverse quantization on non-zero bit encoding subbands to obtain frequency domain coefficients of the non-zero bit encoding subbands;

C. searching for a position of a certain tone of an audio signal in MDCT frequency domain coefficients, taking a bandwidth from a 0 frequency point to a frequency point of the tone position as a spectral band replication period, taking a frequency segment from a frequency point of the 0 frequency point shifting copyband_offset frequency points backwards to a frequency point of the frequency point of the tone position shifting the copyband_offset frequency points backwards as a source frequency segment, carrying out spectral band replication on zero bit encoding subbands, and according to an amplitude envelop of a current encoding subband, carrying out energy adjustment on the frequency domain coefficients obtained by the replication, and combining noise filling, obtaining reconstructed frequency domain coefficients of the zero bit encoding subband, wherein said offset copyband_offset is greater than or equal to 0;

D. carrying out Inverse Modified Discrete Cosine Transform on frequency domain coefficients of the non-zero bit encoding subbands and reconstructed frequency domain coefficients of the zero bit encoding subbands to obtain a final audio signal.

16. The method as claimed in claim 15, wherein in step C, the following method is adopted to search for the position of the certain tone:

taking absolute values or square values of the frequency domain coefficients of a first frequency segment and carrying out smoothing filtering; and

according to a result of the smoothing filtering, searching for a position of a maximum extreme value of filtering outputs of the first frequency segment, and taking the position of this maximum extreme value as the position of the certain tone.

17. The method as claimed in claim 16, wherein in step C, when the spectral band replication is carried out for a zero bit encoding subband, firstly a source frequency segment replication starting sequence number of this zero bit encoding subband is calculated according to the source frequency segment and a starting sequence number of the zero bit encoding subband which requires spectral band replication, then starting from the source frequency segment replication starting sequence number, frequency domain coefficients of the source frequency segment are periodically replicated to the zero bit encoding subband, with the spectral band replication period being a period.

18. The method as claimed in claim 15, wherein the above method for spectral band replication in combination with a method for noise filling is adopted to carry out spectrum reconstruction for all zero bit encoding subbands, or, a method for random noise filling is adopted to carry out spectrum reconstruction for zero bit encoding subbands below a certain frequency point, and a method for frequency domain coefficient replication in combination with noise filling is adopted to carry out spectrum reconstruction for zero bit encoding subbands above the certain frequency point.

19. A system for audio decoding, comprising:

a bit stream demultiplexer (DeMUX), an amplitude envelop decoding unit, a bit allocating unit, a frequency domain coefficient decoding unit, a spectral band replicating unit, a noise filling unit, and an Inverse Modified Discrete Cosine Transform (IMDCT) unit, wherein

said DeMUX is for separating amplitude envelop encoded bits, frequency domain coefficient encoded bits and noise level encoded bits from a bit stream to be decoded;

said amplitude envelop decoding unit, which is connected with the DeMUX, is for carrying out decoding and inverse quantization for the amplitude envelop encoded bits outputted by said bit stream demultiplexer to obtain an amplitude envelop of each encoding subband;

said bit allocating unit, which is connected with said amplitude envelop decoding unit, is for carrying out bit allocation to obtain the number of encoded bits allocated to each frequency domain coefficient of each encoding subband;

the frequency domain coefficient decoding unit, which is connected with the amplitude envelop decoding unit and the bit allocating unit, is for carrying out decoding, inverse quantization and inverse normalization for encoding subbands to obtain frequency domain coefficients;

said spectral band replicating unit, which is connected with said DeMUX, frequency domain coefficient decoding unit, amplitude envelop decoding unit, and bit allocating unit, is for searching for a position of a certain tone of an audio signal in MDCT frequency domain coefficients, taking a bandwidth from a 0 frequency point to a frequency point of the tone position as a spectral band replication period, taking a frequency segment from a frequency point of the 0 frequency point shifting copyband_offset frequency points backwards to a frequency point of the frequency point of the tone position shifting the copyband_offset frequency points backwards as a source frequency segment, carrying out spectral band replication on zero bit encoding subbands, wherein said offset copyband_offset is greater than or equal to 0; and

is also for according to an amplitude envelop of a current encoding subband, carrying out energy adjustment on the frequency domain coefficients obtained by the replication;

the noise filling unit, which is connected with the amplitude envelop decoding unit, bit allocating unit, and spectral band replicating unit, is for according to the amplitude envelop of the current zero bit encoding subband, filling noise for this encoding subband to obtain reconstructed frequency domain coefficients of the zero bit encoding subband;

the IMDCT unit, which is connected with said noise filling unit, is for carrying out IMDCT on the frequency domain coefficients after the noise filling to obtain an audio signal.

20. The system as claimed in claim 19, wherein said spectral band replicating unit comprises a tone position searching module, a period and source frequency segment calculating module, a source frequency segment replication starting sequence number calculating module and a spectral band replicating module connected in sequence, wherein

the tone position searching module is for searching for a position of a certain tone of an audio signal in the MDCT frequency domain coefficients;

the period and source frequency segment calculating module is for determining a spectral band replication period and a source frequency segment for replication according to the tone position, this spectral band replication period being a bandwidth from a 0 frequency point to a frequency point of the tone position, and said source frequency segment being a frequency segment from a frequency point of the 0 frequency point shifting copyband_offset frequency points backwards to a frequency point of the frequency point of the tone position shifting the copyband_offset frequency points backwards;

the source frequency segment replication starting sequence number calculating module is for calculating a source frequency segment replication starting sequence number of a zero bit encoding subband according to the source frequency segment and a starting sequence number of the zero bit encoding subband which requires the spectral band replication;

said spectral band replicating module is for starting from the source frequency segment replication starting sequence number, periodically replicating frequency domain coefficients of the source frequency segment to the zero bit encoding subband, with the spectral band replication period being a period.

21. The system as claimed in claim 19, wherein said tone position searching module adopts the following method to search for the tone position:

taking absolute values or square values of the MDCT frequency domain coefficients of first frequency segment and carrying out smoothing filtering; and

according to a result of the smoothing filtering, searching for a position of a maximum extreme value of filtering outputs of the first frequency segment, the position of this maximum extreme value being the tone position.

22. The system as claimed in claim 21, wherein when said tone position searching module determines the maximum extreme value of filtering outputs, a segment in the first frequency segment is taken as a second frequency segment, and an initial maximum value is searched in the filtering outputs of the frequency domain coefficients corresponding to the second frequency segment, and according to a position of the frequency domain coefficient corresponding to this initial maximum value, different processes are carried out:

a. if this initial maximum value is the filtering output of the frequency domain coefficient of the lowest frequency of the second frequency segment, comparing this filtering output of the frequency domain coefficient of the lowest frequency of the second frequency segment with the filtering output of the frequency domain coefficient of a former lower frequency in the first frequency segment, and comparing forwards in sequence, until the filtering output of a current frequency domain coefficient is greater than the filtering output of a former frequency domain coefficient, then the filtering output of the current frequency domain coefficient being a finally determined maximum extreme value, or, comparing until the filtering output of the frequency domain coefficient of the lowest frequency of the first frequency segment is greater than the filtering output of a latter frequency domain coefficient, then the filtering output of the frequency domain coefficient of the lowest frequency of the first frequency segment being the finally determined maximum extreme value;

b. if this initial maximum value is the filtering output of the frequency domain coefficient of the highest frequency of the second frequency segment, comparing this filtering output of the frequency domain coefficient of the highest frequency of the second frequency segment with the filtering output of the frequency domain coefficient of a latter higher frequency in the first frequency segment, and comparing backwards in sequence, until the filtering output of the current frequency domain coefficient is greater than the filtering output of a latter frequency domain coefficient, then the filtering output of the current frequency domain coefficient being the finally determined maximum extreme value, or, comparing until the filtering output of the frequency domain coefficient of the highest frequency of the first frequency segment is greater than the filtering output of a former frequency domain coefficient, then the filtering output of the frequency domain coefficient of the highest frequency of the first frequency segment being the finally determined maximum extreme value;

c. if this initial maximum value is the filtering output of a frequency domain coefficient between the lowest frequency and the highest frequency in the second frequency segment, then the frequency domain coefficient corresponding to this initial maximum value being the tone position, that is, this initial maximum value being the finally determined maximum extreme value.

23. The system as claimed in claim 19, wherein a method for frequency domain coefficient replication adopted by said spectral band replicating unit in combination with noise filling adopted by said noise filling unit is used to carry out spectrum reconstruction for all zero bit encoding subbands, or, a method for random noise filling adopted by said noise filling unit is used to carry out spectrum reconstruction for zero bit encoding subbands below a certain frequency point, and the method for the frequency domain coefficient replication adopted by said spectral band replicating unit in combination with noise filling adopted by said noise filling unit is used to carry out spectrum reconstruction for zero bit encoding subbands above the certain frequency point.