Adaptive time and/or frequency-based encoding mode determination apparatus and method of determining encoding mode of the apparatus

• US 8,744,841 B2
• Filed: 09/21/2006
• Issued: 06/03/2014
• Est. Priority Date: 01/24/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Oh, Eun Mi, Choo, Ki Hyun, Kim, Jung-Hoe, Son, Chang Yong
• Primary Examiner(s): Saint Cyr, Leonard
• Application Number:
  US11/524,274
• Publication Number:
  US 20070174051A1
• Time in Patent Office: 2,812 Days
• Field of Search: None
• US Class Current: 704/201
• CPC Class Codes: G10L 19/0208 Subband vocoders
• CPC Class Codes: G10L 19/22 Mode decision, i.e. based on audio signal content versus external parameters

Abstract

An adaptive time/frequency-based encoding mode determination apparatus including a time domain feature extraction unit to generate a time domain feature by analysis of a time domain signal of an input audio signal, a frequency domain feature extraction unit to generate a frequency domain feature corresponding to each frequency band generated by division of a frequency domain corresponding to a frame of the input audio signal into a plurality of frequency domains, by analysis of a frequency domain signal of the input audio signal, and a mode determination unit to determine any one of a time-based encoding mode and a frequency-based encoding mode, with respect to the each frequency band, by use of the time domain feature and the frequency domain feature.

Claims

1. An adaptive time and/or frequency-based encoding mode determination apparatus comprising:

a time domain feature extraction device to generate a time domain feature including a time domain short-term feature and a time domain long-term feature, by analyzing a time domain of an input audio signal;

a frequency domain feature extraction device to generate a frequency domain feature including a frequency domain short-term feature and frequency domain long-term feature, by analyzing a frequency domain signal of the input audio signal; and

a mode determination device to determine one of a time-based encoding mode and a frequency-based encoding mode as an encoding mode, with respect to the input audio signal in a predetermined unit, according to the time domain feature and the frequency domain feature.

2. The apparatus of claim 1, wherein, when the mode determination device determines the encoding mode with respect to a current frame, a result of analyzing the time domain with respect to a next frame is used to calculate a short-term/long-term prediction gain with respect to a previous, the current, and the next frame via a frame feature buffer.

3. The apparatus of claim 1, wherein the time domain short-term feature comprises a transition extent and a short-term/long-term prediction gain, and the frequency domain short-term feature comprises a voicing probability.

4. The apparatus of claim 3, wherein the time domain long-term feature comprises a continuity of periodicity, a frequency spectral tilt, and/or a frame energy, and the frequency domain long-term feature comprises a correlation between channels.

5. The apparatus of claim 4, wherein the mode determination device determines the encoding mode to be the frequency-based encoding mode according to at least one of:

a first condition in which a stereo extent of the input audio signal is more than a predetermined level;

a second condition in which a transition extent is less than a predetermined level;

a third condition in which the short-term/long-term prediction gain is less than a predetermined level; and

a fourth condition in which a voicing probability corresponding to a frequency band is less than a predetermined level.

6. The apparatus of claim 5, wherein the mode determination device determines the encoding mode to be the time-based encoding mode when any of the first through fourth conditions are not satisfied and when any of following conditions are also not satisfied:

a fifth condition in which continuity of the periodicity of the input audio signal is continuously maintained for more than predetermined periods;

a sixth condition in which music continuity where the frequency spectral tilt is gentle and the frame energy is continuously maintained at a high level for more than a certain period, is more than a predetermined level, and

the mode determination device determines the encoding mode to be the frequency-based encoding mode when any of the first through fourth conditions are not satisfied and at least one of the fifth and sixth conditions are satisfied.

7. The apparatus of claim 1, wherein the frequency domain feature extraction device transforms the input audio signal of the time domain signal by one of a modulated lapped transform, a frequency-varying modulated lapped transform, and a fast Fourier transform and analyzes the frequency domain signal to generate a frequency domain feature corresponding to each frequency band.

8. A method of determining adaptive time/frequency-based encoding mode, the method comprising:

generating, performing by using at least one processing device, time domain feature including a time domain short-term feature and a time domain long-term feature, by analyzing a time domain signal of an input audio signal;

generating a frequency domain feature including a frequency domain short-term feature and a frequency time domain long-term feature, by analyzing a frequency domain signal of the input audio signal; and

determining one of a time-based encoding mode and a frequency-based encoding mode, with respect to the input audio signal in a predetermined unit, according to the time domain feature and the frequency domain feature.

9. The method of claim 8, wherein, in the determining one of a time-based encoding mode and a frequency-based encoding mode, when determining the encoding mode with respect to a current frame, a result of analyzing the time domain with respect to a next frame is used to calculate a short-term/long-term prediction gain with respect to a previous, the current, and the next frame via a frame feature buffer.

10. The method of claim 8, wherein the time domain short-term feature comprises a transition extent and a short-term/long-term prediction gain, and the frequency domain short-term feature comprises a voicing probability.

11. The method of claim 8, wherein the time domain long-term feature comprises a continuity of periodicity, a frequency spectral tilt, and/or a frame energy, and the frequency domain long-term feature comprises a correlation between channels.

12. The method of claim 8, wherein, in the determining one of a time-based encoding mode and a frequency-based encoding mode, the encoding mode is determined to be the frequency-based encoding mode when a stereo extent of the input audio signal is more than a predetermined level;

a transition extent is less than a predetermined level;

the short-term/long-term prediction gain is less than a predetermined level;

or a voicing probability corresponding to a frequency band is less than a predetermined level.

13. The method of claim 8, wherein, in the determining one of a time-based encoding mode and a frequency-based encoding mode, the encoding mode is determined to be the time-based encoding mode when continuity of the periodicity of the input audio signal is not continuously maintained for more than predetermined periods at a same time as the frequency spectral tilt is more than a predetermined level or the frame energy at a predetermined level is not continuously maintained for more than a certain period.

14. A non-transitory computer readable recording medium in which a program to execute an adaptive time/frequency-based encoding mode determination method is recorded, the method comprising:

generating a time domain feature including a time domain short-term feature and a time domain long-term feature, by analyzing a time domain signal of an input audio signal;

generating a frequency domain feature including a frequency domain short-term feature and a frequency domain long-term feature, by analyzing a frequency domain signal of the input audio signal; and

determining any one of a time-based encoding mode and a frequency-based encoding mode, with respect to the input audio signal in a predetermined unit, according to the time domain feature and the frequency domain feature.

15. An adaptive time and/or frequency-based encoding apparatus, comprising:

a mode determination device to determine a time-based encoding mode and a frequency-based encoding mode as an encoding mode according to a frequency domain feature including a frequency domain short-term feature and a frequency domain long-term feature and a time domain feature including a time domain short-term feature and a time domain long-term feature, with respect to an audio signal in a predetermined unit;

an encoder to encode the audio signal in a predetermined unit according to corresponding ones of the time-based encoding mode and the frequency-based encoding mode to generate an encode data; and

a bit stream output device to process a bit stream with respect to the encoded data, and the encoding mode information of the predetermined unit, and to output the processed bit stream.

16. An adaptive time and/or frequency-based encoding apparatus, comprising:

a domain feature extraction device to extract a time domain feature and a frequency domain feature with respect to an input audio signal in a predetermined unit, respectively;

a mode determination device to determine a time-based encoding mode and a frequency-based encoding mode according to the time domain feature including a time domain long-term feature and the frequency domain feature including a frequency domain long-term feature, and to generate information on the time-based encoding mode or the frequency-based encoding mode;

an encoder to encode the input audio signal in the predetermined unit according to the time-based encoding mode or the frequency-based encoding mode; and

an output device to output a bit stream including the time-based encoded data, the frequency-based encoded data, and the encoding mode information.

17. An encoding and/or decoding system, comprising:

a mode determination device to determine a time-based encoding mode and a frequency-based encoding mode as an encoding mode according to a frequency domain feature including a frequency domain long-term feature and a time domain feature including a time domain long-term feature, with respect to an audio signal in a predetermined unit; and

an encoder to encode the audio signal in the predetermined unit according to corresponding ones of the time-based encoding mode and the frequency-based encoding mode and to generate a bit stream with respect to the encoded audio signal in the predetermined unit, and encoding mode information of the audio signal in the predetermined unit; and

a decoder to receive the bit stream and to decode the audio signal in the predetermined unit according to corresponding ones of a time decoding mode corresponding to the time encoding mode and a frequency decoding mode corresponding to the frequency encoding mode.

18. An adaptive time and/or frequency-based decoding apparatus, comprising:

a bit stream input device to receive a processed bit stream, the processed bit stream comprising;

time-based encoded data;

frequency-based encoded data;

encoding mode information corresponding to a mode determination of an audio signal in a predetermined unit; and

a decoding device to decode the time-based encoded data and the frequency-based encoded data with respect to the audio signal in the predetermined unit to generate decoded data representing an output audio signal,

wherein the encoded mode information has been determined according to a frequency domain feature including a frequency domain long-term feature and a time domain feature including a time domain long-term feature with respect to the audio signal in the predetermined unit.

19. A method of determining adaptive time/frequency-based encoding mode, the method comprising:

generating, performed by using at least one processing device, a long-term feature, by analyzing an input audio signal; and

determining one of a time-based encoding mode and a frequency-based encoding mode, for each frame of the input audio signal, according to whether the long-term feature is a time-domain long term feature or a frequency domain long-term feature.