METHOD AND APPARATUS TO EXTRACT IMPORTANT FREQUENCY COMPONENT OF AUDIO SIGNAL AND METHOD AND APPARATUS TO ENCODE AND/OR DECODE AUDIO SIGNAL USING THE SAME

• US 20080133223A1
• Filed: 10/31/2007
• Published: 06/05/2008
• Est. Priority Date: 12/04/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Jung-hue, SON, Chang-yong, Oh, Bun-mi, Choo, Ki-hyun, Sung, Ho-sang, Lee, Kang-eun
• Granted Patent: US 8,612,215 B2
• Time in Patent Office: Days
• US Class Current: 704/200.1
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/093 using sinusoidal excitation models

Abstract

A method and apparatus to extract an important frequency component of an audio signal and a method and apparatus to encode and/or decode an audio signal by using the same. The method of extracting an important frequency component of an audio signal includes converting an audio signal of a time domain into an audio signal of a frequency domain, selecting a frequency band having a harmonic feature from the converted audio signal of the frequency domain, and extracting an important frequency component from the selected frequency band having the harmonic feature.

Claims

1. A method of extracting an important frequency component of an audio signal, the method comprising:

converting an audio signal of a time domain into an audio signal of a frequency domain;

selecting a frequency band having a harmonic feature from the converted audio signal of the frequency domain; and

extracting an important frequency component from the selected frequency band having the harmonic feature.

2. The method of claim 1, further comprising dividing the converted audio signal of the frequency domain into subbands during the converting of the audio signal of the time domain, and wherein the selecting of the frequency band comprises analyzing the harmonic feature according to each of the subbands to select any subband among the subbands having a harmonic feature.

3. The method of claim 2, wherein the important frequency component comprises a harmonic peak period according to each of the subbands.

4. The method of claim 2, wherein the analyzing of the harmonic feature comprises analyzing an autocorrelation of a peak period according to each of the subbands.

5. The method of claim 2, further comprising extracting the important frequency component from each of the divided subbands based on a psychoacoustic model,

wherein the extracting of the important frequency component comprises extracting an important frequency component having the harmonic feature by using the important frequency component extracted based on the psychoacoustic model.

6. A method of extracting an important frequency component of an audio signal, the method comprising:

converting an audio signal of a time domain into an audio signal of a frequency domain;

dividing the audio signal of the frequency domain into subbands according to a predetermined reference, and determining whether each of the subbands has a harmonic feature or not;

extracting an important frequency component based on a harmonic model from the audio signal of the subband having the harmonic feature according to the determination result; and

extracting an important frequency component based on a psychoacoustic model from the audio signal of the subband not having the harmonic feature according to the determination result.

7. An apparatus for extracting an important frequency component of an audio signal, the apparatus comprising:

a signal converting unit converting an audio signal of a time domain into an audio signal of a frequency domain;

a harmonic feature determining unit determining which frequency band of the converted audio signal has a harmonic feature;

a first extracting unit extracting an important frequency component based on a harmonic model from the audio signal of the frequency band the having the harmonic feature; and

a second extracting unit extracting an important frequency component based on a psychoacoustic model from the audio signal of the frequency band not having the harmonic feature.

8. The apparatus of claim 7, wherein the first extracting unit comprises:

a harmonic peak component extracting unit extracting a harmonic peak component from the audio signal of the frequency band having the harmonic feature; and

a harmonic peak period calculating unit calculating a harmonic peak period by using the extracted harmonic peak component.

9. The apparatus of claim 7, further comprising a frequency dividing unit dividing the audio signal of the frequency domain into subbands,

wherein the harmonic feature determining unit determines whether the audio signal of the frequency domain includes a harmonic feature or not at each of the subbands.

10. The apparatus of claim 9, wherein the harmonic feature determining unit comprises:

a peak detecting unit detecting a peak component of the audio signal;

an autocorrelation calculating unit calculating an autocorrelation for a period of the detected peak component at each subband; and

a comparing unit comparing the calculated autocorrelation value to a predetermined reference value to determine whether the harmonic feature exists or not at each of the subbands.

11. The apparatus of claim 9, wherein the first extracting unit extracts components of the peak frequency and neighboring frequencies from the frequency domain having the harmonic feature as an important frequency component.

12. The apparatus of claim 9, wherein the first extracting unit further comprises a width information extracting unit extracting width information of the important frequency component extracted based on the harmonic model.

13. The apparatus of claim 12, wherein the period of the harmonic peak and the width of the important frequency component have respectively different negative correlations.

14. A method of encoding an audio signal, the method comprising:

converting an audio signal of a time domain into an audio signal of a frequency domain;

selecting a frequency band having a harmonic feature from the converted audio signal of the frequency domain;

extracting an important frequency component having the harmonic feature from the selected frequency band having the harmonic feature;

extracting a harmonic parameter from the important frequency component; and

encoding an audio signal by using the extracted harmonic parameter.

15. The method of claim 14, wherein, during the extracting of the harmonic parameter, the harmonic parameter comprises period information of a harmonic peak according to the frequency band selected during the selecting of the frequency band.

16. The method of claim 14, further comprising dividing the converted audio of the frequency domain into subbands during the converting of the audio signal,

wherein the selecting of the frequency band comprises:

determining whether the harmonic feature exists or not at each of the subbands; and

selecting the subband having the harmonic feature as a frequency band having the harmonic feature.

17. The method of claim 14, wherein the important frequency component during the extracting of the important frequency component comprises a peak frequency component in the subband having the harmonic feature and neighboring components.

18. The method of claim 15, wherein the determining of whether the harmonic feature exists or not comprises using an autocorrelation for a peak period at each subband.

19. The method of claim 14, further comprising:

dividing the converted audio signal of the frequency domain into subbands; and

selecting a important frequency component based on psychoacoustic model from the audio signal divided by the subband during the converting of the audio signal,

wherein the extracting of the important frequency component is performed using the important frequency component selected based on the psychoacoustic model.

20. The method of claim 15, wherein the harmonic parameter further comprises width information of the important frequency component.

21. The method of claim 20, wherein the period of the harmonic peak and the width of the important frequency component have respectively different negative correlations.

22. The method of claim 14, wherein the encoding of the audio signal further comprises magnitude information of the important frequency component extracted during the extracting of the important frequency component.

23. A method of decoding an audio signal, the method comprising:

decoding information including period information of a harmonic peak, quantizing step magnitude information, and a quantized value of an audio signal;

inverse-quantizing the quantized value of the audio signal by using the decoded information; and

converting the inverse-quantized value into a signal of a time domain.

24. A method of decoding an audio signal, the method comprising:

decoding ISC (important spectrum component) extracting mode information, information including a quantized step magnitude information and a quantized value of an audio signal, period information of a harmonic peak, or index information representing whether an ISC exists or not from an encoded bit stream;

inverse-quantizing the quantized value of the audio signal by using the decoded information according to the ISC extracting mode information; and

converting the inverse-quantized value into a signal of a time domain.