METHOD AND APPARATUS FOR ENCODING/DECODING AN AUDIO SIGNAL BY USING AUDIO SEMANTIC INFORMATION

• US 20110035227A1
• Filed: 04/16/2009
• Published: 02/10/2011
• Est. Priority Date: 04/17/2008
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Hyun-Wook, Moon, Han-Gil, Lee, Chul-Woo, Jeong, Jong-Hoon, Lee, Nam-Suk, Lee, Sang-Hoon
• Application Number:
  US12/988,382
• Publication Number:
  US 20110035227A1
• Time in Patent Office: Days
• US Class Current: 704/500
• CPC Class Codes: G10L 19/0208 Subband vocoders
• CPC Class Codes: G10L 19/20 using sound class specific coding, hybrid encoders or object based coding

Abstract

An audio signal encoding method and apparatus and an audio signal decoding method and apparatus are provided. The audio signal encoding method includes: transforming an audio signal into a signal of a frequency domain; extracting semantic information from the audio signal; variably reconfiguring one or more sub-bands included in the audio signal by segmenting or grouping the one or more sub-bands using the extracted semantic information; and generating a quantized bitstream by calculating a quantization step size and a scale factor with respect to a reconfigured sub-band of the one or more sub-bands.

Claims

1. An audio signal encoding method comprising:

transforming an audio signal into a signal of a frequency domain;

extracting semantic information from the audio signal;

variably reconfiguring one or more sub-bands comprised in the audio signal by segmenting or grouping the one or more sub-bands using the extracted semantic information; and

generating a quantized first bitstream by calculating a quantization step size and a scale factor with respect to a reconfigured sub-band of the one or more sub-bands.

2. The audio signal encoding method of claim 1, wherein the semantic information is defined in units of frames of the audio signal, and indicates a statistical value with respect to a plurality of coefficient amplitudes comprised in one or more sub-bands of each of the frames.

3. The audio signal encoding method of claim 2, wherein the semantic information comprises an audio semantic descriptor that is metadata used in searching or categorizing music of the audio signal.

4. The audio signal encoding method of claim 1, wherein the extracting the semantic information further comprises calculating spectral flatness of a first sub-band of the one or more sub-bands.

5. The audio signal encoding method of claim 4, wherein:

if the spectral flatness is less than a predetermined threshold value, the extracting the semantic information further comprises calculating a spectral sub-band peak value of the first sub-band; and

if the spectral flatness is less than the predetermined threshold value, the variably reconfiguring the one or more sub-bands further comprises segmenting the first sub-band into a plurality of sub-bands according to the spectral sub-band peak value.

6. The audio signal encoding method of claim 4, wherein:

if the spectral flatness is greater than a predetermined threshold value, the extracting the semantic information further comprises calculating a spectrum flux value indicating variation of energy distributions between the first sub-band and a second sub-band adjacent to the first sub-band; and

if the spectral flatness is greater than the predetermined threshold value and the spectrum flux value is less than a predetermined threshold value, the variably reconfiguring of the one or more sub-bands further comprises grouping the first sub-band and the second sub-band together.

7. The audio signal encoding method of claim 5, further comprising:

generating a second bitstream comprising at least one of the spectral flatness and the spectral sub-band peak value; and

transmitting the second bitstream with the first bitstream.

21. The audio signal encoding method of claim 6, further comprising:

generating a second bitstream comprising at least one of the spectral flatness and the spectral flux value; and

transmitting the second bitstream with the first bitstream.

22. The audio signal encoding method of claim 5, wherein:

if the spectral flatness is greater than the predetermined threshold value, the extracting the semantic information further comprises calculating a spectrum flux value indicating variation of energy distributions between the first sub-band and a second sub-band adjacent to the first sub-band; and

if the spectral flatness is greater than the predetermined threshold value and the spectrum flux value is less than a predetermined threshold value, the variably reconfiguring the one or more sub-bands further comprises grouping the first sub-band and the second sub-band together.

23. The audio signal encoding method of claim 22, further comprising:

generating a second bitstream comprising at least one of the spectral flatness, the spectral sub-band peak value, and the spectral flux value; and

transmitting the second bitstream with the first bitstream.

26. A computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 1.

8. An audio signal decoding method comprising:

receiving a first bitstream of an encoded audio signal and a second bitstream indicating semantic information of the audio signal;

determining at least one sub-band of the audio signal that is variably configured in the first bitstream of the audio signal, by using the second bitstream indicating the semantic information; and

calculating an inverse-quantization step size and a scale factor with respect to the at least one sub-band, and inverse-quantizing the first bitstream based on the calculated inverse-quantization step size and the calculated scale factor.

9. The audio signal decoding method of claim 8, wherein the semantic information is defined in units of frames of the encoded audio signal, and indicates a statistical value with respect to a plurality of coefficient amplitudes comprised in one or more sub-bands of each of the frames.

10. The audio signal decoding method of claim 9, wherein the semantic information comprises at least one of spectral flatness, a spectral sub-band peak value, and a spectral flux value with respect to the one or more sub-bands.

27. A computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 8.

11. An audio signal encoding apparatus comprising:

a transform unit which transforms an audio signal into a signal of a frequency domain;

a semantic information generation unit which extracts semantic information from the audio signal;

a sub-band reconfiguration unit which variably reconfigures one or more sub-bands comprised in the audio signal by segmenting or grouping the one or more sub-bands bands using the extracted semantic information; and

a first encoding unit which generates a quantized first bitstream by calculating a quantization step size and a scale factor with respect to a reconfigured sub-band of the one or more sub-bands.

12. The audio signal encoding apparatus of claim 11, the semantic information is defined in units of frames of the audio signal, and indicates a statistical value with respect to a plurality of coefficient amplitudes comprised in one or more sub-bands of each of the frames.

13. The audio signal encoding apparatus of claim 12, wherein the semantic information comprises an audio semantic descriptor that is metadata used in searching or categorizing music configured of the audio signal.

14. The audio signal encoding apparatus of claim 11, wherein the semantic information generation unit further comprises a flatness generation unit for which calculates spectral flatness of a first sub-band of the one or more sub-bands.

15. The audio signal encoding apparatus of claim 14, wherein:

the semantic information generation unit further comprises a sub-band peak value calculation unit which, if the spectral flatness is less than a predetermined threshold value, calculates a spectral sub-band peak value of the first sub-band; and

the sub-band reconfiguration unit comprises a segmenting unit which, if the spectral flatness is less than the predetermined threshold value, segments the first sub-band into a plurality of sub-bands according to the spectral sub-band peak value.

16. The audio signal encoding apparatus of claim 14, wherein:

the semantic information generation unit further comprises a flux value calculation unit which, if the spectral flatness is greater than a predetermined threshold value, calculates a spectrum flux value indicating variation of energy distributions between the first sub-band and a second sub-band adjacent to the first sub-band; and

the sub-band reconfiguration unit further comprises a grouping unit which, if the spectral flatness is greater than the predetermined threshold value and the spectrum flux value is less than a predetermined threshold value, groups the first sub-band and the second sub-band together.

17. The audio signal encoding apparatus of claim 15, further comprising a second encoding unit which generates a second bitstream comprising at least one of the spectral flatness and the spectral sub-band peak value,

wherein the second bitstream is transmitted together with the first bitstream.

24. The audio signal encoding apparatus of claim 16, further comprising a second encoding unit which generates a second bitstream comprising at least one of the spectral flatness and the spectral flux value,

wherein the second bitstream is transmitted together with the first bitstream.

18. An audio signal decoding apparatus comprising:

a receiving unit which receives a first bitstream of an encoded audio signal and a second bitstream indicating semantic information of the audio signal;

a sub-band determining unit which determines at least one sub-band of the audio signal that is variably configured in the first bitstream of the audio signal, by using the second bitstream indicating the semantic information; and

a decoding unit which calculates an inverse-quantization step size and a scale factor with respect to the at least one sub-band, and inverse quantizes the first bitstream based on the calculated inverse-quantization step size and the calculated scale factor.

19. The audio signal decoding apparatus of claim 18, wherein the semantic information is defined in units of frames of the encoded audio signal, and indicates a statistical value with respect to a plurality of coefficient amplitudes comprised in one or more sub-bands of each of the frames.

20. The audio signal decoding apparatus of claim 19, wherein the semantic information comprises at least one of spectral flatness, a spectral sub-band peak value, and a spectral flux value with respect to the one or more sub-bands.

25. An audio signal decoding method comprising:

determining at least one sub-band of an audio signal that is variably configured in a bitstream of the audio signal, by using semantic information of the audio signal transmitted with the audio signal; and

calculating an inverse-quantization step size and a scale factor with respect to the at least one sub-band, and inverse-quantizing the first bitstream based on the calculated inverse-quantization step size and the calculated scale factor.

28. A computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 25.