Support of a multichannel audio extension

• US 7,627,480 B2
• Filed: 04/28/2004
• Issued: 12/01/2009
• Est. Priority Date: 04/30/2003
• Status: Expired due to Fees

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Ojanpera, Juha
• Primary Examiner(s): Hudspeth; David R
• Assistant Examiner(s): Neway; Samuel G
• Application Number:
  US10/834,376
• Publication Number:
  US 20040267543A1
• Time in Patent Office: 2,043 Days
• Field of Search: None
• US Class Current: 704/500
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

Methods and units supporting a multichannel audio extension in a multichannel audio coding system are shown. In order to allow an efficient extension of an available mono audio signal {tilde over (M)} of a multichannel audio signal L/R, it is proposed that an encoding end of the multichannel audio coding system provides dedicated multichannel extension information for lower frequencies of the multichannel audio signal L/R, in addition to multichannel extension information at least for higher frequencies of the multichannel audio signal L/R. This dedicated multichannel extension information enables a decoding end of the multichannel audio coding system to reconstruct the lower frequencies of the multichannel audio signal L/R with a higher accuracy than the higher frequencies of the multichannel audio signal L/R.

Claims

1. Method for supporting a multichannel audio extension at an encoding end of a multichannel audio coding system, said method comprising:

generating and providing first multichannel extension information at least for higher frequencies of a multichannel audio signal, which first multichannel extension information allows to reconstruct at least said higher frequencies of said multichannel audio signal based on a mono audio signal available for said multichannel audio signal;

generating and providing second multichannel extension information for lower frequencies of said multichannel audio signal, which second multichannel extension information allows to reconstruct said lower frequencies of said multichannel audio signal based on said mono audio signal with a higher accuracy than said first multichannel extension information allows to reconstruct at least said higher frequencies of said multichannel audio signal; and

generating and providing in addition an indication for additional use in a reconstruction of the lower frequencies of the multichannel audio signal, said indication comprising a first bit indicating whether any channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal, and said indication comprising at least in the case that a channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal a second bit indicating which channel of said multichannel audio signal is considerably stronger than another channel of said multichannel audio signal.

2. Method according to claim 1, wherein generating and providing said second multichannel extension information comprises

transforming a first channel signal of a multichannel audio signal into the frequency domain, resulting in a spectral first channel signal;

transforming a second channel signal of said multichannel audio signal into the frequency domain, resulting in a spectral second channel signal;

generating a spectral side signal representing the difference between said spectral first channel signal and said spectral second channel signal;

quantizing said spectral side signal to obtain a quantized spectral side signal;

encoding said quantized spectral side signal and providing said encoded quantized spectral side signal as part of said second multichannel extension information.

3. Method according to claim 2, wherein said quantizing comprises quantizing said spectral side signal in a loop in which the quantizing gain is varied such that a quantized spectral side signal is obtained of which the maximum absolute value lies below a predetermined threshold value.

4. Method according to claim 3, wherein said predetermined threshold value is adjusted to ensure that said encoding of said quantized spectral side signal results in a number of bits which lies less than a predetermined number of bits below a number of available bits.

5. Method according to claim 3, further comprising setting all values of said quantized spectral side signal to zero, in case a quantizing gain required for said obtained quantized spectral side signal lies below a second predetermined threshold value.

6. Method according to claim 2, further comprising setting all values of said quantized spectral side signal to zero, in case an average energy at said lower frequencies of said spectral first and second channel signals lies below a predetermined threshold value.

7. Method according to claim 2, further comprising setting those values of said quantized spectral side signal to zero, which do not belong to a spectral environment providing a significant contribution to a multichannel image in said multichannel audio signal.

8. Method according to claim 2, wherein said encoding is based on a Huffman coding scheme.

9. Method according to claim 2, wherein said encoding comprises selecting one of at least two coding schemes, which selected coding scheme results for said quantized spectral side signal in the least number of bits.

10. Method according to claim 2, wherein said encoding comprises discarding at least the sample of said quantized spectral side signal having the lowest energy, in case encoding said entire quantized spectral side signal results in a number of bits exceeding a number of available bits.

11. Method according to claim 1, wherein said indication is generated for a respective frame of said multichannel audio signal based on samples of said frame and samples of at least one of a previous frame and a next frame of said multichannel audio signal.

20. Method according to claim 4, further comprising setting all values of said quantized spectral side signal to zero in case a quantizing gain required for said obtained quantized spectral side signal lies below a second predetermined threshold value.

21. A computer readable medium storing program code, said program code realizing the method according to claim 1 when being executed.

12. Method for supporting a multichannel audio extension at a decoding end of a multichannel audio coding system, said method comprising:

reconstructing at least higher frequencies of a multichannel audio signal based on received first multichannel extension information for said multichannel audio signal and on a received mono audio signal for said multichannel audio signal; and

reconstructing lower frequencies of said multichannel audio signal based on received second multichannel extension information, on an indication comprising a first bit indicating whether any channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal and comprising at least in the case that a channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal a second bit indicating which channel of said multichannel audio signal is considerably stronger than another channel of said multichannel audio signal, and on said received mono audio signal with a higher accuracy than said higher frequencies; and

combining said reconstructed higher frequencies and said reconstructed lower frequencies to a reconstructed multichannel audio signal.

13. Method according to claim 12, wherein reconstructing lower frequencies of said multichannel audio signal comprises

decoding a quantized spectral side signal comprised in said second multichannel extension information;

dequantizing said quantized spectral side signal to obtain a dequantized spectral side signal; and

extending said received mono audio signal with said dequantized spectral side signal to obtain reconstructed lower frequencies of a spectral first channel signal and of a spectral second channel signal of said multichannel audio signal.

14. Method according to claim 13, further comprising attenuating one of said spectral channel signals at said lower frequencies, in case said second multichannel extension information further comprises an indication that another one of said spectral channel signals was considerably stronger in said multichannel audio signal which is to be reconstructed at said lower frequencies.

22. A computer readable medium storing program code, said program code realizing the method according to claim 12 when being executed.

15. An apparatus comprising:

an information generation component configured to generate and provide first multichannel extension information at least for higher frequencies of a multichannel audio signal, which first multichannel extension information allows to reconstruct at least said higher frequencies of said multichannel audio signal based on a mono audio signal available for said multichannel audio signal;

an information generation component configured to generate and provide second multichannel extension information for lower frequencies of said multichannel audio signal, which second multichannel extension information allows to reconstruct said lower frequencies of said multichannel audio signal based on said mono audio signal with a higher accuracy than said first multichannel extension information allows to reconstruct at least said higher frequencies of said multichannel audio signal; and

an information generation component configured to generate and provide in addition an indication for additional use in a reconstruction of the lower frequencies of the multichannel audio signal, said indication comprising a first bit indicating whether any channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal, and said indication comprising at least in the case that a channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal a second bit indicating which channel of said multichannel audio signal is considerably stronger than another channel of said multichannel audio signal.

16. The apparatus according to claim 15, wherein said apparatus is one of a multichannel audio encoder, a multichannel extension encoder for a multichannel audio encoder, and a mobile terminal.

19. Multichannel audio coding system comprising an apparatus according to claim 15 and a decoder with:

a reconstruction component configured to reconstruct at least higher frequencies of a multichannel audio signal based on received first multichannel extension information for said multichannel audio signal and on a received mono audio signal for said multichannel audio signal; and

a reconstruction component configured to reconstruct lower frequencies of said multichannel audio signal based on received second multichannel extension information and on said received mono audio signal with a higher accuracy than said higher frequencies; and

a combining component configured to combine said reconstructed higher frequencies and said reconstructed lower frequencies to a reconstructed multichannel audio signal.

25. The apparatus according to claim 15, wherein for generating and providing said second multichannel extension information said information generation component configured to generate and provide second multichannel extension information is configured to:

transform a first channel signal of a multichannel audio signal into the frequency domain, resulting in a spectral first channel signal;

transform a second channel signal of said multichannel audio signal into the frequency domain, resulting in a spectral second channel signal;

generate a spectral side signal representing the difference between said spectral first channel signal and said spectral second channel signal;

quantize said spectral side signal to obtain a quantized spectral side signal;

encode said quantized spectral side signal and providing said encoded quantized spectral side signal as part of said second multichannel extension information.

26. The apparatus according to claim 25, wherein said quantizing comprises quantizing said spectral side signal in a loop in which the quantizing gain is varied such that a quantized spectral side signal is obtained of which the maximum absolute value lies below a predetermined threshold value.

27. The apparatus according to claim 25, wherein said information generation component configured to generate and provide second multichannel extension information is further configured to set all values of said quantized spectral side signal to zero, in case an average energy at said lower frequencies of said spectral first and second channel signals lies below a predetermined threshold value.

28. The apparatus according to claim 25, wherein said information generation component configured to generate and provide second multichannel extension information is further configured to set those values of said quantized spectral side signal to zero, which do not belong to a spectral environment providing a significant contribution to a multichannel image in said multichannel audio signal.

29. The apparatus according to claim 25, wherein said encoding comprises a selection of one of at least two coding schemes, which selected coding scheme results for said quantized spectral side signal in the least number of bits.

17. An apparatus for supporting a multichannel audio extension at a decoding end of a multichannel audio coding system, said apparatus comprising:

a reconstruction component configured to reconstruct at least higher frequencies of a multichannel audio signal based on received first multichannel extension information for said multichannel audio signal and on a received mono audio signal for said multichannel audio signal; and

a reconstruction component configured to reconstruct lower frequencies of said multichannel audio signal based on received second multichannel extension information, on an indication comprising a first bit indicating whether any channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal and comprising at least in the case that a channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal a second bit indicating which channel of said multichannel audio signal is considerably stronger than another channel of said multichannel audio signal, and on said received mono audio signal with a higher accuracy than said higher frequencies; and

a combining component configured to combine said reconstructed higher frequencies and said reconstructed lower frequencies to a reconstructed multichannel audio signal.

18. The apparatus according to claim 17, wherein said apparatus is one of a multichannel audio decoder, a multichannel extension decoder for a multichannel audio decoder, and a mobile terminal.

30. The apparatus according to claim 17, wherein for reconstructing lower frequencies of said multichannel audio signal, said reconstruction component configured to reconstruct lower frequencies of said multichannel audio signal is configured to

decode a quantized spectral side signal comprised in said second multichannel extension information;

dequantize said quantized spectral side signal to obtain a dequantized spectral side signal; and

extend said received mono audio signal with said dequantized spectral side signal to obtain reconstructed lower frequencies of a spectral first channel signal and of a spectral second channel signal of said multichannel audio signal.

31. The apparatus according to claim 30, wherein for reconstructing lower frequencies of said multichannel audio signal, said reconstruction component configured to reconstruct lower frequencies of said multichannel audio signal is configured to attenuate one of said spectral channel signals at said lower frequencies, in case said second multichannel extension information further comprises an indication that another one of said spectral channel signals was considerably stronger in said multichannel audio signal which is to be reconstructed at said lower frequencies.

23. An apparatus for supporting a multichannel audio extension at an encoding end of a multichannel audio coding system, said apparatus comprising:

means for generating and providing first multichannel extension information at least for higher frequencies of a multichannel audio signal, which first multichannel extension information allows to reconstruct at least said higher frequencies of said multichannel audio signal based on a mono audio signal available for said multichannel audio signal;

means for generating and providing second multichannel extension information for lower frequencies of said multichannel audio signal, which second multichannel extension information allows to reconstruct said lower frequencies of said multichannel audio signal based on said mono audio signal with a higher accuracy than said first multichannel extension information allows to reconstruct at least said higher frequencies of said multichannel audio signal; and

means for generating and providing in addition an indication for additional use in a reconstruction of the lower frequencies of the multichannel audio signal,

said indication comprising a first bit indicating whether any channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal, and said indication comprising at least in the case that a channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal a second bit indicating which channel of said multichannel audio signal is considerably stronger than another channel of said multichannel audio signal.

24. An apparatus comprising:

means for reconstructing at least higher frequencies of a multichannel audio signal based on received first multichannel extension information for said multichannel audio signal and on a received mono audio signal for said multichannel audio signal; and

means for reconstructing lower frequencies of said multichannel audio signal based on received second multichannel extension information, on an indication comprising a first bit indicating whether any channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal and comprising at least in the case that a channel of said multichannel audio signal is considerably stronger at said lower frequencies of said multichannel audio signal than another channel of said multichannel audio signal a second bit indicating which channel of said multichannel audio signal is considerably stronger than another channel of said multichannel audio signal, and on said received mono audio signal with a higher accuracy than said higher frequencies; and

means for combining said reconstructed higher frequencies and said reconstructed lower frequencies to a reconstructed multichannel audio signal.