Audio coding device, method, and computer-readable recording medium storing program

• US 9,111,533 B2
• Filed: 11/16/2011
• Issued: 08/18/2015
• Est. Priority Date: 11/30/2010
• Status: Expired due to Fees

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Shirakawa, Miyuki, Kishi, Yohei, Suzuki, Masanao, Tsuchinaga, Yoshiteru
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/297,536
• Publication Number:
  US 20120136657A1
• Time in Patent Office: 1,371 Days
• Field of Search: 704/229, 704/230, 704/200.1, 704500-504, 704/222, 704226-228, 704/219, 704/224, 704/205, 704/203, 375240-245, 375/260
• US Class Current: 1/1
• CPC Class Codes: G10L 19/0017 Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error G10L19/24 takes precedence
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/035 Scalar quantisation

Abstract

An audio coding device includes a time-to-frequency converter that performs time-to-frequency conversion on each frame of a signal in at least one channel included in an audio signal in a predetermined length of time in order to convert the signal in the at least one channel to a frequency signal; a complexity calculator that calculates complexity of the frequency signal for each of the at least one channel. The audio further includes a bit allocation controller that determines a number of bits to be allocated to each of at least one channel so that more bits are allocated to the each of the at least one channel as the complexity of the each of at least one channel increases, and increases the number of bits to be allocated as an estimation error in the number; and a coder that codes the frequency signal.

Claims

1. An audio coding device comprising:

a time-to-frequency converter that performs time-to-frequency conversion on each frame of a signal in at least one channel included in an audio signal in a predetermined length of time in order to convert the signal in the at least one channel to a frequency signal;

a complexity calculator that calculates a first value indicating complexity of the frequency signal for each of the at least one channel, based on a spectral power of a frequency bandwidth and a masking threshold representing a power of a lower limit frequency signal of a sound that a listener is able to hear;

a bit allocation controller that;

determines a second value indicating a number of bits to be allocated to each frame of audio signals for each of the at least one channel so that the second value increases as the first value increases,

calculates a third value indicating a number of bits that have been required to code each frame of the frequency signal so that reproduced sound quality of a previous frame meets a prescribed criterion, and

updates the second value so that the second value increases as an estimation error indicating an estimated number of error bits that have occurred in the previous frame; and

a coder that codes the frequency signal in each channel so that a number of available bits for each frame of coded audio signals does not exceeds the updated second value.

2. The audio coding device according to claim 1,

wherein, for the previous frame, the coder quantizes the frequency signal with a first quantizer scale by which reproduced sound quality meets the criterion, calculates a number of bits to be coded that is obtained by coding the quantized frequency signal and the first quantizer scale according to a prescribed coding method, as third value, and determines a second quantizer scale so that a number of bits to be coded does not exceed the second value, the number of bits to be coded being obtained by quantizing the frequency signal with the second quantizer scale and by coding the second quantizer scale and the quantized frequency signal according to a prescribed coding method, and

wherein, for the previous frame, the bit allocation controller calculates, as the estimation error, a difference between third value and second value or a ratio of the third value to second value.

3. The audio coding device according to claim 2,

wherein, for the previous frame, the coder determines a first quantizer scale by which reproduced sound quality meets the criterion and also determines a second quantizer scale so that a number of bits to be coded does not exceed the number of bits to be allocated, the number of bits to be coded being obtained by quantizing the frequency signal with the second quantizer scale and by coding the second quantizer scale and the quantized frequency signal according to a prescribed coding method, and

wherein the bit allocation controller takes a greater value for the estimation error as the second quantizer scale is greater than the first quantizer scale.

4. The audio coding device according to claim 2,

wherein the bit allocation controller corrects the estimation error so that the estimation error takes a greater value as a quantization error is greater than an upper limit of power of the frequency signal for which a listener is not able to perceive deterioration of reproduced sound quality, the quantization error being caused when the coder quantizes the frequency signal with the second quantizer scale in the previous frame.

5. The audio coding device according to claim 1,

wherein the audio signal includes two or more channels, and

wherein the bit allocation controller sets the second value so that a total of the number of bits to be individually allocated to the two or more channels does not exceed an upper limit of a number of available bits.

6. The audio coding device according to claim 1,

wherein the first value indicating complexity is a perceptual entropy.

7. The audio coding device according to claim 1,

wherein the bit allocation controller determines the second value according to a value obtained by multiplying the first value of each of the at least one channel by an estimation coefficient determined for each of the at least one channel, and updates the estimation coefficient when the estimation error is outside a prescribed allowable range over a prescribed number of frames, which is equal to or greater than 1.

8. An audio coding method comprising:

performing time-to-frequency conversion on each frame of a signal in at least one channel included in an audio signal in a predetermined length of time in order to convert the signal in the at least one channel to a frequency signal;

calculating a first value indicating complexity of the frequency signal for each of the at least one channel, based on a spectral power of a frequency bandwidth and a masking threshold representing a power of a lower limit frequency signal of a sound that a listener is able to hear;

determining a second value indicating a number of bits to be allocated to each frame of audio signals for each of the at least one channel so that the second value increases as the first value increases;

calculating a third value indicating a number of bits that have been required to code each frame of the frequency signal so that reproduced sound quality of a previous frame meets a prescribed criterion;

updating the second value so that the second value increases as an estimation error indicating an estimated number of error bits that have occurred in the previous frame increases; and

coding the frequency signal in each channel so that a number of available bits for each frame of coded audio signals does not exceeds the updated second value.

9. The audio coding method according to claim 8,

wherein, in coding the frequency signal, the frequency signal is quantized for the previous frame with a first quantizer scale by which reproduced sound quality meets the criterion, a number of bits to be coded that is obtained by coding the quantized frequency signal and the first quantizer scale according to a prescribed coding method is calculated as the third value, and a second quantizer scale is determined so that a number of bits to be coded does not exceed second value, the number of bits to be coded being obtained by quantizing the frequency signal with the second quantizer scale and by coding the second quantizer scale and the quantized frequency signal according to a prescribed coding method, and

wherein, in increasing the number of bits to be allocated, a difference between the third value and the second value or a ratio of the third value to the second value is calculated for the previous frame as the estimation error.

10. The audio coding method according to claim 9,

wherein, in coding the frequency signal, a first quantizer scale by which reproduced sound quality meets the criterion and a second quantizer scale are determined for the previous frame, the second quantizer scale being determined so that a number of bits to be coded does not exceed the number of bits to be allocated, the number of bits to be coded being obtained by quantizing the frequency signal with the second quantizer scale and by coding the second quantizer scale and the quantized frequency signal according to a prescribed coding method, and

wherein, in increasing the number of bits to be allocated, the estimation error takes a greater value as the second quantizer scale is greater than the first quantizer scale.

11. The audio coding method according to claim 10,

wherein, in increasing the number of bits to be allocated, the estimation error is corrected so that the estimation error takes a greater value as a quantization error is greater than an upper limit of power of the frequency signal for which a listener is not able to perceive deterioration of reproduced sound quality, the quantization error being caused when the frequency signal is quantized with the second quantizer scale in the coding the frequency signal in the previous frame.

12. The audio coding method according to claim 8,

wherein the audio signal includes two or more channels, and

wherein, in increasing the second value, the second value is set so that a total of the numbers of bits to be individually allocated to the two or more channels does not exceed an upper limit of a number of available bits.

13. The audio coding method according to claim 8,

wherein, in increasing the second value, the second value is determined according to a value obtained by multiplying the first value of each of the at least one channel by an estimation coefficient determined for each of the at least one channel, and the estimation coefficient is updated when the estimation error is outside a prescribed allowable range over a prescribed number of frames, which is equal to or greater than 1.

14. A non-transitory, computer-readable recording medium storing an audio coding computer program that causes a computer to execute a process comprising:

performing time-to-frequency conversion on each frame of a signal in at least one channel included in an audio signal in a predetermined length of time in order to convert the signal in the at least one channel to a frequency signal;

calculating a first value indicating complexity of the frequency signal for each of the at least one channel, based on a spectral power of a frequency bandwidth and a masking threshold representing a power of a lower limit frequency signal of a sound that a listener is able to hear;

determining a second value indicating a number of bits to be allocated to each frame of audio signals for each of the at least one channel so that the second value increases as the first value increases;

calculating a third value indicating a number of bits that have been required to code each frame of the frequency signal so that reproduced sound quality of a previous frame meets a prescribed criterion;

updating the second value so that the second value increases as an estimation error indicating an estimated number of error bits that have occurred in the previous frame increases; and

coding the frequency signal in each channel so that a number of available bits for each frame of coded audio signals does not exceeds the updated second value.

15. The non-transitory, computer-readable recording medium storing the audio coding computer program according to claim 14,

wherein, in coding the frequency signal, the frequency signal is quantized for the previous frame with a first quantizer scale by which reproduced sound quality meets the criterion, a number of bits to be coded that is obtained by coding the quantized frequency signal and the first quantizer scale according to a prescribed coding method is calculated as third value, and a second quantizer scale is determined so that a number of bits to be coded does not exceed the second value, the number of bits to be coded being obtained by quantizing the frequency signal with the second quantizer scale and by coding the second quantizer scale and the quantized frequency signal according to a prescribed coding method, and

wherein, in increasing the number of bits to be allocated, a difference between the third value and the second value or a ratio of the third value to the second value is calculated for the previous frame as the estimation error.

16. The non-transitory, computer-readable recording medium storing the audio coding computer program according to claim 15,

wherein, in coding the frequency signal, a first quantizer scale by which reproduced sound quality meets the criterion and a second quantizer scale are determined for the previous frame, the second quantizer scale being determined so that a number of bits to be coded does not exceed the number of bits to be allocated, the number of bits to be coded being obtained by quantizing the frequency signal with the second quantizer scale and by coding the second quantizer scale and the quantized frequency signal according to a prescribed coding method, and

wherein, in increasing the number of bits to be allocated, the estimation error takes a greater value as the second quantizer scale is greater than the first quantizer scale.

17. The non-transitory, computer-readable recording medium storing the audio coding computer program according to claim 16,

wherein, in increasing the second value, the estimation error is corrected so that the estimation error takes a greater value as a quantization error is greater than an upper limit of power of the frequency signal for which a listener is not able to perceive deterioration of reproduced sound quality, the quantization error being caused when the frequency signal is quantized with the second quantizer scale in the coding the frequency signal in the previous frame.

18. The non-transitory, computer-readable recording medium storing the audio coding computer program according to claim 14,

wherein the audio signal includes two or more channels, and

wherein, in increasing the second value, the second value is set so that a total of the number of bits to be individually allocated to the two or more channels does not exceed an upper limit of a number of available bits.

19. The non-transitory, computer-readable recording medium storing the audio coding computer program according to claim 14,

wherein, in increasing the second value, the second value is determined according to a value obtained by multiplying the first value of each of the at least one channel by an estimation coefficient determined for each of the at least one channel, and the estimation coefficient is updated when the estimation error is outside a prescribed allowable range over a prescribed number of frames, which is equal to or greater than 1.