SPEECH DECODER, SPEECH ENCODER, SPEECH DECODING METHOD, SPEECH ENCODING METHOD, STORAGE MEDIUM FOR STORING SPEECH DECODING PROGRAM, AND STORAGE MEDIUM FOR STORING SPEECH ENCODING PROGRAM

• US 20130339010A1
• Filed: 08/16/2013
• Published: 12/19/2013
• Est. Priority Date: 02/18/2011
• Status: Active Grant

• Current Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Inventors: KIKUIRI, Kei, YAMAGUCHI, Atsushi
• Granted Patent: US 8,756,068 B2
• Time in Patent Office: Days
• US Class Current: 704/203
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 21/0388 Details of processing therefor
• CPC Class Codes: G10L 25/18 the extracted parameters being spectral information of each sub-band
• CPC Class Codes: G10L 25/21 the extracted parameters being power information

Abstract

A speech decoder includes a demultiplexing unit, a low frequency band decoding unit, a band splitting filter bank unit, a coded sequence analysis unit, a coded sequence decoding/dequantization unit, a high frequency band generation unit, low frequency band time envelope calculation units that acquire a plurality of low frequency band time envelopes, a time envelope calculation unit that calculates high frequency band time envelopes using time envelope information and the plurality of low frequency band time envelopes, a time envelope adjustment unit that adjusts the time envelope of high frequency band components using the time envelopes obtained by the time envelope calculation unit, and a band synthesis filter bank unit.

Claims

1. A speech decoder that decodes a coded sequence of encoded speech signal, comprising:

a demultiplexing unit for demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding unit for decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation unit for transforming the low frequency band signal, which is obtained by the low frequency band decoding unit, into a frequency domain;

a high frequency band coded sequence analysis unit for analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring supplementary information for high frequency band generation and time envelope information;

a coded sequence decoding and dequantization unit for decoding and inversely quantizing the supplementary information for high frequency band generation and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation unit for generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring time envelopes for a plurality of low frequency bands;

a time envelope calculation unit for calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a time envelope adjustment unit for adjusting, using the time envelope acquired by the time envelope calculation unit, a time envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation unit for adding the high frequency band components, which are adjusted by the time envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

4. The speech decoder according to claim 1, further comprising:

a time envelope calculation control unit for controlling, using the low frequency band signal transformed into the frequency domain by the frequency transformation unit, at least one of (i) calculation of the low frequency band time envelopes in the first to Nth low frequency band time envelope calculation unit and (ii) calculation of the high frequency band time envelope in the time envelope calculation unit.

5. The speech decoder according to claim 1, further comprising:

a time envelope calculation control unit for controlling, using the time envelope information acquired by the coded sequence decoding and dequantization unit, at least one of (i) calculation of the low frequency band time envelopes in the first to Nth low frequency band time envelope calculation unit and (ii) calculation of the high frequency band time envelope in the time envelope calculation unit.

6. The speech decoder according to claim 1, wherein

the high frequency band coded sequence analysis unit further acquires time envelope calculation control information, and

the speech decoder further comprises time envelope calculation control unit for controlling, using the time envelope calculation control information acquired by the high frequency band coded sequence analysis unit, at least one of (i) calculation of the low frequency band time envelopes in the first to Nth low frequency band time envelope calculation unit and (ii) calculation of the high frequency band time envelope in the time envelope calculation unit.

7. The speech decoder according to claim 1, wherein

the high frequency band coded sequence analysis unit further acquires time envelope calculation control information,

the coded sequence decoding and dequantization unit further acquires second frequency envelope information, and

the speech decoder further comprises time envelope calculation control unit for determining, based on the time envelope calculation control information, whether to adjust the frequency envelope of the high frequency band components based on the second frequency envelope information and, when it is determined to adjust the frequency envelope, controlling not to perform calculation of the low frequency band time envelopes in the first to Nth low frequency band time envelope calculation unit or calculation of the high frequency band time envelope in the time envelope calculation unit.

9. The speech decoder according to claim 1, wherein

the low frequency band time envelope calculation unit processes, with a specified function, the acquired plurality of low frequency band time envelopes.

2. A speech decoder that decodes a coded sequence of encoded speech signal, comprising:

a demultiplexing unit for demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding unit for decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation unit for transforming the low frequency band signal, which is obtained by the low frequency band decoding unit, into a frequency domain;

a high frequency band coded sequence analysis unit for analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation, frequency envelope information, and time envelope information;

a coded sequence decoding and dequantization unit for decoding and inversely quantizing the supplementary information for high frequency band generation, the frequency envelope information, and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation unit for generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring time envelopes for a plurality of low frequency bands;

a time envelope calculation unit for calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a frequency envelope superposition unit for superimposing the frequency envelope information, which is acquired by the coded sequence decoding and dequantization unit, onto the high frequency band time envelope and acquiring a time-frequency envelope;

a time-frequency envelope adjustment unit for adjusting, using the time envelope acquired by the time envelope calculation unit and the time-frequency envelope acquired by the frequency envelope superposition unit, a time envelope and a frequency envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation unit for adding the high frequency band components, which are adjusted by the time-frequency envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

8. The speech decoder according to claim 2, wherein

the time-frequency envelope adjustment unit processes, with a specified function, the high frequency band components of the speech signal generated by the high frequency band generation unit.

3. A speech decoder that decodes a coded sequence of encoded speech signal, comprising:

a demultiplexing unit for demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding unit for decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation unit for transforming the low frequency band signal, which is obtained by the low frequency band decoding unit, into a frequency domain;

a high frequency band coded sequence analysis unit for analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation, frequency envelope information, and time envelope information;

a coded sequence decoding and dequantization unit for decoding and inversely quantizing the supplementary information for high frequency band generation, the frequency envelope information, and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation unit for generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring time envelopes for a plurality of low frequency bands;

a time envelope calculation unit for calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit and the plurality of low frequency band time envelopes, which is acquired by the low frequency band time envelope calculation unit;

a frequency envelope calculation unit for calculating a frequency envelope using the frequency envelope information acquired by the coded sequence decoding and dequantization unit;

a time-frequency envelope adjustment unit for adjusting, using the time envelope acquired by the time envelope calculation unit and the frequency envelope acquired by the frequency envelope calculation unit, a time envelope and a frequency envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation unit for adding the high frequency band components, which are adjusted by the time-frequency envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

10. A speech encoder that encodes a speech signal, comprising:

a frequency transformation unit for transforming the speech signal into a frequency domain;

a down-sampling unit for down-sampling the speech signal and acquiring a low frequency band signal;

a low frequency band encoding unit for encoding the low frequency band signal acquired by the down-sampling unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for calculating a plurality of time envelopes of low frequency band components of the speech signal transformed into the frequency domain by the frequency transformation unit;

a time envelope information calculation unit for calculating, using the time envelopes of the low frequency band components calculated by the first to Nth low frequency band time envelope calculation unit, time envelope information necessary to acquire a time envelope of high frequency band components of the speech signal transformed by the frequency transformation unit;

a supplementary information calculation unit for analyzing the speech signal and calculating supplementary information for high frequency band generation to be used for generating high frequency band components from the low frequency band signal;

a quantization and encoding unit for quantizing and encoding the supplementary information for high frequency band generation, which is generated by the supplementary information calculation unit, and the time envelope information, which is calculated by the time envelope information calculation unit;

a coded sequence construction unit for constructing a high frequency band coded sequence from the supplementary information for high frequency band generation and the time envelope information quantized and encoded by the quantization and encoding unit; and

a multiplexing unit for generating a coded sequence in which the low frequency band coded sequence, which is acquired by the low frequency band encoding unit, and the high frequency band coded sequence, which is constructed by the coded sequence construction unit, are multiplexed.

11. The speech encoder according to claim 10, further comprising:

a frequency envelope calculation unit for calculating frequency envelope information of the high frequency band components of the speech signal transformed into the frequency domain by the frequency transformation unit, wherein

the quantization and encoding unit further quantizes and encodes the frequency envelope information, and

the coded sequence construction unit constructs the high frequency band coded sequence by further adding the frequency envelope information quantized and encoded by the quantization and encoding unit.

12. The speech encoder according to claim 10, further comprising:

a control information generation unit for generating time envelope calculation control information that controls time envelope calculation in a speech decoder using at least one of (i) the speech signal transformed into the frequency domain by the frequency transformation unit and (ii) the time envelope information calculated by the time envelope information calculation unit, wherein

the coded sequence construction unit constructs the high frequency band coded sequence by further adding the time envelope calculation control information generated by the control information generation unit.

13. The speech encoder according to claim 10, wherein

the time envelope information calculation unit calculates a time envelope of high frequency band components of the speech signal transformed into the frequency domain by the frequency transformation unit, and calculates the time envelope information based on correlation between a time envelope calculated from the first to Nth time envelopes of low frequency band components and the time envelope of the frequency components.

14. A speech decoding method of decoding a coded sequence generated by encoding a speech signal, comprising:

a demultiplexing step, performed by a demultiplexing unit, of demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding step, performed by a low frequency band decoding unit, of decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation step, performed by a frequency transformation unit, of transforming the low frequency band signal obtained by the low frequency band decoding unit into a frequency domain;

a high frequency band coded sequence analysis step, performed by a high frequency band coded sequence analysis unit, of analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation and time envelope information;

a coded sequence decoding and dequantization step, performed by coded sequence decoding and dequantization unit, of decoding and inversely quantizing the supplementary information for high frequency band generation and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation step, performed by a high frequency band generation unit, of generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation step, performed by a first to Nth low frequency band time envelope calculation unit, of analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring a plurality of low frequency band time envelopes;

a time envelope calculation step, performed by a time envelope calculation unit, of calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a time envelope adjustment step, performed by the time envelope adjustment unit, of adjusting a time envelope of the high frequency band components generated by the high frequency band generation unit using the time envelope acquired by the time envelope calculation unit; and

an inverse frequency transformation step, performed by an inverse frequency transformation unit, of adding the high frequency band components, which are adjusted by the time envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing the entire frequency band components.

15. A speech decoding method of decoding a coded sequence generated by encoding a speech signal, comprising:

a demultiplexing step, performed by a demultiplexing unit, of demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding step, performed by a low frequency band decoding unit, of decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation step, performed by a frequency transformation unit, of transforming the low frequency band signal, which is obtained by the low frequency band decoding unit, into a frequency domain;

a high frequency band coded sequence analysis step, performed by a high frequency band coded sequence analysis unit, of analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation, frequency envelope information, and time envelope information;

a coded sequence decoding and dequantization step, performed by a coded sequence decoding and dequantization unit, of decoding and inversely quantizing the supplementary information for high frequency band generation, the frequency envelope information, and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation step, performed by a high frequency band generation unit, of generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer of two or more) low frequency band time envelope calculation step, performed by a first to Nth low frequency band time envelope calculation unit, of analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring a plurality of low frequency band time envelopes;

a time envelope calculation step, performed by a time envelope calculation unit, of calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a frequency envelope superposition step, performed by a frequency envelope superposition unit, of superimposing the frequency envelope information, which is acquired by the coded sequence decoding and dequantization unit, onto the high frequency band time envelope and acquiring a time-frequency envelope;

a time-frequency envelope adjustment step, performed by a time-frequency envelope adjustment unit, of adjusting, using the time envelope acquired by the time envelope calculation unit and the time-frequency envelope acquired by the frequency envelope superposition unit, a time envelope and a frequency envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation step, performed by an inverse frequency transformation unit, of adding the high frequency band components, which are adjusted by the time-frequency envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

16. A speech decoding method of decoding a coded sequence generated by encoding a speech signal, comprising:

a demultiplexing step, performed by a demultiplexing unit, of demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding step, performed by a low frequency band decoding unit, of decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation step, performed by a frequency transformation unit, of transforming the low frequency band signal, which is obtained by the low frequency band decoding unit, into a frequency domain;

a high frequency band coded sequence analysis step, performed by a high frequency band coded sequence analysis unit, of analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation, frequency envelope information, and time envelope information;

a coded sequence decoding and dequantization step, performed by a coded sequence decoding and dequantization unit, of decoding and inversely quantizing the supplementary information for high frequency band generation, the frequency envelope information, and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation step, performed by a high frequency band generation unit, of generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation step, performed by a first to Nth low frequency band time envelope calculation unit, of analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring a plurality of low frequency band time envelopes;

a time envelope calculation step, performed by a time envelope calculation unit, of calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a frequency envelope calculation step, performed by a frequency envelope calculation unit, of calculating a frequency envelope using the frequency envelope information acquired by the coded sequence decoding and dequantization unit;

a time-frequency envelope adjustment step, performed by a time-frequency envelope adjustment unit, of adjusting, using the time envelope acquired by the time envelope calculation unit and the frequency envelope acquired by the frequency envelope calculation unit, a time envelope and a frequency envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation step, performed by an inverse frequency transformation unit, of adding the high frequency band components, which are adjusted by the time-frequency envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

17. A speech encoding method of encoding a speech signal, comprising:

a frequency transformation step, performed by a frequency transformation unit, of transforming the speech signal into a frequency domain;

a down-sampling step, performed by a down-sampling unit, of down-sampling the speech signal and acquiring a low frequency band signal;

a low frequency band encoding step, performed by a low frequency band encoding unit, of encoding the low frequency band signal acquired by the down-sampling unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation step, performed by first to Nth low frequency band time envelope calculation unit, of calculating a plurality of time envelopes of low frequency band components of the speech signal transformed into the frequency domain by the frequency transformation unit;

a time envelope information calculation step, performed by a time envelope information calculation unit, of calculating, using the time envelopes of the low frequency band components calculated by the first to Nth low frequency band time envelope calculation unit, time envelope information necessary to acquire a time envelope of high frequency band components of the speech signal transformed by the frequency transformation unit;

a supplementary information calculation step, performed by a supplementary information calculation unit, of analyzing the speech signal and calculating supplementary information for high frequency band generation to be used for generating high frequency band components from the low frequency band signal;

a quantization and encoding step, performed by quantization and encoding unit, of quantizing and encoding the supplementary information for high frequency bands generation, which is generated by the supplementary information calculation unit, and the time envelope information, which is calculated by the time envelope information calculation unit;

a coded sequence construction step, performed by a coded sequence construction unit, of constructing a high frequency band coded sequence from the supplementary information for high frequency band generation and the time envelope information quantized and encoded by the quantization and encoding unit; and

a multiplexing step, performed by a multiplexing unit, of generating a coded sequence in which the low frequency band coded sequence, which is acquired by the low frequency band encoding unit, and the high frequency band coded sequence, which is constructed by the coded sequence construction unit, are multiplexed.

18. A storage medium for storing a speech decoding program that decodes a coded sequence of encoded speech signal, the program causing a computer to function as:

a demultiplexing unit for demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding unit for decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation unit for transforming the low frequency band signal obtained by the low frequency band decoding unit into a frequency domain;

a high frequency band coded sequence analysis unit for analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation and time envelope information;

a coded sequence decoding and dequantization unit for decoding and inversely quantizing the supplementary information for high frequency band generation and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation unit for generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency hand signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring a plurality of low frequency band time envelopes;

a time envelope calculation unit for calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a time envelope adjustment unit for adjusting, using the time envelope acquired by the time envelope calculation unit, a time envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation unit for adding the high frequency band components, which are adjusted by the time envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

19. A storage medium for storing a speech decoding program that decodes a coded sequence of encoded speech signal, the program causing a computer to function as:

a demultiplexing unit for demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding unit for decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation unit for transforming the low frequency band signal obtained by the low frequency band decoding unit into a frequency domain;

a high frequency band coded sequence analysis unit for analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation, frequency envelope information, and time envelope information;

a coded sequence decoding and dequantization unit for decoding and inversely quantizing the supplementary information for high frequency band generation, the frequency envelope information, and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation unit for generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer of two or more) low frequency band time envelope calculation unit for analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring a plurality of low frequency band time envelopes;

a time envelope calculation unit for calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a frequency envelope superposition unit for superimposing the frequency envelope information, which is acquired by the coded sequence decoding and dequantization unit, onto the high frequency band time envelope and acquiring a time-frequency envelope;

a time-frequency envelope adjustment unit for adjusting, using the time envelope acquired by the time envelope calculation unit and the time-frequency envelope acquired by the frequency envelope superposition unit, a time envelope and a frequency envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation unit for adding the high frequency band components, which are adjusted by the time-frequency envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

20. A storage medium for storing a speech decoding program that decodes a coded sequence of encoded speech signal, the program causing a computer to function as:

a demultiplexing unit for demultiplexing the coded sequence into a low frequency band coded sequence and a high frequency band coded sequence;

a low frequency band decoding unit for decoding the low frequency band coded sequence demultiplexed by the demultiplexing unit and obtaining a low frequency band signal;

a frequency transformation unit for transforming the low frequency band signal obtained by the low frequency band decoding unit into a frequency domain;

a high frequency band coded sequence analysis unit for analyzing the high frequency band coded sequence demultiplexed by the demultiplexing unit and acquiring coded supplementary information for high frequency band generation, frequency envelope information, and time envelope information;

a coded sequence decoding and dequantization unit for decoding and inversely quantizing the supplementary information for high frequency band generation, the frequency envelope information, and the time envelope information acquired by the high frequency band coded sequence analysis unit;

a high frequency band generation unit for generating, using the supplementary information for high frequency band generation decoded by the coded sequence decoding and dequantization unit, high frequency band components in the frequency domain of the speech signal from the low frequency band signal transformed into the frequency domain by the frequency transformation unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for analyzing the low frequency band signal transformed into the frequency domain by the frequency transformation unit and acquiring a plurality of low frequency band time envelopes;

a time envelope calculation unit for calculating a high frequency band time envelope using the time envelope information, which is acquired by the coded sequence decoding and dequantization unit, and the plurality of low frequency band time envelopes, which are acquired by the low frequency band time envelope calculation unit;

a frequency envelope calculation unit for calculating a frequency envelope using the frequency envelope information acquired by the coded sequence decoding and dequantization unit;

a time-frequency envelope adjustment unit for adjusting, using the time envelope acquired by the time envelope calculation unit and the frequency envelope acquired by the frequency envelope calculation unit, a time envelope and a frequency envelope of the high frequency band components generated by the high frequency band generation unit; and

an inverse frequency transformation unit for adding the high frequency band components, which are adjusted by the time-frequency envelope adjustment unit, and the low frequency band signal, which is decoded by the low frequency band decoding unit, and outputting a time domain signal containing entire frequency band components.

21. A storage medium for storing a speech encoding program that encodes a speech signal, the program causing a computer to function as:

a frequency transformation unit for transforming the speech signal into a frequency domain;

a down-sampling unit for down-sampling the speech signal and acquiring a low frequency band signal;

a low frequency band encoding unit for encoding the low frequency band signal acquired by the down-sampling unit;

a first to Nth (N is an integer equal to or larger than two) low frequency band time envelope calculation unit for calculating a plurality of time envelopes of low frequency band components of the speech signal transformed into the frequency domain by the frequency transformation unit;

a time envelope information calculation unit for calculating, using the time envelopes of the low frequency band components calculated by the first to Nth low frequency band time envelope calculation unit, time envelope information necessary to acquire a time envelope of high frequency band components of the speech signal transformed by the frequency transformation unit;

a supplementary information calculation unit for analyzing the speech signal and calculating supplementary information for high frequency band generation to be used for generating high frequency band components from the low frequency band signal;

a quantization and encoding unit for quantizing and encoding the supplementary information for high frequency band generation, which is generated by the supplementary information calculation unit, and the time envelope information, which is calculated by the time envelope information calculation unit;

a coded sequence construction unit for constructing a high frequency band coded sequence from the supplementary information for high frequency band generation and the time envelope information quantized and encoded by the quantization and encoding unit; and

a multiplexing unit for generating a coded sequence in which the low frequency band coded sequence, which is acquired by the low frequency band encoding unit, and the high frequency band coded sequence, which is constructed by the coded sequence construction unit, are multiplexed.