Audio decoding device, audio encoding device, audio decoding method, audio encoding method, audio decoding program, and audio encoding program

• US 10,410,647 B2
• Filed: 03/20/2015
• Issued: 09/10/2019
• Est. Priority Date: 03/24/2014
• Status: Active Grant

• Current Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Inventors: Kikuiri, Kei, Yamaguchi, Atsushi
• Primary Examiner(s): Hang, Vu B
• Application Number:
  US15/128,364
• Publication Number:
  US 20170117000A1
• Time in Patent Office: 1,635 Days
• CPC Class Codes: G10L 19/02 using spectral analysis, e.g. transform vocoders or subband vocoders
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 19/028 Noise substitution, i.e. substituting non-tonal spectral components by noisy source comfort noise for discontinuous speech transmission G10L19/012
• CPC Class Codes: G10L 19/032 Quantisation or dequantisation of spectral components
• CPC Class Codes: G10L 19/12 the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
• CPC Class Codes: G10L 19/167 Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G10L 21/038 using band spreading techniques

Abstract

The purpose of the present invention is to reduce distortion a frequency band component encoded with a small number of bits in a time domain and improve quality. An audio decoding device decodes an encoded audio signal and outputs the audio signal. A decoding unit decodes an encoded sequence containing an encoded audio signal and obtains a decoded signal. A selective temporal envelope shaping unit shapes a temporal envelope of a decoded signal in the frequency band on the basis of decoding related information concerning decoding of the encoded sequence.

Claims

1. An audio decoding device that decodes an encoded audio signal and outputs the audio signal, comprising a processor configured to:

decode an encoded sequence containing the encoded audio signal and obtain a decoded signal; and

shape a temporal envelope of a decoded signal in a plurality of frequency bands based on decoding related information concerning decoding of the encoded sequence by;

the processor being configured to replace a part of the decoded signal corresponding to a part of the frequency bands where the temporal envelope is not to be shaped with another signal in a frequency domain, the processor further configured to shape a part of the decoded signal corresponding to another part of the frequency bands where the temporal envelope is to be shaped and the part of the frequency bands where the temporal envelope is not to be shaped into a desired temporal envelope by filtering with a filter the part of the decoded signal corresponding to the another part of the frequency bands where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the part of the frequency bands where the temporal envelope is not to be shaped, the filter comprising a linear prediction coefficient obtained by the processor by linear prediction analysis of the decoded signal in the frequency domain and, after the temporal envelope shaping, the processor further configured to set the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the part of the frequency bands where the temporal envelope is not to be shaped.

3. The audio decoding device according to claim 1, wherein the processor is further configured to:

perform at least one of decoding and inverse quantization of the encoded sequence and obtain a frequency-domain decoded signal; and

output, as decoding related information, at least one of information obtained in the course of at least one of decoding and inverse quantization in the processor and information obtained by analyzing the encoded sequence.

4. The audio decoding device according to claim 1, wherein the processor is further configured to:

extract a first encoded sequence and a second encoded sequence from the encoded sequence;

perform at least one of decoding and inverse quantization of the first encoded sequence, obtain a first decoded signal, and obtain first decoding related information as the decoding related information; and

obtain and output a second decoded signal by using at least one of the second encoded sequence and the first decoded signal, and output second decoding related information as the decoding related information.

5. The audio decoding device according to claim 4, wherein the processor is further configured to:

perform at least one of decoding and inverse quantization of the first encoded sequence and obtain a first decoded signal; and

output, as first decoding related information, at least one of information obtained in the course of at least one of decoding and inverse quantization in the processor and information obtained by analyzing the first encoded sequence.

6. The audio decoding device according to claim 4, wherein the processor is further configured to:

obtain a second decoded signal by using at least one of the second encoded sequence and the first decoded signal; and

output, as second decoding related information, at least one of information obtained in the course of obtaining the second decoded signal in the processor and information obtained by analyzing the second encoded sequence.

7. The audio decoding device according to claim 1, wherein the processor is further configured to:

shape a temporal envelope in each of the frequency bands of the frequency-domain decoded signal based on the decoding related information; and

transform the frequency-domain decoded signal where the temporal envelope in each of the frequency bands has been shaped into a time-domain signal.

8. The audio decoding device according to claim 1, wherein the decoding related information is information concerning the number of encoded bits in each of the frequency bands.

9. The audio decoding device according to claim 1, wherein the decoding related information is information concerning a quantization value in each of the frequency bands.

10. The audio decoding device according to claim 1, wherein the decoding related information is information concerning an encoding scheme in each frequency band.

11. The audio decoding device according to claim 1, wherein the decoding related information is information concerning a noise component to be filled to each frequency band.

2. An audio decoding device that decodes an encoded audio signal and outputs the audio signal, comprising processor configured to:

extract temporal envelope information concerning a temporal envelope of an audio signal from an input encoded sequence;

decode an encoded sequence containing the encoded audio signal and obtain a decoded signal; and

shape a temporal envelope of a decoded signal in a plurality of frequency bands based on decoding related information concerning decoding of the encoded sequence by;

the processor being configured to replace a part of the decoded signal corresponding to a part of the frequency bands where the temporal envelope is not to be shaped with another signal in a frequency domain, the processor further configured to shape a part of the decoded signal corresponding to another part of the frequency bands where the temporal envelope is to be shaped and the part of the frequency bands where the temporal envelope is not to be shaped into a desired temporal envelope by filtering with a filter the part of the decoded signal corresponding to the another part of the frequency bands where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the part of the frequency bands where the temporal envelope is not to be shaped, the filter comprising a linear prediction coefficient obtained by the processor by linear prediction analysis of the decoded signal in the frequency domain and, after the temporal envelope shaping, the processor further configured to set the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the part of the frequency bands where the temporal envelope is not to be shaped.

12. An audio decoding device that decodes an encoded audio signal and outputs the audio signal, comprising a processor configured to:

decode an encoded sequence containing the encoded audio signal and obtain a decoded signal; and

shape the decoded signal into a desired temporal envelope by filtering the decoded signal in the frequency domain with a filter, the filter comprising a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain, and by

the processor being configured to replace a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, the processor further configured to shape a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering with the filter the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to frequency band where the temporal envelope is not to be shaped and, after the temporal envelope shaping, the processor further configured to set the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.

13. An audio decoding method of an audio decoding device that decodes an encoded audio signal and outputs the audio signal, comprising:

a decoding step of decoding, with the audio decoding device, an encoded sequence containing the encoded audio signal and obtaining a decoded signal; and

a selective temporal envelope shaping step of shaping, by the audio decoding device, a temporal envelope of a decoded signal in a frequency band based on decoding related information concerning decoding of the encoded sequence,

wherein the selective temporal envelope shaping step comprises replacing, by the audio decoding device, a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, then shaping, by the audio decoding device, a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering, with the audio decoding device, the part of the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the frequency band where the temporal envelope is not to be shaped with a filter using a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain and, after the temporal envelope shaping, setting, by the audio decoding device, the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.

14. An audio decoding method of an audio decoding device that decodes an encoded audio signal and outputs the audio signal, comprising:

a extracting step of extracting, with the audio decoding device, temporal envelope information concerning a temporal envelope of an audio signal from an encoded sequence;

a decoding step of decoding, by the audio decoding device, the encoded sequence and obtaining a decoded signal; and

a selective temporal envelope shaping step of shaping, by the audio decoding device, a temporal envelope of a decoded signal in a frequency band based on at least one of the temporal envelope information and decoding related information concerning decoding of the encoded sequence,

wherein the selective temporal envelope shaping step comprises replacing, by the audio decoding device, a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, shaping, with the audio decoding device, a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering, with the audio decoding device, the part of the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the frequency band where the temporal envelope is not to be shaped with a filter using a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain and, after the temporal envelope shaping, setting, by the audio decoding device, the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.

15. An audio decoding method of an audio decoding device that decodes an encoded audio signal and outputs the audio signal, comprising:

a decoding step of decoding, with the audio decoding device, an encoded sequence containing the encoded audio signal and obtaining a decoded signal; and

a temporal envelope shaping step of shaping, with the audio decoding device, the decoded signal into a desired temporal envelope by filtering the decoded signal in the frequency domain with use of a filter using a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain,

wherein the selective temporal envelope shaping step comprises replacing, by the audio decoding device, a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, wherein the filtering comprises shaping, by the audio decoding device, a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering, with the audio decoding device, the part of the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the frequency band where the temporal envelope is not to be shaped and, after the temporal envelope shaping, setting, by the audio decoding device, the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.

16. A non-transitory computer readable storage medium storing an audio decoding program that causes a computer to execute:

a decoding step of decoding an encoded sequence containing the encoded audio signal and obtaining a decoded signal; and

a selective temporal envelope shaping step of shaping a temporal envelope of a decoded signal in a frequency band based on decoding related information concerning decoding of the encoded sequence,

wherein the selective temporal envelope shaping step comprises replacing a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, then shaping a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering the part of the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the frequency band where the temporal envelope is not to be shaped with a filter using a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain and, after the temporal envelope shaping, setting the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.

17. A non-transitory computer readable storage medium storing an audio decoding program that causes a computer to execute:

a extracting step of extracting temporal envelope information concerning a temporal envelope of an audio signal from an encoded sequence;

a decoding step of decoding the encoded sequence and obtaining a decoded signal; and

a selective temporal envelope shaping step of shaping a temporal envelope of a decoded signal in a frequency band based on at least one of the temporal envelope information and decoding related information concerning decoding of the encoded sequence,

wherein the selective temporal envelope shaping step comprises replacing a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, shaping a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering the part of the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the frequency band where the temporal envelope is not to be shaped with a filter using a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain and, after the temporal envelope shaping, setting the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.

18. A non-transitory computer readable storage medium storing an audio decoding program that causes a computer to execute:

a decoding step of decoding an encoded sequence containing the encoded audio signal and obtaining a decoded signal; and

a temporal envelope shaping step of shaping the decoded signal into a desired temporal envelope by filtering the decoded signal in the frequency domain with use of a filter using a linear prediction coefficient obtained by linear prediction analysis of the decoded signal in the frequency domain,

wherein the selective temporal envelope shaping step comprises replacing a part of the decoded signal corresponding to a frequency band where the temporal envelope is not to be shaped with another signal in a frequency domain, wherein the filtering comprises shaping a part of the decoded signal corresponding to another frequency band where the temporal envelope is to be shaped and the frequency band where the temporal envelope is not to be shaped into a desired temporal envelope by filtering the part of the decoded signal corresponding to the another frequency band where the temporal envelope is to be shaped and the another signal in the frequency domain corresponding to the frequency band where the temporal envelope is not to be shaped and, after the temporal envelope shaping, setting the part of the decoded signal replaced with the another signal in the frequency domain back to the part of the decoded signal corresponding to the frequency band where the temporal envelope is not to be shaped.