Coding device, decoding device, coding method, and decoding method for audio signals

• US 9,117,461 B2
• Filed: 10/05/2011
• Issued: 08/25/2015
• Est. Priority Date: 10/06/2010
• Status: Active Grant

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Ishikawa, Tomokazu, Norimatsu, Takeshi, Zhong, Haishan, Zhao, Dan, Chong, Kok Seng
• Primary Examiner(s): Bryar, Jeremiah
• Application Number:
  US13/816,741
• Publication Number:
  US 20130144611A1
• Time in Patent Office: 1,420 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G10L 19/0212 using orthogonal transformation
• CPC Class Codes: G10L 19/09 Long term prediction, i.e. removing periodical redundancies, e.g. by using adaptive codebook or pitch predictor
• CPC Class Codes: G10L 19/26 Pre-filtering or post-filtering
• CPC Class Codes: G10L 19/265 Pre-filtering, e.g. high frequency emphasis prior to encoding
• CPC Class Codes: G10L 2025/906 Pitch tracking
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals

Abstract

A coding device includes: a pitch contour detection unit which detects a pitch contour of an input audio signal; a dynamic time warping unit which determines the number of pitch nodes based on the pitch contour and generates a first time warping parameter including information indicating the determined number of pitch nodes, a pitch change position, and a pitch change ratio; a first encoder which codes the first time warping parameter; a time warping unit which corrects pitch, using the information obtained from the first time warping parameter, to approximate the pitches of the number of pitch nodes to a predetermined reference value; a second encoder which codes the input audio signal at the corrected pitch; and a multiplexer which multiplexes the coded time warping parameter and the coded audio signal to generate a bitstream.

Claims

1. A coding device comprising:

a pitch contour detection unit configured to detect a pitch contour that is information indicating a change in pitch of an input audio signal within a period;

a dynamic time warping unit configured to;

analyze the detected pitch contour; and

determine, based on a result of the analysis, the number of pitch nodes that is an optimal number of pitches detected within the period; and

generate a first time warping parameter including information indicating the determined number of pitch nodes, a pitch change position, and a pitch change ratio, the pitch change position being a position where the change in pitch occurs in pitches of the number of pitch nodes, the pitch change ratio being a ratio of the change in pitch at the pitch change position;

a first encoder which codes the generated first time warping parameter to generate a coded time warping parameter;

a time warping unit configured to correct, using the information obtained from the generated first time warping parameter, at least one pitch included in the pitches of the number of pitch nodes, to approximate the pitches of the number of pitch nodes to a predetermined reference value;

a second encoder which codes the input audio signal at the pitch corrected by the time warping unit to generate a coded audio signal; and

a multiplexer which multiplexes the coded time warping parameter generated by the first encoder and the coded audio signal generated by the second encoder to generate a bitstream.

2. The coding device according to claim 1, further comprising

a decoding unit configured to decode the coded time warping parameter generated by the first encoder to generate a second time warping parameter including information indicating the number of pitch nodes, the pitch change position, and the pitch change ratio in the pitch contour within the period,

wherein the time warping unit is configured to correct the pitches using the second time warping parameter generated by the decoding unit.

3. The coding device according to claim 1,

wherein the input audio signal includes signals of two channels,

the coding device further comprises:

a main/side (M/S) computation unit configured to calculate a similarity level of pitch contours of the signals of the two channels to generate a flag indicating whether or not the calculated similarity level is greater than a predetermined value; and

a down-mix unit configured to;

output one signal obtained by down-mixing the signals of the two channels when the generated flag indicates that the similarity level is greater than the predetermined value; and

output the signals of the two channels when the flag indicates that the similarity level is less than or equal to the predetermined value, and

the pitch contour detection unit is configured to detect the pitch contour for each of the signals outputted by the down-mix unit.

4. The coding device according to claim 1, further comprising

a comparison unit configured to compare a first coded signal with a second coded signal, the first coded signal being the coded audio signal generated by the second encoder, the second coded signal being obtained by coding the input audio signal through another coding scheme,

wherein the comparison unit is configured to:

decode the first coded signal using the coded time warping parameter generated by the first encoder to calculate a first difference that is a difference between the input audio signal and the decoded first coded signal;

decode the second coded signal to calculate a second difference that is a difference between the input audio signal and the decoded second coded signal; and

output the first coded signal when the first difference is less than the second difference, and

the multiplexer multiplexes the first coded signal outputted by the comparison unit and the coded time warping parameter to generate the bitstream.

5. A decoding device comprising:

a demultiplexer which demultiplexes a coded audio signal and a coded time warping parameter from a bitstream, the coded audio signal being obtained by coding a pitch-corrected audio signal, the coded time warping parameter being obtained by coding a first time warping parameter for correcting pitches, the bitstream being obtained by multiplexing the coded audio signal and the coded time warping parameter;

a first decoding unit configured to decode the coded time warping parameter to generate a second time warping parameter including information indicating the number of pitch nodes, a pitch change position, and a pitch change ratio, the number of pitch nodes being the number of pitches detected within a period, the pitch change position being a position where a change in pitch occurs in pitches of the number of pitch nodes, the pitch change ratio being a ratio of the change at the pitch change position;

a second decoding unit configured to decode the coded audio signal to generate a pitch-corrected audio signal obtained by correcting pitch to approximate the pitches of the number of pitch nodes to a predetermined reference value; and

a time warping unit configured to transform, using the second time warping parameter, the pitch-corrected audio signal into an audio signal before correction by changing at least one pitch included in the pitches of the number of pitch nodes to restore the pitches of the number of pitch nodes to pitches before correction.

6. The decoding device according to claim 5,

wherein the audio signal includes signals of two channels,

the decoding device further comprises

an M/S mode detection unit configured to generate a flag indicating whether or not a similarity level of pitch contours of the signals of the two channels is greater than a predetermined value, and

the first decoding unit is configured to:

generate the second time warping parameter common to the signals of the two channels when the generated flag indicates that the similarity level is greater than the predetermined value; and

to generate the second time warping parameter for each of the signals of the two channels when the generated flag indicates that the similarity level is less than or equal to the predetermined value.

7. A coding method comprising:

detecting a pitch contour of an input audio signal, the pitch contour being information indicating a change in pitch within a period;

analyzing the detected pitch contour; and

determining, based on a result of the analyzing, the number of pitch nodes that is an optimal number of pitches detected within the period, to generate a first time warping parameter including information indicating the determined number of pitch nodes, a pitch change position, and a pitch change ratio, the pitch change position being a position where the change in pitch occurs in pitches of the number of pitch nodes, the pitch change ratio being a ratio of the change at the pitch change position;

coding the generated first time warping parameter to generate a coded time warping parameter;

correcting, using the information obtained from the generated first time warping parameter, at least one pitch included in the pitches of the number of pitch nodes, to approximate the pitches of the number of pitch nodes to a predetermined reference value;

coding the input audio signal having the pitch corrected in the correcting to generate a coded audio signal; and

multiplexing the coded time warping parameter generated in the coding of the generated first time warping parameter and the coded audio signal generated in the coding of the input audio signal, to generate a bitstream.

9. A non-transitory computer-readable recording medium on which a program is recorded which causes a computer to execute steps included in the coding method according to claim 7.

8. A decoding method comprising:

demultiplexing a coded audio signal and a coded time warping parameter from a bitstream, the coded audio signal being obtained by coding a pitch-corrected audio signal, the coded time warping parameter being obtained by coding a first time warping parameter for correcting pitches, the bitstream being obtained by multiplexing the coded audio signal and the coded time warping parameter;

decoding the coded time warping parameter to generate a second time warping parameter including information indicating the number of pitch nodes, a pitch change position, and a pitch change ratio, the number of pitch nodes being the number of pitches detected within a period, the pitch change position being a position where a change in pitch occurs in pitches of the number of pitch nodes, the pitch change ratio being a ratio of the change at the pitch change position;

decoding the coded audio signal to generate a pitch-corrected audio signal obtained by correcting pitch to approximate the pitches of the number of pitch nodes to a predetermined reference value; and

transforming, using the second time warping parameter, the pitch-corrected audio signal into an audio signal before correction by changing at least one pitch included in the pitches of the number of pitch nodes to restore the pitches of the number of pitch nodes to pitches before correction.

10. A non-transitory computer-readable recording medium on which a program is recorded which causes a computer to execute steps included in the decoding method according to claim 8.

11. An integrated circuit comprising:

a pitch contour detection unit configured to detect a pitch contour that is information indicating a change in pitch of an input audio signal within a period;

a dynamic time warping unit configured to;

analyze the detected pitch contour; and

determine, based on a result of the analysis, the number of pitch nodes that is an optimal number of pitches detected within the period; and

generate a first time warping parameter including information indicating the determined number of pitch nodes, a pitch change position, and a pitch change ratio, the pitch change position being a position where the change in pitch occurs in pitches of the number of pitch nodes, the pitch change ratio being a ratio of the change in pitch at the pitch change position;

a first encoder which codes the generated first time warping parameter to generate a coded time warping parameter;

a time warping unit configured to correct, using the information obtained from the generated first time warping parameter, at least one pitch included in the pitches of the number of pitch nodes, to approximate the pitches of the number of pitch nodes to a predetermined reference value;

a second encoder which codes the input audio signal at the pitch corrected by the time warping unit to generate a coded audio signal; and

a multiplexer which multiplexes the coded time warping parameter generated by the first encoder and the coded audio signal generated by the second encoder to generate a bitstream.

12. An integrated circuit comprising:

a demultiplexer which demultiplexes a coded audio signal and a coded time warping parameter from a bitstream, the coded audio signal being obtained by coding a pitch-corrected audio signal, the coded time warping parameter being obtained by coding a first time warping parameter for correcting pitches, the bitstream being obtained by multiplexing the coded audio signal and the coded time warping parameter;

a first decoding unit configured to decode the coded time warping parameter to generate a second time warping parameter including information indicating the number of pitch nodes, a pitch change position, and a pitch change ratio, the number of pitch nodes being the number of pitches detected within a period, the pitch change position being a position where a change in pitch occurs in pitches of the number of pitch nodes, the pitch change ratio being a ratio of the change at the pitch change position;

a second decoding unit configured to decode the coded audio signal to generate a pitch-corrected audio signal obtained by correcting pitch to approximate the pitches of the number of pitch nodes to a predetermined reference value; and

a time warping unit configured to transform, using the second time warping parameter, the pitch-corrected audio signal into an audio signal before correction by changing at least one pitch included in the pitches of the number of pitch nodes to restore the pitches of the number of pitch nodes to pitches before correction.