Voice waveform interpolating apparatus and method

• US 20090326950A1
• Filed: 08/31/2009
• Published: 12/31/2009
• Est. Priority Date: 03/12/2007
• Status: Abandoned Application

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Matsumoto, Chikako
• Application Number:
  US12/585,005
• Publication Number:
  US 20090326950A1
• Time in Patent Office: Days
• US Class Current: 704/265
• CPC Class Codes: G10L 19/097 using prototype waveform decomposition or prototype waveform interpolative [PWI] coders

Abstract

A voice waveform interpolating apparatus for interpolating part of stored voice data by another part of the voice data so as to generate voice data. To achieve this, it comprises a voice storage unit, an interpolated waveform generation unit generating interpolated voice data, and a waveform combining unit outputting voice data, a part of the voice data is replaced with another part of the voice data, and further comprises an interpolated waveform setting function unit judging if the other part of the voice data is appropriate as interpolated voice data to be generated by the interpolated waveform generation unit.

Claims

1. A voice waveform interpolating apparatus comprising:

a voice storage unit storing voice data;

an interpolated waveform generation unit interpolating part of the voice data by another part of the voice data to generate voice data;

a waveform combining unit combining the voice data from the voice storage unit with the interpolated voice data from the interpolated waveform generation unit replacing part of the same; and

an interpolated waveform setting function unit judging if a part of the voice data is appropriate as interpolated voice data for interpolation in the interpolated waveform generation unit, selecting the voice data deemed appropriate, and setting it as the interpolated voice data.

2. A voice waveform interpolating apparatus as set forth in claim 1, wherein the interpolated waveform setting function unit includes

an amplitude information analyzing part analyzing amplitude information of the voice data from the voice storage unit and

a voice waveform judging unit judging the appropriateness as interpolated voice data based on the analysis results.

3. A voice waveform interpolating apparatus as set forth in claim 1, wherein

the amplitude information analyzing part comprises an amplitude value calculation unit calculating an amplitude value of the voice data to obtain the amplitude value of a time direction and an amplitude information storage unit temporarily storing the calculated amplitude value as amplitude information, and

the voice waveform judging unit judges the appropriateness as interpolated voice data according to the position on the amplitude envelope identified from the amplitude information of the time direction.

4. A voice waveform interpolating apparatus as set forth in claim 3, wherein when the voice waveform judging unit judges that the position on the amplitude envelope of interpolated voice data as a candidate replacing voice loss is, at least, at relative minimums of the amplitude or at the position immediately before an unvoiced segment, the voice data of the related part is not used as interpolated voice data, but other voice data at positions other than the voice data of the related part are searched for or background noise segments are searched for.

5. A voice waveform interpolating apparatus as set forth in claim 4, wherein the voice waveform judging unit selects at least one of the preceding (backward) voice data sequentially appearing earlier on the time axis in voice data to be interpolated and succeeding (forward) voice data appearing later on the time axis in the voice data for a candidate to become interpolated voice data replacing the voice loss.

6. A voice waveform interpolating apparatus as set forth in claim 3, further comprising

a voiced sound/unvoiced sound judging unit judging the voice by dividing the voice data stored in the voice storage unit into a voiced part and unvoiced part and

calculating the maximum value of the amplitude and the fluctuation rate of the amplitude for the voice part judged to be “

voiced”

by the amplitude calculation unit and the results are stored in the amplitude information storage unit, while calculating the average value of the amplitude for the unvoiced part judged to be “

unvoiced”

by the amplitude calculation unit and storing the results in the amplitude information storage unit.

7. A voice waveform interpolating apparatus as set forth in claim 3, further comprising a judgment threshold setting unit setting an amplitude judgment threshold when judging the appropriateness of the interpolated voice data by the voice waveform judging unit based on the voice data stored in the voice storage unit and the amplitude information stored in the amplitude information storage unit.

8. A voice waveform interpolating apparatus as set forth in claim 7, further comprising a speaker identifying unit setting the amplitude judgment threshold for each identified speaker.

9. A voice waveform interpolating apparatus as set forth in claim 6, further comprising an amplitude usage range setting unit, the amplitude usage range setting unit setting what range of the amplitude information is to be used by the voice waveform judging unit.

10. A voice waveform interpolating apparatus as set forth in claim 9, wherein the amplitude usage range is set as a range of time.

11. A voice waveform interpolating apparatus as set forth in claim 9, wherein the amplitude usage range refers to the judgment results of the voiced sound/unvoiced sound judging unit and sets a voiced sound segment between two unvoiced sound segments as the usage range of the amplitude.

12. A voice waveform interpolating apparatus as set forth in claim 9, wherein the amplitude usage range refers to the judgment results of the voiced sound/unvoiced sound judging unit and sets one breath group as the usage range of the amplitude.

13. A voice waveform interpolating apparatus used in a packet communication system, comprising

a voice storage unit storing in sequence voice data of each normally received packet among successively received packets,

an interpolated waveform generation unit interpolating a missing part of voice data by another part of the voice data when part of the voice data is missing due to packet loss so as to generate voice data,

a waveform combining unit combining voice data stored in the voice storage unit with the interpolated voice data from the interpolated waveform generation unit replacing part of the same, and

an interpolated waveform setting function unit judging if the part of the voice data is appropriate as interpolated voice data for interpolation in the interpolated waveform generation unit, selecting the voice data deemed appropriate, and setting it as the interpolated voice data.

14. A voice waveform interpolating apparatus used in a voice editing or processing system, comprising

a voice storage unit storing a plurality of phoneme pieces,

an interpolated waveform generation unit interpolating part of a series of voice data by repeated use of a phoneme piece so as to generate voice data,

a waveform combining unit combining the voice data stored in the voice storage unit with the interpolated voice data from the interpolated waveform generation unit replacing part of the same, and

an interpolated waveform setting function unit judging if the part of the voice data is appropriate as interpolated voice data for interpolation in the interpolated waveform generation unit, selecting the voice data deemed appropriate, and setting it as the interpolated voice data.

15. A voice waveform interpolating method interpolating part of stored voice data by another part of the voice data so as to generate voice data, comprising:

storing the voice data,

judging if the part of the voice data is appropriate as interpolated voice data for interpolation in the interpolated waveform generation unit, selecting the voice data deemed appropriate, and setting it as the interpolated voice data, and

combining the stored voice data with the set interpolated voice data.

16. A voice waveform interpolating method as set forth in claim 15, wherein the judging and setting step comprises

analyzing the amplitude information for the stored voice data and

judging the appropriateness as the interpolated voice data based on the analysis results.

17. A computer readable recording medium storing a voice waveform interpolating program causing a computer to interpolate part of stored voice data by another part of the voice data so as to generate voice data, said program comprising:

storing the voice data,

judging if the part of the voice data is appropriate as interpolated voice data for interpolation in the interpolated waveform generation unit, selecting the voice data deemed appropriate, and setting it as the interpolated voice data, and

combining the stored voice data with the set interpolated voice data.