Interpolating between representative frame waveforms of a prediction error signal for speech synthesis

• US 5,890,118 A
• Filed: 03/08/1996
• Issued: 03/30/1999
• Est. Priority Date: 03/16/1995
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Kagoshima, Takehiko, Akamine, Masami
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Storm, Donald L.
• Application Number:
  US08/613,093
• Time in Patent Office: 1,117 Days
• Field of Search: 395/2.74, 395/2.77, 395/2.76, 395/2.69, 704/261, 704/258, 704/207, 704/208, 704/262, 704/264, 704/221, 704/222, 704/223, 704/219
• US Class Current: 704/265
• CPC Class Codes: G10L 13/07 Concatenation rules

Abstract

A speech synthesis apparatus includes; a memory for storing a plurality of typical waveforms corresponding to a plurality of frames, the typical waveforms each previously obtained by extracting in units of at least one frame from a prediction error signal formed in predetermined units, a voiced speech source generator including an interpolation circuit for performing interpolation between the typical waveforms read out from the memory means to obtain a plurality of interpolation signals each having at least one of an interpolation pitch period and a signal level which changes smoothly between the corresponding frames, a superposition circuit for superposing the interpolation signals obtained by the interpolation circuit to form a voiced speech source signal, an unvoiced speech source generator for generating an unvoiced speech source signal, and a vocal tract filter selectively driven by the voiced speech source signal outputted from the voiced speech source generator and the unvoiced speech source signal from the unvoiced speech source generator to generate synthetic speech. Further, interpolation positions can be determined bases on the pitch period.

Claims

1. A speech synthesis apparatus comprising:

a memory for storing a plurality of typical waveforms corresponding to a plurality of frames, the typical waveforms each previously obtained by extracting in units of at least one frame from a prediction error signal formed in predetermined units;

a voiced speech source generator including an interpolation circuit for performing interpolation between the typical waveforms readout from said memory to obtain a plurality of interpolation signals each having at least one of an interpolation pitch period and a signal level which changes smoothly between the corresponding frames, and a superposing circuit for superposing the interpolation signals obtained by said interpolation circuit to form a voiced speech source signal;

an unvoiced speech source generator for generating an unvoiced speech source signal; and

vocal tract filter selectively driven by the voiced speech source signal outputted from said voiced speech source generator and the unvoiced speech source signal from said unvoiced speech source generator to generate synthetic speech.

2. A speech synthesis apparatus according to claim 1, wherein said voiced speech source generator includes a typical waveform storage for storing a plurality of typical waveforms representative of the plurality of frames, respectively, in units of at least one phoneme, and said interpolation circuit performs interpolation between the typical waveforms so that the the voiced speech source signal changes smoothly.

3. A speech synthesis apparatus according to claim 1, wherein said interpolation circuit includes means for performing interpolation by weighting the typical waveforms with weight coefficients making the voiced speech source signal change smoothly.

4. A speech synthesis apparatus according to claim 1, wherein said interpolation circuit includes a Fourier transformer for Fourier-transforming consecutive ones of the typical waveforms to a frequency vector to output a frequency spectrum signal corresponding to the typical waveforms, and an inverse Fourier transformer for inverse-Fourier-transforming the frequency spectrum by interpolating an absolute value of the frequency spectrum signal and a phase thereof.

5. A speech synthesis apparatus according to claim 1, wherein said interpolation circuit comprises a pitch information generator for generating first pitch period information and a second pitch period information delayed for at least one frame from the first pitch period information, and a pitch period interpolation circuit for interpolating the pitch period so that the pitch periods corresponding to two consecutive frames may change smoothly, on the basis of the first pitch period specified by said first pitch period information and the second pitch period specified by said second pitch period information from said pitch information generator.

6. A speech synthesis apparatus according to claim 1, wherein said typical waveform storage stores typical waveforms each having a zero phase for obtaining a symmetrical wave.

7. A speech synthesis apparatus according to claim 1, wherein said interpolation circuit includes a typical waveform interpolation circuit for performing interpolation to the typical waveforms so that the typical waveforms read from said typical waveform storage and corresponding to consecutive frames change smoothly, and a pitch interpolation circuit for interpolating a gap between the typical waveforms, and said pitch interpolation circuit includes a pitch information generator for generating first pitch period information and second pitch period information delayed for one frame from the first pitch period information, and a pitch period interpolation circuit for performing interpolation between the typical waveforms so that the pitch period corresponding to two consecutive frames change smoothly, on the basis of the first pitch period specified by said first pitch period information and the second pitch period specified by said second pitch period information from said pitch information generator.

8. A speech synthesis apparatus according to claim 7, wherein said typical waveform storage stores typical waveforms each having a zero phase for obtaining a symmetrical wave.

9. A speech synthesis apparatus according to claim 7, wherein said interpolation circuit comprises a Fourier transformer for performing Fourier transformation of the consecutive typical waveforms into a frequency spectrum and outputs a frequency spectrum signal corresponding to the typical waveforms and an inverse Fourier transformer for performing inverse Fourier transformation of the frequency spectrum by performing interpolation to an absolute value of the frequency spectrum signal and a phase thereof.

10. A speech synthesis apparatus comprising:

a typical waveform storage storing a plurality of typical waveforms each representative of individual frames of voiced speech source signals obtained by dividing a time-sequence signal into specific frame units and outputs a typical waveform selected according to waveform selection information given for each frame in accordance with a speech signal to be synthesized;

an interpolation position determining circuit for determining the interpolation positions extending over two consecutive frames on the basis of the pitch period given in accordance with the speech signal to be synthesized;

a waveform interpolation circuit for forming a plurality of voiced speech waveforms corresponding to the interpolation positions determined by said interpolation position determining circuit by performing interpolation to the typical waveforms corresponding to the two consecutive frames outputted from said typical waveform storage;

a waveform superposing circuit for superposing the voiced speech source signal waveforms obtained by said waveform interpolation circuit and corresponding to the interpolation positions determined by said interpolation position determining circuit, to obtain a voiced speech source signal; and

a vocal tract filter driven by said voiced speech source signal for generating synthetic speech.

11. A speech synthesis apparatus comprising:

a typical waveform storage for storing a plurality of typical waveforms each representative of individual frames of voiced speech source signals obtained by dividing a time-sequence signal into specific frame units and outputs a plurality of typical waveforms selected according to waveform selecting information given for each frame in accordance with a speech signal to be synthesized;

a pitch interpolation circuit for interpolating a pitch period given to the typical waveforms so that the pitch periods corresponding to two consecutive frames change smoothly, on the basis of the pitch period given to the typical waveforms for each frame in accordance with the speech signal to be synthesized;

an interpolation position determining circuit for determining the interpolation positions extending over two consecutive frames according to a plurality of interpolated pitch periods obtained by said pitch interpolation circuit;

waveform processing means for arranging the typical waveforms readout from said typical waveform storage at the interpolation positions determined at said interpolation position determining circuit, to obtain a voiced speech source signal; and

a vocal tract filter section driven by said voiced speech source signal for generating synthetic speech.

12. A speech synthesis apparatus according to claim 11, which includes a waveform interpolation circuit for interpolating the typical waveforms corresponding to two consecutive frames to obtain interpolated waveforms corresponding to the interpolation positions determined by said interpolation position determining circuit, and wherein said waveform processing circuit arranges the interpolated waveforms at the determined interpolation positions.

13. A speech synthesis method comprising the steps of:

preparing a plurality of prediction error signals corresponding to phonemes of plural frames;

extracting a plurality of typical waveforms from the prediction error signals in predetermined units and storing the typical waveforms extracted in a storage;

interpolating the typical waveforms corresponding to consecutive frames so that the pitch period and signal waveform change smoothly between the consecutive frames to obtain interpolation signals;

forming a voiced speech source signal by superposing the interpolation signals;

forming an unvoiced speech source signal; and

forming a synthesis speech in accordance with the voiced source signals and the unvoiced speech source signals.

14. A speech synthesis method according to claim 13, wherein said step of interpolation performs interpolation between the typical waveforms so that the pitch periods corresponding to the consecutive frames change smoothly.

15. A speech synthesis method according to claim 14, wherein said step of interpolation includes a step of weighting the typical waveforms with weight coefficients making said pitch periods change smoothly.

16. A speech synthesis method according to claim 13, wherein the step of interpolation includes a step of Fourier-transforming the consecutive typical waveforms to a frequency vector to output a frequency spectrum signal corresponding to the typical waveforms, and a step of inverse-Fourier-transforming the frequency spectrum by interpolating an absolute value of the frequency spectrum signal and a phase thereof.

17. A speech synthesis method according to claim 13, wherein said step of interpolation includes a step of generating first pitch period information and second pitch period information delayed for one frame from the first pitch period information, and a step of interpolating the pitch period so that the pitch periods corresponding to two consecutive frames change smoothly, on the basis of the first pitch period specified by said first pitch period information and the second pitch period specified by said second pitch period information.

18. A speech synthesis method according to claim 13, wherein said step of interpolation includes a step of performing interpolation to the typical waveforms so that the typical waveforms read from said storage and corresponding to consecutive frames change smoothly and a step of interpolating the pitch period of the typical waveforms, and said pitch interpolation step including generating first pitch period information and second pitch period information delayed for one frame from the first pitch period information, and the step of interpolating pitch period performs interpolation to the pitch period so that the pitch periods corresponding to two consecutive frames change smoothly, on the basis of the first pitch period specified by said first pitch period information and the second pitch period specified by the second pitch period information.

19. A speech synthesis system, comprising:

means for preparing a plurality of prediction error signals corresponding to phonemes of plural frames;

means for extracting a plurality of typical waveforms from the prediction error signals in predetermined units and storing the typical waveforms extracted in a memory;

means for interpolating the typical waveforms corresponding to consecutive frames so that the pitch period and signal waveforms change smoothly between the consecutive frames to obtain interpolation signals;

means for forming a voiced speech source signal by superposing the interpolation signals;

forming an unvoiced speech source signal; and

forming a synthesis speech in accordance with the voiced source signals and the unvoiced speech source signals.