Method for synthesizing voiceless consonants

• US 6,112,178 A
• Filed: 03/05/1999
• Issued: 08/29/2000
• Est. Priority Date: 07/03/1996
• Status: Expired due to Term

• Current Assignee: Hanger Solutions, LLC (IP Investments Group LLC)
• Original Assignee: Telia AB (Government of Norway)
• Inventors: Kaja, Jaan
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Smits, Talivaldis Ivars
• Application Number:
  US09/147,466
• Time in Patent Office: 543 Days
• Field of Search: 704/258, 704/267
• US Class Current: 704/267
• CPC Class Codes: G10L 13/07 Concatenation rules

Abstract

A method for synthesizing speech using concatenation and Hanning-windows, in which a synthetic waveform is formed by concatenation of suitably selected parts of recorded human speech, the selected parts being windowed out with a Hanning window and copied into suitably selected locations in the synthetic waveform. The method is adapted to synthesize unvoiced consonants and includes the steps of palindromically copying suitably selected parts of the recorded human speech to form a synthesized waveform for the unvoiced consonant using concatenation. The method may be used for diphone, or polyphone, synthesis. The advantage of this palindromic synthesis method is that when the copying process has been reversed the second time there is either no repetition of identical blocks, or else the time difference between repetitions is markedly larger in comparison with known methods, thus minimizing unwanted periodic artifacts in the synthesized speech.

Claims

1. A method for synthesising speech using concatenation and Hanning-windows, in which a synthetic waveform is formed by concatenation of selected parts of diphones or polyphons of recorded human speech, said selected parts being out-windowed with a Hanning-window and copied into selected locations in the synthetic waveform, characterised in that said method is adapted to synthesise unvoiced consonants and includes the steps of palindromically copying suitably selected parts of a waveform of said recorded diphones or polyphones to form a synthesized waveform for said unvoiced consonant using concatenation.

2. A method as claimed in claim 1, characterised in that the method is used for diphone, or polyphone, synthesis.

3. A method for synthesising speech using concatenation and Hanning-windows, in which a synthetic waveform is formed by concatenation of selected parts of diphones or polyphones of recorded human speech, said selected parts being out-windowed with a Hanning-window and copied into selected locations in the synthetic waveform, characterised in that said method is used for diphone synthesis and includes the steps of:

selecting a first part of said recorded waveform, said first part being a diphone, a first phoneme of which is a vowel and the other phoneme of which is a consonant required to be synthesised;

selecting a second part of said recorded waveform, said second part being a diphone, a first phoneme of which is the consonant required to be synthesised and the other phoneme of which is a vowel;

palindromically copying the start of a synthesised waveform for said consonant from said other phoneme of said first part of said recorded waveform using a first half of a Hanning-window function used to synthesis said vowels;

palindromically copying the end of the synthesised waveform for said consonant from said first phoneme of said second part of said recorded waveform using the other half of said Hanning-window function; and

concatenating said start and said end of said synthesised waveform, resulting from said palindromic copying, to form a synthesised waveform for said consonant.

4. A method as claimed in claim 3, characterised in that said concatenation includes the steps of:

effecting linear interpolation between the points on said synthesised waveform for said consonant where each half of said Hanning-window function is at a maximum;

and in that said interpolation is defined by;

a line which extends, in a linear manner, from a maximum position at the point at which said first half of the Hanning-window function is a maximum to zero at the point at which said other half of said Hanning-window function is a maximum; and

a line which extends, in a linear manner, from a maximum position at the point at which said other half of the Hanning-window function is a maximum to zero at the point at which said first half of said Hanning-window function is a maximum.

5. A method as claimed in claim 4, characterised in that said interpolation lines indicate how much signal has been taken from each of said diphones.

6. A method as claimed in claim 5, for synthesizing the consonant `s`, characterized in that the diphone of said first part of said recorded waveform includes phonemes for `e` and `s` and in that the diphone of said second part of said recorded waveform includes phonemes for `s` and `a`.

7. A method as claimed in claim 5, characterized in that the copying of the synthesized waveform for said consonant is effected between two defined lower and upper limits of each of the waveforms of said other phoneme of said first part of said recorded waveform and of said first phoneme of said second part of said recorded waveform.

8. A method as claimed in claim 4, for synthesizing the consonant `s`, characterized in that the diphone of said first part of said recorded waveform includes phonemes for `e` and `s` and in that the diphone of said second part of said recorded waveform includes phonemes for `s` and `a`.

9. A method as claimed in claim 4, characterized in that the copying of the synthesized waveform for said consonant is effected between two defined lower and upper limits of each of the waveforms of said other phoneme of said first part of said recorded waveform and of said first phoneme of said second part of said recorded waveform.

10. A method as claimed in claim 3, for synthesising the consonant `s`, characterised in that the diphone of said first part of said recorded waveform includes phonemes for `e` and `s` and in that the diphone of said second part of said recorded waveform includes phonemes for `s` and `a`.

11. A method as claimed in claim 10, characterised in that the vowels `e` and `e` are synthesized by a Hanning-windowed glottis pulse, the same Hanning-window function being used to synthesise a waveform for the consonant `s`.

12. A method as claimed in claim 3, characterised in that the copying of the synthesised waveform for said consonant is effected between two defined lower and upper limits of each of the waveforms of said other phoneme of said first part of said recorded waveform and of said first phoneme of said second part of said recorded waveform.

13. A method as claimed in claim 12, characterised in that said lower limit is 30% and said upper limit is 70%.

14. A method as claimed in claim 12, characterised in that copying of the beginning of the waveform for said consonant, from said other phoneme of said first part of said recorded waveform, includes the steps of:

copying said other phoneme starting at the beginning thereof and continuing until said upper limit is reached;

on reaching said upper limit, reversing the copying process and copying said other phoneme between said upper limit and said lower limit; and

on reaching said lower limit, continue with the copying process, forwards and backwards, between said upper and lower limits.

15. A method as claimed in claim 12, characterised in that copying the end of the synthesised waveform for said consonant, from said first phoneme of said second part of said recorded waveform, includes the steps of:

copying said first phoneme starting at the end thereof and continuing until said upper limit is reached;

on reaching said upper limit, reversing the copying process and copying said first phoneme between said upper limit and said lower limit; and

on reaching said lower limit, continue with the copying process, forwards and backwards, between said upper and lower limit.

16. A speech synthesis apparatus for synthesising speech using concatenation and Hanning-windows, said apparatus including concatenation means for linking together selected parts of a waveform of diphones or polyphones of recorded human speech to form a synthetic waveform for said speech, said selected parts being out-windowed with a Hanning-window, and means for copying said out-windowed parts into selected locations in the synthetic waveform, characterised in that said apparatus is adapted to synthesis unvoiced consonants and in that said selected parts of a waveform of said diphones or polyphones are palindromically copied and concatenated to form a synthesized waveform for an unvoiced consonant.

17. A speech synthesis apparatus for synthesising speech using concatenation and Hanning-windows, said apparatus including concatenation means for linking together selected parts of a waveform of diphones or polyphones of recorded human speech to form a synthetic waveform for said speech, said selected parts being out-windowed with a Hanning-window, and means for copying said out-windowed parts into selected locations in the synthetic waveform, characterised in that said apparatus is used for diphone synthesis and includes:

first selection means for selecting a first part of said recorded waveform, said first part being a diphone, a first phoneme of which is a vowel and the other phoneme of which is a consonant required to be synthesised;

second selection means for selecting a second part of said recorded waveform, said second part being a diphone, a first phoneme of which is the consonant required to be synthesised and the other phoneme of which is a vowel;

first palindromic copying means for copying the start of a synthesised waveform for said consonant from said other phoneme of said first part of said recorded waveform using a first half of a Hanning-window function used to synthesis said vowels;

second palindromic copying means for copying the end of the synthesised waveform for said consonant from said first phoneme of said second part of said recorded waveform using the other half of said Hanning-window function; and

in that said concatenation means are adapted to link together said start and said end of said synthesised waveform, resulting from said palindromic copying, to form a synthesised waveform for said consonant.

18. A speech synthesis apparatus as claimed in claim 17, characterised in that said concatenation means include interpolation means for effecting linear interpolation between the points on said synthesised waveform for said consonant where each half of said Hanning-window function is at a maximum, said interpolation being defined by:

a line which extends, in a linear manner, from a maximum position at the point at which said first half of the Hanning-window function is a maximum to zero at the point at which said other half of said Hanning-window function is a maximum; and

a line which extends, in a linear manner, from a maximum position at the point at which said other half of the Hanning-window function is a maximum to zero at the point at which said first half of said Hanning-window function is a maximum.

19. A speech synthesis apparatus as claimed in claim 17, characterised in that said first and second palindromic copying means are adapted to copy the synthesised waveform for said consonant between two defined lower and upper limits.

20. A speech synthesis apparatus as claimed in claim 19, characterised in that said lower limit is 30% and said upper limit is 70%.