Text-to-speech synthesis system

• US 4,685,135 A
• Filed: 03/05/1981
• Issued: 08/04/1987
• Est. Priority Date: 03/05/1981
• Status: Expired due to Term

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Frantz, Gene A., Lin, Kun-Shan, Goudie, Kathleen M.
• Primary Examiner(s): KEMENY, EMANUEL
• Application Number:
  US06/240,694
• Time in Patent Office: 2,343 Days
• Field of Search: 179/1 SF, 179/1 SM, 179/1 SD, 364/513, 364/513.5, 340/146.3 WD, 381/51-53
• US Class Current: 704/260
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination

Abstract

A text-to-speech synthesis system receives digital code representative of characters from a local or remote source, and converts those character codes into speech. A set of allophone rules is contained in a memory and each incoming character set is matched with the proper character set to describe the sound of that particular character set. A microcontroller is dedicated to the comparison procedure which provides allophonic code when a match is made. The allophonic code is provided to a speech producing system which has a system microcontroller for controlling the retrieval, from a read-only memory, of digital signals representative of the individual allophone parameters. The addresses at which such allophone parameters are located are directly related to the allophonic code. A dedicated microcontroller concatenates the digital signals representative of the allophone parameters, including code indicating stress and intonation patterns for the allophones. An LPC speech synthesizer receives the digital signals and provides analog signals corresponding thereto to a loud speaker to produce speech-like sounds with stress and intonation.

Claims

1. A test-to-speed synthesis system for converting printed data as represented by digital characters into audible synthesized speech, said system comprising:

allophone rule means having a plurality of allophonic code signals corresponding to the digital characters which are representative of the printed data, wherein the allophonic code signals are determinative of the respective allophone subset variants of each of the recognized phonemes in a given spoken language as modified by the speech environment in which the particular phoneme occurs;

allophone rules processor means having an input for receiving the digital characters representative of printed data and operably coupled to said allophone rule means for searching the allophone rule means to provide an allophonic code signal output corresponding to the digital characters received by sid allophone rules processor means from the allophonic code signals of said allophone rule means; and

synthesized speech producing means operably coupled to said allophone rules processor means for receiving said allophonic code signal output therefrom to produce an audible synthesized speech-like sound in response to said allophonic code signal output from said allophone rules processor means.

2. The system of claim 1 wherein said allophone rule means comprises digital storage means in which said allophonic code signals are stored.

3. The system of claim 2 wherein said digital storage means comprises a read-only-memory.

4. The system of claim 3 wherein said allophone rules processor means comprises a rules microprocessor.

5. The system of claim 4 wherein said allophone rule means has a plurality of allophonic code signals comprising a plurality of allophone rules arranged in respective character sets as determined by the character and the neighboring characters on each side thereof stored in a common section of said read-only-memory for each of the digital characters representative of printed data that may be input to the system.

6. The system of claim 5 wherein said plurality of allophonic code signals comprising said plurality of allophone rules define units of speech representative of the digital character sets, each of which is assigned a particular allophonic code signal as determined by the character set.

7. The system of claim 6, wherein said allophone rules processor means is responsive to a digital character set received as an input thereto for searching a common section of said read-only-memory comprising said allopohone rule means to obtain a match between the digital character set and respective allophonic code signals stored in said read-only-memory for providing as an output the assigned allophonic code signal for the matched digital character set.

8. The system of claim 3 wherein said synthesized speech producing means comprises:

allophone library means in which digital signals representative of allophone-defining speech parameters identifying the respective allophone subset variants of each of the recognized pheonemes in a given spoken languaage as modified by the speech environment in which the particular phoneme occurs are stored, said allophone library means being operably coupled to said allophone rules processor means and being responsive to the allophonic code signal output therefrom for providing digital signals representative of the particular allophone-defining speech parameters corresponding to said allophonic code signal output;

means operably associated with said allophone library means for concatenating the digital signals, for designating stress and intonation patterns and for designating a pitch parameter for the allophone-defining speech parameters, wherein the allophone is defined by a plurality of speech data frames each of which comprises allophone-defining speech parameters and wherein a pitch parameter is designated for each speech data frame;

speech synthesizing means operable coupled to said digital signal-concatenating means for receiving the digital signals representative of allophone-defining speech parameters and providing analog signals representative of synthesized speech corresponding to the digital signals received thereby;

smoothing means operatively associated with said speech synthesizing means for selectively smoothing the transition between respective allophones as defined by pluralities of speech data frames; and

audio output means operatively connected to the output of said speech synthesizing means for receiving said analog signals representative of syntheiszed speech therefrom to produce audible synthesized speech-like sounds having stress and intonation incorporated therein.

9. The system of claim 8 wherein said allophone library menas comprises a read-only-memory having a plurality of storage addresses respectively corresponding to allophonic code signals of said allophone rule means, the data contents at each of said storage addresses of said allophone library means including digital signals representative of allophone-defining speech parameters.

10. The system of claim 3, wherein said synthesized speech producing means comprises:

allophone library means in which digital signals representative of allophone-defining speech parameters identifying the respective allophone subset variants of each of the recognized phonemes in a given spoken language as modified by the speech environment in which the particular phoneme occurs are stored, said allophone library means being operably coupled to said allophone rules processor means and being responsive to said allophonic code signal output therefrom for providing digital signals representative of allophone-defining speech parameters corresponding to said allophonic code signal output;

means operably coupled to said allophone library means for concatenating said digital signals provided thereby and for designating stress and intonation patterns with respect thereto;

semiconductor integrated circuit speech synthesizing means operatively associated with said concatenating means for receiving said digital signals representative of allophonedefining speech parameters and providing analog signals representative of synthesized speech corresponding to said digital signals; and

audio output means coupled to the output of said semiconducotor intergrated circuit speech synthesizing means for receiving said analog signals representative of synthesized speech therefrom to produce audible synthesized speech-like sounds with stress and intonation incorporated therein.

11. The system of claim 10 wherein said allophone library means comprises a read-only-memory having a plurality of storage addresses respectively corresponding to allophonic code signals of said allophone rule means, the data contents at each of said storage addresses of said allophone library means including digital signals representative of allophone-defining speech parameters.

12. The system of claim 10 wherein said semiconductor integrated circuit speech synthesizing means is a linear predictive coding speech synthesizer.

13. The system of claim 12 further comprising smoothing means operatively associated with said concatenating means for selectively smoothing the transition between the digital signals representative of allophone-defining speech parameters identifying adjacent allophones.

14. The system of claim 13 wherein said allophone library means comprises a read-only-memory having a plurality of storage addresses respectively corresponding to allophonic code signals of said alloiphone rule means, the data contents at each of said storage addresses of said allophone library means including digital signals representative of allophone-defining speech parameters.

15. The system of claim 13 wherein said concatenating means further includes means for designating a pitch parameter for the allohpone-defining speech parameters as represented by the digital signals from said allophone library means corresponding to said allophonic code signal output.

16. The system of claim 15, wherein the digital characters representative of printed data as recieved by the input of said allophone rules processor means are modified to include stress code data therein identifying portions of the digital character input corresponding to syllables in the printed data which are to be stressed, the allophonic code signal output from said allophone rules processor means reflecting the stress code data in the digital characters received thereby such that the digital signals provided by said allophone library means in response to said allophonic code output are representative of allophone-defining speech parameters including the syllable stress as identified by the stress code data, and said pitch parameter-designating means being responsive to said digital signals provided by said allophone library means for designating a base pitch parameter for the allophone-defining speech parameters as modified by the syllable stress included therein.

17. The system of claim 16 wherein the allophone is defined by a plurality of speed data frames each of which comprises allophone-defining speech parameters, and wherein a base pitch parameter is designated by said pitch parameter-designating means fo each speech data frame.

18. The system of claim 17 wherein the stress and intonation patterns designated by said concatenating means are dependent upon gradient pitch control of the stressed syllables preceding the primary stress of the phrase of printed data as represented by the digital characters having stress code data therein, and the gradient pitch control being provided by said pitch parameter-designating means.

19. The system of claim 18 wherein the base pitch comprises a descending gradient for a statement and an ascending gradient for a question.

20. The system of claim 19 wherein said pitch parameter-designating means includes means for designating a delta pitch parameter for limiting the amplitude of the primary or secondary stress.

21. The system of claim 20 wherein each frame comprises a signal indicating whether or not the frame is the end of the allophone.

22. The system of claim 21 wherein the smoothing means comprises means for selectively inserting an additional frame after the last frame in the allophone.

23. The system of claim 22 wherein the smoothing means further comprises means for identifying the current allophone and the subsequent allophone as voiced or unvoiced, or stop.

24. The system of claim 23 wherein the means for selectively inserting an additional frame is activated when no stop is present, and the current allophone and the subsequent allophone are both voiced or both unvoiced.

25. A method for producing audible synthesized speech from printed data as represented by digital characters, said method comprising:

storing a plurality of allophone rules corresponding to the digital characters which are representative of the printed data, wherein the allophone rules are determinative of the respective allophone subset variants of each of the recognized phonemes in a given spoken language as modified by the speech environment in which the particular phoneme occurs;

providing digital characters representative of the printed data so as to define respective digital character sets;

searching the allophone rules for a match to a digital character set;

providing an allophonic code signal corresponding to the matched digital character set;

storing digital signals representative of allophone-defining speech parameters identifying the respective allophone subset variants of each of the recognized phonemes in a given spoken language as modified by the speech environment in which the particular phoneme occcurs;

reading out the particular digital signals corresponding to the allophonic code signal;

concatenating the read out digital signals;

providing digitally coded pitch parameters and intonation to the concatenated digital signals;

transmitting the concatenated digital signals to a speech synthesizer;

generating analog signals representative of synthesized speech by the speech synthesizer corresponding to the concatenated digital signals received thereby; and

directing the analog signals representative of synthesized speech to an audio output means to produce audible synthesized speech-like sounds.

26. A method as set forth in claim 25, further including modifying the digital characters representative of the printed data prior to the search of the allophone rules to include stress code data therein identifying portions of the digital characters corresponding to syllables in the printed data which are to be stressed such that the allophonic code signal corresponding to the matched digital character set will reflect the stress code data therein.

27. The method of claim 26 further including selectively smoothing the transition between the digital signals representative of allophone-defining speech parameters identifying adjacent allophones after the concatenation of the digital signals.