Method and apparatus for converting voice characteristics of synthesized speech

• US 4,624,012 A
• Filed: 05/06/1982
• Issued: 11/18/1986
• Est. Priority Date: 05/06/1982
• Status: Expired due to Fees

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Lin, Kun-Shan, Henderson, Alva E., Frantz, Gene A.
• Primary Examiner(s): Kemeny, E. S. Matt
• Application Number:
  US06/375,434
• Time in Patent Office: 1,657 Days
• Field of Search: 381/29-53, 381/61, 364/513, 364/513.5
• US Class Current: 704/261
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence

Abstract

Method and apparatus for converting voice characteristics of synthesized speech from a single applied source of synthesized speech in a manner obtaining modified voice characteristics pertaining to the apparent age and/or sex of the speaker. The apparatus is capable of altering the voice characteristics of synthesized speech to obtain modified voice sounds simulating child-like, teenage, adult, aged and sexual preference characteristics by control of vocal track parameters including pitch period, vocal tract model, and speech data rate. A source of synthesized speech having a predetermined pitch period, a predetermined vocal tract model, and a predetermined speech rate is separated into the respective speech parameters. The values of pitch, the speech data frame length, and the speech data rate are then varied in a preselected manner to modify the voice characteristics of the synthesized speech from the source thereof. Thereafter, the changed speech data parameters are re-combined into a modified synthesized speech data format having different voice characteristics with respect to the synthesized speech from the source, and an audio signal representative of human speech is generated from the modified synthesized speech data format from which audible synthesized speech may be generated.

Claims

1. A text-to-speech synthesis system for producing audible synthesized human speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics from digital characters comprising:

text reader means adapted to be exposed to text material and responsive thereto for generating information signals indicative of the substantive content thereof;

converter means for receiving said information signals from said text reader means and generating digital character signals representative thereof;

means for receiving said digital character signals from said converter means;

memory means storing digital speech data including digital speech instructional rules and digital speech data representative of sound unit code signals;

data processing means for searching said digital speech data stored in said memory means to locate digital speech data representative of a sound unit code corresponding to said digital character signals received from said converter means;

speech memory means storing digital speech data representative of a plurality of sound units;

concatenating controller means operably coupled to said speech memory means for selectively combining digital speech data representative of a plurality of sound units in a serial sequence to provide concatenated digital speech data representative of a word;

speech synthesis controller means coupled to said data processing means and to said speech memory means for receiving digital speech signals representative of a sound unit code corresponding to said digital character signals and selectively accessing digital speech data representative of sound units corresponding to said sound unit code from said speech memory means;

speech synthesizer means operably coupled to said concatenating controller means and said speech synthesis controller means for receiving selectively accessed serial sequences of digital speech data from said concatenating controller means to provide audio signals corresponding thereto and representative of synthesized human speech;

voice characteristics conversion means interposed between said concatenating controller means and said speech synthesizer means and being coupled therebetween independently of the coupling between said concatenating controller means and said speech synthesizer means, said voice characteristics conversion means being operably coupled to said speech synthesis controller means and being responsive thereto to selectively modify the voice characteristics of said serially sequenced digital speech data output from said concatenating controller means, said voice characteristics conversion means including

means for making a voice character selection of the synthesized speech to be derived from the digital speech data as selectively accessed from said speech memory means so as to simulate a voice sound differing in character with respect to the voice sound of the synthesized speech from the digital speech data of said speech memory means in the voice characteristics pertaining to the apparent age and/or sex of the speaker;

said digital speech data as selectively accessed from said speech memory means having a predetermined pitch period, a predetermined vocal tract model and a predetermined speech rate;

speech parameter control means for modifying the pitch period and speech rate in response to inputs from said voice character selection means to produce a modified pitch period and a modified speech rate, said speech parameter control means including sample rate control circuit means responsive to inputs from said voice character selection means for adjusting the sampling period of said digital speech data selectively accessed from said speech memory means in a manner altering the digital speech formants contained therein to a preselected degree and providing adjusted sampling period signals as an output;

speech data reconstructing means operably associated with said speech parameter control means for combining the modified pitch period and the modified speech rate with the predetermined vocal tract model into a synthesized speech data format of speech data modified with respect to the original speech data from said speech memory means;

said speech synthesizer means being coupled to said speech data reconstructing means and to the output of said sample rate control circuit means for receiving the modified speech data and the adjusted sampling period signals therefrom in providing said audio signals representative of human speech from the modified speech data; and

audio means coupled to said speech synthesizer means for converting said audio signals into audible synthesized human speech in any one of a plurality of voice sound from said digital speech data stored in said speech memory means as determined by said voice characteristics conversion means.

2. A method of converting voice characteristics of synthesized speech to obtain modified synthesized speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics from a single applied source of synthesized speech, said method comprising:

providing a source of synthesized speech in the form of digital speech data subject to speech synthesization using a predetermined sample period comprising a known number of task-accomplishing time increments;

adjusting the sampling period of the digital speech data from said source of synthesized speech in a manner altering the digital speech formants contained therein to a preselected degree;

producing modified digital speech data including the adjusted sampling period and having modified voice characteristics as compared to the synthesized speech from said source;

generating audio signals representative of human speech from the modified digital speech data; and

converting said audio signals into audible synthesized human speech having different voice characteristics from the synthesized human speech which would have been obtained from said source of synthesized speech.

3. A method as set forth in claim 2, further including converting said modified digital speech data into digital speech data compatible with a speech synthesizer utilizing linear predictive coding speech synthesis;

and

directing the converted digital speech data into a linear predictive coding speech synthesizer in generating said audio signals representative of human speech.

4. A method as set forth in claim 2, wherein the sampling period associated with the digital speech data from said source of synthesized speech is adjusted by adding a predetermined number of time increments to the known number of time increments included in said sampling period to provide a new sampling period having a predetermined time duration greater than that of said sampling period associated with the synthesized speech from said source.

5. A method as set forth in claim 2, wherein the sampling period associated with the digital speech data from said source of synthesized speech is adjusted by varying the magnitude of each time increment defining said sampling period in a preselected manner such that the time duration of the adjusted sampling period is different from that of the original sampling period, but the total number of time increments defining said adjusted sampling period equals the known number of time increments defining said original sampling period.

6. A method of converting voice characteristics of synthesized speech to obtain modified synthesized speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics from a single applied source of synthesized speech, said method comprising:

providing a source of synthesized speech as digital speech data including a predetermined pitch period, a predetermined vocal tract model, and a predetermined speech rate;

separating the pitch period, vocal tract model, and speech rate from each other to define said pitch period, vocal tract model, and speech rate as respective independent speech synthesis factors;

adjusting the sampling period associated with said digital speech data from said source of synthesized speech in a manner altering the digital speech formants contained therein to a preselected degree;

modifying the predetermined pitch period and the predetermined speech rate independently of each other and in respective response to the adjusted sampling period in a preselected manner to modify the voice characteristics of the synthesized speech from said source;

re-combining the modified pitch period, the modified speech rate, and the predetermined vocal tract model into a synthesized speech data format of digital speech data modified with respect to the synthesized speech from said source;

generating audio signals representative of human speech from the modified digital speech data in conjunction with the adjusted sampling period; and

converting said audio signals into audible synthesized human speech having different voice characteristics from the synthesized human speech which would have been obtained from said source of synthesized speech.

7. A method as set forth in claim 6, further including converting said modified digital speech data into digital speech data compatible with a speech synthesizer utilizing linear predictive coding speech synthesis;

and

directing the converted digital speech data into a linear predictive coding speech synthesizer in generating said audio signals representative of human speech.

8. A method as set forth in claim 6, wherein the sampling period associated with the digital speech data from said source of synthesized speech is adjusted by adding a predetermined number of time increments to the known number of time increments included in said sampling period to provide a new sampling period having a predetermined time duration greater than that of said sampling period associated with the synthesized speech from said source.

9. A method as set forth in claim 6, wherein the sampling period associated with the digital speech data from said source of synthesized speech is adjusted by varying the magnitude of each time increment defining said sampling period in a preselected manner such that the time duration of the adjusted sampling period is different from that of the original sampling period, but the total number of time increments defining said adjusted sampling period equals the known number of time increments defining said original sampling period.

21. A method as set forth in claim 6, wherein said digital speech data as provided by said source of synthesized speech comprises digital speech data representative of sound units;

and further including

stringing together sequences of digital speech data modified with respect to the synthesized speech from said source as representive of sound units to define respective series of modified digital speech data representative of words from which said audio signals representative of human speech are generated.

22. A method as set forth in claim 21, wherein said sound units are allophones.

23. A method as set forth in claim 21, wherein said digital speech data representative of sound units comprises digital speech formants;

and further including

converting the modified digital speech formants into digital speech data including digital speech parameters representative of reflection coefficients; and

directing the converted digital speech data including digital speech parameters representative of reflection coefficients into a linear predictive coding speech synthesizer in generating said audio signals representative of human speech.

24. A method as set forth in claim 23, wherein said sound units are allophones.

10. Apparatus for converting voice characteristics of synthesized speech to obtain modified synthesized speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics from a single applied source of synthesized speech, said apparatus comprising:

voice character conversion controller means for receiving digital speech data from which synthesized speech may be derived from a source thereof, said digital speech data having a predetermined pitch period, a predetermined vocal tract model and a predetermined speech rate, said voice character conversion controller means having

means for selecting digital speech data representative of at least a portion of a word, and

means for making a voice character selection of the synthesized speech to be derived from the digital speech data received from said source simulating a voice sound differing in character with respect to the voice sound of the synthesized speech from said source in the voice characteristics pertaining to the apparent age and/or sex of the speaker;

speech parameter control means for modifying the pitch period and speech rate in response to inputs from said voice character conversion controller means as determined by said voice character selection means thereof to produce a modified pitch period and a modified speech rate;

speech data reconstructing means operably associated with said speech parameter control means for combining the modified pitch period and the modified speech rate with the predetermined vocal tract model into a synthesized speech data format of speech data modified with respect to the original speech data from said source;

speech synthesizer means coupled to said speech data reconstructing means for receiving the modified speech data therefrom and generating audio signals representative of human speech from the modified speech data; and

audio means coupled to said speech synthesizer means for converting said audio signals into synthesized human speech having different voice characteristics from the synthesized speech which would have been obtained from the source of synthesized speech.

11. Apparatus as set forth in claim 10, wherein said digital speech data from the source is subject to speech synthesization using a predetermined sampling period comprising a known number of task-accomplishing time increments;

said speech parameter control means including sample rate control circuit means responsive to inputs from said voice character conversion controller means as determined by said voice character selection means thereof for adjusting the sampling period of said digital speech data from the source in a manner altering the digital speech formants contained therein to a preselected degree and providing adjusted sampling period signals as an output; and

said speech synthesizer means being coupled to the output of said sample rate control circuit means for receiving said adjusted sampling period signals therefrom as the modified speech data from said speech data reconstructing means is being input thereto.

12. Apparatus as set forth in claim 11, wherein said speech synthesizer means is a linear predictive coding speech synthesizer.

13. Apparatus as set forth in claim 12, wherein said speech data reconstructing means includes parameter look-up means for converting said modified pitch period and said modified speech rate produced by said speech parameter control means into digital speech data compatible with said linear predictive coding speech synthesizer.

14. Apparatus as set forth in claim 11, wherein said sample rate control circuit means includes counter means operably connected to said voice character conversion controller means and being responsive thereto for establishing a preset count value, said counter means having a maximum count value at least equal to the preset count value, and clock means alternately enabling said speech synthesizer means and said counter means, said speech synthesizer means being idle during the time period said counter means is undergoing incremention from said preset count value to the maximum count value thereof.

15. Apparatus as set forth in claim 11, wherein said sample rate control circuit means comprises variable oscillator means operably connected to said voice character conversion controller means and said speech synthesizer means and being responsive to control signals from said voice character conversion controller means for selectively varying the magnitude of each time increment defining said sampling period in a preselected manner such that the time duration of the adjusted sampling period is different from that of the original sampling period, but the total number of time increments defining said adjusted sampling period equals the known number of time increments defining said original sampling period.

16. A speech synthesis system comprising:

memory means having digital speech data stored therein from which synthesized speech having predetermined voice characteristics may be derived;

speech synthesizer means operably connected to said memory means for receiving digital speech data therefrom to generate audio signals from which audible synthesized human speech may be provided;

controller means operably associated with said memory means and said speech synthesizer means for selectively accessing digital speech data from said memory means to be input to said speech synthesizer means;

voice characteristics conversion means interconnected between said memory means and said speech synthesizer means for modifying voice characteristics of the digital speech data selectively accessed from said memory means in response to said controller means; and

audio means coupled to the output of said speech synthesizer means for converting said audio signals into audible synthesized human speech having different voice characteristics from the synthesized speech which would have been obtained from said digital speech data stored in said memory means.

17. A speech synthesis system as set forth in claim 16, wherein said digital speech data stored in said memory means comprises digital speech data representative of sound units;

and further including

concatenating controller means connected to said memory means and interposed between said memory means and said voice characteristics conversion means for stringing together sequences of digital speech data representative of allophones to define respective series of said digital speech data representative of words for input to said voice characteristics conversion means.

18. A speech synthesis system as set forth in claim 17, wherein said digital speech data representative of sound units stored in said memory means comprises digital speech formants;

said speech synthesizer means being a linear predictive coding speech synthesizer; and

further including

parameter look-up means interposed between said voice characteristics conversion means and said linear predictive coding speech synthesizer for converting the modified digital speech formants output from said voice characteristics conversion means to digital speech data including digital speech parameters representative of reflection coefficients for input to said linear predictive coding speech synthesizer.

26. A speech synthesis system as set forth in claim 17, wherein said sound units are allophones.

27. A speech synthesis system as set forth in claim 18, wherein said sound units are allophones.

19. A text-to-speech synthesis system for producing audible synthesized human speech from digital characters comprising:

means for receiving the digital characters;

speech unit rule means for storing encoded speech parameter signals corresponding to the digital characters;

rules processor means for searching the speech unit rule means to provide encoded speech parameter signals corresponding to the digital characters; and

speech producing means connected to receive the encoded speech parameter signals and to produce audible synthesized human speech therefrom, said speech producing means including

voice characteristics conversion means selectively operable to modify the voice characteristics of the encoded speech parameter signals corresponding to the digital characters such that said speech producing means is enabled to provide audible synthesized human speech of any one of a plurality of voice sounds.

20. A text-to-speech synthesis system for producing audible synthesized human speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics from digital characters comprising:

text reader means adapted to be exposed to text material and responsive thereto for generating information signals indicative of the substantive content thereof;

converter means for receiving said information signals from said text reader means and generating digital character signals representative thereof;

means for receiving said digital character signals from said converter means;

memory means storing digital speech data including digital speech instructional rules and digital speech data representative of sound unit code signals;

data processing means for searching said digital speech data stored in said memory means to locate digital speech data representative of a sound unit code corresponding to said digital character signals received from said converter means;

speech memory means storing digital speech data representative of a plurality of sound units;

concatenating controller means operably coupled to said speech memory means for selectively combining digital speech data representative of a plurality of sound units in a serial sequence to provide concatenated digital speech data representative of a word;

speech synthesis controller means coupled to said data processing means and to said speech memory means for receiving digital speech signals representative of a sound unit code corresponding to said digital character signals and selectively accessing digital speech data representative of sound units corresponding to said sound unit code from said speech memory means;

speech synthesizer means operably coupled to said concatenating controller means and said speech synthesis controller means for receiving selectively accessed serial sequences of digital speech data from said concatenating controller means to provide audio signals corresponding thereto and representative of synthesized human speech;

voice characteristics conversion means interposed between said concatenating controller means and said speech synthesizer means and being coupled therebetween independently of the coupling between said concatenating controller means and said speech synthesizer means, said voice characteristics conversion means being operably coupled to said speech synthesis controller means and being responsive thereto to selectively modify the voice characteristics of said serially sequenced digital speech data output from said concatenating controller means; and

audio means coupled to said speech synthesizer means for converting said audio signals into audible synthesized human speech in any one of a plurality of voice sounds from said digital speech data stored in said speech memory means as determined by said voice characteristics conversion means.

29. A text-to-speech synthesis system as set forth in claim 20, wherein said sound units and said sound unit codes are allophones and allophonic codes.

25. A speech synthesis system comprising:

memory means providing a source of synthesized speech as digital speech data stored therein from which synthesized speech having predetermined voice characteristics may be derived;

speech synthesizer means operably connected to said memory means for receiving digital speech data therefrom to generate audio signals from which audible synthesized human speech may be provided;

controller means operably associated with said memory means and said speech synthesizer means for selectively accessing digital speech data from said memory means to be input to said speech synthesizer means;

voice characteristics conversion means interconnected between said memory means and said speech synthesizer means for modifying voice characteristics of the digital speech data selectively accessed from said memory means in response to said controller means, said voice characteristics conversion means comprising

means for making a voice character selection of the synthesized speech to be derived from the digital speech data received from said memory means as selectively accessed in response to said controller means to simulate a voice sound differing in character with respect to the voice sound of the synthesized speech from the digital speech data as selectively accessed from said memory means in the voice characteristics pertaining to the apparent age and/or sex of the speaker;

said digital speech data as accessed from said memory means having a predetermined pitch period, a predetermined vocal tract model and a predetermined speech rate;

speech parameter control means for modifying the pitch period and speech rate in response to inputs from said voice character selection means to produce a modified pitch period and a modified speech rate, said speech parameter control means including sample rate control circuit means responsive to inputs from said voice character selection means for adjusting the sampling period of said digital speech data as selectively accessed from said memory means in a manner altering the digital speech formants contained therein to a preselected degree and providing adjusted sampling period signals as an output;

speech data reconstructing means operably associated with said speech parameter control means for combining the modified pitch period and the modified speech rate with the predetermined vocal tract model into a synthesized speech data format of speech data modified with respect to the original speech data as selectively accessed from said memory means;

said speech synthesizer means being coupled to the output of said sample rate control circuit means for receiving said adjusted sampling period signals therefrom as the modified speech data from said speech data reconstructing means is being input thereto in generating said audio signals representative of human speech from the modified speech data; and

audio means coupled to the output of said speech synthesizer means for converting said audio signals into audible synthesized human speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics and having different voice characteristics from the synthesized speech which would have been obtained from said digital speech data stored in said memory means.

28. A text-to-speech synthesis system for producing audible synthesized human speech from digital characters comprising:

means for receiving the digital characters;

speech unit rule means for storing encoded speech parameter signals corresponding to the digital characters;

rules processor means for searching the speech unit rule means to provide encoded speech parameter signals corresponding to the digital characters and in the form of digital speech data from which synthesized speech having predetermined voice characteristics may be derived;

voice characteristics conversion means selectively operable to modify the voice characteristics of the encoded speech parameter signals corresponding to the digital characters and comprising

means for making a voice character selection of the synthesized speech to be derived from the digital speech data as received from said rules processor means simulating a voice sound differing in character with respect to the voice sound of the synthesized speech from the digital speech data in the voice characteristics pertaining to the apparent age and/or sex of the speaker;

said digital speech data having a predetermined pitch period, a predetermined vocal tract model and a predetermined speech rate;

speech parameter control means for modifying the pitch period and speech rate in response to inputs from said voice character selection means to produce a modified pitch period and a modified speech rate, said speech parameter control means including sample rate control circuit means responsive to inputs from said voice character selection means for adjusting the sampling period of said digital speech data in a manner altering the digital speech formants contained therein to a preselected degree and providing adjusted sampling period signals as an output;

speech data reconstructing means operably associated with said speech parameter control means for combining the modified pitch period and the modified speech rate with the predetermined vocal tract model into a synthesized speech data format of speech data modified with respect to the original speech data as derived from said encoded speech parameter signals; and

speech producing means coupled to said speech data reconstructing means for receiving the modified speech data therefrom and to produce audible synthesized human speech from the modified speech data as synthesized human speech of any one of a plurality of voice sounds simulating child-like, adult, aged and sexual characteristics and having different voice characteristics from the synthesized speech which would have been obtained from said encoded speech parameter signals as a source of synthesized speech.