Adaptive methods for controlling the annunciation rate of synthesized speech

• US 5,749,071 A
• Filed: 01/29/1997
• Issued: 05/05/1998
• Est. Priority Date: 03/19/1993
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Nynex Science And Technology, Inc.
• Inventors: Silverman, Kim Ernest Alexander
• Primary Examiner(s): Hafiz, Tariq R.
• Application Number:
  US08/790,580
• Time in Patent Office: 461 Days
• Field of Search: 395/2.1, 395/2.67-2.74, 395/2.84, 395/2.09, 704/201, 704/258-274, 704/275, 704/218
• US Class Current: 704/260
• CPC Class Codes: G10L 13/04 Details of speech synthesis systems, e.g. synthesiser structure or memory management
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 13/10 Prosody rules derived from text; Stress or intonation

Abstract

Improved automated synthesis of human audible speech from text is disclosed. Performance enhancement of the underlying text comprehensibility is obtained through prosodic treatment of the synthesized material, improved speaking rate treatment, and improved methods of spelling words or terms for the sysstem user. Prosodic shaping of text sequences appropriate for the discourse in large groupings of text segments, with prosodic boundaries developed to indicate conceptual units within the text groupings, is implemented in a preferred embodiment.

Claims

1. A method of synthesizing human audible speech from a plurality of text segments represented in electronic form, the method comprising the steps of:

generating audible speech from a first text segment using an initial annunciation rate;

in response to a first number of requests from a first listener to repeat the audible speech generated from the first text segment,

adjusting the initial annunciation rate to produce a repeat annunciation rate; and

generating audible speech from the first text segment using the repeat annunciation rate.

2. The method of claim 1, wherein the step of adjusting the annunciation rate in response to the request to repeat the audible speech includes the step of:

slowing the initial annunciation rate to produce the repeat annunciation rate.

3. The method of claim 1, further comprising the step of:

embedding the speech generated from the first text segment in a carrier phrase having an annunciation rate that is faster than the annunciation rate used to generate the audible speech from the first text segment.

4. The method of claim 1, further comprising the steps of:

generating audible speech from the first text segment for a plurality of different listeners using the initial annunciation rate; and

adjusting the initial annunciation rate to produce a new initial annunciation rate, after the audible speech generated from the first text segment is repeated a multiple number of times for each of a first preselected number of listeners; and

using the new initial annunciation rate to generate audible speech from the first text segment for an additional listener.

5. The method of claim 4,

wherein the first preselected number of listeners are consecutive listeners;

and

wherein the new initial annunciation rate is slower than the initial annunciation rate which is adjusted to produce the new initial annunciation rate.

6. The method of claim 5, wherein the speed of the new initial annunciation rate is increased when a second preselected number of consecutive listeners do not request repetition of the audible speech generated from the first text segment.

7. A method of synthesizing human audible speech from a plurality of text segments represented in electronic form, the method comprising the steps of:

generating audible speech from a first text segment using an initial annunciation rate;

in response to a first number of requests from a first listener to repeat the audible speech generated from the first text segment,

adjusting the initial annunciation rate to produce a repeat annunciation rate;

generating audible speech from the first text segment using the repeat annunciation rate;

generating audible speech from subsequent text segments in the plurality of text segments using the initial annunciation rate;

in response to requests from the first user to repeat the audible speech generated from multiple ones of the subsequent text segments, modifying the initial annunciation rate to generate a modified initial annunciation rate which is slower than the initial annunciation rate; and

using the modified initial annunciation rate to generate audible speech from at least one additional text segment in the plurality of text segments.

8. The method of claim 7, wherein the initial annunciation rate is modified only if the first user requests that speech generated from multiple sequential text segments be repeated.

9. The method of claim 7, further comprising the step of:

after generating audible speech from a second number of text segments without receiving a request to repeat the audible speech generated from any of the second number of text segments, modifying the initial annunciation rate to generate a new modified initial annunciation rate which is faster than the modified annunciation rate; and

using the new modified initial annunciation rate to generate audible speech from at least one additional text segment in the plurality of text segments.

10. A method of generating speech from a text segment represented in electronic form for a plurality of different listeners, the method comprising the steps of:

generating speech from the first text segment for each of a first subset of the plurality of different listeners using an initial annunciation rate;

if a first number of requests are received from the first subset of listeners to repeat the speech generated from the first text segment;

performing the step of modifying the initial annunciation rate by decreasing the speed of the initial annunciation rate;

otherwise, upon completing the generation of speech from the first text segment for the first subset of listeners, modifying the initial annunciation rate by increasing the speed of the initial annunciation rate.

11. The method of claim 10, further comprising the step of:

generating speech from the first text segment for a second plurality of listeners using the modified initial annunciation rate; and

further modifying the initial annunciation rate as a function of requests received from the second plurality of listeners to repeat the speech generated from the first text segment.

12. The method of claim 11, further comprising the step of:

generating speech from the first text segment a plurality of times for a single listener in response to a request by the single user to repeat the generated speech; and

adjusting the annunciation rate used for generating the speech for the single listener as a function of the number of times the single listener requests the generated speech to be repeated.

13. The method of claim 12, wherein the step of adjusting the annunciation rate used for generating the speech for the single listener includes the step of slowing the annunciation rate as a function of the number of times the generated speech is repeated for the single listener.

14. The method of claim 10, further comprising the step of:

embedding the speech generated from the first text segment in a carrier phrase having an annunciation rate that is faster than the annunciation rate used to generate the audible speech from the first text segment.

15. A method of synthesizing human audible speech, comprising the step of:

embedding a first text segment represented in electronic form in a carrier phrase;

generating audible speech from the first text segment and the carrier phase using a first annunciation rate to generate the speech from the first text segment and a second annunciation rate to generate the speech from the carrier phrase, the second annunciation rate being faster than the first annunciation rate.

16. The method of claim 15, further comprising the steps of:

repeatedly generating audible speech from the first text segment; and

with each subsequent repeated generation of audible speech from the first text segment using a slower annunciation rate of the speech generated from the first text segment.

17. The method of claim 15, further comprising the steps of:

receiving requests to repeat the speech generated from the first text segment; and

adjusting the annunciation rate of the speech being generated from the first text segment as a function of the number of requests to repeat the speech.

18. The method of claim 17, further comprising the step of:

increasing the annunciation rate of the speech being generated from the first text segment if no requests are received to repeat the speech after generating the speech for a plurality of different listeners.

19. A method of repeatedly synthesizing human audible speech from a segment of text, comprising the step of:

generating audible speech from the segment of text for a first plurality of different listeners;

dynamically adjusting an annunciation rate used to generate audible speech from the segment of text as a function of feedback from the first plurality of different users; and

using the adjusted annunciation rate to generate audible speech for a second plurality of listeners.

20. The method of claim 19, wherein the feedback includes requests to repeat generated speech, the method further comprising the step of:

altering the annunciation rate used when repeatedly generating speech from the text segment for the same listener.

21. A method of adjusting the annunciation rate of speech, comprising the steps of:

generating, for a first user, speech from a first text segment;

dynamically adjusting the annunciation rate of additional speech generated in response to feedback from the first user.

22. The method of claim 21, wherein the feedback is a request to repeat generated speech.

23. The method of claim 21, wherein the step of dynamically adjusting the annunciation rate of speech is also performed as a function of feedback from a plurality of different users;

and

wherein the step of dynamically includes the step of;

slowing the annunciation rate used to generate additional speech.

24. A method of generating speech, comprising the steps of:

generating a first speech segment from text for a first user using a first annunciation rate and a speech generation system;

repeatedly using the speech generation system to generate the first speech segment; and

adjusting the annunciation rate of the speech system when repeatedly generating the first speech segment so that at least a second annunciation rate which is different than the first annunciation rate is used when generating the first speech segment for a repeated time.

25. The method of claim 24, further comprising the step of:

generating the first speech segment multiple times for each of a plurality of different users; and

dynamically modifying the annunciation rate used when generating speech from additional text segments as a function of the number of times the first speech segment is repeatedly generated for each of a plurality of different users.

26. A method of generating speech, comprising the steps of:

generating speech for a plurality of different users, some of the generated speech being repeated for at least some of the plurality of users; and

dynamically adjusting an annunciation rate used in generating speech for a subsequent user, as a function of the number of times generated speech is repeated for at least some of the plurality of different users, the subsequent user being a different user than the users included in the plurality of users.