Speech synthesis apparatus and method

• US 20040049375A1
• Filed: 08/11/2003
• Published: 03/11/2004
• Est. Priority Date: 06/04/2001
• Status: Active Grant

• Current Assignee: Paul St John Brittan, Reger Cecil Ferry Tucker
• Original Assignee: Paul St John Brittan, Reger Cecil Ferry Tucker
• Inventors: Tucker, Reger Cecil Ferry, Brittan, Paul St John
• Granted Patent: US 7,062,439 B2
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 13/07 Concatenation rules
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination

Abstract

A speech synthesizer has a language generator for generating a text-form utterance from input semantic information and a text-to-speech converter for converting the text-from utterance into speech form. The overall quality of the speech-form utterance produced by the text-to-speech converter, is assessed and if judged inadequate, the language generator is triggered to produce a new version of the text-form utterance. The assessment of the overall quality of the speech form utterance is preferably effected by a classifier fed with feature values generated during the conversion process operated by the text-to-speech converter.

Claims

1. Speech synthesis apparatus comprising:

a language generator responsive to input information indicative of at least the content of a desired speech output, to generate a corresponding text-form utterance;

a text-to-speech converter for converting text-form utterances received from the language generator into speech form; and

an assessment arrangement for assessing the overall quality of the speech form produced by the text-to-speech converter from an input text-form utterance whereby to selectively produce a modification indicator when it determines that the current speech form is inadequate;

the language generator being responsive to the assessment arrangement producing a said modification indication, to generate a new version of the text-form utterance concerned.

2. Apparatus according to claim 1, wherein the text-to-speech converter is arranged to generate, in the course of converting a text-form utterance into speech form, values of predetermined features that are indicative of the overall quality of the speech form of the utterance, the assessment arrangement comprising:

a classifier responsive to the feature values generated by the text-to-speech converter to provide a confidence measure of the speech form of the utterance concerned; and

a comparator for comparing confidence measures produced by the classifier against one or more stored threshold values, in order to determine whether to produce a said modification indicator.

3. Apparatus according to claim 1, wherein the text-to-speech converter includes a concatenative speech generator which in generating a speech-form utterance, produces an accumulated unit selection cost in respect of the speech units used to make up the speech-form utterance;

the assessment arrangement comprising a comparator for comparing the selection cost produced by the speech generator against one or more stored threshold values, in order to determine whether to produce a said modification indicator.

4. Apparatus according to claim 1, further comprising an output buffer for temporarily storing the latest speech-form utterance generated by the text-to-speech converter, the assessment arrangement releasing this speech-form utterance for output upon determining than a new version is not required.

5. Apparatus according to claim 1, wherein the language generator is responsive to a said modification indicator to produce a new version of the text-form utterance by choosing one or more alternative words for the previously-determined phrasing of the current input information.

6. Apparatus according to claim 1, wherein the language generator is responsive to a said modification indicator to produce a new version of the text-form utterance by rephrasing the current input information.

7. Apparatus according to claim 1, wherein the language generator is responsive to a said modification indicator to produce a new version of the text-form utterance by inserting pauses in front of selected words.

8. Apparatus according to claim 7, wherein said selected words are specialized terms such as proper nouns.

9. A method of generating speech output comprising the steps of:

(a) in response to input information indicative of at least the content of a desired speech output, generating a corresponding text-form utterance;

(b) converting the text-form utterances generated in step (a) into speech form;

(c) assessing the overall quality of the speech form produced in step (b) selectively producing a modification indicator when the current speech form is assessed as inadequate; and

(d) upon a modification indicator being produced instep (c), generating a new version of the text-form utterance that gave rise to the modification indicator.

10. A method according to claim 9, wherein in step (b), in the course of converting a text-form utterance into speech form, values of predetermined features are generated that are indicative of the overall quality of the speech form of the utterance, the assessment carried out in step (c) involving:

using a classifier responsive to said values of predetermined features to provide a confidence measure of the speech form of the utterance concerned; and

comparing confidence measures produced by the classifier against one or more stored threshold values, in order to determine whether to produce a said modification indicator.

11. A method according to claim 9, wherein step (b) is effected using a concatenative speech generator which in generating a speech-form utterance, produces an accumulated unit selection cost in respect of the speech units used to make up the speech-form utterance;

step (c) involving comparing this selection cost against one or more stored threshold values, in order to determine whether to produce a said modification indicator.

12. A method according to claim 9, further involving temporarily storing the latest speech-form utterance generated in step (b) and only releasing this speech-form utterance for output upon the assessment of this speech-form utterance in step (c) not resulting in the production of a modification indicator.

13. A method according to claim 9, wherein step (d) involves choosing one or more alternative words for the previously-determined phrasing of the current input information.

14. A method according to claim 9, wherein step (d) involves rephrasing the current input information.

15. A method according to claim 9, wherein step (d) involves inserting pauses in front of selected words.

16. Apparatus according to claim 15, wherein said selected words are specialized terms such as proper nouns.