Synthetically generated speech responses including prosodic characteristics of speech inputs

• US 20040193421A1
• Filed: 03/25/2003
• Published: 09/30/2004
• Est. Priority Date: 03/25/2003
• Status: Active Grant

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Blass, Oscar J.
• Granted Patent: US 7,280,968 B2
• Time in Patent Office: Days
• US Class Current: 704/258
• CPC Class Codes: G06F 40/295 Named entity recognition
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/04 Details of speech synthesis systems, e.g. synthesiser structure or memory management

Abstract

A method for digitally generating speech with improved prosodic characteristics can include receiving a speech input, determining at least one prosodic characteristic contained within the speech input, and generating a speech output including the prosodic characteristic within the speech output. Consequently, the method can adjust speech output based on prosodic features within the speech input.

Claims

1. A method for synthetically generating speech with improved prosodic characteristics comprising the steps of:

receiving a speech input;

determining at least one prosodic characteristic contained within said speech input; and

,

generating a speech output including said at least one prosodic characteristic within said speech output.

2. The method of claim 1, further comprising the steps of:

converting said speech input into an input text string; and

,

performing a function responsive to said converting step.

3. The method of claim 2, further comprising the steps of:

generating an output text string responsive to said performing step; and

,

converting said output text string into said speech output.

4. The method of claim 1, wherein said speech output includes a portion of said speech input, wherein said portion of said speech output utilizes said at least one prosodic characteristic.

5. The method of claim 1, further comprising the steps of:

identifying a part of speech associated with at least one word within said speech input; and

,

detecting said at least one prosodic characteristic for said selected part of speech.

6. The method of claim 5, wherein said part of speech is a proper noun.

7. The method of claim 1, further comprising the steps of:

upon completing said determining step, storing said prosodic characteristic into a data store; and

,

before said generating step, retrieving said prosodic characteristic from said data store.

8. The method of claim 1, wherein said receiving step occurs during a first session and wherein said generating step occurs during a second session, and wherein said first session and said second session represent two different interactive periods for a common user.

9. The method of claim 1, wherein at least one prosodic characteristic is selected from the group consisting of the speed before and after a word, the pause before and after a word, the rhyme of words, the relative tones of a word, the relative stresses applied to a word, the relative stresses applied to a syllable, and the relative stresses applied to a syllable combination.

10. The method of claim 1, wherein said receiving step and said generating step are performed by an interactive voice response system.

11. A system for generating synthetic speech comprising:

a speech recognition component capable of extracting prosodic characteristics from speech input;

a text-to-speech component capable of modifying at least a portion of synthetically generated speech based upon at least a portion of said prosodic characteristics; and

,

a prosodic characteristic store configured to store and permit retrieval of said prosodic characteristics.

12. The system of claim 11, wherein said system is an interactive voice response system.

13. A machine readable storage having stored thereon, a computer program having a plurality of code sections, said code sections executable by a machine for causing the machine to perform the steps of:

receiving a speech input;

determining at least one prosodic characteristic contained within said speech input; and

,

generating a speech output including said at least one prosodic characteristic within said speech output.

14. The machine readable storage of claim 13, further comprising the steps of:

converting said speech input into an input text string; and

,

performing a function responsive to said converting step.

15. The machine readable storage of claim 14, further comprising the steps of:

generating an output text string responsive to said performing step; and

,

converting said output text string into said speech output.

16. The machine readable storage of claim 13, wherein said speech output includes a portion of said speech input, wherein said portion of said speech output utilizes said at least one prosodic characteristic.

17. The machine readable storage of claim 13, further comprising the steps of:

identifying a part of speech associated with at least one word within said speech input; and

,

detecting said at least one prosodic characteristic for said selected part of speech.

18. The machine readable storage of claim 17, wherein said part of speech is a proper noun.

19. The machine readable storage of claim 13, further comprising the steps of:

upon completing said determining step, storing said prosodic characteristic into a data store; and

,

before said generating step, retrieving said prosodic characteristic from said data store.

20. The machine readable storage of claim 13, wherein said receiving step occurs during a first session and wherein said generating step occurs during a second session, and wherein said first session and said second session represent two different interactive periods for a common user.

21. The machine readable storage of claim 13, wherein at least one prosodic characteristic is selected from the group consisting of the speed before and after a word, the pause before and after a word, the rhyme of words, the relative tones of a word, the relative stresses applied to a word, the relative stresses applied to a syllable, and the relative stresses applied to a syllable combination.

22. The machine readable storage of claim 13, wherein said receiving step and said generating step are performed by an interactive voice response system.

23. A method for synthetically generating speech comprising the steps of:

receiving a speech input;

analyzing said speech input to generate special handling instructions; and

,

altering at least one speech generation characteristic of a text-to-speech application based upon said special handling instructions.

24. The method of claim 23, wherein the altering step is based upon at least one of a language proficiency level and an emotional state of the listener.

25. The method of claim 23, wherein said speech generation characteristic alters at least one of clarity and pace of speech output.

26. A machine readable storage having stored thereon, a computer program having a plurality of code sections, said code sections executable by a machine for causing the machine to perform the steps of:

receiving a speech input;

analyzing said speech input to generate special handling instructions; and

,

altering at least one speech generation characteristic of a text-to-speech application based upon said special handling instructions.

27. The machine readable storage of claim 26, wherein the altering step is based upon at least one of a language proficiency level and an emotional state of the listener.

28. The machine readable storage of claim 26, wherein said speech generation characteristic alters at least one of clarity and pace of speech output.