Method and apparatus for assigning word prominence to new or previous information in speech synthesis

• US 7,313,523 B1
• Filed: 05/14/2003
• Issued: 12/25/2007
• Est. Priority Date: 05/14/2003
• Status: Expired due to Fees

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bellegarda, Jerome R., Silverman, Kim E. A.
• Primary Examiner(s): Storm, Donald L.
• Application Number:
  US10/439,217
• Time in Patent Office: 1,686 Days
• Field of Search: None
• US Class Current: 704/268
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 13/04 Details of speech synthesis systems, e.g. synthesiser structure or memory management

Abstract

A method and apparatus is provided for generating speech that sounds more natural. In one embodiment, word prominence and latent semantic analysis are used to generate more natural sounding speech. A method for generating speech that sounds more natural may comprise generating synthesized speech having certain word prominence characteristics and applying a semantically-driven word prominence assignment model to specify word prominence consistent with the way humans assign word prominence. A speech representative of a current sentence is generated. The determination is made whether information in the current sentence is new or previously given in accordance with a semantic relationship between the current sentence and a number of preceding sentences. A word prominence is assigned to a word in the current sentence in accordance with the information determination.

Claims

1. An apparatus for assigning word prominence in synthetic speech comprising:

a memory having stored thereon a set of instructions; and

a processing device coupled with the memory, the processing device, when executing the set of instructions, to

generate a speech representative of a current sentence,

determine whether an information in the current sentence is new or previously given based on a semantic relationship between the current sentence and a number of preceding sentences, and

assign a word prominence to a word in the current sentence in accordance with the information determination.

2. The apparatus of claim 1, the processing device, when executing the set of instructions, to determine the semantic relationship between the current sentence and the number of preceding sentences using latent semantic analysis (LSA).

3. The apparatus of claim 2, the processing device, when determining the semantic relationship using LSA, to:

generate a word prominence assignment model comprising semantic anchors associated with the current sentence and the number of preceding sentences; and

classify each word in the current sentence against the semantic anchors to determine whether the word represents the new or previously given information.

4. The apparatus of claim 3, the processing device, when classifying each word in the current sentence against the semantic anchors, to:

measure a closeness between a vector representing the word and the semantic anchors to determine closeness measures; and

determine a novelty score from the closeness measures, wherein the novelty score has a first value when the information is new and a second value when the information is previously given.

5. The apparatus of claim 4, wherein the first value is a positive value and the second value is a negative value.

6. The apparatus of claim 4, wherein the first value is a negative value and the second value is a positive value.

7. The apparatus of claim 4, the processing device, when determining the novelty score from the closeness measures, to:

compute a content prediction index from a first closeness measure of the closeness measures of the semantic anchor associated with the number of preceding sentences and a second closeness measure of the closeness measures of the semantic anchors associated with the current sentence; and

invert the content prediction index.

8. The apparatus of claim 1, the processing device, when assigning a word prominence to a word in the current sentence, to:

emphasize the word in the current sentence when the word represents the new information; and

de-emphasize the word in the current sentence when the word represents the previously given information.

9. The apparatus of claim 8, wherein to achieve emphasizing and de-emphasizing, the processing device alters a prosodic feature of the word.

10. The apparatus of claim 9, wherein altering the prosodic feature includes altering at least one of volume, pitch, and phoneme duration.

11. The apparatus of claim 1, wherein the memory comprises a random access memory device.

12. The apparatus of claim 1, wherein the memory comprises a nonvolatile storage device.

13. The apparatus of claim 1, wherein the memory comprises a remote memory device coupled with the processing device by a network.

14. The apparatus of claim 1, wherein the processing device comprises a microprocessor.

15. The apparatus of claim 1, wherein the processing device comprises an application specific integrated circuit (ASIC).

16. An apparatus for assigning word prominence in synthetic speech comprising:

means for storing a set of instructions; and

means for processing coupled with the means for storing, the means for processing, when executing the set of instructions, to

generate a speech representative of a current sentence,

determine whether an information in the current sentence is new or previously given based on a semantic relationship between the current sentence and a number of preceding sentences, and

assign a word prominence to a word in the current sentence in accordance with the information determination.

17. The apparatus of claim 16, the means for processing, when executing the set of instructions, to determine the semantic relationship between the current sentence and the number of preceding sentences using latent semantic analysis (LSA).

18. The apparatus of claim 17, the means for processing, when determining the semantic relationship using LSA, to:

generate a word prominence assignment model comprising semantic anchors associated with the current sentence and the number of preceding sentences; and

classify each word in the current sentence against the semantic anchors to determine whether the word represents the new or previously given information.

19. The apparatus of claim 18, the means for processing, when classifying each word in the current sentence against the semantic anchors, to:

measure a closeness between a vector representing the word and the semantic anchors to determine closeness measures; and

determine a novelty score from the closeness measures, wherein the novelty score has a first value when the information is new and a second value when the information is previously given.

20. The apparatus of claim 19, wherein the first value is a positive value and the second value is a negative value.

21. The apparatus of claim 19, wherein the first value is a negative value and the second value is a positive value.

22. The apparatus of claim 19, the means for processing, when determining the novelty score from the closeness measures, to:

compute a content prediction index from a first closeness measure of the closeness measures of the semantic anchor associated with the number of preceding sentences and a second closeness measure of the closeness measures of the semantic anchors associated with the current sentence; and

invert the content prediction index.

23. The apparatus of claim 16, the means for processing, when assigning a word prominence to a word in the current sentence, to:

emphasize the word in the current sentence when the word represents the new information; and

de-emphasize the word in the current sentence when the word represents the previously given information.

24. The apparatus of claim 23, wherein to achieve emphasizing and de-emphasizing, the means for processing alters a prosodic feature of the word.

25. The apparatus of claim 24, wherein altering the prosodic feature includes altering at least one of volume, pitch, and phoneme duration.