SPEECH PROCESSING SYSTEM

• US 20140025382A1
• Filed: 07/15/2013
• Published: 01/23/2014
• Est. Priority Date: 07/18/2012
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: CHEN, Langzhou, Gales, Mark John Francis, Knill, Katherine Mary, Masami, Akamine
• Application Number:
  US13/941,968
• Publication Number:
  US 20140025382A1
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/10 Prosody rules derived from text; Stress or intonation
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

A text to speech method, the method comprising:

• • receiving input text;
  • dividing said inputted text into a sequence of acoustic units;
  • converting said sequence of acoustic units to a sequence of speech vectors using an acoustic model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to a speech vector; and
  • outputting said sequence of speech vectors as audio,
  • the method further comprising determining at least some of said model parameters by:
    • extracting expressive features from said input text to form an expressive linguistic feature vector constructed in a first space; and
    • mapping said expressive linguistic feature vector to an expressive synthesis feature vector which is constructed in a second space.

Claims

1. A text to speech method, the method comprising:

receiving input text;

dividing said inputted text into a sequence of acoustic units;

converting said sequence of acoustic units to a sequence of speech vectors using an acoustic model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to a speech vector; and

outputting said sequence of speech vectors as audio,

the method further comprising determining at least some of said model parameters by;

extracting expressive features from said input text to form an expressive linguistic feature vector constructed in a first space; and

mapping said expressive linguistic feature vector to an expressive synthesis feature vector which is constructed in a second space.

2. A method according to claim 1, wherein mapping the expressive linguistic feature vector to an expressive synthesis feature vector comprises using a machine learning algorithm.

3. A method according to claim 1, wherein said second space is a multi-dimensional continuous space.

4. A method according to claim 1, wherein extracting the expressive features from said input text comprises a plurality of extraction processes, said plurality of extraction processes being performed at different information levels of said text.

5. A method according to claim 4, wherein the different information levels are selected from a word based linguistic feature extraction level to generate word based linguistic feature vector, a full context phone based linguistic feature extraction level to generate full context phone based linguistic feature, a part of speech (POS) based linguistic feature extraction level to generate POS based feature and a narration style based linguistic feature extraction level to generate narration style information.

6. A method according to claim 4, wherein each of the plurality of extraction processes produces a feature vector, the method further comprising concatenating the linguistic feature vectors generated from the different information levels to produce a linguistic feature vector to map to the second space.

7. A method according to claim 4, wherein mapping the expressive linguistic feature vector to an expressive synthesis feature vector comprises a plurality of hierarchical stages corresponding to each of the different information levels.

8. A method according to claim 1, wherein the mapping uses full context information.

9. A method according to claim 1, wherein the acoustic model receives full context information from the input text and this information is combined with the model parameters derived from the expressive synthesis feature vector in the acoustic model.

10. A method according to claim 1, wherein the model parameters of said acoustic model are expressed as the weighted sum of model parameters of the same type and the weights are represented in the second space.

11. A method according to claim 10, wherein the said model parameters which are expressed as the weighted sum of model parameters of the same type are the means of Gaussians.

12. A method according to claim 10, wherein the parameters of the same type are clustered and the synthesis feature vector comprises a weight for each cluster.

13. A method according to claim 12, wherein each cluster comprises at least one decision tree, said decision tree being based on questions relating to at least one of linguistic, phonetic or prosodic differences.

14. A method according to claim 13, wherein there are differences in the structure between the decision trees of the clusters.

20. A carrier medium comprising computer readable code configured to cause a computer to perform the method of claim 1.

15. A method of training a text-to-speech system, the method comprising:

receiving training data, said training data comprising text data and speech data corresponding to the text data;

extracting expressive features from said input text to form an expressive linguistic feature vector constructed in a first space;

extracting expressive features from the speech data and forming an expressive feature synthesis vector constructed in a second space;

training a machine learning algorithm, the training input of the machine learning algorithm being an expressive linguistic feature vector and the training output the expressive feature synthesis vector which corresponds to the training input.

16. A method according to claim 15, further comprising outputting the expressive synthesis feature vector a speech synthesizer, said speech synthesizer comprising an acoustic model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to a speech vector.

17. A method according to claim 16, wherein the parameters of the acoustic model and the machine learning algorithm are jointly trained.

18. A method according to claim 16, wherein the model parameters of said acoustic model are expressed as the weighted sum of model parameters of the same type and the weights are represented in the second space and wherein the weights represented in the second space and the machine learning algorithm are jointly trained.

19. A text to speech apparatus, the apparatus comprising:

a receiver for receiving input text;

a processor adapted to;

divide said inputted text into a sequence of acoustic units; and

convert said sequence of acoustic units to a sequence of speech vectors using an acoustic model, wherein said model has a plurality of model parameters describing probability distributions which relate an acoustic unit to a speech vector; and

an audio output adapted to output said sequence of speech vectors as audio, the processor being further adapted to determine at least some of said model parameters by;

extracting expressive features from said input text to form an expressive linguistic feature vector constructed in a first space; and

mapping said expressive linguistic feature vector to an expressive synthesis feature vector which is constructed in a second space.