Speech-to-speech generation system and method
First Claim
Patent Images
1. A speech-to-speech generation system, comprising:
- speech recognition means, for recognizing the speech of language A and creating the corresponding text of language A;
machine translation means for translating the text from language A to language B;
text-to-speech generation means, for generating the speech of language B according to the text of language B,said speech-to-speech generation system is characterized by further comprising;
expressive parameter detection means, for extracting expressive parameters from the speech of language A, said expressive parameters comprising pitch, volume and duration at a word level and intonation and sentence envelope at a sentence level;
for obtaining normalized expressive parameters for language A based on a degree of variation of pitch, volume and duration at a word level and intonation and sentence envelope at a sentence level for words in a sentence and deriving relative expressive parameters from the normalized parameters;
for comparing relative parameters of expressive speech with those of reference speech to identify varying relative parameters to be provided to said expressive parameter mapping means; and
expressive parameter mapping means for mapping the identified varying relative parameters extracted by the expressive parameter detection means from language A to language B to obtain adjustment parameters for language B, and driving the text-to-speech generation means using the adjustment parameters mapping results to synthesize expressive speech in language B.
0 Assignments
0 Petitions
Accused Products
Abstract
An expressive speech-to-speech generation system which can generate expressive speech output by using expressive parameters extracted from the original speech signal to drive the standard TTS system. The system comprises: speech recognition means, machine translation means, text-to-speech generation means, expressive parameter detection means for extracting expressive parameters from the speech of language A, and expressive parameter mapping means for mapping the expressive parameters extracted by the expressive parameter detection means from language A to language B, and driving the text-to-speech generation means by the mapping results to synthesize expressive speech.
14 Citations
6 Claims
-
1. A speech-to-speech generation system, comprising:
-
speech recognition means, for recognizing the speech of language A and creating the corresponding text of language A; machine translation means for translating the text from language A to language B; text-to-speech generation means, for generating the speech of language B according to the text of language B, said speech-to-speech generation system is characterized by further comprising; expressive parameter detection means, for extracting expressive parameters from the speech of language A, said expressive parameters comprising pitch, volume and duration at a word level and intonation and sentence envelope at a sentence level;
for obtaining normalized expressive parameters for language A based on a degree of variation of pitch, volume and duration at a word level and intonation and sentence envelope at a sentence level for words in a sentence and deriving relative expressive parameters from the normalized parameters;
for comparing relative parameters of expressive speech with those of reference speech to identify varying relative parameters to be provided to said expressive parameter mapping means; andexpressive parameter mapping means for mapping the identified varying relative parameters extracted by the expressive parameter detection means from language A to language B to obtain adjustment parameters for language B, and driving the text-to-speech generation means using the adjustment parameters mapping results to synthesize expressive speech in language B. - View Dependent Claims (2, 3)
-
-
4. A speech-to-speech generation system, comprising:
-
speech recognition means for recognizing the speech of dialect A and creating the corresponding text; text-to-speech generation means for generating the speech of another dialect B according to the text, said speech-to-speech generation system is characterized by further comprising; expressive parameter detection means, for extracting expressive parameters from the speech of dialect A, said expressive parameters comprising pitch, volume and duration at a word level and intonation and sentence envelope at a sentence level;
for obtaining normalized expressive parameters for dialect A based on a degree of variation of pitch, volume and duration at a word level and intonation and sentence envelope at a sentence level for words in a sentence and deriving relative expressive parameters from the normalized parameters;
for comparing relative parameters of expressive speech with those of reference speech to identify varying relative parameters to be provided to said expressive parameter mapping means; andexpressive parameter mapping means for mapping the identified varying relative parameters extracted by the expressive parameter detection means from dialect A to dialect B to obtain adjustment parameters for dialect B, and driving the text-to-speech generation means using the adjustment parameters mapping results to synthesize expressive speech in dialect B. - View Dependent Claims (5, 6)
-
Specification