Speech synthesis using concatenation of speech waveforms

• US 20040111266A1
• Filed: 12/01/2003
• Published: 06/10/2004
• Est. Priority Date: 11/13/1998
• Status: Active Grant

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Fackrell, Justin, Rutten, Peter, DeMoortel, Jan, Schenk, Andre, Deprez, Filip, Van Coile, Bert, Leys, Steven, De Bock, Mario, Coorman, Geert
• Granted Patent: US 7,219,060 B2
• Time in Patent Office: Days
• US Class Current: 704/260
• CPC Class Codes: G10L 13/06 Elementary speech units used in speech synthesisers; Concatenation rules
• CPC Class Codes: G10L 13/07 Concatenation rules

Abstract

A high quality speech synthesizer in various embodiments concatenates speech waveforms referenced by a large speech database. Speech quality is further improved by speech unit selection and concatenation smoothing.

Claims

1. A system for speech unit selection comprising:

a large speech database referencing speech waveforms and associated symbolic prosodic features, wherein the speech database is accessed by speech waveform designators, at least one designator being associated with a sequence of one or more diphones; and

a speech waveform selector, in communication with the speech database, that selects based, at least in part, on the symbolic prosodic features stored in the speech database, waveforms referenced by the speech database.

2. A system according to claim 1, wherein the speech waveform selector uses criteria that favor approximately equally all waveform candidates having low level prosody features within a target range determined as a function of high level linguistic features.

4. A system according to claim 2 or 3, wherein the criteria include a first requirement favoring waveform candidates having pitch within a target range determined as a function of high level linguistic features.

5. A system according to claim 2 or 3, wherein the criteria include a second requirement favoring waveform candidates having a duration within a target range determined as a function of high level linguistic features.

6. A system according to claim 2 or 3, wherein the criteria include a third requirement favoring waveform candidates having coarse pitch continuity within a target range determined as a function of high-level linguistic features.

7. A system according to claim 2 or 3, wherein the synthesizer operates to select among waveform candidates without recourse to specific target duration values or specific target pitch contour values over time.

3. A system for speech unit selection comprising:

a large speech database referencing speech waveforms;

a speech waveform selector, in communication with the speech database, that selects waveforms referenced by the speech database using criteria that, at least in part, favor (i) waveform candidates based directly on high level prosody features, and (ii) approximately equally all waveform candidates having low level prosody features within a target range determined as a function of high level linguistic features.