System and Method for Generalized Preselection for Unit Selection Synthesis

• US 20140350940A1
• Filed: 08/07/2014
• Published: 11/27/2014
• Est. Priority Date: 09/21/2009
• Status: Active Grant

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: CONKIE, Alistair D., BEUTNAGEL, Mark, KIM, Yeon-Jun, SYRDAL, Ann K.
• Granted Patent: US 9,564,121 B2
• Time in Patent Office: Days
• US Class Current: 704/258
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/047 Architecture of speech synthesisers
• CPC Class Codes: G10L 13/06 Elementary speech units used in speech synthesisers; Concatenation rules

Abstract

Disclosed herein are systems, computer-implemented methods, and computer-readable storage media for unit selection synthesis. The method causes a computing device to add a supplemental phoneset to a speech synthesizer front end having an existing phoneset, modify a unit preselection process based on the supplemental phoneset, preselect units from the supplemental phoneset and the existing phoneset based on the modified unit preselection process, and generate speech based on the preselected units. The supplemental phoneset can be a variation of the existing phoneset, can include a word boundary feature, can include a cluster feature where initial consonant clusters and some word boundaries are marked with diacritics, can include a function word feature which marks units as originating from a function word or a content word, and/or can include a pre-vocalic or post-vocalic feature. The speech synthesizer front end can incorporates the supplemental phoneset as an extra feature.

Claims

1. A method comprising:

adding a supplemental phoneset to a speech synthesizer front end having an existing phoneset;

modifying a unit selection process by adding costs associated with the supplemental phoneset to a selection cost that is part of the unit selection process, to yield a modified unit selection process; and

generating speech using units from the supplemental phoneset and the existing phoneset, wherein the units are selected by the modified unit selection process.

2. The method of claim 1, wherein the supplemental phoneset comprises a cluster feature where initial consonant clusters are marked with diacritics.

3. The method of claim 1, wherein the supplemental phoneset is a variation of the existing phoneset.

4. The method of claim 1, wherein the supplemental phoneset comprises a word boundary feature.

5. The method of claim 1, wherein the supplemental phoneset comprises a function word feature which marks units as originating from one of a function word and a content word.

6. The method of claim 1, wherein the supplemental phoneset comprises one of a pre-vocalic and a post-vocalic feature.

7. The method of claim 1, adjusting the costs using weights.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising;

adding a supplemental phoneset to a speech synthesizer front end having an existing phoneset;

modifying a unit selection process by adding costs associated with the supplemental phoneset to a selection cost that is part of the unit selection process, to yield a modified unit selection process; and

generating speech using units from the supplemental phoneset and the existing phoneset, wherein the units are selected by the modified unit selection process.

9. The system of claim 8, wherein the supplemental phoneset comprises a cluster feature where initial consonant clusters are marked with diacritics.

10. The system of claim 8, wherein the supplemental phoneset is a variation of the existing phoneset.

11. The system of claim 8, wherein the supplemental phoneset comprises a word boundary feature.

12. The system of claim 8, wherein the supplemental phoneset comprises a function word feature which marks units as originating from one of a function word and a content word.

13. The system of claim 8, wherein the supplemental phoneset comprises one of a pre-vocalic and a post-vocalic feature.

14. The system of claim 8, adjusting the costs using weights.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

adding a supplemental phoneset to a speech synthesizer front end having an existing phoneset;

modifying a unit selection process by adding costs associated with the supplemental phoneset to a selection cost that is part of the unit selection process, to yield a modified unit selection process; and

generating speech using units from the supplemental phoneset and the existing phoneset, wherein the units are selected by the modified unit selection process.

16. The computer-readable storage device of claim 15, wherein the supplemental phoneset comprises a cluster feature where initial consonant clusters are marked with diacritics.

17. The computer-readable storage device of claim 15, wherein the supplemental phoneset is a variation of the existing phoneset.

18. The computer-readable storage device of claim 15, wherein the supplemental phoneset comprises a word boundary feature.

19. The computer-readable storage device of claim 15, wherein the supplemental phoneset comprises a function word feature which marks units as originating from one of a function word and a content word.

20. The computer-readable storage device of claim 15, wherein the supplemental phoneset comprises one of a pre-vocalic and a post-vocalic feature.