Method and system for defining a sequence of sound modules for synthesis of a speech signal in a tonal language

• US 7,162,424 B2
• Filed: 04/26/2002
• Issued: 01/09/2007
• Est. Priority Date: 04/26/2001
• Status: Expired due to Fees

• Current Assignee: Unify GmbH & Co. KG (Atos SE)
• Original Assignee: Siemens AG
• Inventors: Holzapfel, Martin, Tao, Jianhua
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): Shortledge, Thomas E
• Application Number:
  US10/132,731
• Publication Number:
  US 20020188450A1
• Time in Patent Office: 1,719 Days
• Field of Search: 704/258, 704/260, 704/268, 704/278
• US Class Current: 704/258
• CPC Class Codes: G10L 13/06 Elementary speech units used in speech synthesisers; Concatenation rules

Abstract

The invention relates to a method for defining a sequence of sound modules for synthesis of a speech signal in a tonal language corresponding to a sequence of speech modules. The method according to the invention differs from known methods in that the speech modules represent triphones, which each comprise one phoneme with the respective context, and with syllables in the tonal language being composed of one or more triphones. This results in a high level of flexibility for the synthesis of tonal languages.

Claims

1. A method for defining a sequence of sound modules for synthesis of a speech signal in a tonal language in accordance with a predetermined sequence of speech modules, comprising:

choosing groups of sound modules which can be associated with the speech modules in the predetermined sequence; and

selecting from the groups of sound modules a corresponding sound module for each speech module based on at least one suitability function defining a suitability distance from the speech module corresponding thereto and weighted by applying a weighting factor to a power thereof, resulting in the predetermined sequence of speech modules having a sequence of corresponding sound modules with a global suitability distance quantitatively describing a preferred suitability among the groups of sound modules for representation of the predetermined sequence of speech modules, each corresponding sound module being a triphone formed of only one phoneme with respective contexts and with each syllable in the tonal language being composed of at least one triphone.

2. The method as claimed in claim 1, wherein said selecting includes

calculating a partial suitability distance for each corresponding sound module using a plurality of suitability functions;

and

multiplying the partial suitability distance for each corresponding sound module in the sequence of corresponding sound modules by one another to form the global suitability distance.

3. The method as claimed in claim 2, wherein the at least one suitability function describes a concatenation capability for two adjacent sound modules and has a value weighted differently at syllable boundaries than within syllables.

4. The method as claimed in claim 3, wherein the at least one suitability function describing the concatenation capability is also weighted at word and sentence boundaries.

5. The method as claimed in claim 1, wherein the weighting factor is greater than 1000 within syllables, and between 5 and 100 at syllable boundaries.

6. The method as claimed in claim 5, wherein the weighting factor is between 2 and 5 at word boundaries, and is equal to 0 at sentence boundaries.

7. The method as claimed in claim 6, wherein the suitability function describes a match between pitch levels of two adjacent sound modules.

8. The method as claimed in claim 7, wherein at least one partial suitability distance for each corresponding sound module is in a range from 0 to 1, with 1 corresponding to optimum suitability and 0 to minimum suitability.

9. A computer readable medium storing at least one program embodying a method for defining a sequence of sound modules for synthesis of a speech signal in a tonal language in accordance with a predetermined sequence of speech modules, said method comprising:

choosing groups of sound modules which can be associated with the speech modules in the predetermined sequence; and

selecting from the groups of sound modules a corresponding sound module for each speech module based on at least one suitability function defining a suitability distance from the speech module corresponding thereto and weighted by applying a weighting factor to a power thereof, resulting in the predetermined sequence of speech modules having a sequence of corresponding sound modules with a global suitability distance quantitatively describing a preferred suitability among the groups of sound modules for representation of the predetermined sequence of speech modules, each corresponding sound module being a triphone formed of only one phoneme with respective contexts and with each syllable in the tonal language being composed of at least one triphone.

10. The computer readable medium as claimed in claim 9, wherein said selecting includes

calculating a partial suitability distance for each corresponding sound module using a plurality of suitability functions;

and

multiplying the partial suitability distance for each corresponding sound module in the sequence of corresponding sound modules by one another to form the global suitability distance.

11. The computer readable medium as claimed in claim 10, wherein the at least one suitability function describes a concatenation capability for two adjacent sound modules and has a value weighted differently at syllable boundaries than within syllables.

12. The computer readable medium as claimed in claim 11, wherein the at least one suitability function describing the concatenation capability is also weighted at word and sentence boundaries.

13. The computer readable medium as claimed in claim 9, wherein the weighting factor is greater than 1000 within syllables, and between 5 and 100 at syllable boundaries.

14. The computer readable medium as claimed in claim 13, wherein the weighting factor is between 2 and 5 at word boundaries, and is equal to 0 at sentence boundaries.

15. The computer readable medium as claimed in claim 14, wherein the suitability function describes a match between pitch levels of two adjacent sound modules.

16. The computer readable medium as claimed in claim 15, wherein at least one partial suitability distance for each corresponding sound module is in a range from 0 to 1, with 1 corresponding to optimum suitability and 0 to minimum suitability.

17. A system for defining a sequence of sound modules for synthesis of a speech signal in a tonal language in accordance with a predetermined sequence of speech modules, comprising:

a processor programmed to choose groups of sound modules which can be associated with the speech modules in the predetermined sequence and to select from the groups of sound modules a corresponding sound module for each speech module based on at least one suitability function defining a suitability distance from the speech module corresponding thereto and weighted by applying a weighting factor to a power thereof, resulting in the predetermined sequence of speech modules having a sequence of corresponding sound modules with a global suitability distance quantitatively describing a preferred suitability among the groups of sound modules for representation of the predetermined sequence of speech modules, each corresponding sound module being a triphone formed of only one phoneme with respective contexts and with each syllable in the tonal language being composed of at least one triphone.

18. The system as claimed in claim 17, wherein the weighting factor is greater than 1000 within syllables, and between 5 and 100 at syllable boundaries.

19. The system as claimed in claim 18, wherein the weighting factor is between 2 and 5 at word boundaries, and is equal to 0 at sentence boundaries.

20. The system as claimed in claim 19, wherein the suitability function describes a match between pitch levels of two adjacent sound modules.