Pitch pattern generating method and pitch pattern generating apparatus

• US 20060224380A1
• Filed: 03/22/2006
• Published: 10/05/2006
• Est. Priority Date: 03/29/2005
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Hirabayashi, Gou, Kagoshima, Takehiko
• Application Number:
  US11/385,822
• Publication Number:
  US 20060224380A1
• Time in Patent Office: Days
• US Class Current: 704/207
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals

Abstract

A pitch pattern generating method includes preparing a memory to store a plurality of pitch patterns each extracted from natural speech, and pattern attribute information corresponding to the pitch patterns, inputting language attribute information obtained by analyzing a text including prosody control units, selecting, from the pitch patterns stored in the memory, a group of pitch patterns corresponding to each of the prosody control units based on the language attribute information, to obtain a plurality of groups corresponding to the prosody control units respectively, generating a new pitch pattern corresponding to the each of prosody control units by fusing pitch patterns of the group, to obtain a plurality of new pitch patterns corresponding to the prosody control units respectively, and generating a pitch pattern corresponding to the text based on the new pitch patterns.

Claims

1. A pitch pattern generating method comprising:

preparing a memory to store a plurality of pitch patterns each extracted from natural speech, and pattern attribute information corresponding to the pitch patterns;

inputting language attribute information obtained by analyzing a text including prosody control units;

selecting, from the pitch patterns stored in the memory, a group of pitch patterns corresponding to each of the prosody control units based on the language attribute information, to obtain a plurality of groups corresponding to the prosody control units respectively;

generating a new pitch pattern corresponding to the each of prosody control units by fusing pitch patterns of the group, to obtain a plurality of new pitch patterns corresponding to the prosody control units respectively; and

generating a pitch pattern corresponding to the text based on the new pitch patterns.

2. The pitch pattern generating method according to claim 1, wherein selecting includes:

estimating a degree of difference between each of the pitch patterns stored in the memory and a desired pitch variation corresponding to the each of the prosody control units, to obtain a plurality of degrees corresponding to the pitch patterns respectively; and

selecting the group, based on the degrees.

3. The pitch pattern generating method according to claim 1, wherein generating the new pitch pattern generates the new pitch pattern by calculating weighted sum of the pitch patterns of the group.

4. The pitch pattern generating method according to claim 3, wherein generating the new pitch pattern includes:

determining a weight which corresponds to each of the pitch patterns of the group in order to fuse the pitch patterns of the group, based on relationship between the language attribute information and the pattern attribute information which corresponds to the each of the pitch patterns of the group.

5. The pitch pattern generating method according to claim 3, wherein generating the new pitch pattern includes:

calculating a centroid of the pitch patterns of the group; and

determining a weight which corresponds to each of the pitch patterns of the group in order to fuse the pitch patterns of the group, based on a distance between the centroid and the each of the pitch patterns of the group.

6. The pitch pattern generating method according to claim 1, wherein generating the new pitch pattern includes:

transforming each of the pitch patterns of the group based on relationship between the language attribute information and the pattern attribute information which corresponds to the each of the pitch patterns of the group, to obtain a plurality of transformed pitch patterns corresponding to the pitch patterns of the group respectively; and

fusing the transformed pitch patterns, to generate the new pitch pattern.

7. The pitch pattern generating method according to claim 6, wherein transforming transforms the each of the pitch patterns of the group with a microprosody correction process.

8. The pitch pattern generating method according to claim 6, wherein transforming transforms the each of the pitch patterns of the group by expanding and/or contracting the each of the pitch patterns of the group in order to eliminate a mismatch between a target accent position in the each of the prosody control units and an accent position in the each of the pitch patterns of the group.

9. The pitch pattern generating method according to claim 6, wherein transforming transforms the each of the pitch patterns of the group by expanding and/or contracting the each of the pitch patterns of the group in order to eliminate a mismatch between a target number of syllables in the each of the prosody control units and a number of syllables in the each of the pitch patterns of the group.

10. The pitch pattern generating method according to claim 1, wherein generating the pitch pattern corresponding to the text includes:

transforming each of the new pitch patterns based on an offset value corresponding to an overall pitch level of a corresponding one of the prosody control units.

11. The pitch pattern generating method according to claim 1, wherein the memory stores the pitch patterns quantized.

12. The pitch pattern generating method according to claim 1, wherein the memory stores the pitch patterns approximated.

13. A pitch pattern generating apparatus comprising:

a memory to store a plurality of pitch patterns each extracted from natural speech, and pattern attribute information corresponding to the pitch patterns;

an input unit configured to input language attribute information obtained by analyzing a text including prosody control units;

a selecting unit configured to select, from the pitch patterns stored in the memory, a group of pitch patterns corresponding to each of the prosody control units based on the language attribute information, to obtain a plurality of groups corresponding to the prosody control units respectively;

a first generating unit configured to generate a new pitch pattern corresponding to the each of prosody control units by fusing pitch patterns of the group, to obtain a plurality of new pitch patterns corresponding to the prosody control units respectively; and

a second generating unit configured to generate a pitch pattern corresponding to the text based on the new pitch patterns.

14. The pitch pattern generating apparatus according to claim 13, wherein the selecting unit includes:

an estimating unit configured to estimate a degree of difference between each of the pitch patterns stored in the memory and a desired pitch variation corresponding to the each of the prosody control units, to obtain a plurality of degrees corresponding to the pitch patterns respectively; and

wherein the selecting unit selects the group, based on the degrees.

15. The pitch pattern generating apparatus according to claim 13, wherein the first generating unit generates the new pitch pattern by calculating weighted sum of the pitch patterns of the group.

16. The pitch pattern generating apparatus according to claim 13, wherein the first generating unit includes:

a transforming unit configured to transform each of the pitch patterns of the group based on relationship between the language attribute information and the pattern attribute information which corresponds to the each of the pitch patterns of the group, to obtain a plurality of transformed pitch patterns corresponding to the pitch patterns of the group respectively; and

a fusing unit configured to fuse the transformed pitch patterns, to generate the new pitch pattern.

17. The pitch pattern generating apparatus according to claim 13, wherein the second generating unit includes:

a transforming unit configured to transform each of the pitch patterns of the group based on an offset value corresponding to an overall pitch level of a corresponding one of the prosody control units.

18. The pitch pattern generating apparatus according to claim 13, wherein the memory stores the pitch patterns each quantized.

19. The pitch pattern generating apparatus according to claim 13, wherein the memory stores the pitch patterns approximated 20. A pitch pattern generating program product comprising instructions of:

preparing a memory to store a plurality of pitch patterns each extracted from natural speech, and pattern attribute information corresponding to the pitch patterns;

inputting language attribute information obtained by analyzing a text including prosody control units;

selecting, from the pitch patterns stored in the memory, a group of pitch patterns corresponding to each of the prosody control units based on the language attribute information, to obtain a plurality of groups corresponding to the prosody control units respectively;

generating a new pitch pattern corresponding to the each of prosody control units by fusing pitch patterns of the group, to obtain a plurality of new pitch patterns corresponding to the prosody control units respectively; and

generating a pitch pattern corresponding to the text based on the new pitch patterns.