Computer prosody user interface

• US 6,006,187 A
• Filed: 10/01/1996
• Issued: 12/21/1999
• Est. Priority Date: 10/01/1996
• Status: Expired due to Term

• Current Assignee: Nokia of America Corporation (Nokia Corporation)
• Original Assignee: Lucent Technologies, Inc. (Nokia Corporation)
• Inventors: Tanenblatt, Michael Abraham
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Chawan, Vijay B.
• Application Number:
  US08/720,759
• Time in Patent Office: 1,176 Days
• Field of Search: 704/260, 704/235, 704/261, 704/255, 704/267, 704/268
• US Class Current: 704/260
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 13/04 Details of speech synthesis systems, e.g. synthesiser structure or memory management

Abstract

The present invention discloses a computer prosody user interface operable to visually tailor the prosody of a text to be uttered by a text-to-speech system. The prosody user interface, permits users to alter a synthesized voice along one or more dimensions on a word-by-word basis. In one embodiment of the present invention, the prosody user interface is operable to alter the speaking rate relative word duration and the word prominence of a synthesized voice. Specifically, one or more words are selected using presentation means, and speech parameters corresponding to the speaking rate relative word duration and the word prominence are manipulated using speech parameter manipulation means. Modifications to the speech parameters are accompanied by visual changes to the presentation means, thereby providing a visual feel to the computer prosody user interface. To hear the modifications to the speech parameters, the present invention transmits a text string to a text-to-speech synthesizer program, wherein the text string comprises the text and escape sequences corresponding to the speech parameters set using the speech parameter manipulation means.

Claims

1. In a system for converting text to voiced speech, an interface means operable to permit a user to alter a prosody characteristic of a synthesized voice for particular words of said text, said interface means comprising:

means for selecting one or more words and punctuation in text input to said system;

display means operable to provide a visual display of said selected one or more words including an indicia of change in at least one prosody characteristic for said displayed words;

means, operating in conjunction with said display means, for enabling a user to dynamically effect a change in said at least one prosody characteristic for at least one of said displayed words; and

means for applying said changed prosody characteristic to a voiced output of said at least one of said displayed words as to which said changed prosody characteristic is effected.

2. The interface means of claim 1, wherein a change in said indicia of change along a first dimension is indicative of a change in a first prosody characteristic for a selected word and a change in said indicia of change along a second dimension is indicative of a change in a second prosody characteristic for said selected word.

3. The interface means of claim 2, wherein horizontal dimensions of said indicia of change correspond to speaking rate relative word duration of said selected words.

4. The interface means of claim 2, wherein horizontal dimensions of said indicia of change correspond to speaking rate relative word duration of said selected punctuations.

5. The interface means of claim 2, wherein vertical dimensions of said indicia of change correspond to word prominence of said selected words.

6. The interface means of claim 1, wherein said means for enabling includes a means for redimensioning said indicia of change in said display means, said redimensioning manifesting a correspondence with changes made in said at least one prosody characteristic.

7. The interface means of claim 1, wherein said means for enabling is operable to effect a redimensioning of said indicia of change for a selected word, said redimensioning corresponding to a change in said at least one prosody characteristic.

8. The interface means of claim 1, wherein said indicia of change in said display means is visually coordinated with changes in said at least one prosody characteristic effected by said means for enabling.

9. The interface means of claim 1, wherein said means for enabling includes:

duration control means for setting speaking rate relative word duration of selected words to be uttered by said synthesized voice.

10. The interface means of claim 1, wherein said means for enabling includes:

duration control means for setting speaking rate relative word duration dimension of selected punctuations.

11. The interface means of claim 1, wherein said means for enabling includes:

prominence control means for setting word prominence of selected words to be uttered by said synthesized voice.

12. The interface means of claim 1, wherein said means for enabling includes:

accent means for assigning accents to selected words, said selected accents being assigned using escape sequences.

13. The interface means of claim 12, wherein said accent means have active and deactive positions, said accent means causing visual changes to said indicia of change when said accent means are in said active positions.

14. The interface means of claim 13, wherein said visual changes to said indicia of change upon said accent means being in said active position is manifested as a change in background color for said selected word.

15. The interface means of claim 1, wherein said means for enabling includes:

phrase contour means for assigning phrase contours to portions of said text, said phrase contours being assigned using escape sequences.

16. The interface means of claim 1, wherein said means for applying includes:

creation means for forming a text string using said selected words and prosody characteristics therefor as established by said means for enabling.

17. The interface means of claim 1, wherein said means for applying includes:

comparison means for relating prosody characteristics of a current word with prosody characteristics of a previous word.

18. The interface means of claim 1, wherein said means for applying includes:

comparison means for relating prosody characteristics of a current word with default prosody characteristics.

19. A method for altering a prosody characteristic of a synthesized voice in a text to speech system comprising the steps of:

selecting one or more words and punctuation in text input to said text-to-speech system;

providing a visual display to a user of said selected one or more words, said display including an indicia of change in at least one prosody characteristic for said displayed words;

providing a user interface to said display, whereby a user to able to dynamically alter said at least one prosody characteristic for at least one of said displayed words; and

applying said altered prosody characteristic to a voiced output of said at least one of said displayed words.

20. The method for altering a prosody characteristic of claim 19 further comprising the additional steps of:

causing a change in said indicia of change along a first dimension to correspond with a change in a first prosody characteristic for a selected word; and

causing a change in said indicia of change along a second dimension to correspond with a change in a second prosody characteristic for said selected word.

21. The method for altering a prosody characteristic of claim 20, wherein horizontal dimensions of said indicia of change correspond to speaking rate relative word duration of said selected words.

22. The method for altering a prosody characteristic of claim 20, wherein horizontal dimensions of said indicia of change correspond to speaking rate relative word duration of said selected punctuations.

23. The method for altering a prosody characteristic of claim 20, wherein vertical dimensions of said indicia of change correspond to word prominence of said selected words.

24. The method for altering a prosody characteristic of claim 19, wherein said user interface includes a means for redimensioning said indicia of change in said display means, said redimensioning manifesting a correspondence with changes made in said at least one prosody characteristic.

25. The method for altering a prosody characteristic of claim 19, wherein said user interface is operable to effect a redimensioning of said indicia of change for a selected word, said redimensioning corresponding to a change in said at least one prosody characteristic.

26. The method for altering a prosody characteristic of claim 19, wherein said indicia of change is visually coordinated with changes in said at least one prosody characteristic.

27. The method for altering a prosody characteristic of claim 19, wherein said user interface includes an accent means for causing accents to be assigned to selected words, said accents being assigned using escape sequences.

28. The method for altering a prosody characteristic of claim 27, wherein said accent means has active and deactive positions, and is operative to cause visual changes to said indicia of change when said accent means is in said active positions.

29. The method for altering a prosody characteristic of claim 19, wherein said step of applying includes a substep of:

forming a text string using said selected words and prosody characteristics therefor.

30. The method for altering a prosody characteristic of claim 19, wherein said step of applying includes a substep of:

relating prosody characteristics of a current word with prosody characteristics of a previous word.

31. The method for altering a prosody characteristic of claim 19, wherein said step of applying includes a substep of:

relating prosody characteristics of a current word with default prosody characteristics.