Visual comparison of speech utterance waveforms in which syllables are indicated

• US 20070067174A1
• Filed: 09/22/2005
• Published: 03/22/2007
• Est. Priority Date: 09/22/2005
• Status: Abandoned Application

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Verma, Ashish, Kapoor, Hitesh
• Application Number:
  US11/232,679
• Publication Number:
  US 20070067174A1
• Time in Patent Office: Days
• US Class Current: 704/276
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

Speech utterance waveforms are visually compared in which syllables are indicated, such as in color. A speech utterance from a first user and a corresponding speech utterance from a second user are recorded. The phones, or phonemes, of each speech utterance are segmented, and these phones are mapped to the syllables of the speech utterances. A waveform of each speech utterance is displayed, in which syllables of the words spoken in the speech utterance are indicated. The syllables of the words may be distinguished in different colors, such that the same color is used for the same syllable in both of the utterances. A specific color can also be used to specify the stress level of a syllable. The users may visually compare the waveforms to assist understanding of the differences in syllable stress patterns between the utterance of the first user and the corresponding utterance of the second user.

Claims

1. A method comprising:

receiving a speech utterance from a first user, the speech utterance having one or more syllables of one or more words;

displaying a waveform of the speech utterance in which the syllables of the speech utterance are indicated; and

,

displaying a waveform of a corresponding speech utterance from a second user, in which one or more syllables of the corresponding speech utterance are indicated.

2. The method of claim 1, wherein receiving the speech utterance from the first user comprises receiving the speech utterance as prerecorded.

3. The method of claim 1, wherein receiving the speech utterance from the first user comprises recording the speech utterance from the first user.

4. The method of claim 1, further comprising:

segmenting one or more phones of the speech utterance; and

,

mapping the phones of the speech utterance to the syllables of the speech utterance.

5. The method of claim 4, wherein segmenting the phones of the speech utterance comprises performing a Viterbi alignment of the speech utterance employing one or more speech recognition models.

6. The method of claim 4, wherein segmenting the phones of the speech utterance comprises employing a phonetic spellings database.

7. The method of claim 4, wherein mapping the phones of the speech utterance to the syllables of the speech utterance comprises employing a syllabic mapping database.

8. The method of claim 4, wherein displaying the waveform of the speech utterance comprises displaying portions of the waveform corresponding to the syllables in different colors.

9. The method of claim 1, further comprising directly segmenting the syllables of the speech utterance.

10. The method of claim 9, wherein directly segmenting the syllables of the speech utterance comprises employing a syllabic spellings database.

11. The method of claim 9, wherein directly segmenting the syllables of the speech utterance comprises employing one or more speech recognition models.

12. The method of claim 1, wherein the first user is a student learning proper accenting of the syllables of the words, and the second user is capable of speaking the proper accenting of the syllables of the words.

13. The method of claim 1, further comprising visually comparing the waveform of the speech utterance to the waveform of the corresponding speech utterance to assist understanding of differences in syllable stress patterns between the speech utterance of the words and the corresponding speech utterance of the words.

14. The method of claim 8, wherein displaying the waveform of the corresponding speech utterance comprises displaying portions of the waveform corresponding to the syllables in the different colors.

15. The method of claim 1, wherein displaying the waveform of the speech utterance comprise labeling different syllables of the words with names of the syllables.

16. A system comprising:

a recording mechanism adapted to record a first speech utterance from a first user and a second speech utterance from a second user, both the first and the second speech utterances having one or more syllables of one or more words;

a processing mechanism adapted to segment the syllables of each of the first and the second speech utterances; and

,

a display mechanism adapted to display a first waveform of the first speech utterance in which the syllables thereof are indicated and to display a second waveform of the second speech utterance in which the syllables thereof are indicated,

such that differences in pronunciation of the syllables of the first and the second speech utterances are discernable by visual comparison of the first and the second waveforms.

17. The system of claim 16, wherein the processing mechanism is adapted to segment the syllables of each of the first and the second speech utterances by segmenting one or more phones of each of the first and the second speech utterances, and mapping the phones of each of the first and the second speech utterances to the syllables.

18. The system of claim 16, wherein the processing mechanism is adapted to segment the syllables of each of the first and the second speech utterances by directly segmenting the syllables of each of the first and the second speech utterances.

19. The system of claim 16, wherein the display mechanism is adapted to display portions of the first and the second waveforms in different colors corresponding to the syllables of the first and the second speech utterances, such that corresponding syllables of the first and the second speech utterances have corresponding portions of the first and the second waveforms displayed in identical colors.

20. An article of manufacture comprising:

a computer-readable medium; and

,

computer code in the medium for displaying a first waveform corresponding to a first speech utterance and a second waveform corresponding to a second speech utterance in which syllables thereof are indicated, and in which corresponding syllables of the first and the second speech utterances are displayed as portions of the first and the second waveforms in identical colors.