Interactive digital phonetic captioning program

• US 6,336,089 B1
• Filed: 08/20/1998
• Issued: 01/01/2002
• Est. Priority Date: 09/22/1998
• Status: Expired due to Term

• Current Assignee: Michael B. Everding
• Original Assignee: Michael Everding
• Inventors: Everding, Michael
• Primary Examiner(s): Thomas, Joseph
• Application Number:
  US09/137,107
• Time in Patent Office: 1,230 Days
• Field of Search: 704/1, 704/9, 704/8, 704/200, 704/258, 704/260, 704/270, 704/271, 704/272, 704/255, 434/156, 434/167, 434/169, 434/178, 434/185, 434/157, 434/323, 345/473, 345/474, 345/475
• US Class Current: 704/1
• CPC Class Codes: G02F 1/13454 Drivers integrated on the active matrix substrate G02F1/136277 takes precedence
• CPC Class Codes: G02F 2202/105 single crystal Si
• CPC Class Codes: G09B 19/06 Foreign languages with audible presentation of material to be studied G09B5/04
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

An interactive computer assisted pronunciation learning system which allows a student to compare his/her pronunciation with that of a model speaker. A model speaker'"'"'s recorded reading of text is digitally linked to and aligned with each corresponding syllable of the text. Pitch, volume and duration parameters of each syllable are extracted digitally and displayed in a simplified notation above each word. The student'"'"'s own speech is also recorded, analyzed, displayed, and/or replayed in the same manner. The student can choose the option of overlapping his/her own notation above those of the model speaker and determine whether, to what extent, and on which parameters his own speech varies from that of the model speaker. Scores may be provided in the margin denoting the percentage of correct correspondence to the model as well as the type and degree of each error.

Claims

1. An interactive pronunciation learning system comprising:

a microprocessor;

a data input device coupled to said microprocessor to enable a user to interact with said microprocessor;

a display device coupled to said microprocessor to enable the user to visually compare his/her speech characteristics with that of a model speaker;

a speech processor for recording and linking the continuous speech of said user reading a body of displayed text, said speech processor being coupled to said microprocessor;

an audio device coupled to said speech processor for receiving the continuous stream of speech from said model speaker reading the same body of displayed text read by said user;

means for connecting the output of said speech processor to a hearing device, the user thus being able to both visually and audibly compare his/her speech characteristics to that of the model speaker'"'"'s; and

means for mathematically comparing the phonetic and phonemic elements of the acoustic waveforms of the two linked speech segments and displaying the results for each line of text at the user'"'"'s option, segments of the user'"'"'s digitally recorded speech being marked and analyzed and compared to each equivalent segment of the model speaker'"'"'s speech wherein each of said segments comprises one accented syllable and is about three syllables in length.

2. The interactive pronunciation learning system of claim 1 wherein numeric scores are provided rating the correspondence of all the prosodic/phonemic elements on each line, paragraph and/or page.

3. The interactive pronunciation learning system of claim 1 wherein a segment of speech of the model speaker or user is replayed as recorded or optionally as only tones of the detected pitch, volume and duration.

4. The interactive pronunciation learning system of claim 1 wherein the correspondence for each speech segment is based on the dimensions of pitch, volume, duration and phonemic accuracy of the user'"'"'s speech waveform.

5. A method for implementing an interactive pronunciation learning system comprising the steps of:

providing a microprocessor to enable a user to interact therewith;

having the user visually compare his/her speech characteristics with that of a model speaker;

recording and linking the continuous speech of said user reading a body of displayed text;

receiving the continuous stream of speech from said model speaker reading the same body of displayed text read by said user;

visually and audibly comparing the speech characteristics of the user to that of the model speaker'"'"'s; and

mathematically comparing the phonetic and phonemic elements of the acoustic waveforms of the two linked speech segments and displaying the results for each line of text at the user'"'"'s option, segments of the user'"'"'s digitally recorded speech being marked, analyzed and compared to an equivalent segment of the model speech, wherein each of said segments comprises one accented syllable and is about three syllables in length.

6. The method of claim 5 further including the step of providing numeric scores rating the correspondce of all the prosodic/phonemic elements on each line, paragraph and/or page.

7. The method of claim 5 further including the step of replaying as recorded a segment of speech of the model speaker or user or optionally as only tones of the detected pitch, volume and duration.

8. The method of claim 5 wherein the correspondence for each speech segment is based on the dimensions of pitch, volume, duration and phonemic accuracy of the user'"'"'s speech waveform.