Speech recognition apparatus and method for learning

• US 6,134,529 A
• Filed: 02/09/1998
• Issued: 10/17/2000
• Est. Priority Date: 02/09/1998
• Status: Expired due to Fees

• Current Assignee: Syracuse Language Systems, Inc. (Vivendi SE)
• Original Assignee: Syracuse Language Systems, Inc. (Vivendi SE)
• Inventors: Rothenberg, Martin
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): ZINTEL, HAROLD ALBERT
• Application Number:
  US09/020,899
• Time in Patent Office: 981 Days
• Field of Search: 704/270, 704/276, 704/201, 704/271, 704/272, 704/277, 704/251, 704/252, 704/243, 434/185, 434/156, 434/159, 434/167
• US Class Current: 704/270
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

The invention extends the capability of conventional computer speech recognition programs to reliably recognize and understand large word and phrase vocabularies for teaching written language skills. At each step of a teaching program, information is supplied to the user such that some responses in the language being taught are correct (or appropriate) and some are incorrect (or inappropriate), with these respective sets of responses judiciously selected to teach some language aspect (i.e., vocabulary, sentence structure). A subset of allowable correct; and incorrect responses is selected such that a speech recognition subprogram readily discerns certain allowable responses from other allowable responses, including each incorrect response being discriminable from each correct response. The meanings of at least the correct allowable responses are made clear by aural or visual information, such as graphic images, printed text, or translations into the user'"'"'s native language. The invention may be used for the effective teaching of reading skills. This method pertains to children learning to read in their native language, as well as to adults that have learned only the spoken form. The method encourages a user into pronouncing the words and phrases being used, the letter-sound relations will be reinforced much more strongly than if the student'"'"'s response is just a mouse click indicating correct comprehension.

Claims

1. A method for using a computer to teach language reading skills comprising:

selecting a subset of stored internal speech patterns containing at least one correct internal speech pattern which corresponds to a correct response and at least one internal speech pattern corresponding to an incorrect response, from a set of stored internal speech patterns, using a computer program, wherein said correct internal speech pattern is readily differentiable from each of said internal speech patterns corresponding to an incorrect response by a comparison subprogram;

presenting a visual image to a user that corresponds to said correct internal speech pattern,

obtaining a speech response segment from the user;

comparing, using the comparison subprogram, said speech response segment to the subset of stored internal speech patterns and determining the degree of matching to each internal speech pattern in the subset of internal speech patterns; and

presenting to the user a response to the speech segment based on the results of the step of comparing.

2. The method of claim 1 wherein the subset of stored internal speech patterns includes at least one internal speech pattern corresponding to an improperly formed or pronounced response which is a variation of said correct response.

3. The method of claim 2 wherein the step of directing further comprises directing the user toward a more properly formed or pronounced speech response if the speech response segment most closely matches the improperly formed or pronounced response.

4. The method of claim 1 wherein said subset of internal speech patterns includes at least one improperly pronounced variation of a response represents a speech response segment indicative of the user'"'"'s native speech pattern.

5. The method of claim 4 wherein the step of directing further comprises directing the user toward a more properly pronounced speech response if the speech response segment most closely matches an improperly pronounced response.

6. The method of claim 1 wherein the step of presenting further comprises automatically representing aurally to the user each response in the subset of internal speech patterns.

7. The method of claim 1 wherein the step of presenting further comprises automatically representing visually to the user each response in the subset of internal speech patterns.

8. The method of claim 1 wherein the step of presenting further comprises representing aurally to the user a response in the subset of internal speech patterns when a signal is generated by the user.

9. The method of claim 1 wherein the step of presenting auditory or visual information further comprises encouraging the user to use perceptual skills, cognitive skills, memory skills, or motor skills to identify a correct response.

10. The method of claim 1 wherein the step of obtaining a speech response further comprises obtaining a measurement of the nasality of the speech response segment.

11. The method of claim 1 wherein the step of obtaining further comprises obtaining the spectral qualities of the speech response segment.

12. The method of claim 1 wherein the step of obtaining a speech response further comprises obtaining a measurement of the airflow from a mouth of the user during the release phase of a stop or plosive consonant in the speech response segment.

13. The method of claim 1 wherein the step of obtaining further comprises obtaining a measurement of the intonation pattern of the speech response segment.

14. A method for using a computer to teach language reading skills, according to claim 1, wherein said visual image is a string of text containing at least one word.

15. A method for using a computer to teach language reading skills, according to claim 1, wherein said visual image is a string of text containing at least one syllable.

16. A method for using a computer to teach language reading skills, according to claim 1, wherein said visual image is a string of text containing at least one phonetic image.

17. A method for using a computer to teach language reading skills, according to claim 1, wherein said visual image is a vocabulary definition of said image.