Speech recognition apparatus and method for learning
First Claim
1. A method for using a computer to teach language skills comprising:
- presenting auditory or visual information to a user that defines for the user at least one correct response and at least one incorrect response, each response corresponding to a stored internal speech pattern, wherein said speech patterns are readily differentiable from each other by a comparison subprogram, which is part of a computer program running on said computer;
selecting, from a set of stored internal speech patterns, using said computer program, a subset containing at least one internal speech pattern corresponding to a correct response and at least one internal speech pattern corresponding to an incorrect response, each internal speech pattern corresponding to a correct response being readily differentiable from each internal speech pattern corresponding to an incorrect response by said comparison subprogram;
presenting or making available to a user auditory or visual information that presents the correct pronunciation of each of the responses corresponding to an internal speech pattern in the subset and also the meaning of at least the correct responses corresponding to the internal speech patterns in the subset;
obtaining a speech response segment from the user;
comparing, using the comparison subprogram, the speech response segment to the subset of internal speech patterns and determining the degree of matching to each internal speech pattern in the subset of internal speech patterns; and
presenting to the user an auditory or visual response to the speech segment based on the results of the step of comparing.
2 Assignments
0 Petitions
Accused Products
Abstract
The invention extends the capability of conventional computer speech recognition programs to reliably recognize and understand large word and phrase vocabularies for teaching language comprehension and oral production skills. At each step of a teaching program, information is supplied to the user such that some responses in the language being taught are correct (or appropriate) and some are incorrect (or inappropriate), with these respective sets of responses judiciously selected to teach some language aspect. A subset of allowable correct and incorrect responses is selected such that a speech recognition subprogram readily discerns certain allowable responses from other allowable responses, including each incorrect response being discriminable from each correct response. The meanings of at least the correct allowable responses are made clear by aural or visual information, such as graphic images, printed text, or translations into the user'"'"'s native language. A model of the correct pronunciation of each allowable response may be available, with these models presented either exhaustively or selectively. The invention includes a mechanism for differentiating between improperly formed and deficient productions and providing corrective feedback upon deficient production. The mechanism for differentiating may include dummy, improperly formed speech models, and augmentative voice analyzers may be used. Augmentative monitors capturing non-acoustic measurements may be included.
171 Citations
23 Claims
-
1. A method for using a computer to teach language skills comprising:
-
presenting auditory or visual information to a user that defines for the user at least one correct response and at least one incorrect response, each response corresponding to a stored internal speech pattern, wherein said speech patterns are readily differentiable from each other by a comparison subprogram, which is part of a computer program running on said computer; selecting, from a set of stored internal speech patterns, using said computer program, a subset containing at least one internal speech pattern corresponding to a correct response and at least one internal speech pattern corresponding to an incorrect response, each internal speech pattern corresponding to a correct response being readily differentiable from each internal speech pattern corresponding to an incorrect response by said comparison subprogram; presenting or making available to a user auditory or visual information that presents the correct pronunciation of each of the responses corresponding to an internal speech pattern in the subset and also the meaning of at least the correct responses corresponding to the internal speech patterns in the subset; obtaining a speech response segment from the user; comparing, using the comparison subprogram, the speech response segment to the subset of internal speech patterns and determining the degree of matching to each internal speech pattern in the subset of internal speech patterns; and presenting to the user an auditory or visual response to the speech segment based on the results of the step of comparing. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A language learning apparatus comprising:
-
at least one transducer; a digital computer having both visual and auditory output capabilities and auditory input capabilities; and a program running on the digital computer which analyzes input speech patterns derived from said at least one tranducer, the program including a comparison program which can compare the input speech patterns to each member of a subset of a total set of speech patterns stored in a memory located in the digital computer, with a result of each such comparison being output to a decision mechanism program, and the comparison program receiving an identification code for specifying which of a total set of internally stored speech patterns are to be included in the subset for each such comparison. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A method for using a computer to teach language skills comprising:
-
presenting auditory or visual information to a user that defines for the user a plurality of appropriate oral responses, at least two of said appropriate oral responses being in a set of at least two internal speech patterns and being readily differentiable from each other by a comparison subprogram, which is part of a computer program running on said computer; selecting, from the set of at least two internal speech patterns, using said computer program, a subset of responses that are properly pronounced, and that contains at least two appropriate responses, each appropriate response being readily differentiable from each other appropriate response by said comparison subprogram; presenting or making available to a user auditory or visual information that communicates the correct pronunciation of cach of the responses in the subset; obtaining a speech response segment from the user; comparing, using the comparison subprogram, the speech response segment to the subset of responses and determining the degree of matching to each response in the subset of responses; and presenting to the user an auditory or visual response to the speech response segment based on the results of the step of comparing.
-
Specification