Intelligent tutoring feedback
First Claim
Patent Images
1. A computer-based method comprising:
- receiving by a computer audio input associated with a user reading a sequence of words displayed on a graphical user interface generated from the computer, with words in the sequence of words associated with at least one pre-assigned word category;
assessing by the computer a level of fluency and pronunciation accuracy of the reading by the user of the sequence of words by;
applying the audio input to a speech recognition engine, configured to produce an output, as a sequence of recognized words, corresponding to the received input;
comparing the sequence of recognized words to an expected sequence of words; and
providing by the computer feedback to the user related to the level of fluency and pronunciation accuracy for a word in the sequence of recognized words, wherein providing the feedback includes;
(a) providing immediate feedback comprising one or more of a visual intervention that includes visual indications provided on the graphical user interface and an audio intervention that includes an audio indication if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words does not meet a first set of criteria;
(b) placing words on a review list if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words meets the first set of criteria, but does not meet a second set of criteria;
(c) placing words on a review list if immediate feedback was given for the word in the sequence of recognized words, depending on the word'"'"'s category and type of immediate feedback previously given;
(d) providing deferred feedback by concurrently presenting a plurality of words from the review list to the user;
wherein the computer-based method is executed by a processor in a computer system.
5 Assignments
0 Petitions
Accused Products
Abstract
Methods and related computer program products, systems, and devices for providing intelligent feedback to a user based on audio input associated with a user reading a passage are disclosed. The method can include assessing a level of fluency of a user'"'"'s reading of the sequence of words using speech recognition technology to compare the audio input with an expected sequence of words and providing feedback to the user related to the level of fluency for a word.
-
Citations
29 Claims
-
1. A computer-based method comprising:
-
receiving by a computer audio input associated with a user reading a sequence of words displayed on a graphical user interface generated from the computer, with words in the sequence of words associated with at least one pre-assigned word category; assessing by the computer a level of fluency and pronunciation accuracy of the reading by the user of the sequence of words by; applying the audio input to a speech recognition engine, configured to produce an output, as a sequence of recognized words, corresponding to the received input; comparing the sequence of recognized words to an expected sequence of words; and providing by the computer feedback to the user related to the level of fluency and pronunciation accuracy for a word in the sequence of recognized words, wherein providing the feedback includes; (a) providing immediate feedback comprising one or more of a visual intervention that includes visual indications provided on the graphical user interface and an audio intervention that includes an audio indication if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words does not meet a first set of criteria; (b) placing words on a review list if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words meets the first set of criteria, but does not meet a second set of criteria; (c) placing words on a review list if immediate feedback was given for the word in the sequence of recognized words, depending on the word'"'"'s category and type of immediate feedback previously given; (d) providing deferred feedback by concurrently presenting a plurality of words from the review list to the user; wherein the computer-based method is executed by a processor in a computer system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 28)
-
-
16. A computer program product residing on a non-transitory computer readable medium comprising instructions for causing an electrical device to:
-
receive audio input associated with a user reading a sequence of words displayed on a graphical user interface, with at least one of the words in the sequence of words associated with a pre-assigned word category; assess a level of fluency and pronunciation accuracy of the reading by the user of the sequence of words by; applying the audio input to a speech recognition engine, configured to produce an output, as a sequence of recognized words, corresponding to the received input; comparing the sequence of recognized words to an expected sequence of words; and providing feedback to the user related to the level of fluency and pronunciation accuracy for a word in the sequence of recognized words, wherein providing the feedback includes; (a) providing immediate feedback comprising one or more of a visual intervention that includes visual indications provided on the graphical user interface and an audio intervention if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words does not meet a first set of criteria; (b) placing words on a review list if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words meets the first set of criteria, but does not meet a second set of criteria; (c) placing words on a review list if immediate feedback was given for the word in the sequence of recognized words, depending on the word'"'"'s category and type of immediate feedback previously given; and (d) providing deferred feedback by concurrently presenting a plurality of words from the review list to the user. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. An apparatus comprising:
-
a processor; and an input device; wherein; the input device is configured to receive audio input associated with a user reading a sequence of words displayed on a graphical user interface, with at least one word in the sequence of words associated with a pre-assigned word category; the processor is configured to assess a level of fluency and pronunciation accuracy of the reading by the user of the sequence of words by; applying the audio input to a speech recognition engine, configured to produce an output, as a sequence of recognized words, corresponding to the received input; and comparing the sequence of recognized words to an expected sequence of words; and the processor is further configured to provide feedback to the user related to the level of fluency and pronunciation accuracy for a word in the sequence of recognized words, with providing feedback comprising; providing immediate feedback comprising one or more of a visual intervention that includes visual indications provided on the graphical user interface and an audio intervention if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words does not meet a first set of criteria; placing words on a review list if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words meets the first set of criteria, but does not meet a second set of criteria; placing words on a review list if immediate feedback was given for the word in the sequence of recognized words, depending on the word'"'"'s category and type of immediate feedback previously given; and providing deferred feedback by concurrently presenting a plurality of words from the review list to the user. - View Dependent Claims (24, 25, 26, 27)
-
-
29. A computer-based method comprising:
-
receiving by a computer audio input associated with a user reading a sequence of words displayed on a graphical user interface generated from the computer, with words in the sequence of words associated with at least one pre-assigned word category; assessing by the computer a level of fluency and pronunciation accuracy of the reading by the user of the sequence of words by; applying the audio input to a speech recognition engine, configured to produce an output, as a sequence of recognized words, corresponding to the received input; comparing the sequence of recognized words to an expected sequence of words; and providing by the computer feedback to the user related to the level of fluency and pronunciation accuracy for a word in the sequence of recognized words, wherein providing the feedback includes; (a) providing, based on a first attempt by the user to read a word, a visual intervention that includes a visual indication provided on the graphical user interface if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words does not meet a first set of criteria, (b) providing, based on a second attempt by the user to read a word, an audio intervention that includes an audio indication if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words does not meet the first set of criteria; (c) placing a word on a review list if the level of fluency and pronunciation accuracy for a word in the sequence of recognized words meets the first set of criteria, but does not meet a second set of criteria; (d) placing a word on the review list if immediate feedback was given for the word in the sequence of recognized words, depending on the word'"'"'s category and type of immediate feedback previously given; and (e) providing deferred feedback by concurrently presenting a plurality of words from the review list to the user; wherein the computer-based method is executed by a processor in a computer system.
-
Specification