System and method for assessing reading skills

• US 10,699,592 B2
• Filed: 09/30/2016
• Issued: 06/30/2020
• Est. Priority Date: 09/30/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kochura, Nadiya, Lu, Fang
• Primary Examiner(s): Egloff, Peter R
• Application Number:
  US15/282,466
• Publication Number:
  US 20180096626A1
• Time in Patent Office: 1,369 Days
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/168 Evaluating attention deficit, hyperactivity
• CPC Class Codes: A61B 5/4088 Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
• CPC Class Codes: A61B 5/4266 sweat secretion
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: G09B 17/003 electrically operated apparatus or devices
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G09B 5/12 different stations being capable of presenting different information simultaneously G09B5/14 takes precedence
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

Embodiments can provide a computer implemented method in a data processing system comprising a processor and a memory comprising instructions which are executed by the processor to cause the processor to implement a reading skill assessment system, the method comprising: processing a body of text; applying one or more text mutators to the body of text to produce a mutated text output; presenting the mutated text output to a reader; prompting the reader to provide one or more answers to one or more questions regarding the mutated text output; processing the one or more answers provided by the reader; processing one or more metrics collected from the reader; calculating a reader skill score for the reader; mapping the calculated reader skill score against one or more baseline reading skill score levels; and suggesting a reading skill level to the reader.

Claims

1. A computer implemented method, in a data processing system comprising a processor and a memory comprising instructions which are executed by the processor to cause the processor to implement a reading skill assessment system on a cognitive system, the method comprising:

processing a body of text in a learning mode;

applying one or more text mutators to the body of text to produce a mutated text output based on a plurality of randomization rules, wherein the plurality of randomization rules further comprises;

keeping a first letter and a last letter of a particular word while jumbling all letters between the first letter and the last letter of the particular word;

transposing one or more letters of text;

splitting words; and

jumbling a spelling of a split word;

presenting the mutated text output to a reader;

prompting the reader to provide one or more answers to one or more questions through the cognitive system regarding the mutated text output;

processing the one or more answers provided by the reader;

processing one or more metrics collected from the reader, wherein the one or more metrics include biometrics and one or more of mean reading duration per word, reading speed, total reading time, correctness of responses regarding text understanding, time needed to provide responses, word reading level with applied text mutators, and sentence reading level with applied text mutators;

wherein the biometrics includes one or more of heart rate, hormonal status, stress levels, transpiration, and galvanic skin response;

calculating a reader skill score for the reader based on the collected metrics, wherein one or more machine learning classification algorithms are applied to learn at least one parameter of a scoring function of the reader skill score;

mapping the calculated reader skill score against one or more baseline reading skill score levels; and

suggesting a reading skill level to the reader.

2. The method as recited in claim 1, further comprising:

processing one or more metrics collected from the reader, wherein the metrics collected comprise at least one of;

mean reading duration per word, reading speed, total reading time, correctness of responses regarding text understanding, time needed to provide responses, biometrics, word reading level with applied text mutators, and sentence reading level with applied mutators.

3. The method as recited in claim 1, further comprising:

determining whether the reader had difficulty reading the mutated text output based upon the one or more answers received and one or more metrics collected;

if the reader had difficulty reading the mutated text output;

applying an alternate set of text mutators to produce an alternate mutated text output;

presenting the alternate mutated text output to a reader;

prompting the reader to provide one or more answers to one or more questions regarding the alternate mutated text output;

processing the one or more answers provided by the reader;

processing one or more metrics collected from the reader;

calculating a reader skill score for the reader; and

mapping the calculated reader skill score against one or more baseline reading skill score levels.

4. The method as recited in claim 1, further comprising:

transforming one or more subsequent text documents into a format suitable for the reader'"'"'s suggested reading skill level by applying one or more of the text mutators to the subsequent text documents.

5. The method as recited in claim 1, further comprising:

deriving the one or more baseline reading skill score levels by;

creating the one or more sets of parameterized text mutators for one or more different reading skill levels;

applying a reading skill score function to calculate baseline scores for one or more tested reading skill levels;

adjusting the reading skill score function to best match with the one or more tested reading skill levels;

optimizing the parameters of the one or more sets of text mutators;

creating the one or more baseline reading skill score levels for each of the one or more tested reading skill levels; and

associating one or more sets of text mutators with the one or more tested reading skill levels.

6. A computer program product for reading skill assessment implemented on a cognitive system, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

process a body of text in a learning mode;

apply one or more text mutators to the body of text to produce a mutated text output based on a plurality of randomization rules, wherein the plurality of randomization rules further comprises;

keeping a first letter and a last letter of a particular word while jumbling all letters between the first letter and the last letter of the particular word;

transposing one or more letters of text;

splitting words; and

jumbling a spelling of a split word;

present the mutated text output to a reader;

prompt the reader to provide one or more answers to one or more questions through the cognitive system regarding the mutated text output;

process the one or more answers provided by the reader;

process one or more metrics collected from the reader, wherein the one or more metrics include biometrics and one or more of mean reading duration per word, reading speed, total reading time, correctness of responses regarding text understanding, time needed to provide responses, word reading level with applied text mutators, and sentence reading level with applied text mutators;

wherein the biometrics includes one or more of heart rate, hormonal status, stress levels, transpiration, and galvanic skin response;

calculate a reader skill score for the reader based on the collected metrics, wherein one or more machine learning classification algorithms are applied to learn at least one parameter of a scoring function of the reader skill score;

map the calculated reader skill score against one or more baseline reading skill score levels; and

suggest a reading skill level to the reader.

7. The computer program product as recited in claim 6, wherein the processor is further caused to:

process one or more metrics collected from the reader, wherein the metrics collected comprise at least one of;

mean reading duration per word, reading speed, total reading time, correctness of responses regarding text understanding, time needed to provide responses, biometrics, word reading level with applied text mutators, and sentence reading level with applied mutators.

8. The computer program product as recited in claim 6, wherein the processor is further caused to:

determine whether the reader had difficulty reading the mutated text output based upon the one or more answers received and one or more metrics collected;

if the reader had difficulty reading the mutated text output;

apply an alternate set of text mutators to produce an alternate mutated text output;

present the alternate mutated text output to a reader;

prompt the reader to provide one or more answers to one or more questions regarding the alternate mutated text output;

process the one or more answers provided by the reader;

process one or more metrics collected from the reader;

calculate a reader skill score for the reader; and

map the calculated reader skill score against one or more baseline reading skill score levels.

9. The computer program product as recited in claim 6, wherein the processor is further caused to:

transform one or more subsequent text documents into a format suitable for the reader'"'"'s suggested reading skill level by applying one or more of the text mutators to the subsequent text documents.

10. The computer program product as recited in claim 6, wherein the processor is further caused to:

derive the one or more baseline reading skill score levels by;

creating the one or more sets of parameterized text mutators for one or more different reading skill levels;

applying a reading skill score function to calculate baseline scores for one or more tested reading skill levels;

adjusting the reading skill score function to best match with the one or more tested reading skill levels;

optimizing the parameters of the one or more sets of text mutators;

creating the one or more baseline reading skill score levels for each of the one or more tested reading skill levels; and

associating one or more sets of text mutators with the one or more tested reading skill levels.

11. A reading skill assessment system implemented on a cognitive system, comprising:

a reading skill assessment processor configured to;

process a body of text in a learning mode;

apply one or more text mutators to the body of text to produce a mutated text output based on a plurality of randomization rules, wherein the plurality of randomization rules further comprises;

keeping a first letter and a last letter of a particular word while jumbling all letters between the first letter and the last letter of the particular word;

transposing one or more letters of text;

splitting words; and

jumbling a spelling of a split word;

present the mutated text output to a reader;

prompt the reader to provide one or more answers to one or more questions through the cognitive system regarding the mutated text output;

process the one or more answers provided by the reader;

process one or more metrics collected from the reader, wherein the one or more metrics include biometrics and one or more of mean reading duration per word, reading speed, total reading time, correctness of responses regarding text understanding, time needed to provide responses, word reading level with applied text mutators, and sentence reading level with applied text mutators;

wherein the biometrics includes one or more of heart rate, hormonal status, stress levels, transpiration, and galvanic skin response;

calculate a reader skill score for the reader based on the collected metrics, wherein one or more machine learning classification algorithms are applied to learn at least one parameter of a scoring function of the reader skill score;

map the calculated reader skill score against one or more baseline reading skill score levels; and

suggest a reading skill level to the reader.

12. The system as recited in claim 11, wherein the reading skill assessment processor is further configured to:

process one or more metrics collected from the reader, wherein the metrics collected comprise at least one of;

mean reading duration per word, reading speed, total reading time, correctness of responses regarding text understanding, time needed to provide responses, biometrics, word reading level with applied text mutators, and sentence reading level with applied mutators.

13. The system as recited in claim 11, wherein the reading skill assessment processor is further configured to:

determine whether the reader had difficulty reading the mutated text output based upon the one or more answers received and one or more metrics collected;

if the reader had difficulty reading the mutated text output;

apply an alternate set of text mutators to produce an alternate mutated text output;

present the alternate mutated text output to a reader;

prompt the reader to provide one or more answers to one or more questions regarding the alternate mutated text output;

process the one or more answers provided by the reader;

process one or more metrics collected from the reader;

calculate a reader skill score for the reader; and

map the calculated reader skill score against one or more baseline reading skill score levels.

14. The system as recited in claim 11, wherein the reading skill assessment processor is further configured to:

transform one or more subsequent text documents into a format suitable for the reader'"'"'s suggested reading skill level by applying one or more of the text mutators to the subsequent text documents.

15. The system as recited in claim 11, wherein the reading skill assessment processor is further configured to:

derive the one or more baseline reading skill score levels by;

creating the one or more sets of parameterized text mutators for one or more different reading skill levels;

applying a reading skill score function to calculate baseline scores for one or more tested reading skill levels;

adjusting the reading skill score function to best match with the one or more tested reading skill levels;

optimizing the parameters of the one or more sets of text mutators;

creating the one or more baseline reading skill score levels for each of the one or more tested reading skill levels; and

associating one or more sets of text mutators with the one or more tested reading skill levels.