DIALOG SYSTEM FOR COMPREHENSION EVALUATION

• US 20110123967A1
• Filed: 11/24/2009
• Published: 05/26/2011
• Est. Priority Date: 11/24/2009
• Status: Abandoned Application

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Lofthus, Robert M., PERRONNIN, Florent C., German, Kristine A., Brun, Caroline
• Application Number:
  US12/624,960
• Publication Number:
  US 20110123967A1
• Time in Patent Office: Days
• US Class Current: 434/178
• CPC Class Codes: G09B 17/003 electrically operated apparatus or devices
• CPC Class Codes: G09B 17/006 with audible presentation of the material to be studied audio and audio-visual teaching apparatus in general G09B5/04, G09B5/06
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

An automated system, apparatus and method for evaluation of comprehension are disclosed. The method includes receiving an input text and natural language processing the text to identify dependencies between text elements in the input text. Grammar rules are applied to generate questions and associated answers from the processed text, at least some of the questions being based on the identified dependencies. A set of the generated questions is posed to a reader of the input text and the comprehension of the reader evaluated, based on the reader'"'"'s responses to the questions posed.

Claims

1. A method for evaluation of a reader'"'"'s comprehension, comprising:

receiving an input text;

natural language processing the text to identify dependencies between text elements in the input text;

with a computer processor, applying grammar rules to generate questions and associated answers from the processed text, at least some of the questions each being based on at least one of the identified dependencies;

automatically posing questions from the generated questions to a reader of the input text;

evaluating comprehension of the reader based on received responses of the reader to the questions posed.

2. The method of claim 1, wherein the receiving an input text includes receiving a digital version of a hardcopy document to be read by the reader.

3. The method of claim 1, wherein the natural language processing includes inputting the text to a parser, the parser comprising instructions stored in memory for identifying different types of dependencies, which are executed by an associated computer processor.

4. The method of claim 1, wherein the natural language processing includes identifying coreference links between pronouns and their antecedent text elements and the question generating includes generating a question based on an identified antecedent text element and a text element in the input text, the text element identified as being in a dependency with a pronoun linked by coreference to the antecedent text element.

5. The method of claim 1, wherein the natural language processing includes identifying named entities and wherein the question generating includes generating a question based on an identified named entity and a text element in the input text, the text element identified as being in a dependency with the identified named entity.

6. The method of claim 1, wherein the applying grammar rules to generate questions and associated answers from the processed text comprises at least one of:

applying a grammar rule for generating a who-type question where a person name is identified in the input text as being in a dependency with an identified verb in the input text, wherein the identified verb and the person name are used in generating the who-type question; and

applying a grammar rule for generating a where-type question where a location is identified in the input text as being in a dependency with an identified verb in the input text, wherein the identified verb and the location are used in generating the where-type question.

7. The method of claim 1, wherein the posing of questions includes outputting a generated question as synthesized speech.

8. The method of claim 7, wherein the received responses of the reader comprise spoken responses and wherein the evaluation comprises comparing the spoken answer with a synthesized speech version of the generated associated answer.

9. The method of claim 1, further comprising identifying a reading level of the reader and wherein the posed questions or associated answers include words selected from a set of words designated as being appropriate to the reading level.

10. The method of claim 1, wherein when a comparison of the reader'"'"'s answer with the generated answer indicates the reader'"'"'s answer is incorrect, automatically providing the reader with help, the evaluation of comprehension taking into account the help provided to the reader.

11. The method of claim 1, wherein the dependencies include normalized syntactic dependencies selected from the group consisting of:

subject-verb dependencies;

object-verb dependencies;

modifiers dependencies;

and combinations thereof.

12. The method of claim 1, wherein the applying of the grammar rules to generate questions and associated answers from the processed text comprises generating question in the form of a dependency tree from words in the input text which satisfy one of the grammar rules and applying agreement rules to the dependency tree.

13. The method of claim 1, wherein at least some of the questions are each based on a plurality of the identified dependencies.

14. The method of claim 1, further comprising generating questions which are each based on an image associated with the input text.

15. The method of claim 1, further comprising outputting a report based on the evaluation.

16. The method of claim 1, wherein the text comprises a children'"'"'s book.

17. The method of claim 1, further comprising displaying at least one of the input text and the posed questions on a display.

18. A computer program product encoding instructions, which when executed by a computer, perform the method of claim 1.

19. An apparatus for performing the method of claim 1 comprising:

memory which receives the input text;

memory which stores instructions for;

natural language processing the text to identify dependencies between text elements in the input text,

applying grammar rules to generate questions and associated answers from the processed text, at least some of the questions being based on the identified dependencies,

posing questions from the generated questions to a reader of the input text, and

outputting an evaluation of comprehension of the reader based on received responses of the reader to the questions posed; and

a processor in communication with the memory which executes the instructions.

20. The apparatus of claim 19, wherein the apparatus comprises an e-reader which displays the text and poses the questions.

21. A system for evaluation of a reader'"'"'s comprehension comprising:

memory which stores instructions for;

receiving natural language processed input text,

applying grammar rules to generate questions and associated answers from the processed text, at least some of the questions being based on syntactic dependencies identified in the processed text,

posing questions from the generated questions to a reader of the input text, and

evaluating comprehension of the reader based on received responses of the reader to the questions posed; and

a processor in communication with the memory which executes the instructions.

22. The system of claim 21, further comprising a text to speech converter for converting generated questions into synthesized speech.

23. The system of claim 21, further comprising a display for displaying at least one of the input text and the posed questions.

24. The system of claim 21, wherein the memory stores instructions for outputting a report based on the evaluation.