System and method for generating questions and multiple choice answers to adaptively aid in word comprehension

• US 9,384,678 B2
• Filed: 03/30/2011
• Issued: 07/05/2016
• Est. Priority Date: 04/14/2010
• Status: Active Grant

• Current Assignee: Thinkmap Incorporated
• Original Assignee: Thinkmap Incorporated
• Inventors: Tinkler, Marc, Freedman, Michael
• Primary Examiner(s): Godbold, Douglas
• Assistant Examiner(s): Villena, Mark
• Application Number:
  US13/075,973
• Publication Number:
  US 20110257961A1
• Time in Patent Office: 1,924 Days
• Field of Search: 434/178, 434/236, 434/322, 434/323, 434/335, 434/350, 704/3, 704/10, 715/255, 715/731
• US Class Current: 1/1
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 7/06 of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers

Abstract

An adaptive learning system and method provides for automatically generating question types to a user for word comprehension and selecting multiple choice answers for display. Questions are developed for the user by obtaining online content and indexing the content into individual sentences and questions. The system provides questions in a series of rounds to the user and then adaptively tracks the progress of the user based on the categorization of each question.

Claims

1. A computer-implemented method for generating vocabulary questions, the method comprising:

obtaining, by a computer processor, a sentence from a database;

determining, by the computer processor, whether a word of the obtained sentence, the word having multiple definitions, is used in the sentence consistently with one of the multiple definitions which has been selected as a target definition;

responsive to a result of the determining being that the use of the word in the sentence is consistent with the one of the multiple definitions, providing, by the computer processor, the sentence for use to generate a question concerning the word of the sentence; and

outputting, by the computer processor, the question.

2. The method of claim 1, further comprising outputting a set of selectable multiple choice answers selectable for responding to the output question.

3. The method of claim 2, wherein the set of multiple choice answers is a set of text strings, each including one or more words, which are alternatively selectable by the user for answering the generated question.

4. The method of claim 3, wherein only one of the set of multiple choice answers corresponds to the correct answer.

5. The method of claim 1, further comprising:

retrieving text, by the computer processor, from an online content source; and

analyzing at least one punctuation mark in the retrieved text to determine at least one boundary of the sentence in the retrieved text, the obtaining of the sentence being in accordance with the determined boundary.

6. The method of claim 5, wherein the retrieved text is timestamped, and the method further comprises discarding text retrieved multiple times from a same source within a predetermined period of time of the timestamp.

7. The method of claim 5, further comprising:

parsing the sentence, by the computer processor, to apply at least one marker for the definition of the word with which the use of the word in the sentence is consistent; and

storing the sentence in the database, wherein the sentence is retrievable by the at least one definition marker.

8. The method of claim 1, further comprising:

assigning a priority to the sentence, by the computer processor, based on at least one of frequency of use of words of the sentence and likelihood of appearance of the words of the sentence on a standardized test.

9. The method of claim 8, wherein a plurality of sentences, including the sentence to which the priority was assigned, are reviewed in an order that is based on the assigned priority, during which review the plurality of sentences are assigned to respective ones of a plurality of quality categories.

10. The method of claim 9, wherein the plurality of sentences are ranked by a difficulty or discrimination level.

11. The method of claim 1, wherein the using includes modifying the sentence by removing the word to formulate the question.

12. The method of claim 11, further comprising outputting a set of selectable multiple choice answers selectable for responding to the output question, wherein similar words or synonyms are excluded from the set of multiple choice answers.

13. The method of claim 1, wherein additional questions are generated and output to the user, the question and the additional questions forming a round of questions.

14. The method of claim 13, wherein the question and additional questions are tailored to the user by asking the question and additional questions in a series of rounds, and the method further comprises tracking progress of the user based on a categorization of each question.

15. The method of claim 1, further comprising:

automatically recognizing, and removing from a corpus of text that includes the sentence, boilerplate language.

16. The method of claim 1, wherein an electronic dictionary provides the definitions of the word, and wherein a sense is created that indicates a meaning of the word in a context of the sentence.

17. The method claim 1, further comprising:

querying a corpus of words to determine a synonym or antonym of the word.

18. The method of claim 17, further comprising outputting a set of selectable multiple choice answers selectable for responding to the output question, wherein one of the set of multiple choice answers corresponds to the synonym of the word and additional synonyms are excluded from the set of multiple choice answers.

19. The method of claim 17, further comprising outputting a set of selectable multiple choice answers selectable for responding to the output question, wherein one of the set of multiple choice answers corresponds to the definition of the word, and similar definitions and definitions of a synonym of the word are excluded from the set of multiple choice answers.

20. The method of claim 17, further comprising outputting a set of selectable multiple choice answers selectable for responding to the output question, wherein one of the set of multiple choice answers corresponds to the antonym of the word, and other antonyms of the word are excluded from the set of multiple choice answers.

29. The system of claim 7, wherein the computer processor parses the sentence to apply at least one marker for the definition of the word with which the use of the word in the is consistent.

30. The system of claim 29, wherein the sentence is retrievable based on the at least one definition marker.

21. A computer-implemented method for generating vocabulary questions in an adaptive learning system, the method comprising:

outputting, by a computer processor, questions in a series of rounds to a user, wherein each of the rounds contains a determined number of question slots;

allocating a set of the question slots for questions previously missed by the user;

distributing remaining question slots to additional questions concerning words about which the user previously correctly answered questions;

subsequently determining whether any additional question slots are available; and

if the determination is that there is one or more additional question slots available, allotting the available question slots to new questions containing words about which the user has not been tested.

22. The method of claim 21, wherein up to two questions slots are allocated for previously missed questions.

23. The method of claim 21, wherein new questions are only allotted in the question slots if the additional questions do not fill the remaining question slots.

24. The method of claim 21, wherein the remaining question slots are distributed according to a percentage distribution to follow-up questions testing different definitions of the words about which the user has previously correctly answered questions and mastery questions about words the user has previously mastered.

25. The method of claim 24, wherein 90% of the remaining question slots are distributed to the follow-up questions and 10% of the remainder is made up of the mastery questions.

26. The method of claim 21, wherein the questions are based on contained words in sentences stored in a database.

27. An adaptive learning system for generating questions and multiple choice answers to assist in teaching word comprehension, the system comprising:

a computer processor configured to;

obtain a sentence;

determine whether a word of the obtained sentence, the word having multiple definitions, is used in the sentence consistently with one of the multiple definitions which has been selected as a target definition;

responsive to a result of the determination being that the use of the word in the sentence is consistent with the one of the multiple definitions, provide the sentence for use to generate a question concerning the word of the sentence; and

output the question and a set of selectable multiple choice answers.

28. The system of claim 27, wherein the computer processor retrieves text from an online content source, and analyzes at least one punctuation mark in the retrieved text to determine at last one boundary of the sentence in the retrieved text, the obtaining being in accordance with the determined at least one boundary.

31. The system of claim 27, wherein the computer processor assigns a priority to the sentence based on at least one of frequency of use of words of the sentence and likelihood of appearance of the words of the sentence on a standardized test.

32. The system of claim 31, wherein a plurality of sentences, including the sentence to which the priority was assigned, are reviewed in an order that is based on the assigned priority, during which the plurality of sentences are assigned to respective ones of a plurality of quality categories.

33. A hardware computer-readable medium having stored thereon instructions executable by a processor, the instructions which, when executed by the processor, cause the processor to perform a method for generating vocabulary questions, the method comprising:

obtaining a sentence from a database;

determining whether a word of the obtained sentence, the word having multiple definitions, is used in the sentence consistently with one of the multiple definitions which has been selected as a target definition;

responsive to a result of the determining being that the use of the word in the sentence is consistent with the one of the multiple definitions, providing the sentence for use to generate a question concerning the word of the sentence; and

outputting the question.

34. A computer-implemented method for generating vocabulary questions, the method comprising:

obtaining, by a computer processor, a sentence from a database, the sentence having been assigned to one of a plurality of quality categories;

using the sentence, by the computer processor, to generate a question concerning a word of the sentence, the question being one of a plurality of question types selected based on the quality category to which the sentence has been assigned; and

outputting, by the computer processor, the question;

wherein the quality category;

corresponds to at least one ratio, each of the at least one ratio being of text, in the sentence, which is of a respective predetermined characteristic, relative to text, in the sentence, which is not of the respective predetermined characteristic, the predetermined characteristic being that the text at least one of includes a non-alphanumeric character and is an acronym; and

is assigned such that the larger the at least one ratio of the text of the predetermined characteristic relative to the text that is not of the predetermined characteristic, the lower the quality category.

35. A computer-implemented method for generating vocabulary questions, the method comprising:

obtaining, by a computer processor, a sentence from a database, the sentence having been assigned to one of a plurality of quality categories;

using the sentence, by the computer processor, to generate a question concerning a word of the sentence, the question being one of a plurality of question types selected based on the quality category to which the sentence has been assigned; and

outputting, by the computer processor, the question;

wherein the quality category corresponds to both;

(a) a determined degree to which the sentence has correctly applied the word; and

(b) at least one of (i) at least one ratio, each of the at least one ratio being of text, in the sentence, which is of a respective predetermined characteristic, relative to text, in the sentence, which is not of the respective predetermined characteristic, the predetermined characteristic being that the text at least one of includes a non-alphanumeric character and is an acronym; and

(ii) a sentence length.

36. A computer-implemented method for generating vocabulary questions, the method comprising:

obtaining, by a computer processor, a sentence from a database, the sentence having been assigned to one of a plurality of quality categories;

using the sentence, by the computer processor, to generate a question concerning a word of the sentence, the question being one of a plurality of question types selected based on the quality category to which the sentence has been assigned; and

outputting, by the computer processor, the question;

wherein the quality category corresponds to the at least one ratio, each of the at least one ratio being of text, in the sentence, which is of a respective predetermined characteristic, relative to text, in the sentence, which is not of the respective predetermined characteristic, the predetermined characteristic being that the text is an acronym.