Learning assessment and programmatic remediation

• US 8,639,177 B2
• Filed: 05/08/2008
• Issued: 01/28/2014
• Est. Priority Date: 05/08/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hines, Michael Frederick, Koenig, Michael F., Prakriya, Tara, Bhattacharyay, Subha, Tiwari, Anuraag
• Primary Examiner(s): Utama, Robert J
• Application Number:
  US12/117,196
• Publication Number:
  US 20090280466A1
• Time in Patent Office: 2,091 Days
• Field of Search: 434/322, 434/323, 434/350
• US Class Current: 434/350
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

Learning content may be provided to a user where the learning content may contain learning objectives. A response to the learning content may be received. The response may be analyzed by determining whether the response was the proper response to the learning objectives. If the response was a proper response, less questions on the learning objective may be presented in the future and the if response was an improper response, additional questions on the learning objective may be presented in the future.

Claims

1. A method of computerized programmatic assessment of learning comprising:

providing learning content to a user, wherein the learning content comprises a question and a plurality of answers, and wherein the question and at least one of the plurality of answers are each associated with learning objectives;

receiving an individual answer selected by the user;

determining whether the selected answer was correct; and

in an instance where the selected answer was incorrect;

identifying the learning objective associated with the question and the learning objective associated with a correct answer to the question,

identifying the learning objective associated with the selected answer,

storing an indication that the user did not meet the learning objective associated with the question or the learning objective associated with the correct answer, and storing the learning objective associated with the selected answer, and

allowing the user to express doubt about a concept by;

accepting a doubt input,

communicating the selected answer, the correct answer, the doubt input, and a doubt context to a learning professional, wherein the doubt context comprises past work by the user related to the doubt input and a time that the doubt input was entered, and

presenting to the user the learning objective associated with the correct answer, why the user got the learning objective associated with the correct answer wrong, and what the user can do to improve,

wherein at least the determining is performed by a computing device.

2. The method of claim 1, further comprising:

displaying a work input space for the user to input answer data wherein the answer data is data used to work out the selected answer to the question; and

storing the answer data in a memory.

3. The method of claim 1, further comprising displaying an analysis page to the user wherein the analysis page comprises at least one selected from a group comprising:

met learning objectives;

unmet learning objectives;

a number of questions attempted;

a number of questions correctly answered;

a number of questions incorrectly answered; and

a date and time when questions were answered.

4. The method of claim 1, further comprising designing answers to questions that identify individual learning objectives that are not understood.

5. The method of claim 1, further comprising in an instance where the selected answer does not satisfy individual learning objectives, displaying additional questions that have answers associated with the unsatisfied individual learning objectives.

6. The method of claim 1, further comprising, in an instance where the selected answer does not satisfy an individual learning objective:

displaying another question that has at least one answer associated with the unsatisfied individual learning objective and at least one answer associated with a different individual learning objective.

7. The method of claim 1, further comprising, in an instance where there are unsatisfied learning objectives for the user:

identifying past unsatisfied learning objectives for the user;

determining whether the past unsatisfied learning objectives are present in the learning content; and

in an instance where the past unsatisfied learning objectives are present in the learning content, displaying additional content related to the past unsatisfied learning objectives.

8. The method of claim 1, further comprising, in an instance where there is a plurality of unsatisfied learning objectives, using a failure analysis to identify a root cause of the plurality of unsatisfied learning objectives.

9. The method of claim 8, wherein the failure analysis is based on historical data.

10. The method of claim 8, wherein the failure analysis is created using experience from other learning professionals to determine the root cause of the plurality of unsatisfied learning objectives.

11. The method of claim 1, wherein the doubt context comprises at least one selected from a group comprising:

content being displayed to the user at the time of the doubt input; and

past work by the user related to the content, and further comprising receiving a doubt response from the learning professional.

12. A computer system comprising a processor, a memory and an input/output circuit, the processor being configured to execute computer executable instructions causing actions, comprising:

providing learning content to a user, wherein the learning content comprises a question and a plurality of answers, and wherein the question and at least one of the plurality of answers are each associated with a different learning objective;

receiving an individual answer submitted by the user;

determining whether the submitted answer was correct; and

in an instance where the submitted answer was incorrect;

identifying the learning objective associated with the question and the learning objective associated with a correct answer to the question,

identifying the learning objective associated with the submitted incorrect answer,

storing an indication that the user did not meet the learning objective associated with the question or the correct answer, and storing the learning objective associated with the submitted incorrect answer, and

allowing the user to express doubt about a concept by;

accepting a doubt input, and

communicating the submitted answer, the correct answer, the doubt input, and an associated doubt context to a learning professional, wherein the associated doubt context comprises;

the learning content being displayed to the user at a time that the doubt input was entered, wherein the learning content also includes a work input space, the work input space includes the individual answer and additional data used to work out the individual answer to the question,

past work by the user related to the learning content, and

the time that the doubt input was entered to the work input space.

13. The computer system of claim 12, further comprising computer executable instructions for:

in an instance where there are unsatisfied learning objectives;

using a failure analysis to identify a root cause of the unsatisfied learning objectives based on a history of submitted incorrect answers; and

displaying an additional question and answers related to the unsatisfied learning objective.

14. The computer system of claim 13, further comprising computer executable instructions for creating the failure analysis from at least one selected from a group comprising:

using historical data; and

using data experience from other learning professionals to determine unsatisfied learning objectives causes.

15. A system comprising a processor, the processor being configured to execute computer executable instruction causing action, comprising:

providing a learning content to a user, wherein the learning content comprises one or more concepts;

receiving an answer from the user, the answer corresponding to a question related to the one or more concepts; and

allowing the user to express doubt about at least one of the one or more concepts by;

accepting a doubt input; and

communicating the answer, a correct answer to the question, the doubt input, and an associated doubt context to a learning professional, wherein the associated doubt context comprises;

the learning content being displayed to the user at a time that the doubt input was entered, wherein the learning content also includes a work input space, the work input space includes the answer and additional data used to work out the answer to the question;

past work by the user related to the learning content; and

the time that the doubt input was entered to the work input space.