Constructed Response Scoring Mechanism
First Claim
Patent Images
1. A system for scoring user responses to a test question, comprising:
- a scoring engine for receiving a user response to a test question and evaluating the response against a scoring rubric, wherein the scoring rubric includes a binding stage, an assertion stage, and a scoring stage; and
a database for referencing elements used by the scoring engine which include at least one of objects, object sets, attributes of objects, and transformations of any elements.
8 Assignments
0 Petitions
Accused Products
Abstract
A system, method, and related techniques are disclosed for scoring user responses to constructed response test items. The system includes a scoring engine for receiving a user response to a test question and evaluating the response against a scoring rubric. The scoring rubric may include a binding stage, an assertion stage, and a scoring stage. Furthermore, the system includes a database for referencing elements used by the scoring engine which may comprise objects, object sets, attributes of objects, and transformations of any elements.
-
Citations
19 Claims
-
1. A system for scoring user responses to a test question, comprising:
-
a scoring engine for receiving a user response to a test question and evaluating the response against a scoring rubric, wherein the scoring rubric includes a binding stage, an assertion stage, and a scoring stage; and a database for referencing elements used by the scoring engine which include at least one of objects, object sets, attributes of objects, and transformations of any elements. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for scoring user responses to a test question, comprising:
-
receiving a user response wherein the response is a collection of objects with one or more attributes; binding one or more variables identified in a binding tree based on the collection of objects; evaluating at least one named assertion associated with an element; and storing the named assertion. - View Dependent Claims (12, 13)
-
-
14. A method of refining a scoring rubric, comprising:
-
receiving a plurality of user responses to a test item; identifying a set of responses from the plurality of user responses; providing a score for each of the identified responses; generating one or more rules for differentiating a correct score from an incorrect score; modifying a scoring rubric based on the one or more rules; and applying the modified scoring rubric to multiple user responses. - View Dependent Claims (15)
-
-
16. The method of claim 16, further comprising
identifying one or more scores of user responses that change using the modified scoring rubric; - and
reviewing a sample of the user responses and changed scores. - View Dependent Claims (17, 18, 19)
- and
Specification