Collaborative and quality control scoring method
DCFirst Claim
Patent Images
1. A method for verifying test answers between two or more test resolvers, the method comprising the steps of:
- a) electronically receiving an answer to a test question, the answer comprising an electronic representation of at least a portion of a test answer sheet;
b) electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers;
c) electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals; and
d) electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
1 Assignment
Litigations
0 Petitions
Accused Products
Abstract
A method for managing resolvers of test answers to maintain consistent and efficient scoring of test answers. Collaborative scoring allows two test resolvers to score the same test answer and resolves potential discrepancies in the scores provided by the resolvers. Quality items monitor a test resolver'"'"'s scoring performance against a known standard. A quality-control test item, having a known score, is transmitted to a test resolver. After receiving a score from the resolver, the known score is compared with the resolver'"'"'s score and a quality profile is generated for the resolver.
-
Citations
12 Claims
-
1. A method for verifying test answers between two or more test resolvers, the method comprising the steps of:
-
a) electronically receiving an answer to a test question, the answer comprising an electronic representation of at least a portion of a test answer sheet; b) electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers; c) electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals; and d) electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for evaluating the performance of test resolvers by routing quality-control questions for scoring to test resolvers, the quality-control questions comprising a test answer with a score known to quality-control personnel, the method comprising the steps of:
-
a) electronically transmitting to a test resolver terminal a quality-control question to be scored by a test resolver, the quality-control question comprising a test answer with a score known to quality-control personnel; b) electronically receiving from the test resolver terminal a resolver score, as determined by the test resolver, for the quality-control question; and c) electronically comparing the score known to the quality-control personnel and the resolver score and reporting a discrepancy between the known score and the resolver score.
-
Specification