System and method of distribution of digitized materials and control of scoring for open-ended assessments
First Claim
1. An assessment response processing system configured to distribute digitized electronic representations of responses to non-objective assessment tasks to a reader, the system comprising:
- a digitizing system configured to create a digitized electronic representation of a batch of representative responses to a non-objective assessment task;
a memory system configured to store in an electronic file the digitized electronic representations;
a memory system configured to store in an electronic file an established score for each of the representative responses in accordance with a scoring criteria;
a display system configured to display digitized information to a reader;
a distribution system configured to distribute the digitized representations of responses and the established scores to the display system;
a recording system configured to record a score assigned by a reader;
wherein the processing system is configured to display a digitized representation of a response to the reader on the display system, and record a score assigned by the reader to a response in the batch.
0 Assignments
0 Petitions
Accused Products
Abstract
Methods are disclosed for distributing digitized electronic representations of representative responses to non-objective assessment tasks and established scores for the responses to readers in order to train the readers to determine scores for responses in accordance with a scoring criteria, to qualify the readers to determine scores for responses in accordance with the scoring criteria, and to monitor how well a reader is determining scores for such responses in accordance with the scoring criteria. In disclosed embodiments, the methods provide such distribution for multiple scorers on a network located at a single site, for multiple scorers on a network remote from a central site; and scoring by individual scorers remote from the central site. Distribution may be accomplished by transferring data from electronic files using diverse techniques such as magnetic storage discs, CD-ROM, cable or high-speed public communications network, in accordance with the needs of the particular job and setting.
117 Citations
35 Claims
-
1. An assessment response processing system configured to distribute digitized electronic representations of responses to non-objective assessment tasks to a reader, the system comprising:
-
a digitizing system configured to create a digitized electronic representation of a batch of representative responses to a non-objective assessment task;
a memory system configured to store in an electronic file the digitized electronic representations;
a memory system configured to store in an electronic file an established score for each of the representative responses in accordance with a scoring criteria;
a display system configured to display digitized information to a reader;
a distribution system configured to distribute the digitized representations of responses and the established scores to the display system;
a recording system configured to record a score assigned by a reader;
wherein the processing system is configured to display a digitized representation of a response to the reader on the display system, and record a score assigned by the reader to a response in the batch. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system for distributing digitized electronic representations of responses to non-objective assessment tasks to a reader, the system comprising:
-
a digitizing means for creating a digitized electronic representation of a batch of representative responses to a non-objective assessment task;
a memory means for storing in an electronic file the digitized electronic representations;
a memory means for storing in an electronic file an established score for each of the representative responses in accordance with a scoring criteria;
a display means for displaying digitized information to a reader;
a distribution means for distributing the digitized representations of responses and the established scores to the display means;
a recording means for recording a score assigned by a reader;
wherein the system is configured to display a digitized representation of a response to the reader on the display means, and record a score assigned by the reader to a response in the batch. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30)
-
-
31. A method of electronically displaying to a human scorer a nonobjective assessment material authored by a test taker in response to an assessment form and recording a score entered by the scorer, comprising the steps of:
-
electronically receiving from a test taker an assessment material comprising character strings of text authored by the test taker;
recording the assessment material in an electronic assessment file;
recording in an electronic file information identifying the test taker;
recording in an electronic file information identifying the assessment form;
selectively displaying the assessment material but not said information identifying the test taker on a computer screen for scoring by the scorer; and
recording in an electronic file a score entered by the scorer for the stored digitized image of the assessment materials. - View Dependent Claims (32)
-
-
33. A system for electronically displaying to a human scorer a nonobjective assessment material authored by a test taker in response to an assessment form and recording a score entered by the scorer, the system comprising:
-
a receiving system configured to receive from a test taker an assessment material comprising character strings of text authored by the test taker;
a recording system configured to record the assessment material in an electronic assessment file;
a recording system configured to record in an electronic file information identifying the test taker;
a recording system configured to record in an electronic file information identifying the assessment form;
a display system configured to selectively display the assessment material but not said information identifying the test taker on a computer screen for scoring by the scorer; and
a recording system configured to record in an electronic file a score entered by the scorer for the stored digitized image of the assessment materials. - View Dependent Claims (34)
-
-
35. A system for electronically displaying to a human scorer a nonobjective assessment material authored by a test taker in response to an assessment form and recording a score entered by the scorer, the system comprising:
-
receiving means for receiving from a test taker an assessment material comprising character strings of text authored by the test taker;
a recording system for recording the assessment material in an electronic assessment file;
recording means for recording in an electronic file information identifying the test taker;
recording means for recording in an electronic file information identifying the assessment form;
display means for selectively displaying the assessment material but not said information identifying the test taker on a computer screen for scoring by the scorer; and
recording means for recording in an electronic file a score entered by the scorer for the stored digitized image of the assessment materials.
-
Specification