Apparatus and method for scoring nonobjective assessment materials through the application and use of captured images
DCFirst Claim
1. A method of electronically displaying to a human scorer an image of handwritten nonobjective assessment materials recorded by a test taker in an assessment area of an assessment form, and recording a score entered by the scorer, comprising the steps of:
- providing an assessment form having thereon at least one assessment area;
recording in an electronic file information identifying the test taker;
recording in an electronic file information identifying the assessment form;
capturing from the assessment form a digitized image of said assessment materials recorded in the at least one assessment area;
storing said digitized image in anelectronic image file;
recording in an electronic file information to locate said stored image of said assessment materials;
selectively displaying electronically said stored image of said assessment materials but not said information identifying the test taker on a computer screen for scoring by the scorer; and
recording in an electronic file a score entered by the scorer for the stored digitized image of the assessment materials.
3 Assignments
Litigations
0 Petitions
Accused Products
Abstract
An apparatus and method are provided for scoring nonobjective assessment materials recorded on paper, such as essays, by displaying digitized images of the assessment materials on computer screens for scoring by human scorers. A digitized image of the assessment material is captured by scanning an assessment form and storing the image in an electronic file. The stored digitized image is displayed to the scorer and a score entered by the scorer is returned to a scoring center where reports are generated. Embodiments of the invention include capturing the image in association with Optical Mark Reading (OMR), capturing identifying information through OMR, training and testing the scorer by displaying images of anchor items and validity items for scoring. A series of computer data files ensure control of the scoring process.
-
Citations
25 Claims
-
1. A method of electronically displaying to a human scorer an image of handwritten nonobjective assessment materials recorded by a test taker in an assessment area of an assessment form, and recording a score entered by the scorer, comprising the steps of:
-
providing an assessment form having thereon at least one assessment area; recording in an electronic file information identifying the test taker; recording in an electronic file information identifying the assessment form; capturing from the assessment form a digitized image of said assessment materials recorded in the at least one assessment area; storing said digitized image in an electronic image file; recording in an electronic file information to locate said stored image of said assessment materials; selectively displaying electronically said stored image of said assessment materials but not said information identifying the test taker on a computer screen for scoring by the scorer; and recording in an electronic file a score entered by the scorer for the stored digitized image of the assessment materials. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method of displaying images of handwritten nonobjective assessment materials to a human scorer and recording the scores recorded by the scorer, comprising the steps of:
-
capturing digitized images for a plurality of assessment materials; storing the digitized images in a computer file; displaying a first subset of the digitized images on a computer screen for scoring by the scorer to train the scorer; displaying a second subset of the digitized images on a computer screen for scoring by the scorer to test the scorer'"'"'s selection of scores; and displaying additional digitized images on a computer screen for scoring by the scorer to provide scores for the assessment materials represented by the additional images; and recording in an electronic file scores entered by the scorer for the digitized images. - View Dependent Claims (17, 18, 19)
-
-
20. An apparatus for displaying to a human scorer an image of handwritten assessment materials recorded by a test taker in an assessment area of an assessment form and for recording a score selected by the scorer, comprising:
input means for capturing from the assessment form a digitized image of the assessment materials to be scored, said means for capturing a digitized image comprising; means for storing the digitized image in an electronic file; means for selectively displaying the digitized image on a computer screen for the scoring by the scorer; means for electronically recording a score entered by the scorer for the digitized image; means for identifying the form by OMR; means responsive to said means for identifying the form for determining the location of the assessment area; means for determining by OMR the presence of marks within the assessment area of assessment materials recorded by the test taker and the portion of the assessment area in which marks are present; and means for storing in digital electronic form as part of an image file an image of at least the portion of the assessment area in which assessment materials are present.
-
21. A method of displaying to a human scorer an image of handwritten nonobjective assessment materials recorded by a test taker in an assessment area of an assessment form, and recording a score entered by the scorer, comprising the steps of:
-
providing an assessment form having thereon at least one assessment area; capturing a digitized image of said assessment materials recorded in at least one assessment area in digital form from the assessment form; storing said digitized image in a computer file; displaying said digitized image of the assessment materials on a computer screen for scoring by the scorer; and recording a score entered by the scorer for the digitized image of the assessment materials; said step of capturing a digitized image comprising the further steps of; identifying the form by OMR; determining the location of at least one assessment area on the form based on said step of identifying the form by OMR; determining by OMR whether marks are present within said at least one assessment area; determining by OMR the portion of said assessment area in which marks are present; and storing in digital form the image of the portion of the assessment area in which it was determined that marks are present.
-
-
22. A method of displaying no a human scorer images of handwritten nonobjective assessment materials recorded in an assessment area of an assessment form and recording scores recorded by the scorer, comprising the steps of:
-
capturing digitized images for a plurality of assessment materials; storing the digitized images in a computer file; displaying a first subset of the digitized images on a computer screen for scoring by the scorer to train the scorer; displaying a second subset of the digitized images on the a computer screen for scoring by the scorer to test the scorer'"'"'s selection of scores; and
displaying additional digitized images on the computer screen for scoring by the scorer to provide scores for the assessment materials represented by the additional images;said step of capturing digitized images comprising the further steps of; determining by OMR the location of the assessment area on the assessment form, the presence within the assessment area of assessment materials and the location within the assessment area of said assessment materials; and storing in electronic form an image of at least said location within the assessment area in which said assessment materials are present.
-
-
23. An apparatus for electronically displaying to a human scorer an image of handwritten assessment materials recorded by a test taker in an assessment area of an assessment form and for recording a score selected by scorer, comprising:
-
an electronic file for storing identifying information to identify the test taker; input means for capturing from the assessment form a digitized image of the assessment materials to be scored, said means for capturing a digitized image comprising; an electronic image file for storing the digitized image; means operatively connected to said image files for selectively displaying the digitized image but not the identifying information on a computer screen for scoring by the scorer; means for electronically recording a score entered by the scorer for the digitized image; said input means having means for identifying by electronic optical scanning the assessment form; means for determining by electronic optical scanning the location of the assessment area on the assessment form, the presence within the assessment area of assessment materials recorded by the test taker, and the location within the assessment area of said assessment materials; and means for storing in electronic form as part of said image file an image of at least said location within the assessment area in which said assessment materials recorded by the test taker are present. - View Dependent Claims (24, 25)
-
Specification