System for preventing bias in test answer scoring

• US 5,558,521 A
• Filed: 08/12/1994
• Issued: 09/24/1996
• Est. Priority Date: 02/05/1993
• Status: Expired due to Term

• Current Assignee: NCS Pearson Incorporated (Pearson plc)
• Original Assignee: National Computer Systems, Inc. (Pearson plc)
• Inventors: Clark, Jay V., Moyer, Judith, Bramlett, William L. Jr.
• Primary Examiner(s): CHENG, JOE H
• Application Number:
  US08/290,014
• Time in Patent Office: 774 Days
• Field of Search: 434/156, 434/157, 434/169, 434/185, 434/118, 434/307 R, 434/308, 434/322, 434/323, 434/350, 434/362, 434/365, 364/419.2, 382/10, 382/48, 382/5 P, 395/164, 395/166, 395/200, 395/400, 395/425, 395/927, 358/444, 273/273, 273/430, 273/DIG. 28
• US Class Current: 434/322
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
• CPC Class Codes: G09B 7/066 with answer indicating cards, blocks
• CPC Class Codes: Y10S 706/927 Education or instruction

Abstract

A system for managing resolvers of test answers to maintain consistent and efficient scoring of test answers. The system routes test answers to resolvers based on classifications of resolvers and persons who generated the test answers. Monitoring and selecting resolvers based on classifications promotes fair and consistent scoring of test answers.

Claims

1. A system for preventing bias in the scoring of answers to tests taken by persons in particular classifications, the system comprising:

a) receive means for electronically receiving a plurality of answers to test questions, the test answers corresponding to tests taken by a plurality of respondents from particular definable classifications and comprising electronic representations of at least a portion of test answer sheets, wherein the test answers are to be scored by a plurality of test resolvers;

b) classification means for receiving a particular classification of each of the respondents and for electronically associating each of the particular classifications with the test answers for the corresponding respondent; and

c) routing means for electronically selecting a test resolver within the plurality of test resolvers for scoring each of the answers based upon the particular classification of the corresponding respondent and for transmitting the answers to a test resolver terminal for the selected test resolver.

2. The system of claim 1 wherein:

a) the classification means comprises means for receiving racial classifications identifying a race of each of the respondents and the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the test answers to a test resolver terminal for a test resolver having a same racial classification as the racial classification of the corresponding respondent.

3. The system of claim 1 wherein:

a) the classification means comprises means for receiving geographical classifications identifying a location where the tests were taken by the respondents and where the test answers are to be scored by the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the answers to a test resolver terminal for a test resolver having a same geographical classification as the geographical classification of the corresponding respondent.

4. The system of claim 1 wherein:

a) the classification means comprises means for receiving racial classifications identifying a race of each of the respondents and the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the test answers to a test resolver terminal for a test resolver having a different racial classification as the racial classification of the corresponding respondent.

5. The system of claim 1 wherein:

a) the classification means comprises means for receiving racial classifications identifying a race of each of the respondents and the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the test answers to a test resolver terminal for a test resolver having a preferred blend racial classification as the racial classification of the corresponding respondent.

6. The system of claim 1 wherein:

a) the classification means comprises means for receiving geographical classifications identifying a location where the tests were taken by the respondents and where the test answers are to be scored by the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the answers to a test resolver terminal for a test resolver having a different geographical classification as the geographical classification of the corresponding respondent.

7. The system of claim 1 wherein:

a) the classification means comprises means for receiving geographical classifications identifying a location where the tests were taken by the respondents and where the test answers are to be scored by the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the answers to a test resolver terminal for a test resolver having a preferred blend geographical classification as the geographical classification of the corresponding respondent.

8. A system for preventing bias in the scoring of answers to tests taken by persons in particular classifications, the system comprising:

a) receive means for electronically receiving a plurality of answers to test questions, the test answers corresponding to tests taken by a plurality of respondents from particular definable classifications and comprising electronic representations of at least a portion of test answer sheets, wherein the test answers are to be scored by a plurality of test resolvers;

b) classification means for receiving a particular classification of a group of the respondents and for electronically associating each of the particular classifications with the test answers for the corresponding group; and

c) routing means for electronically selecting a test resolver within the plurality of test resolvers for scoring each of the answers based upon the particular classification of the corresponding group and for transmitting the answers to a test resolver terminal for the selected test resolver.

9. The system of claim 8 wherein:

a) the classification means comprises means for receiving racial classifications identifying a race of each of the respondents and the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the test answers to a test resolver terminal for a test resolver having a same racial classification as the racial classification of the corresponding group.

10. The system of claim 8 wherein:

a) the classification means comprises means for receiving racial classifications identifying a race of each of the respondents and the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the test answers to a test resolver terminal for a test resolver having a different racial classification as the racial classification of the corresponding group.

11. The system of claim 8 wherein:

a) the classification means comprises means for receiving racial classifications identifying a race of each of the respondents and the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the test answers to a test resolver terminal for a test resolver having a preferred blend racial classification as the racial classification of the corresponding group.

12. The system of claim 8 wherein:

a) the classification means comprises means for receiving geographical classifications identifying a location where the tests were taken by the respondents and where the test answers are to be scored by the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the answers to a test resolver terminal for a test resolver having a same geographical classification as the geographical classification of the corresponding group.

13. The system of claim 8 wherein:

a) the classification means comprises means for receiving geographical classifications identifying a location where the tests were taken by the respondents and where the test answers are to be scored by the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the answers to a test resolver terminal for a test resolver having a different geographical classification as the geographical classification of the corresponding group.

14. The system of claim 8 wherein:

a) the classification means comprises means for receiving geographical classifications identifying a location where the tests were taken by the respondents and where the test answers are to be scored by the test resolvers; and

b) the routing means comprises means for electronically transmitting each of the answers to a test resolver terminal for a test resolver having a preferred blend geographical classification as the geographical classification of the corresponding group.