Item banking system for standards-based assessment

• US 8,630,577 B2
• Filed: 08/07/2008
• Issued: 01/14/2014
• Est. Priority Date: 08/07/2007
• Status: Expired due to Fees

• Current Assignee: Assessment Technology, Inc. (Imagine Learning LLC (Arizona))
• Original Assignee: Assessment Technology, Inc. (Imagine Learning LLC (Arizona))
• Inventors: Benson, Brian, Bergan, John Robert, Cunningham, Scott, Nochumsun, Karyn
• Primary Examiner(s): GEBREMICHAEL, BRUK A
• Application Number:
  US12/222,384
• Publication Number:
  US 20090164406A1
• Time in Patent Office: 1,986 Days
• Field of Search: 434/322, 434/323, 434/350, 434/362
• US Class Current: 434/350
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

An computer item banking system for standards-based assessments has test items used in standards-based assessments wherein a plurality of item specifications are developed using a specification building feature to create new, edit, move, and delete specifications and to assign specifications to one or more standards; a plurality of test items are constructed and edited using a test building feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned; bank types include agency-wide assessments including benchmark tests and end-of-course examinations, and formative assessments such as classroom quizzes. The system includes means for certification of test items and preventing use of uncertified test items to be used in agency-wide assessments under construction.

Claims

1. A computer-implemented item banking system for test items used in standards-based assessments comprising:

a plurality of item specifications developed using a specification building feature to create new, edit, move, and delete specifications and to assign each item specification to exactly one corresponding performance objective of each of multiple different standards;

a plurality of test items each constructed and edited using a test building feature so as to comply with a selected one of the item specifications, the test building feature further enabling a user to specify a type of test item being constructed, points available for the test item, and a selected type of item bank to which the test item is assigned,

wherein the item bank type is selectable from available item bank types including an agency-wide benchmark assessments item bank type, and a formative assessments item bank type;

a test item review and certification feature for certifications of test items, wherein said test item review and certification feature is configured to generate;

a graphical screen display that displays all of the test items linked to a selected one of the plurality of item specifications, so as to assist a user of the system in constructing tests aligned to educational standards,

a display of available item classifications for a selected test item to enable a reviewer to classify the selected test item in terms of a selected one of a predetermined set of review categories, wherein said set of review categories includes Not Reviewed, Needs Modification, Accept, and Accept and Certify review categories, and

system protection for preventing use of not yet certified test items to be used in agency-wide assessments under construction.

2. The computer-implemented item banking system according to claim 1 wherein a test item and an item specification are each mapped to only one item class, and an item class is mapped to only one standard within a single set of standards.

3. The computer-implemented item banking system as claimed in claim 2 wherein sets of test items, via mapping to item specifications, are mapped to more than one standard only when each of the standards is in a different set of standards.

4. The computer-implemented test items banking system according to claim 1 wherein the system is configured to generate a display of the selected item specification in a popup window within a review screen of the test item review feature.

5. The computer-implemented test items banking system according to claim 1 wherein the system is configured to generate a screen display of test items selected by one of the predetermined set of review categories.

6. The computer-implemented test items banking system according to claim 1 wherein the system is configured to generate a screen display of a comment box for a reviewer to enter an explanation of a basis for the selected classification.

7. The computer-implemented test items banking system according to claim 6 wherein the system is configured to display the corresponding item specification during on-screen review of an assessment item by a reviewer to improve compliance with the item specification.

8. The computer-implemented test items banking system according to claim 1 wherein the system is configured to display the corresponding item specification while a user is using the test building feature to create a new test item, to help ensure compliance with the item specification.

9. A non-transitory computer-readable medium encoded with a computer executable data structure comprising instructions for implementing the recited features of claim 1.

10. A computer-implemented method to construct and maintain an item bank containing a collection of items for use in assessments of learners, the method comprising:

(a) storing, in a storage, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding skill or performance objective;

(b) storing, in said storage, second data comprising a second set of educational standards promulgated by a second agency, each one of the second set of standards comprising at least one corresponding skill or performance objective;

(c) using a computer having access to the storage, creating at least one item specification, the item specification defining an item class comprised of items each having characteristics required by the item specification;

(d) using the computer, entering a title for the item specification, a description of the item class defined by the item specification, and the requirements imposed by the item specification for membership in the item class, wherein the requirements including at least one specified skill or performance objective;

(e) using the computer, assigning the item specification to exactly one performance objective in the first set of educational standards, and to exactly one performance objective in the second set of educational standards;

(f) using the computer, storing the item specification in association with a selected library of test items;

(g) using the computer, creating a new item to add to a selected library of test items, wherein creating said new item includes selecting an item bank question type, entering a point value for the new item, and the selecting a type of bank to which the new item is assigned, and wherein the item specification is displayed via a popup window as the new item is written or edited; and

(h) using the computer, mapping the new item to a selected item specification, whereby the item is automatically and correctly associated to both the first set of standards and the second set of standards based on a mapping procedure.

11. The method of claim 10 wherein the first and second agencies are different educational entities within the U.S. federal government.

12. The method of claim 10 wherein the first and second agencies are different state education agencies.

13. The method of claim 10 wherein exactly one of the first and second agencies are different local education agencies.

14. The method of claim 10 wherein one of the first and second agencies is a state, local or federal education within a different parent agency than the other one of the first and second agencies.

15. The method of claim 10 wherein the type of bank is selected from a set that includes (a) a first type of bank that includes items to be used in agency-wide assessments, and (b) a second type of bank that includes items to be used in formative assessments including classroom quizzes.

16. The method of claim 15 wherein the method is deployed via a web browser.