Extensible exam language (XXL) protocol for computer based testing

• US 8,579,633 B2
• Filed: 02/24/2009
• Issued: 11/12/2013
• Est. Priority Date: 11/13/2001
• Status: Active Grant

• Current Assignee: Prometric, LLC
• Original Assignee: Prometric Inc. (Educational Testing Service)
• Inventors: Bowers, Clarke D., Hartley, Tronster Maxwell, Kvech, Kyle Michael, Garrison, William Howard
• Primary Examiner(s): MOSSER, KATHLEEN MICHELE
• Application Number:
  US12/391,436
• Publication Number:
  US 20090155758A1
• Time in Patent Office: 1,722 Days
• Field of Search: 434/323, 434/350, 434/353
• US Class Current: 434/323
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

A memory stores a plurality of first data structures, which includes element specific data objects indicating a classification of at least one of the plurality of segments of the test definition language, and second data structures, which include attribute specific data objects indicating at least one attribute of the segments of the test definition language implemented by a computer. A method for computer-based testing includes authoring a test specification and content of the at least one test using a test definition language, compiling the test specification and content of the at least one test to create a compiled test specification and content, which includes validating the test specification and content, storing the compiled test specification and content to a resource file, and retrieving the compiled test specification and content from the resource file during delivery of the test.

Claims

1. A method for defining a schema for a test definition language, the method comprising:

defining a first set of elements;

defining a set of attributes; and

defining a second set of elements depending from and subordinate to the first set of elements, wherein the second set of elements references the first set of elements and the set of attributes;

compiling by a compiler implemented in a computer server a test specification and content of at least one test using the defined schema comprising the first set of elements, the set of attributes and the second set of elements to create a compiled test specification and content of the at least one test, the compiling including compiling a first set of data filed, wherein the first set of data files are globally accessible to the a test driver and compiling a second set of data filed, where the second set of data files comprise the test definition language;

validating the compiled test specification and content;

determining whether the compiled test specification and content are correctly formatted;

storing the compiled test specification and content of the at least one test to a resource file in a database; and

retrieving from the resource file in the database the compiled test specification and content of the at least one test during delivery of the test.

2. The method of claim 1, wherein the test definition language comprises extensible markup language format.

3. The method of claim 1, wherein a correct format for the test specification and content is defined in a schema.

4. The method of claim 1, wherein the test specification and content are compiled by a compiler and at least one validation module.

5. The method of claim 4, wherein the at least one validation module is a plugin.

6. The method of claim 1, further comprising authoring the test specification and content, wherein authoring the test specification and content further comprises:

defining at least one element for each aspect of the at least one test; and

defining at least one of at least one attribute object and at least one data object of the at least one element.

7. The method of claim 6, wherein the at least one element comprises one of message boxes, scripts, data, plug-ins, templates, categories, items, groups, sections, forms, form groups, and exams.

8. The method of claim 1, wherein the first set of data files comprises multimedia data and wherein the first set of data files are compiled before the second set of data files are compiled.

9. The method of claim 1, wherein the second set of data files further comprises at least one of data comprising scripts, data comprising at least one validation module, data comprising the presentation format of the at least one test, data comprising items, and data comprising the data content of the at least one test.

10. The method of claim 9, wherein compiling the second set of data files further comprises:

compiling the data comprising scripts;

compiling the data comprising the at least one validation module after compiling the data comprising scripts;

compiling the data comprising the presentation format of the at least one test alter compiling the data comprising the at least one validation module;

compiling the data comprising items after compiling the data comprising the presentation format of Inc at least one test; and

compiling the data comprising the data content of the at least one test after compiling the data comprising items.

11. The method of claim 1, further comprising:

accessing a plurality of segments of test definition language and creating an exam resource file.

12. The method of claim 11, further comprising:

organizing the test specification into a first data structure and a second data structure which is dependent upon the first data structure responsive to the exam resource file.

13. The method of claim 12, wherein the first data structure defines an element of information from the at least one segment of test definition language and wherein the second data structure contains attributes of the test specification.

14. The method of claim 11, further comprising validating the at least one segment of test definition language through a plugin accessing the exam resource file.

15. The method of claim 14, further comprising accessing the exam resource file using a test driver to deliver a test to an examinee and accessing a plugin for additional data to expand the functionality of the test driver.

16. The method of claim 14, further comprising executing additional functionality by the test driver using the test definition language without necessitating changes to the test driver'"'"'s executable code.

17. The method of claim 14, further comprising customizing the at least one plugin without changing the test driver'"'"'s executable code.

18. The method of claim 14, further comprising enabling the test driver to support at least one of new item types, navigation algorithms, information displays, scoring algorithms, timing algorithms, test unit selection algorithms, results persistence reporting, printed score reporting, and helm types without changing the test driver'"'"'s executable code.

19. The method of claim 14, wherein the at least one plugin is independent from the test driver.

20. A method for defining a schema for a test definition language, the method comprising:

defining a first set of elements;

defining a set of attributes;

defining a second set of elements depending from and subordinate to the first set of elements, wherein the second set of elements references the first set of elements and the set of attributes;

accessing a plurality of segments of test definition language and creating an exam resource file; and

compiling by a compiler implemented in a computer server a test specification and content of at least one test using the defined schema comprising the first set of elements, the set of attributes, the second set of elements and the exam resource file to create a compiled test specification and content, the compiling including compiling a first set of data files, wherein the first set of data files are globally accessible to a test driver and compiling a second set of data files, wherein the second set of data files comprise the test definition language;

organizing the test specification into a first data structure and a second data structure which is dependent upon the first data structure responsive to the exam resource file.

21. The method of claim 20, wherein the first data structure defines an element of information from the at least one segment of test definition language and wherein the second data structure contains attributes of the test specification.

22. The method of claim 20, further comprising validating the at least one segment of test definition language through a plugin using the exam resource file.

23. The method of claim 22, further comprising accessing the exam resource file using a test driver to deliver a test to an examinee and accessing a plugin for additional data to expand the functionality of the test driver.

24. The method of claim 22, further comprising executing additional functionality by the test driver using the test definition language without necessitating changes to the test driver'"'"'s executable code.

25. The method of claim 22, further comprising customizing the at least one plugin without changing the test driver'"'"'s executable code.

26. The method of claim 22, further comprising enabling the test driver to support at least one of new item types, navigation algorithms, information displays, scoring algorithms, timing algorithms, test unit selection algorithms, results persistence reporting, printed score reporting, and helm types without changing the test driver'"'"'s executable code.

27. The method of claim 22, wherein the at least one plugin is independent from the test driver.