Extensible exam language (XXL) protocol for computer based testing

• US 9,418,565 B2
• Filed: 02/23/2009
• Issued: 08/16/2016
• Est. Priority Date: 11/13/2001
• Status: Expired due to Fees

• Current Assignee: Prometric, LLC
• Original Assignee: Prometric Inc. (Educational Testing Service)
• Inventors: Bowers, Clarke D., Hartley, Tronster Maxwell, Kvech, Kyle Michael, Garrison, William Howard
• Primary Examiner(s): Yao, Sam
• Assistant Examiner(s): Saint-Vil, Eddy
• Application Number:
  US12/390,930
• Publication Number:
  US 20090155756A1
• Time in Patent Office: 2,731 Days
• Field of Search: 434/322, 434/323, 434/350
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

A memory stores a plurality of first data structures, which includes element specific data objects indicating a classification of at least one of the plurality of segments of the test definition language, and second data structures, which include attribute specific data objects indicating at least one attribute of the segments of the test definition language implemented by a computer. A method for computer-based testing includes authoring a test specification and content of the at least one test using a test definition language, compiling the test specification and content of the at least one test to create a compiled test specification and content, which includes validating the test specification and content, storing the compiled test specification and content to a resource file, and retrieving the compiled test specification and content from the resource file during delivery of the test.

Claims

1. A method for computer-based testing for at least one test having a presentation format and a data content, the at least one test being delivered by a test driver, the method comprising the steps of:

authoring a test specification and content of the at least one test using a test definition language, wherein the test specification and content defines the presentation format and the data content of the at least one test;

compiling via a computer-implemented compiler the test specification and content of the at least one test to create a compiled test specification and content, with the compiling including at least compiling a first set of data files and a second set of data files, with the first set of data files being globally accessible to the test driver and the second set of data files including the test definition language;

validating, by at least one validation module, the test specification and content, the at least one validation module including an independent plugin module defined by, and compiled from, test definition language stored within a plugin file;

storing to a memory the compiled test specification and content to a resource file; and

retrieving from the memory the compiled test specification and content from the resource file during delivery of the test.

2. The method of claim 1, wherein validating the test specification and content comprises determining whether the test specification and content are correctly formatted.

3. The method of claim 1, wherein the test definition language is eXtensible eXam Language (XXL).

4. The method of claim 1, wherein validating the test specification and content comprises determining whether the test specification and content are correctly formatted and wherein a correct format for the test specification and content is defined in a schema.

5. The method of claim 1, wherein authoring the test specification and content further comprises:

defining at least one element for each aspect of the at least one test; and

defining at least one of at least one attribute object and at least one data object of the at least one element.

6. The method of claim 5, wherein the at least one element comprises at least one of message boxes, scripts, data, plugins, templates, categories, items, groups, sections, forms, form groups, or exams.

7. The method of claim 1, wherein the second set of data files further comprises attribute specific data objects indicating at least one attribute of the segments of the test definition language.

8. The method of claim 7, wherein the first set of data files comprises multimedia data and wherein the first set of data files are compiled before the second set of data files are compiled.

9. The method of claim 7, wherein the second set of data files further comprises at least one of data comprising scripts, data comprising at least one validation module, data comprising the presentation format of the at least one test, data comprising items, and data comprising the data content of the at least one test.

10. The method of claim 9, wherein compiling the second set of data files further comprises:

compiling the data comprising scripts;

compiling the data comprising the at least one validation module after compiling the data comprising scripts;

compiling the data comprising the presentation format of the at least one test after compiling the data comprising the at least one validation module;

compiling the data comprising items after compiling the data comprising the presentation format of the at least one test; and

compiling the data comprising the data content of the at least one test after compiling the data comprising items.

11. A computer implemented test generation and examination system comprising:

a memory storing at least one segment of test definition language; and

a processor, coupled to the memory, adapted to execute a test definition language compiler for;

accessing the at least one segment of test definition language,

compiling a first set of data files and a second set of data files, the first set of data files being globally accessible to a test driver and the second set of data files including the test definition language,

validating, with an independent plugin module, the at least one segment of test definition language, the plugin module defined by, and compiled from, test definition language stored within a plugin file, and

incorporating the at least one segment of test definition language into an exam resource file that is operable to organize test data into a first data structure which defines an element of information from the at least one segment of test definition language, and a second data structure which is dependent upon the first data structure and contains attributes of the test data.

12. The system of claim 11, wherein the segment of test definition language defines at least one of data content, presentation format, progression, scoring, printing, timing, and results reporting.

13. The system of claim 11, wherein the test definition language allows the addition of new test functionality without necessitating changes to the test driver'"'"'s executable code.

14. The system of claim 11, wherein the at least one plugin is customizable without changing the test driver.

15. The system of claim 11, wherein the at least one plugin enables the test driver to support at least one of new item types, navigation algorithms, information displays, scoring algorithms, timing algorithms, test unit selection algorithms, results persistence reporting, printed score reporting, and helm types without changing the test driver'"'"'s executable code.

16. The system of claim 11, wherein the at least one plugin is independent from the test driver.

17. The system of claim 11, further comprising a test driver accessing the exam resource file to deliver a test to an examinee using a display device and managing the test according to at least one plugin.

18. The system of claim 17, wherein the test driver controls results reporting of the at least one computer-based test based on the test definition language and at least one plugin accessed by the test driver through at least one interface, and wherein the at least one plugin customizes the behavior the test driver by allowing the test driver to access the at least one plugin for additional data that expands the functionality of the test driver.

19. The system of claim 11, wherein the test definition language is eXtensible eXam Language (XXL).

20. A computer implemented test generation and examination system comprising:

a memory storing a plurality of segments of test definition language defining data content and specifications for a test; and

a processor, coupled to the memory, adapted to execute a test definition language compiler for accessing the plurality of segments of test definition language and for creating an exam resource file,

wherein the exam resource file resides on the memory with the compiled test content in an object-linking and embedding structured format and contains media, visual and logic components, and

wherein the test definition language compiler compiles a first set of data files and a second set of data files, with the first set of data files being globally accessible to a test driver and the second set of data files including the test definition language, and

wherein the test definition language compiler validates at least one segment of test definition language of the plurality of segments of test definition language through an independent plugin module using the exam resource file, the plugin module defined by, and compiled from, test definition language stored within a plugin file.

21. The system of claim 20, wherein the exam resource file organizes test data into a first data structure and a second data structure which is dependent upon the first data structure.

22. The system of claim 21, wherein the first data structure defines an element of information from the at least one segment of test definition language and wherein the second data structure contains attributes of the test data.

23. The system of claim 20, further comprising the test driver accessing the exam resource file to deliver a test to an examinee using a display device and accessing a plugin for additional data to expand the functionality of the test driver.

24. The system of claim 20, wherein the test definition language allows the addition of new test functionality without necessitating changes to the test driver'"'"'s executable code.

25. The system of claim 20, wherein the at least one plugin is customizable without changing the test driver.

26. The system of claim 20, wherein the at least one plugin enables the test driver to support at least one of new item types, navigation algorithms, information displays, scoring algorithms, timing algorithms, test unit selection algorithms, results persistence reporting, printed score reporting, and helm types without changing the test driver'"'"'s executable code.

27. The system of claim 20, wherein the test definition language is eXtensible eXam Language (XXL).