Method and system for computer based testing using an amalgamated resource file

• US 20060069970A1
• Filed: 08/19/2005
• Published: 03/30/2006
• Est. Priority Date: 11/13/2001
• Status: Active Grant

• Current Assignee: Prometric, LLC
• Original Assignee: Prometric Inc. (Educational Testing Service)
• Inventors: Bowers, Clarke Daniel
• Granted Patent: US 7,784,045 B2
• Time in Patent Office: Days
• US Class Current: 714/724
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

A system for computer-based testing for producing a test and delivering the test to an examinee includes a storage device that has a first storage location, which stores a first segment of a test definition language, and a second storage location, which stores a second segment of the test definition language, a validation expansion module that validates the first segment and the second segment of the test definition language, a test packager that amalgamates the first storage location and the second storage location and transmits the amalgamated segment to the validation expansion module such that the validation expansion module can determine whether the amalgamated segment forms a complete and valid set, and a test driver that has an executable code that controls functionality that enables the test driver to deliver the test to an examinee. A method of computer-based testing includes validating a first segment of the test definition language, amalgamating the first segment and the second segment of the test definition language, validating an amalgamated segment, such that the amalgamated segment is valid if the amalgamated segment forms a complete and valid set, and amalgamating the first segment and the second segment of the test definition language during a test delivery cycle.

Claims

1. A system for computer based testing for at least one test, the at least one test having a presentation format and data content, comprising:

a storage device comprising a first storage location and a second storage location, the first storage location storing a first segment of a test definition language and the second storage location storing a second segment of the test definition language, wherein the first segment and the second segment define information comprising at least one of the data content, the presentation format, progression, scoring, printing, timing, and results reporting of the at least one test;

a validation expansion module, in operative data communication with the storage device, that validates the first segment and the second segment of the test definition language by determining whether the first segment and the second segment are correctly formatted, and stores the first segment to one of the first storage location and the second storage location and the second segment to another one of the first storage location and the second storage location in the storage device;

a test packager, in operative data communication with the storage device and the validation expansion module, that, during production of the at least one test, transmits the first segment and the second segment of the test definition language to the validation expansion module, determines to which of the first storage location and the second storage location in the storage device the first segment and the second segment are stored by the validation expansion module, amalgamates the first storage location and the second storage location and stores an amalgamated segment of the test definition language in a first virtual storage location, and transmits the amalgamated segment to the validation expansion module such that the validation expansion module is capable of determining whether the amalgamated segment forms a complete and valid set of the first segment and second segment of the test definition language; and

a test driver, in operative data communication with the storage device and the validation expansion module, comprising an executable code that controls functionality that enables the test driver to deliver the at least one test to an examinee using a display device, manage the at least one test, control the progression of the at least one test, control the scoring of the at least one test, control the printing of the at least one test, control the timing of the at least one test, and control the results reporting of the at least one test based on the test definition language, the test driver, during delivery of the at least one test, amalgamating the first storage location and the second storage location into a second virtual storage location such that the validation expansion module is capable of retrieving the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

2. The system of claim 1, wherein the test definition language comprises extensible markup language format and wherein the test packager comprises a compiler.

3. The system of claim 1, wherein the first segment and the second segment of the test definition language further comprise a same category of information, the same category of information comprising at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

4. The system of claim 2, wherein the same category of information further comprises at least one of non-interactive display material, test navigation, test navigation controls, items, timing, selection, scoring, results, and reporting.

5. The system of claim 1,

wherein the validation expansion module comprises a plug-in,

wherein the first segment of the test definition language defines the plug-in, and

wherein the second segment of the test definition language defines a usage of the plug-in on at least one unit of the at least one test.

6. The system of claim 5, wherein the similar feature defined by the first segment and the second segment of the test definition language further comprises at least one of test navigation, timing, selection, scoring, results, and reporting.

7. The system of claim 1, further comprising a function interface that enables communication between the test packager and the validation expansion module, wherein the function interface enables the test packager to transmit the first segment and the second segment of the test definition language to the validation expansion module such that the validation expansion module is capable of validating the first segment and the second segment.

8. The system of claim 1, further comprising a persistence interface that enables communication between the validation expansion module and the storage device such that the validation expansion module is capable of storing the first segment to one of the first storage location and the second storage location and the second segment of the test definition language to another one of the first storage location and the second storage location in the storage device.

9. The system of claim 8, wherein the persistence interface enables storing of the first segment and the second segment as one of a set of data and a directory.

10. The system of claim 8, wherein the persistence interface further enables the test packager to transmit the amalgamated segment from the storage device to the validation expansion module such that the validation expansion module is capable of validating the amalgamated segment.

11. The system of claim 8, wherein the persistence interface further enables the validation expansion module to retrieve the amalgamated segment from the storage device such that the validation expansion module is capable of enabling the functionality of the test driver.

12. The system of claim 1, further comprising a function interface that enables communication between the test packager and the validation expansion module such that the test packager is capable of transmitting the amalgamated segment to the validation expansion module and such that the validation expansion module is capable of determining whether the amalgamated segment forms a complete and valid set of the first segment and second segment of the test definition language.

13. The system of claim 1, further comprising a function interface that enables communication between the test driver and the validation expansion module such that such that the test packager is capable of instructing the validation expansion module to retrieve the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

14. The system of claim 1, wherein the storage device further comprises a third storage location and the test definition language further comprises a third segment:

wherein the validation module validates the third segment and stores the first segment to one of the first storage location, the second storage location, and the third storage location, stores the second segment to another one of the first storage location, the second storage location, and stores the third storage location, and the third segment of the test definition language to another one of the first storage location, the second storage location, and the third storage location,

wherein the test packager, during production of the at least one test, transmits the third segment to the validation expansion module such that the validation expansion module is capable of validating the third segment, determines to which of the first storage location, the second storage location, and the third storage location in the storage device the first segment, the second segment, and the third segment of the test definition language are stored by the validation expansion module, amalgamates the first storage location, the second storage location, and the third storage location and stores an amalgamated segment of the test definition language in a first virtual storage location, and transmits the amalgamated segment to the validation expansion module such that the validation expansion module is capable of determining a complete and valid set of the first segment, the second segment, and the third segment of the test definition language, and

wherein the test driver, during delivery of the at least one test, amalgamates the first storage location, the second storage location, and the third storage location into the second virtual storage location such that the validation expansion module is capable of retrieving the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

15. The system of claim 14:

wherein the validation expansion module comprises a plug-in,

wherein the first segment of the test definition language defines the plug-in,

wherein the second segment of the test definition language defines an area in a template in which the plug-in is to be used, the template determining a visual presentation of the at least one test on the display device, and

wherein the third segment of the test definition language defines a presentation in which the plug-in is to be used, the presentation determining the visual presentation of the at least one test on the display device at a particular instance during the at least one test.

16. The system of claim 14, wherein the first segment, the second segment, and the third segment of the test definition language further comprise a same category of information, the same category of information comprising at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

17. The system of claim 16, wherein the same category of information further comprises at least one of non-interactive display material, test navigation controls, and items.

18. The system of claim 14:

wherein the validation expansion module comprises a plug-in,

the first segment of the test definition language defines the plug-in;

wherein the second segment of the test definition language defines an area in a template in which the plug-in is to be used, the template determining a visual presentation of the at least one test on the display device,

wherein the third segment of the test definition language defines an item, which includes at least one question delivered to the examinee during the at least one test, and

wherein the similar feature defined by the first segment, the second segment, and the third segment of the test definition language is items.

19. The system of claim 14, further comprising a function interface that enables communication between the test packager and the validation expansion module, wherein the function interface enables the test packager to transmit the first segment, the second segment, and the third segment of the test definition language to the validation expansion module such that the validation expansion module is capable of validating the first segment, the second segment, and the third segment.

20. The system of claim 14, further comprising a persistence interface that enables communication between the validation expansion module and the storage device such that the validation expansion module is capable of storing the first segment to one of the first storage location and the second storage location and the second segment of the test definition language to another one of the first storage location and the second storage location in the storage device.

21. The system of claim 20, wherein the persistence interface enables storing of the first segment, the second segment, and the third segment as one of a set of data and a directory.

22. The system of claim 20, wherein the persistence interface further enables the test packager to transmit the amalgamated segment from the storage device to the validation expansion module such that the validation expansion module is capable of validating the amalgamated segment.

23. The system of claim 20, wherein the persistence interface further enables the validation expansion module to retrieve the amalgamated segment from the storage device such that the validation expansion module is capable of enabling the functionality of the test driver.

24. The system of claim 14, further comprising a function interface that enables communication between the test packager and the validation expansion module such that the test packager is capable of transmitting the amalgamated segment to the validation expansion module and such that the validation expansion module is capable of determining whether the amalgamated segment forms a complete and valid set of the first segment and second segment of the test definition language.

25. The system of claim 14, further comprising a function interface that enables communication between the test driver and the validation expansion module such that such that the test packager is capable of instructing the validation expansion module to retrieve the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

26. A system for computer based testing for at least one test, the at least one test having a presentation format and data content, comprising:

a storage device comprising a first storage location, a second storage location, and a third storage location, the first storage location storing a first segment of a test definition language, the second storage location storing a second segment of the test definition language, and the third storage location storing a third segment of the test definition language, wherein the first segment, the second segment, and the third segment comprise at least one of the data content, the presentation format, progression, scoring, printing, timing, and results reporting of the at least one test;

a validation expansion module, in operative data communication with the storage device, that validates the first segment, the second segment, and the third segment of the test definition language, and stores the first segment to one of the first storage location, the second storage location, and the third storage location, the second segment to another one of the first storage location, the second storage location, and the third storage location, and the third segment to another one of the first storage location, the second storage location, and the third storage location;

a test packager, in operative data communication with the storage device and the validation expansion module, that, during production of the at least one test, transmits the first segment, the second segment, and the third segment of the test definition language to the validation expansion module such that the validation expansion module is capable of validating the first segment, the second segment, and the third segment, determines to which of the first storage location, the second storage location, and the third storage location in the storage device the first segment, the second segment, and the third segment are stored by the validation expansion module, amalgamates the first storage location, the second storage location, and the third storage location and stores an amalgamated segment of the test definition language in a first virtual storage location, and transmits the amalgamated segment to the validation expansion module such that the validation expansion module is capable of determining a complete and valid set of the first segment, the second segment, and the third segment of the test definition language; and

a test driver, in operative data communication with the storage device and the validation expansion module, comprising an executable code that controls functionality performed by the test driver that enables the test driver to deliver the at least one test to an examinee using a display device, manage the at least one test, control progression of the at least one test, control scoring of the at least one test, control printing of the at least one test, control timing of the at least one test, and control reporting of test results based on the test definition language, the test driver, during delivery of the at least one test, amalgamating the first storage location, the second storage location, and the third storage location into a second virtual storage location such that the validation expansion module is capable of retrieving the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

27. The system of claim 26,

wherein the validation expansion module comprises a plug-in,

wherein the first segment of the test definition language defines the plug-in,

wherein the second segment of the test definition language defines an area in a template in which the plug-in is to be used, the template determining a visual presentation of the at least one test on the display device, and

wherein the third segment of the test definition language defines a presentation in which the plug-in is to be used, the presentation determining the visual presentation of the at least one test on the display device at a particular instance during the at least one test.

28. The system of claim 26, wherein the first segment, the second segment, and the third segment of the test definition language further comprise a same category of information, the same category of information comprising at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

29. The system of claim 28, wherein the same category of information further comprises at least one of non-interactive display material, test navigation controls, and items.

30. The system of claim 26:

wherein the validation expansion module comprises a plug-in,

wherein the first segment of the test definition language defines the plug-in,

wherein the second segment of the test definition language defines an area in a template in which the plug-in is to be used, the template determining a visual presentation of the at least one test on the display device

wherein the third segment of the test definition language defines an item, which includes at least one question delivered to the examinee during the at least one test, and

wherein the first segment, the second segment, and the third segment further comprise a same category of information, the same category of information comprising items.

31. The system of claim 26, further comprising a function interface that enables communication between the test packager and the validation expansion module, wherein the function interface enables the test packager to transmit the first segment, the second segment, and the third segment of the test definition language to the validation expansion module such that the validation expansion module is capable of validating the first segment, the second segment, and the third segment.

32. The system of claim 26, further comprising a persistence interface that enables communication between the validation expansion module and the storage device such that the validation expansion module is capable of storing the first segment to one of the first storage location and the second storage location and the second segment of the test definition language to another one of the first storage location and the second storage location in the storage device.

33. The system of claim 32, wherein the persistence interface enables storing of the first segment, the second segment, and the third segment as one of a set of data and a directory.

34. The system of claim 32, wherein the persistence interface further enables the test packager to transmit the amalgamated segment from the storage device to the validation expansion module such that the validation expansion module is capable of validating the amalgamated segment.

35. The system of claim 32, wherein the persistence interface further enables the validation expansion module to retrieve the amalgamated segment from the storage device such that the validation expansion module is capable of enabling the functionality of the test driver.

36. The system of claim 26, further comprising a function interface that enables communication between the test packager and the validation expansion module such that the test packager is capable of transmitting the amalgamated segment to the validation expansion module and such that the validation expansion module is capable of determining whether the amalgamated segment forms a complete and valid set of the first segment and second segment of the test definition language.

37. The system of claim 26, further comprising a function interface that enables communication between the test driver and the validation expansion module such that such that the test packager is capable of instructing the validation expansion module to retrieve the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

38. A system for computer based testing for at least one test, the at least one test having a presentation format and data content, comprising:

first storage means for storing a first segment of a test definition language;

second storage means for storing a second segment of the test definition language, wherein the first segment and the second segment define information comprising at least one of the data content, the presentation format, progression, scoring, printing, timing, and results reporting of the at least one test;

validation means, in operative data communication with the first storage means and the second storage means, for validating the first segment and the second segment of the test definition language, and storing the first segment to one of the first storage means and the second storage means and the second segment to another one of the first storage means and the second storage means;

test packager means, in operative data communication with the first storage means, the second storage means, and the validation means, for, during production of the at least one test, transmitting the first segment and the second segment of the test definition language to the validation means such that the validation means is capable of validating the first segment and the second segment, determining to which of the first storage means and the second storage means the first segment and the second segment are stored by the validation means, amalgamating the first storage means and the second storage means and storing an amalgamated segment of the test definition language in a third storage means, and transmitting the amalgamated segment to the validation means such that the validation means is capable of determining a complete and valid set of the first segment and second segment of the test definition language; and

test driver means, in operative data communication with the first storage means, the second storage means, and the validation means, for amalgamating the first storage means and the second storage means into a third storage means such that the validation means is capable of retrieving the amalgamated segment from the third storage means, the test driver means comprising an executable code that controls functionality performed by the test driver means that enables the test driver means to deliver the at least one test to an examinee using a display device, manage the at least one test, control progression of the at least one test, control scoring of the at least one test, control printing of the at least one test, control timing of the at least one test, and control reporting of test results based on the test definition language, wherein the validation means enables the functionality of the test driver means.

39. The system of claim 38, wherein the first segment and the second segment of the test definition language further comprise a same category of information, the same category of information comprising at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

40. The system of claim 38, further comprising function interface means that enables communication between the test packager means and the validation means.

41. The system of claim 38, further comprising persistence interface means that enables communication between the validation means and the first storage means and the second storage means.

42. The system of claim 38, further comprising function interface means that enables communication between the test packager means and the validation means such that the test packager means is capable of transmitting the amalgamated segment to the validation means and such that the validation means is capable of determining whether the amalgamated segment forms a complete and valid set of the first segment and second segment of the test definition language.

43. The system of claim 38, further comprising function interface means that enables communication between the test driver means and the validation means such that such that the test packager means is capable of instructing the validation means to retrieve the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

44. A system for computer based testing for at least one test, the at least one test having a presentation format and data content, comprising:

first storage means for storing a first segment of a test definition language;

second storage means for storing a second segment of the test definition language;

third storage means for storing a third segment of the test definition language, wherein the first segment, the second segment, and the third segment define information comprising at least one of the data content, the presentation format, progression, scoring, printing, timing, and results reporting of the at least one test;

validation means, in operative data communication with the first storage means, the second storage means, and the third storage means, for validating the first segment, the second segment, and the third segment of the test definition language, and storing the first segment to one of the first storage means, the second storage means, and the third storage means, the second segment to another one of the first storage means, the second storage means, and the third storage means, and the third segment to another one of the first storage means, the second storage means, and the third storage means;

test packager means, in operative data communication with the first storage means, the second storage means, the third storage means, and the validation means, for, during production of the at least one test, transmitting the first segment, the second segment, and the third segment of the test definition language to the validation means such that the validation means is capable of validating the first segment, the second segment, and the third segment, determining to which of the first storage means, the second storage means, and the third storage means the first segment, the second segment, and the third segment are stored by the validation means, amalgamating the first storage means, the second storage means, and the third storage means and storing an amalgamated segment of the test definition language in a fourth storage means, and transmitting the amalgamated segment to the validation means such that the validation means is capable of determining a complete and valid set of the first segment, the second segment, and the third segment of the test definition language; and

test driver means, in operative data communication with the first storage means, the second storage means, the third storage means, and the validation means, for, during delivery of the at least one test, amalgamating the first storage means, the second storage means, and the third storage means into a fourth storage means such that the validation means is capable of retrieving the amalgamated segment from the fourth storage means, the test driver means comprising an executable code that controls functionality performed by the test driver means that enables the test driver means to deliver the at least one test to an examinee using a display device, manage the at least one test, control progression of the at least one test, control scoring of the at least one test, control printing of the at least one test, control timing of the at least one test, and control reporting of test results based on the test definition language, wherein the validation means enables the functionality of the test driver means.

45. The system of claim 44, wherein the first segment, the second segment, and the third segment of the test definition language further comprise a same category of information, the same category of information comprising at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

46. The system of claim 44, further comprising function interface means that enables communication between the test packager means and the validation means.

47. The system of claim 44, further comprising persistence interface means that enables communication between the validation means and the first storage means, the second storage means, and the third storage means.

48. The system of claim 44, further comprising function interface means that enables communication between the test packager means and the validation means such that the test packager means is capable of transmitting the amalgamated segment to the validation means and such that the validation means is capable of determining whether the amalgamated segment forms a complete and valid set of the first segment and second segment of the test definition language.

49. The system of claim 44, further comprising function interface means that enables communication between the test driver means and the validation means such that such that the test packager means is capable of instructing the validation means to retrieve the amalgamated segment from the second virtual storage location to enable the functionality of the test driver.

50. A method for computer based testing for at least one test, the at least one test having a presentation format and data content, the at least one test being controlled by a test driver, the test driver having an executable code that controls the test driver and functionality that enables the test driver to deliver the at least one test to an examinee using a display device, manage the at least one test, control progression of the at least one test, control scoring of the at least one test, control printing of the at least one test, control timing of the at least one test, and control results reporting of the at least one test based on a test definition language, the test definition language comprising a plurality of segments, the method comprising the steps of:

validating a first segment of the test definition language during a test production cycle;

validating a second segment of the test definition language during the test production cycle, wherein the first segment and the second segment define information comprising at least one of the data content, the presentation format, progression, scoring, printing, timing, and results reporting of the at least one test;

amalgamating the first segment and the second segment of the test definition language during the test production cycle, wherein an amalgamated segment is formed;

validating the amalgamated segment during the test production cycle, wherein a validated amalgamated segment is created and wherein the amalgamated segment is valid if the amalgamated segment forms a complete and valid set; and

amalgamating the first segment and the second segment of the test definition language during a test delivery cycle, wherein the validated amalgamated segment is reformed and retrieved by a validation expansion module to enable the functionality of the test driver.

51. The method of claim 50, wherein the first segment and the second segment of the test definition language comprise a same category of information, the same category of information being at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

52. The method of claim 51, wherein the same category of information further comprises at least one of test navigation, timing, selection, scoring, printing, timing, results, and reporting.

53. The method of claim 50, further comprising the step of instantiating the validation expansion module during the test production cycle, wherein validating the first segment and the second segment of the test definition language is performed by the validation expansion module.

54. The method of claim 53, wherein instantiating the validation expansion module is facilitated by standard Microsoft object instantiation using a component object model server.

55. The method of claim 53, wherein the first segment and the second segment of the test definition language are transmitted to the validation expansion module by a test packager and wherein transmitting to the validation expansion module is facilitated by a function interface.

56. The method of claim 55, wherein the test packager comprises a compiler.

57. The method of claim 50, wherein the test definition language comprises extensible markup language format, validating the first segment and the second segment of the test definition language further comprising the step of determining whether the first segment and the second segment are correctly formatted.

58. The method of claim 57, wherein a correct format for the first segment and the second segment of the test definition language is defined in a schema.

59. The method of claim 57, further comprising the step of instantiating the validation expansion module during the test production cycle, wherein validating the first segment and the second segment of the test definition language is performed by the validation expansion module, instantiating the validation expansion module further comprising the step of calling the validation expansion module using a product identification defined in extensible markup language in the test definition language.

60. The method of claim 50, further comprising the step of storing the first segment to one of a first storage location and a second storage location and the second segment to another one of the first storage location and the second storage location in a storage device after the first segment and the second segment have been validated.

61. The method of claim 60,

wherein the first segment and the second segment of the test definition language are stored the storage device by the validation expansion module, and

wherein a test packager determines into which of the first storage location and the second storage location the first segment and the second segment are stored.

62. The method of claim 60, wherein storing the first storage location and the second storage location into the storage device is facilitated by a persistence interface.

63. The method of claim 60, wherein the test packager comprises a compiler.

64. The method of claim 50, amalgamating the first segment and the second segment of the test definition language further comprising the steps of:

combining the first segment and the second segment of the test definition language according to an amalgamation rule; and

storing the amalgamated segment in a virtual storage location in a storage device.

65. The method of claim 50, further comprising the step of instantiating the validation expansion module during the test production cycle, wherein validating the amalgamated segment is performed by the validation expansion module.

66. The method of claim 65, wherein instantiating the validation expansion module is facilitated by standard Microsoft object instantiation using a component object model server.

67. The method of claim 65, wherein an amalgamated interface is retrieved from a virtual storage object in a storage device by the validation expansion module and wherein communication between the virtual storage location and the validation expansion module is facilitated by a function interface.

68. The method of claim 65, wherein the first segment of the test definition language is stored to one of a first storage location and a second storage location and the second segment of the test definition language to another one of the first storage location and the second storage location in the storage device, the first segment and the second segment forming the amalgamated segment, wherein the first segment and the second segment are retrieved from the storage device by the validation expansion module in amalgamated form using a persistence interface.

69. The method of claim 65, wherein the validation expansion module determines what requirements are necessary for the amalgamated segment to form a complete and valid set.

70. The method of claim 50, further comprising the step of instantiating the validation expansion module during the test production delivery cycle, wherein validating the amalgamated segment is performed by the validation expansion module.

71. The method of claim 70, further comprising the step of loading the validated amalgamated segment into the validation expansion module, wherein the validated amalgamated segment is retrieved from a virtual storage location in a storage device by the validation expansion module and wherein communication between the virtual storage location and the validation expansion module is facilitated by a function interface.

72. The method of claim 70, wherein the first segment of the test definition language is stored to one of a first storage location and a second storage location and the second segment of the test definition language to another one of the first storage location and the second storage location in the storage device, the first segment and the second segment forming the amalgamated segment, wherein the first segment and the second segment are retrieved from the storage device by the validation expansion module in amalgamated form using a persistence interface.

73. A method computer based testing for at least one test, the at least one test having a presentation format and data content, the at least one test being controlled by a test driver, the test driver having an executable code that controls the test driver and functionality that enables the test driver to deliver the at least one test to an examinee using a display device, manage the at least one test, control progression of the at least one test, control scoring of the at least one test, control printing of the at least one test, control timing of the at least one test, and control results reporting of the at least one test based on a test definition language, the test definition language comprising a plurality of segments, the method comprising the steps of:

validating a first segment of the test definition language during a test production cycle;

validating a second segment of the test definition language during the test production cycle;

validating a third segment of the test definition language, wherein the first segment, the second segment, and the third segment define information comprising at least one of the data content, the presentation format, progression, scoring, printing, timing, and results reporting of the at least one test;

amalgamating the first segment, the second segment, and the third segment of the test definition language during the test production cycle, wherein an amalgamated segment is formed;

validating the amalgamated segment during the test production cycle, wherein a validated amalgamated segment is created and wherein the amalgamated segment is valid if the amalgamated segment forms a complete and valid set; and

amalgamating the first segment, the second segment, and the third segment of the test definition language during a test delivery cycle, wherein the validated amalgamated segment is reformed and retrieved by a validation expansion module to enable the functionality of the test driver.

74. The method of claim 73, further comprising the step of instantiating the validation expansion module during the test production cycle, wherein validating the first segment, the second segment, and the third segment of the test definition language is performed by the validation expansion module.

75. The method of claim 74, wherein instantiating the validation expansion module is facilitated by standard Microsoft object instantiation using a component object model server.

76. The method of claim 74, wherein the first segment, the second segment, and the third segment of the test definition language are transmitted to the validation expansion module by a test packager and wherein transmitting to the validation expansion module is facilitated by a function interface.

77. The method of claim 76, wherein the test packager comprises a compiler.

78. The method of claim 73, wherein the test definition language comprises extensible markup language format, validating the first segment, the second segment, and the third segment of the test definition language further comprising the step of determining whether the first segment, the second segment, and the third segment are correctly formatted.

79. The method of claim 78, wherein a correct format for the first segment, the second segment, and the third segment of the test definition language is defined in a schema.

80. The method of claim 78, further comprising the step of instantiating the validation expansion module during the test production cycle, wherein validating the first segment, the second segment, and the third segment of the test definition language is performed by the validation expansion module, instantiating the validation expansion module further comprising the step of calling the validation expansion module using a product identification defined in extensible markup language in the test definition language.

81. The method of claim 73, further comprising the step of storing the first segment to one of a first storage location, a second storage location, and a third storage location, storing the second segment to another one of the first storage location, the second storage location, and the third storage location, and storing the third segment of the test definition language to another one of the first storage location, the second storage location, and the third storage location after the first segment, the second segment, and the third segment have been validated.

82. The method of claim 81,

wherein the first segment is stored to one of a first storage location, a second storage location, and a third storage location, the second segment is stored to another one of the first storage location, the second storage location, and the third storage location, and the third segment is stored to another one of the first storage location, the second storage location, and the third storage location by the validation expansion module, and

wherein a test packager determines into which of the first storage location, the second storage location, and the third storage location the first segment, the second segment, and the third segment are stored.

83. The method of claim 82, wherein storing the the first storage location, the second storage location, and the third storage location into the storage device is facilitated by a persistence interface.

84. The method of claim 82, wherein the test packager comprises a compiler.

85. The method of claim 73, amalgamating the first segment, the second segment, and the third segment of the test definition language further comprising the steps of:

combining the first segment, the second segment, and the third segment of the test definition language according to an amalgamation rule; and

storing the amalgamated segment in a virtual storage location in a storage device.

86. The method of claim 73, further comprising the step of instantiating the validation expansion module during the test production cycle, wherein validating the amalgamated segment is performed by the validation expansion module.

87. The method of claim 86, wherein instantiating the validation expansion module is facilitated by standard Microsoft object instantiation using a component object model server.

88. The method of claim 86, wherein an amalgamated interface is retrieved from a virtual storage object in a storage device by the validation expansion module and wherein communication between the virtual storage location and the validation expansion module is facilitated by a function interface.

89. The method of claim 86, wherein the first segment is stored to one of a first storage location, a second storage location, and a third storage location, the second segment is stored to another one of the first storage location, the second storage location, and the third storage location, and the third segment is stored to another one of the first storage location, the second storage location, and the third storage location, and the first segment, the second segment, and the third segment of the test definition language forming the amalgamated segment, and wherein the first segment, the second segment, and the third segment are retrieved from the storage device by the validation expansion module in amalgamated form using a persistence interface.

90. The method of claim 86, wherein the validation expansion module determines what requirements are necessary for the amalgamated segment to form a complete and valid set.

91. The method of claim 73, further comprising the step of instantiating the validation expansion module during the test delivery cycle, wherein validating the amalgamated segment is performed by the validation expansion module.

92. The method of claim 91, further comprising the step of loading the validated amalgamated segment into the validation expansion module, wherein the validated amalgamated segment is retrieved from a virtual storage location in a storage device by the validation expansion module and wherein communication between the virtual storage location and the validation expansion module is facilitated by a function interface.

93. The method of claim 91, wherein the first segment is stored to one of a first storage location, a second storage location, and a third storage location, the second segment is stored to another one of the first storage location, the second storage location, and the third storage location, and the third segment is stored to another one of the first storage location, the second storage location, and the third storage location, the first segment, the second segment, and the third segment of the test definition language forming the validated amalgamated segment, and wherein the first segment, the second segment, and the third segment are retrieved from the storage device by the validation expansion module in amalgamated form using a persistence interface.

94. The system of claim 73, wherein the first segment, the second segment, and the third segment of the test definition language further comprise a same category of information, the same category of information being at least one of the data content, the presentation format, the progression, the scoring, the printing, the timing, and the results reporting of the at least one test.

95. The method of claim 94, wherein the same category further comprises at least one of non-interactive display material, test navigation controls, and items.

96. A method for computer based testing for at least one test, the at least one test having a presentation format and data content, comprising:

defining the presentation format and the data content in at least two locations comprising a plugin element and actual usage of the plugin element on at least one unit of the at least one test, the at least one unit comprising form, section and group associated with the at least one test; and

amalgamating the presentation format and the data content defined in the two locations by at least one test driver to deliver the at least one test to an examinee.

97. A method for computer based testing for at least one test, the at least one test having a presentation format and data content, comprising:

validating by a plugin at least partial exam source information that is received;

amalgamating exam resource data associated with the at least one test and validating the exam resource data that has been amalgamated to provide a substantially complete amalgamated exam specification and content; and

delivering the substantially complete amalgamated exam specification and content validated by the validating step.

98. The method of claim 97, wherein the validating step further comprises the step of validating by the plugin the at least partial exam source information that is received during compilation of the at least one test.

99. The method of claim 97, wherein the validating step further comprises the step of amalgamating the exam resource data associated with the at least one test, and validating the exam resource data that has been amalgamated to provide the substantially complete amalgamated exam specification and content during test compilation.

100. The method of claim 97, wherein the delivering further comprises the step of delivering the substantially complete amalgamated exam specification and content during delivery of the at least one test to an examinee.

101. A method for computer based testing for at least one test, the at least one test having a first presentation format, a second presentation format, a first data content, and second data content, comprising:

defining the first presentation format and the second presentation format in at least two locations comprising a plugin element and actual usage of the plugin element on at least one unit of the at least one test, the at least one unit comprising form, section and group associated with the at least one test;

defining the first data content and the second data content in at least two locations comprising the plugin element and the actual usage of the plugin element on at least one unit of the at least one test, the at least one unit comprising form, section and group associated with the at least one test; and

amalgamating at least one of the first and second presentation format and the first and second data content defined in the two locations by at least one test driver to deliver the at least one test to an examinee.