Test processing workflow tracking system

• US 6,810,232 B2
• Filed: 03/05/2001
• Issued: 10/26/2004
• Est. Priority Date: 03/05/2001
• Status: Expired due to Term

• Current Assignee: NCS Pearson Incorporated (Pearson plc)
• Original Assignee: NCS Pearson Incorporated (Pearson plc)
• Inventors: Knowles, Kristian, Pascale, Robert Nicola
• Primary Examiner(s): Harris, Chandra L.
• Application Number:
  US09/799,376
• Publication Number:
  US 20020176598A1
• Time in Patent Office: 1,331 Days
• Field of Search: 434/353, 434/359, 434/358, 434/355, 382/312, 382/321, 382/317
• US Class Current: 434/353
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A method and system for organizing and tracking the workflow of responses provided by a response provider. The responses are electronically imaged. The electronic images are tracked using individual identifiers based in part on the type of optical imaging device used. The invention further tracks and reports a group or batch of the electronic images.

Claims

1. In a computerized test processing workflow system configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, a method for increasing the volume of test question responses processed by embedding within each electronic image an individual digital identifier, the method comprising:

a. receiving audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents and process parameters;

b. electronically generating at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. optically imaging the particular set of test question responses;

d. electronically embedding within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image;

e. selectively moving the electronic images of the particular set of test question responses through one or more individual workflow steps using the individual digital identifier;

f. using the unique batch identifier to track the progress of the electronic images through the individual workflow steps.

2. The method of claim 1, further comprising the step of generating a report for the particular set of electronic images, wherein the report is based on the progress of the particular set of electronic images as tracked by the unique batch identifier.

3. The method of claim 1, further comprising the step of automatically setting up a directory structure in the server subsystem to hold data files relating to the audit information.

4. The method of claim 3, wherein the step of automatically setting up a directory structure in the server subsystem to held data files relating to the audit information directory structure comprises setting up a document definition file.

5. The method of claim 3, wherein the step of automatically setting up a directory structure in the server subsystem to hold data files relating to the audit information directory structure comprises setting up a scanning parameter file.

6. The method of claim 1, further comprising the step of storing the audit information in a database.

7. The method of claim 1, wherein the step of using the unique batch identifier to track the progress of the electronic images comprises the step of comparing the number of expected test question response to the number of test question responses actually optically imaged.

8. The method of claim 1, wherein the step of receiving audit information comprises receiving scanner interface data.

9. The method of claim 1, further comprising the step of determining whether the particular set of test question responses to be optically imaged include a machine readable identifier.

10. The method of claim 9, further comprising the step of reading the machine readable identifier for each of the test question response documents of the particular set of test questions.

11. The method of claim 1, wherein the step of receiving audit information comprises receiving information defining at least one region of interest for each of the test question response documents of the particular set of test questions.

12. The method of claim 1, wherein the step of receiving audit information comprises receiving workflow rules, whereby the workflow rules are instructions for the steps to be performed on each electronic image.

13. In a computerized test processing workflow system configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, a method for increasing the volume of test question responses processed by embedding within each electronic image an individual digital identifier, the method comprising:

a. receiving in the server subsystem audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. electronically generating in the server subsystem at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. receiving in the server subsystem optical images of the particular set of test question responses;

d. electronically embedding within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image;

e. selectively moving the electronic images of the particular set of test question responses through one or more individual workflow steps using the individual digital identifier;

f. using the unique batch identifier to track the progress of the electronic images through the individual workflow steps.

14. The method of claim 13, further comprising the step of storing the audit information in a database within the server subsystem.

15. In a computerized test processing workflow system configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, a method for increasing the volume of test question responses processed by embedding within each electronic image an individual digital identifier, the method comprising:

a. receiving in at least one client computer audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. electronically generating in at least one client computer at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. receiving in at least one client computer optical images of the particular set of test question responses;

d. electronically embedding within each electronic image an individual digital identifier, wherein each individual digital identifier is based on

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image;

e. selectively moving the electronic images of the particular set of test question responses through one or more individual workflow steps using the individual digital identifier;

f. using the unique batch identifier to track the progress the of electronic images through the individual workflow steps.

16. A computerized test processing workflow system for increasing the volume of test question responses processed by embedding within each electronic image an individual image identifier and configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optic imaging device is electronically identifiable, the system comprising:

a. an input system for receiving audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. a processing system configured to electronically generate at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. an optical imaging device for electronically imaging the particular set of test question responses;

d. the processing system being further configured to electronically embed within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image.

17. The system of claim 16, wherein the optical imaging device is a scanner.

18. The system of claim 16, wherein the optical imaging device is a facsimile machine.

19. The system of claim 16, further comprising a means for reading a machine readable identifier located on a document.

20. The system of claim 19, wherein a barcode reader is used to read a machine readable identifier located on a document.

21. A computerized test process in workflow system for increasing the volume of test question responses processed by embedding within each electronic image an individual image identifier and configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, the system comprising:

a. an input system for receiving audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameter;

b. a processing system configured to electronically generate at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. a scanner for electronically imaging the particular set of test question responses;

d. the processing system being further configured to electronically embed within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the scanner that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image.

22. A computer program product readable by a computing system for a computer process for a test processing workflow system configure for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, the computer program product comprising encoded instructions either embedded on a computer-readable media or transmitted in a propagating wave, the encoded instructions being arranged and configured to be read by the computing system for causing the computing system to perform the steps of:

a. receiving audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents and process parameters;

b. electronically generating at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. optically imaging the particular set of test question responses;

d. electronically embedding within each electronic image an individual digital identifier, wherein each individual digital identifier is based;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question responses were optically imaged;

or

4. the coordinates of the image;

e. selectively moving the electronic images of the particular set of test question responses through one or more individual workflow steps using the individual digital identifier;

f. using the unique batch identifier to track the progress of the electronic images through the individual workflow step.

23. A computer program product readable by a computing system for a computer process for a computerized test processing workflow system configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, the computer program product comprising encoded instructions either embedded on a computer-readable media or transmitted in a propagating wave, the encoded instructions being arranged and configured to be read by the computing system for causing the computing system to perform the steps of:

a. receiving in the server subsystem audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. electronically generating in the server subsystem at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. receiving in the server subsystem optical images of the particular set of test question responses;

d. electronically embedding within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question responses were optically imaged;

or

4. the coordinates of the image;

e. selectively moving the electronic images of the particle set of test question responses through one or more individual workflow steps using the individual digital identifier;

f. using the unique batch identifier to track the workflow progress of the electronic images through the individual workflow steps.

24. A computer program product readable by a computing system for a computer process for a computerized test processing workflow a system configured for analyzing electronic images of test question responses provide by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, the computer program product comprising encoded instructions either embedded on a computer-readable media or transmitted in a propagating wave, the encoded instructions being arranged and configured to be read by the computing system for causing the computing system to perform the steps of:

a. receiving in at least one client computer audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. electronically generating in at least one client compute at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. receiving in at least one client computer optical images of the particular set of test question responses;

d. electronically embedding within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question responses were optically imaged;

or

4. the coordinates of the image;

e. selectively moving the electronic images of the particular set of test question responses through one or more individual workflow steps using the individual digital identifier;

f. using the unique batch identifier to track the progress of the electronic images through the individual workflow steps.

25. A computerized test processing workflow system for increasing the volume of test question responses processed by embedding within each electronic image an individual image identifier and configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, the system comprising:

a. means for receiving audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. means for electronically generating at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. an optical imaging device means for electronically imaging the particular set of test question responses;

d. the processing system being further configured with means to electronically embed within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the optical imaging device that was used to generate the electronic image;

2. the unique batch identifier; and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image.

26. A computerized test processing workflow system for increasing the volume of test question responses processed by embedding within each electronic image an individual image identifier and configured for analyzing electronic images of test question responses provided by a test taker, the system comprising a server subsystem having at least one server computer, a client subsystem having a plurality of client computers, and at least one of a plurality of types of optical imaging devices for electronically capturing the test question responses, wherein each type of optical imaging device is electronically identifiable, the system comprising:

a. means for receiving audit information, wherein the audit information comprises information pertaining to the optical imaging device, information pertaining to the type of test question response documents; and

process parameters;

b. means for electronically generating at least one unique batch identifier at the server subsystem, wherein;

1. each unique batch identifier is based on the audit information, and

2. each unique batch identifier corresponds to a particular set of test question responses;

c. a means for electronically imaging the particular set of test question responses;

d. the processing system being further configured with means to electronically embed within each electronic image an individual digital identifier, wherein each individual digital identifier is based on;

1. the scanner that was used to generate the electronic image;

2. the unique batch identifier, and

3. the sequence in which the test question response were optically imaged;

or

4. the coordinates of the image.