Method and system to attribute metadata to preexisting documents

• US 10,325,511 B2
• Filed: 01/30/2015
• Issued: 06/18/2019
• Est. Priority Date: 01/30/2015
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Inventors: Clar, Megan, Gross, Eric Michael, Harte, Eric, Venable, Dennis L., Hamby, Eric S.
• Primary Examiner(s): Hong, Stephen S
• Assistant Examiner(s): Sheffield, Hope C
• Application Number:
  US14/609,820
• Publication Number:
  US 20160224516A1
• Time in Patent Office: 1,600 Days
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
• CPC Class Codes: G09B 7/06 of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 2201/0094 Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception

Abstract

This disclosure provides a method and system to convert a first digital representation of a document including a first format to a second digital representation of the document including a second format. According to an exemplary method, a preexisting printed assessment is scanned to produce an image file and an educational assessment analysis system captures an image area associated with a question, processes the captured image area to automatically assign metadata associated with an independent assessment creation process to the captured image area, which is subsequently processed to generate an assessment based on the assigned metadata which conforms with a format consistent with the independent assessment creation process.

Claims

1. A computer-implemented method of creating an assessment using an educational assessment analysis system including one or more questions to be answered by a student, the method comprising:

a) the educational assessment analysis system acquiring a first digital representation of a preexisting assessment not created with the educational assessment analysis system;

b) the educational assessment system capturing a first area of the first digital representation of the preexisting assessment, the first area selected by a user of the educational assessment analysis system and the first area including text associated with a question to be answered by a student;

c) the educational assessment system assigning metadata to the first area, the metadata including a plurality of one or more predefined user selectable metadata field entries associated with the first area and the plurality of predefined user selectable metadata field entries including metadata field entries generated by a plurality of trained metadata field type classifiers and a plurality of metadata classification category classifiers for each field type classification, each metadata classifier trained using a training set associated with assessments generated by an independent assessment creation process and each metadata field type classifier classifying the first area text as being associated with a single metadata field type and each metadata classification category classifier further classifying the first area text as being associated with two or more classification categories ordered by likelihood and associated with the single metadata field type, and the plurality of predefined user selectable metadata field entries defined by the associated independent document creation process configured to generate assessments based on one of a plurality of predefined assessment models and based on the user inputting the plurality of one or more predefined selectable metadata field entries;

d) the educational assessment system displaying each metadata field populated with a most likely classification category of the ordered classification categories from the metadata classification category classifiers and displaying a user selectable menu listing in order of likelihood other classification categories of the ordered classification categories from the metadata classification category classifiers selectable by a user; and

e) the independent assessment creation process generating a second digital representation of the preexisting assessment based on the first area and the user assigned metadata and processable by the educational assessment analysis system to evaluate questions and associated student answers included in the preexisting assessment,

wherein prior to step e), step a), step b) step c) and step d) are repeated to capture a second area of the first digital representation of the preexisting assessment and assign metadata to the second area, and step d) generates the second digital representation of the preexisting assessment document based on the first area, the first area'"'"'s assigned metadata, the second area, and the second area'"'"'s assigned metadata, and,

wherein the captured first area is associated with one of a distinct first layer and first cell, and the metadata is assigned to one of the first layer and first cell and the captured second area is associated with one of a respective second layer and second cell, and the metadata is assigned to one of the second layer and second cell.

2. The computer-implemented method of creating an assessment according to claim 1, wherein all or part of the metadata is automatically assigned to the first area, step c) comprising:

c1) extracting one or more of numbers, characters, key words and key phrases from the first area, the numbers, characters, key words and key phrases associated with the one or more predefined selectable metadata fields;

c2) accessing the plurality of trained metadata classifiers to determine the plurality of predefined selectable metadata field entries associated with the first area, each of the trained metadata classifiers associated with a respective predefined selectable metadata field entry; and

c3) assigning the determined selectable metadata field entries as metadata associated with the first area.

3. The computer-implemented method of creating an assessment according to claim 2, wherein the plurality of trained metadata classifiers are derived from one or more heuristics applied to the extracted one or more numbers, characters, key words and key phrases from the first area.

4. The computer-implemented method of creating an assessment according to claim 2, wherein the plurality of trained metadata classifiers are trained using a machine learning process including a supervised training set.

5. A computer program product comprising a non-transitory recording medium storing instructions, which when executed on a computer causes the computer to perform the method for converting a first digital representation of a first form assessment document to a second digital representation of the form assessment document according to claim 1.