Computerized processing of pictorial responses in evaluations

• US 9,099,007 B1
• Filed: 05/14/2012
• Issued: 08/04/2015
• Est. Priority Date: 05/15/2011
• Status: Expired due to Fees

• Current Assignee: Quaest, Inc.
• Original Assignee: Quaest, Inc.
• Inventors: Abumov, Pavel
• Primary Examiner(s): Carter, Aaron W
• Application Number:
  US13/470,980
• Time in Patent Office: 1,177 Days
• Field of Search: 382186-189, 345173-183
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

A system and methods for computerized processing of evaluations containing responses in a pictorial from are disclosed. The system is suitable for interpreting and displaying contextualized responses in evaluations, such as knowledge assessments and surveys. The system includes a collection terminal for obtaining evaluation response data and a processing terminal with memory storing an evaluation template containing processing rules. The processing method locates areas of interest containing pictorial responses and carries out analysis of each area, which includes locating the area within the obtained data, identifying type of the response within the area, and determining value of a response within the area by applying a processing method corresponding to the type of the response. Then the response is recorded in a database and is available for display in a context of an evaluation.

Claims

1. A computerized system for processing of an evaluation containing pictorial responses, comprising:

a collection terminal configured for obtaining in a digital form evaluation response data provided by a plurality of evaluation respondents; and

a processing terminal including a non-volatile memory configured for storing an evaluation template for analyzing at least one area of interest containing a pictorial response within the obtained response data, said processing terminal is electronically coupled to the collection terminal, and said evaluation template specifying location of areas of interest, and the evaluation template includes an image pattern including a set of predefined segments, wherein analyzing includes;

locating the area of interest within the obtained response data;

determining a type of the response within the area of interest from a set of predefined response types, wherein the set of predefined response types includes a first response type associated with marking patterns within the area of interest, and a second response type associated with a set of lines;

determining the type of the response within the area of interest is the second response type; and

determining a value of the response by applying a processing method corresponding to the second type of the response, wherein the value is based on a number of segments from the set of predefined segments that the set of lines within the area of interest overlaps;

whereby different types of responses are consistently processed within the evaluation.

2. The system of claim 1, further comprising a display terminal including an electronic display configured for displaying pictorial response data within an evaluation context using a display template stored in the non-volatile memory of the processing terminal, said display terminal is electronically coupled to the processing terminal.

3. The system of claim 1, wherein said processing method corresponding to the type of the response includes interpretation of the response by a trained editor using an editing terminal, said editing terminal is electronically coupled to the processing terminal.

4. The system of claim 1, wherein said processing method corresponding to the type of the response includes:

associating the response with a set of image patterns specified in the evaluation template;

analyzing a representation of each of the image patterns in the response and associating the value with each representation; and

determining the value of the response based on the values associated with the representations of the image patterns.

5. The system of claim 1, wherein said evaluation includes at least three different types of responses.

6. The system of claim 1, wherein at least one of the collecting terminal and the processing terminal comprise a plurality of geographically distributed computing systems that are capable of transferring the response data using standard data transfer protocols.

7. The system of claim 1, wherein said analyzing is used to update the evaluation template data.

8. A computer-implemented method for processing of pictorial responses in an evaluation, said processing comprising:

using a collection terminal, obtaining in a digital form evaluation response data provided by a plurality of evaluation respondents;

using a computer, identifying a pictorial response within the obtained response data;

using a set of rules specified in an evaluation template;

determining a type of the response from a set of predefined response types, wherein the set of predefined response types includes a first response type associated with marking patterns within the area of interest, and a second response type associated with a set of lines; and

determining a value of the response, said evaluation template including an image pattern including a set of predefined segments, said type of the response within the area of interest including the set of lines, and said value of the response being based on a number of segments from the set of predefined segments that the set of lines within the area of interest overlaps; and

recording the value of the response to a computer-readable media;

whereby different types of responses are processed in a consistent manner.

9. The method of claim 8, further comprising using an electronic display to display the pictorial response within an evaluation context using a display template.

10. The method of claim 8, wherein said determining the value of the response comprises using discretion of a trained editor to interpret the response utilizing an electronic display.

11. The method of claim 8, wherein said determining the value of the response comprises:

associating the response with a set of image patterns specified in the evaluation template;

analyzing a representation of each of the image patterns in the response;

and associating the value with each representation.

12. The method of claim 8, wherein said evaluation includes at least three different types of responses.

13. The method of claim 8, wherein said processing deploys a plurality of geographically distributed computing systems that are capable of transferring the response data using standard data transfer protocols.

14. A computerized system for processing of an evaluation containing pictorial responses, comprising:

a collecting device for obtaining in a digital form evaluation response data provided by a plurality of evaluation respondents, wherein obtaining includes converting the response data to a suitable digital form;

a storing device for storing an evaluation template, said evaluation template specifying location of areas of interest and image patterns associated with pictorial responses; and

an analyzing device for analyzing at least one area of interest containing a pictorial response within the obtained response data using the evaluation template, wherein analyzing includes;

locating the area of interest within the obtained response data;

identifying a pictorial response within the area of interest;

determining a type of the response within the area of interest from a set of predefined response types, wherein the set of predefined response types includes a first response type associated with marking patterns within the area of interest, and a second response type associated with a set of lines;

associating the pictorial response with a type of response, said evaluation template including an image pattern including a set of predefined segments, said pictorial response within the area of interest including the set of lines;

analyzing a representation of each of the image patterns in the response and associate a value with each representation;

determining the value of the response based a number of segments from the set of predefined segments that the set of lines within the area of interest overlaps; and

recording the value of the response to a computer-readable media.

15. The system of claim 14, further comprising a displaying device for displaying the pictorial response within an evaluation context using a display template stored in the storing device, wherein said displaying device include an electronic screen.

16. The system of claim 14, wherein said analyzing device comprise discretion of a trained editor including interpretation of the pictorial response by the trained editor.

17. The system of claim 14, wherein said collection device comprise at least one of a document scanner, an electronic imaging device, an interactive whiteboard, an electronic screen, a touch screen, a drawing pad, a network adapter, a disk controller, and a signal receiver.

18. The system of claim 14, wherein said evaluation includes at least three different types of responses.

19. The system of claim 14, wherein at least one of said collecting device, said storing device, and said analyzing device are geographically distributed.

20. The system of claim 14, wherein said analyzing is used to update the evaluation template data.