Techniques for detecting user-entered check marks

• US 9,396,389 B2
• Filed: 10/08/2014
• Issued: 07/19/2016
• Est. Priority Date: 06/25/2014
• Status: Active Grant

• Current Assignee: ABBYY Development LLC
• Original Assignee: ABBYY Development LLC
• Inventors: Kuznetsov, Sergey Anatolyevich
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US14/509,188
• Publication Number:
  US 20150379339A1
• Time in Patent Office: 650 Days
• Field of Search: 382/170, 382/171, 382/190, 382/274, 382/275, 358/3.26, 358/3.27, 358/537, 358/538
• US Class Current: 1/1
• CPC Class Codes: G06V 10/225 based on a marking or identifier characterising the area
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

A digital camera associated with a mobile processing apparatus is used to produce a file containing a 2D digitized image of a document having pre-formatted fields for user'"'"'s check marks. The image is electronically matched to a digital template of the document for extracting digitized images of the pre-formatted fields, which are thereafter analyzed for presence therein of user-entered check marks.

Claims

1. A method of using a mobile processing apparatus to process check marks in a document having pre-formatted fields for entering the check marks, the method comprising:

using a digital camera associated with the apparatus to produce a first electronic file containing a 2D digitized image of the document; and

using the apparatus for;

(a) in the first file, detecting identifiers of the document and markers identifying location and orientation of portions containing the pre-formatted fields;

(b) producing a second file wherein the 2D digitized image is modified to match a digital template of the document;

(c) using the digital template for electronically extracting digitized images of the pre-formatted fields from the second file; and

(d) detecting presence of the check marks in the digitized images of the pre-formatted fields based on analysis therein of non-background pixels.

2. The method of claim 1, wherein:

the apparatus is a mobile phone, a mobile computing device, or a digital camera.

3. The method of claim 1, wherein:

the document is a form, a checklist, a questionnaire, or a plurality thereof; and

the document is a single-page article or a multi-page article which pages are provided with selective identifiers.

4. The method of claim 1, further comprising:

using as the markers (i) pre-selected graphical symbols or graphical images, or (ii) at least a portion of the pre-formatted fields.

5. The method of claim 1, wherein the step (b) further comprises one or more of:

electronically cropping, determining page orientation, correcting perspective distortions and scaling the 2D digitized image of the document.

6. The method of claim 1, wherein the step (c) further comprises:

deleting the second file.

7. The method of claim 1, wherein the step (d) further comprises:

in the extracted digitized images (i) subtracting background pixels and determining if a number of remaining pixels exceeds a first pre-selected threshold, or (ii) determining if a ratio of non-background pixels to all pixels exceeds a second pre-selected threshold.

8. The method of claim 1, wherein the step (d) further comprises:

using the apparatus for saving, in a pre-selected format, results of detecting the detected check marks.

9. The method of claim 1 further comprising performing steps (a)-(d) for a plurality of documents having pre-formatted fields for entering the check marks.

10. The method of claim 9 further comprising accumulating data based on the check marks detected in the plurality of documents, in a pre-selected format;

and analyzing the accumulated data.

11. The method of claim 1, wherein the apparatus are coupled to resources of a computer network or a cloud computing architecture.

12. A platform for processing check marks in a document having pre-formatted fields for entering the check marks, the platform comprising:

a mobile processing apparatus associated with a digital camera adapted to produce a first file containing a 2D digitized image of the document; and

a local processor provided with hardware or software resources configured to perform;

(a) in the first file, detecting identifiers of the document and markers identifying location and orientation of portions containing the pre-formatted fields;

(b) producing a second file wherein the 2D digitized image is modified to match a digital template of the document;

(c) using the digital template for electronically extracting digitized images of the pre-formatted fields from the second file; and

(d) detecting presence of the check marks in the digitized images of the pre-formatted fields based on analysis therein of non-background pixels.

13. The platform of claim 12, wherein:

the apparatus is a mobile phone, a mobile computing device, or a digital camera;

the document is a form, a checklist, a questionnaire, or a plurality thereof;

the document is a single-page article or a multi-page article which pages are provided with selective identifiers;

the check marks are handwritten, stamped or printed check marks; and

results of detecting the check marks are saved, in a pre-selected format, using the apparatus.

14. The platform of claim 12, wherein (i) the markers are pre-selected graphical symbols or graphical images, or (ii) at least a portion of the pre-formatted fields is used as the markers.

15. The platform of claim 12, wherein the local is configured for one or more of electronically cropping, determining page orientation, correcting perspective distortions and scaling the 2D digitized image of the document.

16. The platform of claim 12, wherein the apparatus are coupled to resources of a computer network or a cloud computing architecture.

17. A non-transitory medium storing processor-readable instructions for processing check marks in a document having pre-formatted fields for entering the check marks, the instructions which, responsive to execution in a mobile processing apparatus associated with a digital camera, cause the apparatus to perform:

using the camera to produce a first file containing a 2D digitized image of the document; and

selectively using the apparatus for;

(a) in the first file, detecting identifiers of the document and markers identifying location and orientation of portions containing the pre-formatted fields;

(b) producing a second file wherein the 2D digitized image is modified to match a digital template of the document;

(c) using the digital template for electronically extracting digitized images of the pre-formatted fields from the second file; and

(d) detecting presence of the check marks in the digitized images of the pre-formatted fields based on analysis therein of non-background pixels.

18. The non-transitory medium of claim 17, wherein the instructions further cause:

using as the markers (i) pre-selected graphical symbols or graphical images, or (ii) at least a portion of the pre-formatted fields.

19. The non-transitory medium of claim 17, wherein the instructions for the step (b) further cause one or more of:

electronically cropping, determining page orientation, correcting perspective distortions and scaling the 2D digitized image of the document.

20. The non-transitory medium of claim 17, wherein the instructions for the step (c) further cause:

deleting the second file.

21. The non-transitory medium of claim 17, wherein the instructions for the step (d) further cause:

in the extracted digitized images (i) subtracting background pixels and determining if a number of remaining pixels exceeds a first pre-selected threshold, or (ii) determining if a ratio of non-background pixels to all pixels exceeds a second pre-selected threshold.

22. The non-transitory medium of claim 17, wherein the instructions for the step (d) further cause:

using the apparatus for saving, in a pre-selected format, results of detecting the detected check marks.