SYSTEMS AND METHODS FOR CLASSIFYING OBJECTS IN DIGITAL IMAGES CAPTURED USING MOBILE DEVICES

• US 20140270349A1
• Filed: 03/13/2013
• Published: 09/18/2014
• Est. Priority Date: 03/13/2013
• Status: Active Grant

• Current Assignee: Tungsten Automation Corp.
• Original Assignee: Kofax Incorporated
• Inventors: Amtrup, Jan Willers, Macciola, Anthony, Thompson, Steve, Ma, Jiyong, Shustorovich, Alexander, Thrasher, Christopher W.
• Granted Patent: US 9,355,312 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06V 10/247 by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors

Abstract

In one embodiment, a method includes receiving a digital image captured by a mobile device; and using a processor of the mobile device: generating a first representation of the digital image, the first representation being characterized by a reduced resolution; generating a first feature vector based on the first representation; comparing the first feature vector to a plurality of reference feature matrices; and classifying an object depicted in the digital image as a member of a particular object class based at least in part on the comparing.

Claims

1. A method, comprising:

receiving a digital image captured by a mobile device; and

using a processor of the mobile device;

generating a first representation of the digital image, the first representation being characterized by a reduced resolution;

generating a first feature vector based on the first representation;

comparing the first feature vector to a plurality of reference feature matrices; and

classifying an object depicted in the digital image as a member of a particular object class based at least in part on the comparing.

2. The method as recited in claim 1, wherein generating the first representation comprises:

dividing the digital image into a plurality of sections; and

determining, for each section, at least one characteristic value, each characteristic value corresponding to one or more features descriptive of the section.

3. The method as recited in claim 2, wherein the first representation comprises a plurality of pixels,

wherein each of the plurality of pixels corresponds to one section of the plurality of sections, and

wherein each of the plurality of pixels is characterized by the at least one characteristic value determined for the corresponding section.

4. The method as recited in claim 1, wherein the digital image comprises a cropped, color image.

5. The method as recited in claim 1, wherein one or more of the reference feature matrices comprises a plurality of feature vectors, and

wherein each feature vector corresponds to at least one characteristic of an object.

6. The method as recited in claim 1, wherein the comparing comprises an N-dimensional comparison, and

wherein N is greater than 50.

7. The method as recited in claim 1, wherein the first feature vector is characterized by a feature vector length greater than 500.

8. The method as recited in claim 1, further comprising:

determining one or more object features of the object based at least in part on the particular object class.

9. The method as recited in claim 1, further comprising:

detecting the object depicted in the digital image based at least in part on the classifying and/or result thereof.

10. The method as recited in claim 1, further comprising:

rectangularizing the object depicted in the digital image based at least in part on the classifying and/or result thereof.

11. The method as recited in claim 1, further comprising:

cropping the digital image based at least in part on the classifying and/or result thereof.

12. The method as recited in claim 1, further comprising binarizing the digital image based at least in part on the classifying and/or result thereof.

13. The method as recited in claim 12, wherein the binarizing comprises:

determining an object class color scheme;

adjusting one or more binarization parameters based on the object class color scheme; and

thresholding the digital image using the one or more adjusted binarization parameters.

14. The method as recited in claim 12, wherein the binarizing comprises:

determining an object class mask;

applying the object class mask to the digital image; and

thresholding a subregion of the digital image based on the object class mask.

15. The method as recited in claim 14, wherein the binarizing further comprises:

adjusting one or more binarization parameters based on the object class mask; and

thresholding the digital image using the one or more adjusted binarization parameters.

16. The method as recited in claim 1, further comprising:

determining a geographical location associated with the mobile device,

wherein the classifying is further based at least in part on the geographical location.

17. The method as recited in claim 1, further comprising:

outputting an indication of the particular object class to a display of the mobile device; and

receiving user input via the display of the mobile device in response to outputting the indication.

18. The method as recited in claim 1, further comprising:

determining one or more object features of the object based at least in part on the particular object class.

19. A method, comprising:

generating a first feature vector based on a digital image captured by a mobile device;

comparing the first feature vector to a plurality of reference feature matrices;

classifying an object depicted in the digital image as a member of a particular object class based at least in part on the comparing; and

determining one or more object features of the object based at least in part on the particular object class; and

performing at least one processing operation using a processor of a mobile device, the at least one processing operation selected from a group consisting of;

detecting the object depicted in the digital image based at least in part on the one or more object features;

rectangularizing the object depicted in the digital image based at least in part on the one or more object features;

cropping the digital image based at least in part on the one or more object features; and

binarizing the digital image based at least in part on the one or more object features.

20. The method as recited in claim 19, wherein the one or more object features comprise an object color scheme, and

wherein the binarizing comprises:

determining the object color scheme;

adjusting one or more binarization parameters based on the processing; and

thresholding the digital image using the one or more adjusted binarization parameters.

21. The method as recited in claim 19, wherein the one or more object features comprise an object class mask, and

wherein the binarizing comprises:

determining the object class mask;

applying the object class mask to the digital image; and

thresholding a subregion of the digital image based on the object class mask.

22. The method as recited in claim 21, wherein the one or more object features further comprise an object color scheme, and

wherein the binarizing comprises:

determining the object color scheme;

adjusting one or more binarization parameters based on the processing; and

thresholding the digital image using the one or more adjusted binarization parameters.

23. A system, comprising:

a processor; and

logic in and/or executable by the processor to cause the processor to;

generate a first representation of a digital image captured by a mobile device;

generate a first feature vector based on the first representation;

compare the first feature vector to a plurality of reference feature matrices; and

classify an object depicted in the digital image as a member of a particular object class based at least in part on the comparison.

24. A computer program product comprising:

a computer readable storage medium having program code embodied therewith, the program code readable/executable by a processor to;

generate a first representation of a digital image captured by a mobile device;

generate a first feature vector based on the first representation;

compare the first feature vector to a plurality of reference feature matrices; and

classify an object depicted in the digital image as a member of a particular object class based at least in part on the comparison.