SYSTEMS AND METHODS FOR DETECTING AND CLASSIFYING OBJECTS IN VIDEO CAPTURED USING MOBILE DEVICES

• US 20170104885A1
• Filed: 12/22/2016
• Published: 04/13/2017
• Est. Priority Date: 05/03/2013
• Status: Active Grant

• Current Assignee: Kofax Incorporated
• Original Assignee: Kofax Incorporated
• Inventors: Amtrup, Jan W., Ma, Jiyong, Macciola, Anthony
• Granted Patent: US 9,819,825 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06V 2201/09 Recognition of logos
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: H04N 1/00251 with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00801 according to characteristics of the original
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 2201/0032 where the still picture apparatus acts as the slave
• CPC Class Codes: H04N 2201/0075 by a user operated remote control device, e.g. receiving instructions from a user via a computer terminal or mobile telephone handset
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0458 Additional arrangements for improving or optimising scanning resolution or quality
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/265 Mixing

Abstract

In one embodiment, a system includes a processor and logic executable by the processor. The logic is configured to cause the processor to: capture video data using a mobile device, the video data comprising a plurality of frames; determine whether one or more of the frames depict a document exhibiting one or more defining characteristics; determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document. Corresponding computer program products are also disclosed.

Claims

1. A system, comprising a processor and logic executable by the processor, the logic being configured to cause the processor to:

capture video data using a mobile device, the video data comprising a plurality of frames;

determine whether one or more of the frames depict a document exhibiting one or more defining characteristics;

determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and

in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document.

2. The system as recited in claim 1, wherein the image is characterized by a resolution higher than a resolution of any of the plurality of frames.

3. The system as recited in claim 1, wherein the defining characteristics comprise one or more of:

a document shape;

a document contour;

one or more document dimensions; and

a document color profile.

4. The system as recited in claim 1, wherein determining whether one or more of the frames depict the document comprises performing optical character recognition (OCR).

5. The system as recited in claim 1, wherein the defining characteristics comprise one or more of:

textual information depicted on the document;

a photograph depicted on the document;

a barcode depicted on the document;

a logo depicted on the document;

an emblem depicted on the document;

a seal depicted on the document; and

an aspect ratio of the document.

6. The system as recited in claim 1, wherein the document corresponds to a loan application;

and

wherein the defining characteristics comprise the document depicting one or more of;

a customer name;

a guarantor name;

a customer address;

a date;

an account number

a loan number;

a digital signature;

a handwritten signature; and

a photograph.

7. The system as recited in claim 1, wherein the document comprises one or more of:

a receipt;

an expense report;

a credit card; and

a check; and

wherein the defining characteristics comprise the document depicting one or more of;

a credit card number;

a name;

an expense amount; and

an order number.

8. The system as recited in claim 1, wherein the document corresponds to an insurance claim;

and

wherein the defining characteristics comprise the document depicting one or more of;

a photograph of an automobile;

a photograph of an accident report;

a photograph of a proof of insurance document;

a photograph of a driver'"'"'s license;

a photograph of a quote; and

a signature.

9. The system as recited in claim 1, wherein the document corresponds to a delivery;

and

wherein the defining characteristics comprise the document depicting one or more of;

a signature;

a proof of delivery;

a package number;

a photograph of a package; and

a declaration of package contents.

10. The system as recited in claim 1, wherein the document corresponds to an educational program application;

and

wherein the defining characteristics comprise the document depicting one or more of;

an applicant name;

a photograph of the applicant; and

a student identification document.

11. A computer program product, comprising a computer readable storage medium having embodied therewith computer readable program code configured to cause a processor to:

capture video data using a mobile device, the video data comprising a plurality of frames;

determine whether one or more of the frames depict a document exhibiting one or more defining characteristics;

determine whether one or more of the frame(s) determined to depict the document also satisfy one or more predetermined quality control criteria; and

in response to determining one or more of the frames depict the document and also satisfy the one or more predetermined quality control criteria, automatically capture an image of the document.

12. The computer program product as recited in claim 11, wherein the image is characterized by a resolution higher than a resolution of any of the plurality of frames.

13. The computer program product as recited in claim 11, wherein the defining characteristics comprise one or more of:

a document shape;

a document contour;

one or more document dimensions; and

a document color profile.

14. The computer program product as recited in claim 11, wherein determining whether one or more of the frames depict the document comprises performing optical character recognition (OCR).

15. The computer program product as recited in claim 11, wherein the defining characteristics comprise one or more of:

textual information depicted on the document;

a photograph depicted on the document;

a barcode depicted on the document;

a logo depicted on the document;

an emblem depicted on the document;

a seal depicted on the document; and

an aspect ratio of the document.

16. The computer program product as recited in claim 11, wherein the document corresponds to a loan application;

and

wherein the defining characteristics comprise the document depicting one or more of;

a customer name;

a guarantor name;

a customer address;

a date;

an account number

a loan number;

a digital signature;

a handwritten signature; and

a photograph.

17. The computer program product as recited in claim 11, wherein the document comprises one or more of:

a receipt;

an expense report;

a credit card; and

a check; and

wherein the defining characteristics comprise the document depicting one or more of;

a credit card number;

a name;

an expense amount; and

an order number.

18. The computer program product as recited in claim 11, wherein the document corresponds to an insurance claim;

and

wherein the defining characteristics comprise the document depicting one or more of;

a photograph of an automobile;

a photograph of an accident report;

a photograph of a proof of insurance document;

a photograph of a driver'"'"'s license;

a photograph of a quote; and

a signature.

19. The computer program product as recited in claim 11, wherein the document corresponds to a delivery;

and

wherein the defining characteristics comprise the document depicting one or more of;

a signature;

a proof of delivery;

a package number;

a photograph of a package; and

a declaration of package contents.

20. The computer program product as recited in claim 11, wherein the document corresponds to an educational program application;

and

wherein the defining characteristics comprise the document depicting one or more of;

an applicant name;

a photograph of the applicant; and

a student identification document.