Methods for mobile image capture and processing of checks

• US 8,000,514 B2
• Filed: 12/30/2008
• Issued: 08/16/2011
• Est. Priority Date: 01/18/2008
• Status: Active Grant

• Current Assignee: Mitek Systems Incorporated
• Original Assignee: Mitek Systems Incorporated
• Inventors: Nepomniachtchi, Grigori, DeBello, James
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): MOTSINGER, SEAN T
• Application Number:
  US12/346,047
• Publication Number:
  US 20090185738A1
• Time in Patent Office: 959 Days
• Field of Search: 382137-140, 705 39- 45, 235/379
• US Class Current: 382/137
• CPC Class Codes: G06Q 20/042 characterized in that the payment protocol involves at least one cheque
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/108 Remote banking, e.g. home banking
• CPC Class Codes: G06V 10/20 Image preprocessing
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00816 Determining the reading area, e.g. eliminating reading of margins
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/403 Discrimination between the two tones in the picture signal of a two-tone original
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/001 Sharing resources, e.g. processing power or memory, with a connected apparatus or enhancing the capability of the still picture apparatus

Abstract

The present invention relates to automated document processing and more particularly, to methods and systems for document image capture and processing using mobile devices. In accordance with various embodiments, methods and systems for document image capture on a mobile communication device are provided such that the image is optimized and enhanced for data extraction from the document as depicted. These methods and systems may comprise capturing an image of a document using a mobile communication device; transmitting the image to a server; and processing the image to create a bi-tonal image of the document for data extraction. Additionally, these methods and systems may comprise capturing a first image of a document using the mobile communication device; automatically detecting the document within the image; geometrically correcting the image; binarizing the image; correcting the orientation of the image; correcting the size of the image; and outputting the resulting image of the document.

Claims

1. A method for mobile image capture and processing for checks, comprising:

capturing a first image of a check using the mobile communication device;

automatically detecting the check within the first image using a processor the first communication device, wherein detecting the check within the first image further comprises

converting the first image to a color icon image, wherein the first image is in color;

reducing color within the color icon image, resulting in a gray-scale icon image; and

determining a plurality of corners belonging to the check within the first image;

geometrically correcting the first image using the processor of the communication device, resulting in a second image;

transmitting the second image to a server;

binarizing the second image using a processor of the server, resulting in a third image;

correcting the orientation of the third image using the processor of the server, resulting in a fourth image; and

outputting the fourth image of the check.

2. The method of claim 1, wherein automatically detecting the check comprises determining a plurality of corners belonging to the check within the first image.

3. The method of claim 1, wherein geometrically correcting the first image comprises:

reducing color within the first image, wherein the first image is in color and the color reduction of the first image results in a first gray-scale image;

building a projective transformation model, wherein the projective transformation model maps the check within the first gray-scale image to a gray-scale check image;

applying the projective transformation model to the first image, resulting in the second image as a gray-scale check image.

4. The method of claim 3, wherein geometrically correcting the first image further comprises:

correcting the orientation of the check within a gray-scale icon image if the check within the first image is in landscape orientation; and

building the projective transformation model from the gray-scale icon image.

5. The method of claim 1, wherein the third image comprises a bi-tonal image.

6. The method of claim 1, wherein correcting the orientation of the third image comprises correcting the orientation of the check within the third image if the check is in upside-down orientation.

7. The method of claim 6, wherein correcting the orientation of the third image further comprises determining the orientation of the check within the third image using an MICR-line on the check.

9. The method of claim 1, wherein outputting the fourth image of the document comprises outputting a bi-tonal image of the document.

10. The method of claim 1, wherein the mobile communication device is a camera phone.

8. A computer-implemented method for mobile image capture and processing for checks, wherein one or more processors are programmed to perform the steps comprising:

receiving a first image of a check from a mobile communication device;

automatically detecting the check within the first image;

geometrically correcting the first image, resulting in a second image;

binarizing the second image, resulting in a third image;

correcting the orientation of the third image, resulting in a fourth image; and

correcting the size of the fourth image using the processor of the server, resulting in a fifth image, wherein correcting the size of the fourth image comprises;

reading an MICR-line at the bottom of the check within the fourth image;

computing an average width of MICR-characters within the MICR-line;

computing a scaling factor based on the average width of the MICR-characters;

using the scaling factor to determine whether the fourth image needs a size correction;

applying a size correction to the first image, resulting in a resized image;

geometrically correcting the resized image, resulting in a corrected image; and

binarizing the corrected image, resulting in a binarized image;

outputting the corrected image of the check.

11. A computer program product comprising a non-transitory computer readable medium having computer program code embodied therein for enabling a computing device to perform the operations of:

receiving a color image of a document from a mobile device, the color image being captured using an image capture device of the mobile device;

detecting the financial document in the color image;

geometrically correcting the color image and generating a gray-scale image;

binarizing the gray-scale image to produce a bi-tonal image correcting the orientation of the bi-tonal image;

correcting the size of the bi-tonal image using the processor of the server, wherein correcting the size of the bi-tonal image comprises;

reading an MICR-line at the bottom of the check within the bi-tonal image;

computing an average width of MICR-characters within the MICR-line;

computing a scaling factor based on the average width of the MICR-characters;

using the scaling factor to determine whether the fourth image needs a size correction;

applying a size correction to the color image, resulting in a resized image;

geometrically correcting the resized image, resulting in a corrected image;

binarizing the corrected image, resulting in a corrected binarized image; and

outputting the corrected binarized image.

12. A computer-implemented method for image capture and processing of checks, wherein one or more processors are programmed to perform steps comprising:

receiving a color image of a check from a mobile device, the color image being captured using an image capture device of the mobile device;

detecting the check in the color image;

geometrically correcting the color image and generate a gray-scale image,

binarizing the gray-scale image to produce a bi-tonal image,

correcting the orientation of the bi-tonal image, wherein correcting the orientation further comprises;

reading an MICR line on the bottom of the financial document;

generating a MICR confidence value for the MICR line as read;

comparing the MICR confidence value to a threshold;

when the MICR confidence value exceeds the threshold, determining that the bi-tonal image is right-side up; and

when the MICR confidence value does not exceed the threshold;

determining that the bi-tonal image is not right side up,

rotating the image 180 degrees,

re-reading the MICR line,

generating a new MICR confidence value,

comparing the new MICR confidence value to the previous MICR confidence value,

when the new MICR confidence value exceeds the first MICR confidence value, determining that the rotated, bi-tonal image is right side up, and

when the new MICR confidence value does not exceeds the first MICR confidence value, determining that the original un-rotated, bi-tonal image is right side up, and

correct the size of the bi-tonal image.

13. The method of claim 12, wherein detecting the check in the color image further comprises:

converting the color image into a smaller color image;

performing color depth reduction on the smaller color image to generate a small gray-scale image; and

determining check corner positions for the check in the smaller grey-scale image.

14. The method of claim 13, wherein converting the color image into a smaller color image further comprises:

eliminating over-sharpening in the color image;

eliminating small dark objects in the color image; and

suppressing high local contrast objects in the color image.

15. The method of claim 13, wherein performing color depth reduction on the smaller color image further comprises:

dividing the smaller color image into a grid;

computing an average color for a central part of the smaller image;

computing an average color for the remainder of the smaller color image;

finding a linear transformation by mapping the central part color on white and mapping the color for the rest of the smaller image on black; and

transforming RGB values for the image into gray-shades to produce a smaller gray image.

16. The method of claim 15, further comprising:

find voting points in the smaller gray image for each side of the check;

find side candidates for the check based on the voting points;

choose best side candidates from the side candidates; and

determine document corner positions for the check based on the best side candidates.

17. The method of claim 16, wherein geometrically correcting the color image and generating a geometrically corrected gray-scale image further comprises:

reducing the color depth of the color image;

generating a gray-scale image corresponding to the color image;

applying perspective transformation to the interior of a quadrangle comprising found document corner positions included in the gray-scale image.

18. The method of claim 17, wherein geometrically correcting the color image and generating a geometrically corrected gray-scale image further comprises:

correcting the landscape orientation of the smaller gray-scale image based on the determined document corner positions;

building a projective transformation model of the smaller gray-scale image; and

applying perspective transformation to the interior of a quadrangle include in the smaller gray-scale image.

19. The method of claim 12, wherein binarizing the geometrically corrected image to produce a bi-tonal image further comprises:

choosing a pixel on the gray-scale image;

computing an average value and standard deviation for the chosen pixel;

whether the standard deviation is too small and if it is too small then converting the chosen pixel to white and if it is not too small then converting the chosen pixel to black or white based on the intensity; and

choosing another pixel an repeating the computing and determining steps until there are no more pixels to chose.

20. A computer-implemented method for image capture and processing of checks, wherein one or more processors are programmed to perform steps comprising:

receiving a color image of a check from a mobile device, the color image being captured using an image capture device of the mobile device;

detecting the check in the color image;

geometrically correcting the color image and generate a gray-scale image,

binarizing the gray-scale image to produce a bi-tonal image,

correcting the orientation of the bi-tonal image, and

correcting the size of the bi-tonal image, wherein correcting the size of the bi-tonal image further comprises;

reading an MICR line on the bottom of the check;

computing an average width of the MICR characters;

computing a scaling factor;

when the scaling factor is not greater than a threshold, outputting the bi-tonal image; and

when the scaling factor is greater than a threshold;

repeating geometric correction and binarization using recomputed dimensions for the check; and

outputting the bi-tonal image.