Systems for Mobile Image Capture and Remittance Processing of Documents on a Mobile Device

• US 20140032406A1
• Filed: 09/30/2013
• Published: 01/30/2014
• Est. Priority Date: 01/18/2008
• Status: Active Grant

• Current Assignee: Mitek Systems Incorporated
• Original Assignee: Mitek Systems Incorporated
• Inventors: Roach, John J., Bell, Kevin Andrew, Rybakov, Oleg
• Granted Patent: US 9,672,510 B2
• Time in Patent Office: Days
• US Class Current: 705/42
• CPC Class Codes: G06Q 20/042 characterized in that the payment protocol involves at least one cheque
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/108 Remote banking, e.g. home banking
• CPC Class Codes: G06Q 20/3223 Realising banking transactions through M-devices
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1475 Inclination or skew detection or correction of characters or of image to be recognised
• CPC Class Codes: G06V 30/162 Quantising the image signal
• CPC Class Codes: G06V 30/166 Normalisation of pattern dimensions
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/001 Sharing resources, e.g. processing power or memory, with a connected apparatus or enhancing the capability of the still picture apparatus
• CPC Class Codes: H04N 2201/0084 Digital still camera

Abstract

Systems and methods are provided for capturing and processing images of remittance coupons using a mobile device and obtaining data from the captured image which is used to set up or carry out payment of a bill that corresponds to the remittance coupon. Optimization and enhancement of image capture and image processing are provided on the mobile device to improve the initial quality of the captured image and provide a user with real time feedback. The image is then sent from the mobile device to a remote server, where additional image processing is performed to improve the quality of the image and then extract data from the image that is relevant to paying the bill. The extracted data may be verified through comparisons with databases which store information on billers, bill formats and other relevant content that will appear on the bill.

Claims

1. A method of capturing and processing an image of a document on a mobile device, comprising:

activating an image capture device on the mobile device;

displaying a plurality of preview frames received from the image capture device in real time on a display of the mobile device;

measuring at least one parameter related to the image capture process with the mobile device; and

automatically capturing at least one image of the document when the value of the at least one parameter meets a threshold value.

2. The method of claim 1, further comprising displaying visual feedback related to the at least one parameter on the display.

3. The method of claim 2, wherein the visual feedback includes a color-changing graphic which changes color as the value of the at least one parameter becomes closer to the threshold value.

4. The method of claim 3, wherein one or more recommendations is provided to help a user adjust the parameters to attain the threshold value.

5. The method of claim 3, wherein the visual feedback includes a rectangular outline configured to match a ration of length to width of the document.

6. The method of claim 4, wherein the size of the rectangular outline corresponds to a threshold size of the document needed before the at least one image can be captured.

7. The method of claim 5, wherein the rectangular outline changes color when edges of the document fit within the rectangular outline.

8. The method of claim 5, wherein the rectangular outline animates when edges of the document fit within the rectangular outline.

9. The method of claim 1, wherein the at least one measured parameter is selected from at least one of:

a steadiness of the mobile device;

a distance of the mobile device from the document, movement of the mobile device, a lighting level of the image being detected, detection of all four corners of the document, a level of focus of the image being detected, a level of reflection of the document, and a size of the document within the image being detected.

10. The method of claim 1, wherein the at least one parameter includes an angle of variance from parallel of the mobile device with respect to the document.

11. The method of claim 10, wherein the at least one image is automatically captured when the angle of variance from parallel of the mobile device is equal or less than a threshold value with respect to the document.

12. The method of claim 11, wherein the threshold value is approximately 5 degrees.

13. The method of claim 1, wherein the at least one parameter includes a brightness level of the preview frames of the document.

14. The method of claim 13, further comprising activating a flash on the mobile device if the brightness level of the preview frames does not meet the threshold level.

15. The method of claim 1, further comprising detecting a level of image quality of the preview frames in real time using an edge detection algorithm.

16. A method of capturing and processing an image of a document on a mobile device, comprising:

activating an image capture device on the mobile device;

displaying a plurality of preview frames received from the image capture device in real time on a display of the mobile device;

measuring at least one parameter related to an image capture process with the mobile device;

automatically capturing at least one image of the document when the value of the at least one parameter meets or exceeds a threshold value;

assessing the quality of the at least one captured image of the document;

transferring the captured image to an image processing unit on the mobile device.

17. The method of claim 16, further comprising requesting that a user of the mobile device perform another image capture process if the quality of the corrected image does not meet the one or more threshold values.

18. The method of claim 16, wherein assessing the quality of the at least one captured image includes performing an edge detection technique.

19. The method of claim 16, wherein performing at least one geometric correction to the at least one captured image includes cropping the at least one captured image.