Systems and methods for capturing images using a mobile device

• US 9,160,946 B1
• Filed: 01/21/2015
• Issued: 10/13/2015
• Est. Priority Date: 01/21/2015
• Status: Active Grant

• Current Assignee: A2iA Corporation (Mitek Systems Incorporated)
• Original Assignee: A2iA Corporation (Mitek Systems Incorporated)
• Inventors: Semenov, Andrey V., Anisimov, Valery, Sashov, Sergey N., Gorski, Nikolai D.
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US14/601,437
• Time in Patent Office: 265 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/403 Edge-driven scaling; Edge-based scaling
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction

Abstract

The systems and methods of the present disclosure enable a user to use a mobile device to automatically capture a high resolution image of a rectangular object. The methods include capturing a low resolution image of the rectangular object and detecting edges of the rectangular object in the low resolution image, where the edges form a quadrangle, calculating a coordinate of each corner of the quadrangle, calculating an average coordinate of each corner of the quadrangle in a most recent predetermined number of low resolution images, calculating a dispersion of each corner of the quadrangle in the most recent predetermined number of low resolution images from a corresponding coordinate of each calculated average coordinate, determining whether the dispersion of each corner of the quadrangle is less than a predetermined value, capturing a high resolution image of the rectangular object when it is determined that the dispersion of each corner of the quadrangle is less than the predetermined value, and geometrically transforming the quadrangle of the rectangular object in the high resolution image into a rectangle.

Claims

1. A method for controlling a camera of a mobile device to automatically capture images of a rectangular object, the method comprising:

capturing a low resolution image of the rectangular object;

detecting edges of the rectangular object in the low resolution image, the edges forming a quadrangle;

calculating a coordinate of each corner of the quadrangle;

calculating an average coordinate of each corner of the quadrangle in a most recent predetermined number of low resolution images;

calculating a dispersion of each corner of the quadrangle in the most recent predetermined number of low resolution images from a corresponding coordinate of each calculated average coordinate;

determining whether the dispersion of each corner of the quadrangle is less than a predetermined value;

capturing a high resolution image of the rectangular object when it is determined that the dispersion of each corner of the quadrangle is less than the predetermined value; and

geometrically transforming the quadrangle of the rectangular object in the high resolution image into a rectangle.

2. The method according to claim 1, wherein the low resolution image is captured after locking onto the rectangular object using an autofocus process.

3. The method according to claim 1, wherein the coordinate is based on a pixel location within the low resolution image.

4. The method according to claim 1, wherein the low resolution image is a video image and the high resolution image is a still image.

5. The method according to claim 1, wherein the rectangular object is a card, document, financial note, drawing, photo, or planar object.

6. The method according to claim 1, wherein the edges are detected based on high-brightness gradients.

7. The method according to claim 1, wherein each corner of the quadrangle is an intersecting point of two of the detected edges.

8. The method according to claim 1, wherein the dispersion for each corner is a mean difference, standard deviation, variance, or other statistical measure.

9. The method according to claim 1, further comprising displaying boundaries surrounding the quadrangle after detecting the edges.

10. The method according to claim 9, wherein the boundaries surrounding the quadrangle are displayed in a color.

11. The method according to claim 1, further comprising displaying boundaries surrounding the quadrangle of the high resolution image.

12. The method according to claim 11, wherein the boundaries surrounding the quadrangle are based on the average coordinates of each corner of the quadrangle of the most recent predetermined number of low resolution images.

13. The method according to claim 12, further comprising calculating a coordinate of each corner of the boundaries surrounding the quadrangle by multiplying the average coordinates with a resolution ratio between a resolution of the low resolution image and a resolution of the high resolution image.

14. The method according to claim 11, wherein the boundaries surrounding the quadrangle are displayed in a color.

15. The method according to claim 1, further comprising removing a portion outside of the quadrangle of the rectangular object in the high resolution image.

16. A mobile device comprising:

an image capturing device configured to capture a low resolution image and a high resolution image;

a display unit coupled to the image capturing device and configured to display the captured low and high resolution images;

a processor coupled to the display unit; and

a memory coupled to the image capturing device and the processor, the memory configured to store the captured low and high resolution images and instructions, that, when executed by the processor, cause the processor to;

detect edges of a rectangular object in low resolution images of the rectangular object, the edges forming a quadrangle;

calculate a coordinate of each corner of the quadrangle;

calculate an average coordinate of each corner of the quadrangle in a most recent predetermined number of low resolution images;

calculate a dispersion of each corner of the quadrangle in the most recent predetermined number of low resolution images from a corresponding coordinate of each calculated average coordinate;

determine whether the dispersion of each corner of the quadrangle is less than a predetermined value;

cause the image capturing device to automatically capture a high resolution image of the rectangular object when it is determined that the dispersion of each corner is less than the predetermined value; and

geometrically transform the quadrangle of the rectangular object in the high resolution image into a rectangle.

17. The mobile device according to claim 16, wherein the memory further includes instructions that, when executed by the processor, cause the processor to send a control signal that triggers the image capturing device to capture the high resolution image of the rectangular object.

18. The mobile device according to claim 16, further comprising a button configured to receive an input to start the image capturing device to capture a low resolution image of the rectangular object.

19. The mobile device according to claim 16, wherein the memory further includes instructions that, when executed by the processor, cause the processor to detect the edges of the rectangular object after the image capturing device locks an auto-focus of the rectangular object.

20. The mobile device according to claim 16, wherein the memory further includes instructions that, when executed by the processor, cause the processor to instruct the display unit to display boundaries of the quadrangle based on the average coordinates in a color before it is determined that the dispersion of each corner of the quadrangle is less than the predetermined value.

21. The mobile device according to claim 16, wherein the memory further includes instructions that, when executed by the processor, cause the processor to instruct the display unit to display boundaries of the quadrangle based on the average coordinates in a predetermined color after it is determined that the dispersion of each corner of the quadrangle is less than the predetermined value.

22. A method for controlling a camera of a mobile device to automatically capture images of a polygon-shaped object, the method comprising:

capturing a low resolution image of the polygon-shaped object;

detecting edges of the polygon-shaped object in the low resolution image, the edges forming an irregular polygon;

calculating a coordinate of each corner of the irregular polygon;

calculating an average coordinate of each corner of the irregular polygon in a most recent predetermined number of low resolution images;

calculating a dispersion of each corner of the irregular polygon in the most recent predetermined number of low resolution images from a corresponding coordinate of each calculated average coordinate;

determining whether the dispersion of each corner of the irregular polygon is less than a predetermined value;

capturing a high resolution image of the polygon-shaped object when it is determined that the dispersion of each corner of the irregular polygon is less than the predetermined value; and

geometrically transforming the irregular polygon of the polygon-shaped object in the high resolution image into a regular polygon.