Systems and methods for capturing images using a mobile device

• US 9,628,709 B2
• Filed: 10/13/2015
• Issued: 04/18/2017
• Est. Priority Date: 01/21/2015
• Status: Active Grant

• Current Assignee: A2iA Corporation (Mitek Systems Incorporated)
• Original Assignee: A2iA Corporation (Mitek Systems Incorporated)
• Inventors: Semenov, Andrey V., Anisimov, Valery, Sashov, Sergey N., Gorski, Nikolai D.
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US14/881,491
• Publication Number:
  US 20160212342A1
• Time in Patent Office: 553 Days
• Field of Search: None
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/403 Edge-driven scaling; Edge-based scaling
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction

Abstract

The systems and methods of the present disclosure enable a user to use a mobile device to automatically capture a high resolution image of a rectangular object. The methods include capturing a low resolution image of the rectangular object and detecting edges of the rectangular object in the low resolution image, where the edges form a quadrangle, calculating a coordinate of each corner of the quadrangle, calculating an average coordinate of each corner of the quadrangle in a most recent predetermined number of low resolution images, calculating a dispersion of each corner of the quadrangle in the most recent predetermined number of low resolution images from a corresponding coordinate of each calculated average coordinate, determining whether the dispersion of each corner of the quadrangle is less than a predetermined value, capturing a high resolution image of the rectangular object when it is determined that the dispersion of each corner of the quadrangle is less than the predetermined value, and geometrically transforming the quadrangle of the rectangular object in the high resolution image into a rectangle.

Claims

1. A method for controlling a camera of a mobile device to automatically capture images of a rectangular object, the method comprising:

capturing a video stream including low resolution images of the rectangular object;

calculating a coordinate of each corner of a quadrangle in each frame of the video stream;

calculating a statistical measure for deviation of the coordinate of each corner of the quadrangle in each frame of the video stream;

capturing a high resolution image of the rectangular object based on the statistical measure; and

geometrically transforming a quadrangle of the rectangular object in the high resolution image into a rectangle.

2. The method according to claim 1, wherein the video stream is captured after locking onto the rectangular object using an autofocus process.

3. The method according to claim 1, wherein the coordinate is based on a pixel location within the video stream.

4. The method according to claim 1, wherein the high resolution image is a still image.

5. The method according to claim 1, wherein the rectangular object is a card, document, financial note, drawing, photo, or planar object.

6. The method according to claim 1, wherein edges of the quadrangle in each frame of the video stream are detected based on high-brightness gradients.

7. The method according to claim 1, wherein the statistical measure is a mean difference, standard deviation, or variance.

8. The method according to claim 1, further comprising displaying boundaries surrounding the quadrangle in each frame of the video stream.

9. The method according to claim 8, wherein the boundaries surrounding the quadrangle in each frame of the video stream are displayed in a color.

10. The method according to claim 1, further comprising displaying boundaries surrounding the quadrangle of the rectangular object in the high resolution image.

11. The method according to claim 10, wherein the boundaries surrounding the quadrangle of the rectangular object in the high resolution image are based on the statistical measure of the coordinate of each corner of the quadrangle in each frame of the video stream.

12. The method according to claim 10, wherein the boundaries surrounding the quadrangle of the rectangular object in the high resolution image are displayed in a color.

13. The method according to claim 1, further comprising removing a portion outside of the quadrangle of the rectangular object in the high resolution image.

14. A mobile device comprising:

an image capturing device configured to capture a video stream including low resolution images, and capture a high resolution image;

a display unit coupled to the image capturing device and configured to display the captured video stream and high resolution image;

a processor coupled to the display unit; and

a memory coupled to the image capturing device and the processor, the memory configured to store the captured low and high resolution images and instructions, that, when executed by the processor, cause the processor to;

cause the image capturing device to capture the video stream including the low resolution images of a rectangular object;

calculate a coordinate of each corner of a quadrangle of the rectangular object in each frame of the video stream;

calculate a statistical measure for deviation of the coordinate of each corner of the quadrangle in each frame of the video stream;

cause the image capturing device to automatically capture a high resolution image of the rectangular object based on the statistical measure; and

geometrically transform a quadrangle of the rectangular object in the high resolution image into a rectangle.

15. The mobile device according to claim 14, wherein the memory further includes instructions that, when executed by the processor, cause the processor to send a control signal that triggers the image capturing device to capture the high resolution image of the rectangular object.

16. The mobile device according to claim 14, further comprising a button configured to receive an input to start the image capturing device to capture the video stream of the rectangular object.

17. The mobile device according to claim 14, wherein the memory further includes instructions that, when executed by the processor, cause the processor to capture the video stream after the image capturing device locks an auto-focus of the rectangular object.

18. The mobile device according to claim 14, wherein the memory further includes instructions that, when executed by the processor, cause the processor to instruct the display unit to display boundaries of the quadrangle of the rectangular object in the high resolution image based on the statistical measure.

19. The mobile device according to claim 14, wherein the memory further includes instructions that, when executed by the processor, cause the processor to instruct the display unit to display boundaries of the quadrangle in each frame of the video stream.

20. A method for controlling a camera of a mobile device to automatically capture images of a polygon-shaped object, the method comprising:

capturing a video stream including low resolution images of the polygon-shaped object;

calculating a coordinate of each corner of an irregular polygon in each frame of the video stream;

calculating a statistical measure for deviation of the coordinate of each corner of the irregular polygon of the polygon-shaped object in each frame of the video stream;

capturing a high resolution image of the polygon-shaped object based on the statistical measure; and

geometrically transforming the irregular polygon of the polygon-shaped object in the high resolution image into a regular polygon.