Dynamically optimizing photo capture for multiple subjects

• US 10,460,191 B1
• Filed: 08/20/2018
• Issued: 10/29/2019
• Est. Priority Date: 08/20/2018
• Status: Active Grant

• Current Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Original Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Inventors: Pribble, Jason, Jarvis, Daniel Alan, Capurso, Nicholas
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US15/998,988
• Time in Patent Office: 435 Days
• Field of Search: None
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 30/1478 of characters or characters lines
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04N 1/38 Circuits or arrangements for blanking or otherwise eliminating unwanted parts of pictures H04N1/387 takes precedence
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/40068 Modification of image resolution, i.e. determining the values of picture elements at new relative positions H04N1/3935 takes precedence

Abstract

A user device detects, in a field of view of the camera, a first side of a document, and determines first information associated with the first side of the document. The user device selects a first image resolution based on the first information and captures, by the camera, a first image of the first side of the document according to the first image resolution. The user device detects, in the field of view of the camera, a second side of the document, and determines second information associated with the second side of the document. The user device selects a second image resolution based on the second information, and captures, by the camera, a second image of the second side of the document according to the second image resolution. The user device performs an action related to the first image and the second image.

Claims

1. A method, comprising:

determining, by a user device, a plurality of image resolutions supported by a camera of the user device;

determining, by the use device, a screen aspect ratio of a display of the user device;

capturing, by the camera of the user device, a first preview image;

processing, by the user device, the first preview image using a first computer vision technique;

detecting, by the user device and based on processing the first preview image, a first side of a document;

determining, by the user device and based on processing the first preview image, first information associated with the first side of the document;

selecting, by the user device and based on the first information, a first image resolution of the plurality of image resolutions;

capturing, by the camera of the user device, a first image of the first side of the document according to the first image resolution;

capturing, by the camera of the user device, a second preview image;

processing, by the user device, the second preview image using a second computer vision technique;

detecting, by the user device and based on processing the second preview image, a second side of the document;

determining, by the user device and based on processing the second preview image, second information associated with the second side of the document;

determining, by the user device, a threshold image resolution based on the second information;

determining, by the user device and based on the screen aspect ratio, a set of image resolutions of the plurality of image resolutions that fit the display of the user device;

selecting, by the user device and based on the second information, a second image resolution from the set of image resolutions,

wherein the second image resolution corresponds to a different quality of image than the first image resolution, and

wherein the second image resolution satisfies the threshold image resolution;

capturing, by the camera of the user device, a second image of the second side of the document according to the second image resolution; and

performing, by the user device, an action related to the first image and the second image.

2. The method of claim 1, wherein determining the first information associated with the first side of the document comprises:

determining the first information associated with the first side of the document further based on a first identification string that is visible on the first side of the document, and

wherein determining the second information associated with the second side of the document comprises;

determining the second information associated with the second side of the document further based on a quick response (QR) code, bar code, or second identification string that is visible on the second side of the document.

3. The method of claim 1, wherein detecting the first side of the document comprises:

detecting a plurality of edges associated with the first side of the document; and

detecting text associated with the first side of the document.

4. The method of claim 1, wherein detecting the second side of the document comprises:

detecting a plurality of edges associated with the second side of the document;

detecting a bar code associated with the second side of the document; and

detecting text associated with the second side of the document.

5. The method of claim 1, wherein

the first image resolution is associated with a quick capture mode of the camera, and

the second image resolution is associated with a full capture mode of the camera.

6. The method of claim 1, wherein performing the action related to the first image and the second image comprises:

validating the first image and the second image;

sending the first image and the second image to a remote device;

receiving, based on sending the first image and the second image to the remote device, third information concerning the document; and

presenting, for display on the display of the user device, a message indicating the third information.

7. The method of claim 6, wherein validating the first image and the second image comprises:

determining that first data can be extracted from the first image; and

determining that second data can be extracted from the second image.

8. A user device, comprising:

one or more memories; and

one or more processors, communicatively coupled to the one or more memories, to;

determine a plurality of image resolutions supported by a camera of the user device;

determine a screen aspect ratio of a display of the user device;

receive, from the camera of the user device, a first preview image;

process the first preview image using a first computer vision technique;

detect, based on processing the first preview image, a first side of a document;

determine, based on processing the first preview image, first information associated with the first side of the document;

select, based on the first information and the screen aspect ratio, a first image resolution of the plurality of image resolutions;

capture, by the camera of the user device, a first image of the first side of the document according to the first image resolution;

receive, from the camera, a second preview image;

process the second preview image using a second computer vision technique;

detect, based on processing the second preview image, a second side of the document;

determine, based on processing the second preview image, second information associated with the second side of the document;

select, based on the second information and the screen aspect ratio, a second image resolution of the plurality of image resolutions,

wherein the second image resolution is a different level of resolution than the first image resolution, and

wherein the one or more processors, when selecting the second image resolution, are to;

determine a threshold image resolution based on the second information;

determine, based on the screen aspect ratio, a set of image resolutions of the plurality of image resolutions that fit the display of the user device; and

select the second image resolution from the set of image resolutions,

 

wherein the second image resolution satisfies the threshold image resolution;

capture, by the camera of the user device, a second image of the second side of the document according to the second image resolution; and

perform an action related to the first image and the second image.

9. The user device of claim 8, wherein the one or more processors, when selecting, based on the first information and the screen aspect ratio, the first image resolution of the plurality of image resolutions, are to:

determine, based on the screen aspect ratio, a set of optimal image resolutions of the plurality of image resolutions that correspond to dimensions of the display of the user device; and

select, based on the first information, the first image resolution from the set of optimal image resolutions.

10. The user device of claim 8, wherein the one or more processors, when determining the first information associated with the first side of the document, are to:

receive input data from a user, via the user device, regarding the first side of the document;

determine, based on detecting the first side of the document, image data concerning the first side of the document; and

determine the first information associated with the first side of the document by comparing the input data and the image data.

11. The user device of claim 8, wherein the one or more processors, when performing the action related to the first image and the second image, are to:

crop the first image to include first image data concerning only the first side of the document; and

crop the second image to include second image data concerning only the second side of the document.

12. The user device of claim 8, wherein the one or more processors are further to:

cause the first image to be displayed on the display of the user device after capturing the first image; and

cause the second image to be displayed on the display of the user device after capturing the second image.

13. The user device of claim 8, wherein the one or more processors, when performing the action related to the first image and the second image, are to:

identify a document type of the document based on the first image and the second image; and

cause a message indicating the document type to be displayed on the display of the user device.

14. The user device of claim 8, wherein the one or more processors, when performing the action related to the first image and the second image, are to:

perform optical character recognition on the first image and the second image to generate third information; and

validate the document based on the first information, the second information, and the third information.

20. The user device of claim 8, wherein the one or more processors, when detecting the second side of the document, are to:

detect a plurality of edges associated with the second side of the document;

detect a bar code associated with the second side of the document; and

detect text associated with the second side of the document.

15. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors of a user device, cause the one or more processors to;

determine a plurality of image resolutions supported by a camera of the user device;

receive, from the camera of the user device, a first preview image;

process the first preview image using a first computer vision technique;

detect, based on processing the first preview image, a first side of a document;

determine, based on processing the first preview image, first information associated with the first side of the document;

select, based on the first information, a first image resolution of the plurality of image resolutions,

wherein the one or more instructions, that cause the one or more processors to select the first image resolution, cause the one or more processors to;

determine a first threshold image resolution based on the first information; and

select the first image resolution,

 

wherein the first image resolution satisfies the first threshold image resolution;

capture, by the camera of the user device, a first image of the first side of the document according to the first image resolution;

receive, from the camera, a second preview image;

process the second preview image using a second computer vision technique;

detect, based on processing the second preview image, a second side of the document;

determine, based on processing the second preview image, second information associated with the second side of the document;

select, based on the second information, a second image resolution of the plurality of image resolutions,

wherein the second image resolution is the same as the first image resolution, and

wherein the one or more instructions, that cause the one or more processors to select the second image resolution, cause the one or more processors to;

determine a second threshold image resolution based on the second information; and

select the second image resolution,

 

wherein the second image resolution satisfies the second threshold image resolution;

capture, by the camera of the user device, a second image of the second side of the document according to the second image resolution; and

perform an action related to the first image and the second image.

16. The non-transitory computer-readable medium of claim 15, wherein the document includes:

a government-issued identification card,

an employee identification card,

a health insurance card, or

a transaction card.

17. The non-transitory computer-readable medium of claim 15, wherein the first threshold image resolution is different than the second threshold image resolution.

18. The non-transitory computer-readable medium of claim 15, wherein the first threshold image resolution is associated with a quick capture mode of the camera and the second threshold image resolution is associated with a full capture mode of the camera.

19. The non-transitory computer-readable medium of claim 15, wherein the one or more instructions, that cause the one or more processors to perform the action related to the first image and the second image, are to:

identify a document type of the document based on the first image and the second image; and

cause a message indicating the document type to be displayed on a display of the user device.