Systems and methods for assessing standards for mobile image quality

• US 9,779,297 B2
• Filed: 01/03/2017
• Issued: 10/03/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Mitek Systems Incorporated
• Original Assignee: Mitek Systems Incorporated
• Inventors: Nepomniachtchi, Grigori, Strange, Mike
• Primary Examiner(s): Koziol, Stephen R
• Assistant Examiner(s): CHOI, TIMOTHY WING HO
• Application Number:
  US15/397,639
• Publication Number:
  US 20170116475A1
• Time in Patent Office: 273 Days
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

Methods are provided for defining and determining a formal and verifiable mobile document image quality and usability (MDIQU) standard, or Standard for short. The Standard ensures that a mobile image can be used in an appropriate mobile document processing application, for example an application for mobile check deposit. In order to quantify the usability, the Standard establishes 5 quality and usability grades. A mobile image is first tested to determine if the quality is sufficient to obtain content from the image by performing multiple different image quality assessment tests. If the image quality is sufficient, one or more document usability computations are made to determine if the document or content in the image is usable by a particular application. A ranking is then assigned to the image based on the results of the tests which is indicative of the quality and usability of the image.

Claims

1. A non-transitory computer-readable medium comprising instructions which, when executed by a processor, cause the processor to:

receive a set of images associated with a document;

evaluate the set of images to select an image of the set of images satisfying an image quality criteria;

in response to the image satisfying the image quality criteria, process the selected image to determine a set of image quality assurance (IQA) scores, comprising;

performing a computation relating to a set of image quality assurance (IQA) scores for the selected image to obtain at least one compound IQA score, and wherein the set of IQA scores is based on at least combining a subset of strongly correlated IQA scores in the set of IQA scores into a compound IQA score, and wherein the subset of strongly correlated IQA scores is associated with a common image defect;

in response to at least one compound IQA score associated with the selected image of the set of images satisfying a predetermined standard of image quality;

select the set of images as accepted.

2. The non-transitory computer-readable medium of claim 1, wherein to satisfy an image quality criteria, content is at least extractable from the selected image.

3. The non-transitory computer-readable medium of claim 1, wherein in response to an IQA score associated with the selected image of the set of images not satisfying the predetermined standard of image quality the processor is further to evaluate the set of images to select another image of the set of images satisfying the image quality criteria.

4. The non-transitory computer-readable medium of claim 1, wherein the processor is further to determine a false selection in response to an IQA score associated with the selected image of the set of images not satisfying the predetermined standard of image quality.

5. The non-transitory computer-readable medium of claim 4, wherein the processor is further to calculate a false selection rate of the set of images.

6. The non-transitory computer-readable medium of claim 1, wherein in response to the set of images failing to satisfy the image quality criteria;

rejecting the set of images.

7. The non-transitory computer-readable medium of claim 1, wherein the set of IQA scores includes one or more of:

an out-of-focus (OOF) score, a shadow score, a small-image-size score, a view-skew score, a plain-skew score, a warpage score, a low-internal-contrast score, a reflection score, a cut-corners score, a cut-sides score, a busy-background score, and a low-external-contrast score.

8. The non-transitory computer-readable medium of claim 1, wherein performing the computation relating to the set of IQA scores to obtain at least one compound IQA score includes computing a linear combination of the set of IQA scores.

9. The non-transitory computer-readable medium of claim 1, wherein to satisfy the predetermined standard of image quality, the processor is further to:

assess a usability score of the document associated with the set of images to verify that the document belongs to one of a set of supported categories of documents.

10. The non-transitory computer-readable medium of claim 9, wherein assessing the usability score of the document includes:

capturing a set of critical fields from the image of the document; and

determining the usability score based on the set of captured critical fields.

11. A system for assessing mobile image qualities of a document, comprising:

a processor; and

a memory coupled to the processor to store instructions for assessing qualities of mobile images of documents;

wherein the processor is configured to;

receive a set of images associated with a document;

evaluate the set of images to select an image of the set of images satisfying an image quality criteria;

in response to the image satisfying the image quality criteria, process the selected image to determine a set of image quality assurance (IQA) scores, comprising;

performing a computation relating to a set of image quality assurance (IQA) scores for the selected image to obtain at least one compound IQA score, and wherein the set of IQA scores is based on at least combining a subset of strongly correlated IQA scores in the set of IQA scores into a compound IQA score, and wherein the subset of strongly correlated IQA scores is associated with a common image defect;

in response to at least one compound IQA score associated with the selected image of the set of images satisfying a predetermined standard of image quality;

select the set of images as accepted.

12. The system of claim 11, wherein to satisfy an image quality criteria, content is at least extractable from the selected image.

13. The system of claim 11, wherein in response to an IQA score associated with the selected image of the set of images not satisfying the predetermined standard of image quality the processor is further to evaluate the set of images to select another image of the set of images satisfying the image quality criteria.

14. The system of claim 11, wherein the processor is further to determine a false selection in response to an IQA score associated with the selected image of the set of images not satisfying the predetermined standard of image quality.

15. The system of claim 14, wherein the processor is further to calculate a false selection rate of the set of images.

16. The system of claim 11, wherein in response to the set of images failing to satisfy the image quality criteria;

rejecting the set of images.

17. The system of claim 11, wherein the set of IQA scores includes one or more of:

an out-of-focus (OOF) score, a shadow score, a small-image-size score, a view-skew score, a plain-skew score, a warpage score, a low-internal-contrast score, a reflection score, a cut-corners score, a cut-sides score, a busy-background score, and a low-external-contrast score.

18. The system of claim 11, wherein performing the computation relating to the set of IQA scores to obtain at least one compound IQA score includes computing a linear combination of the set of IQA scores.

19. The system of claim 11, wherein to satisfy the predetermined standard of image quality, the processor is further to:

assess a usability score of the document associated with the set of images to verify that the document belongs to one of a set of supported categories of documents.

20. The system of claim 19, wherein assessing the usability score of the document includes:

capturing a set of critical fields from the image of the document; and

determining the usability score based on the set of captured critical fields.