Quality metrics for biometric authentication

• US 9,361,681 B2
• Filed: 05/06/2014
• Issued: 06/07/2016
• Est. Priority Date: 08/10/2012
• Status: Active Grant

• Current Assignee: Jumio Inc.
• Original Assignee: Eyeverify LLC
• Inventors: Derakhshani, Reza, Gottemukkula, Vikas
• Primary Examiner(s): Koziol, Stephen R
• Assistant Examiner(s): Lee, Jonathan S
• Application Number:
  US14/270,925
• Publication Number:
  US 20140294252A1
• Time in Patent Office: 763 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2113 by ranking or filtering the set of features, e.g. using a measure of variance or of feature cross-correlation
• CPC Class Codes: G06T 2207/20041 Distance transform
• CPC Class Codes: G06T 2207/20112 Image segmentation details
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 40/14 Vascular patterns
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/197 Matching; Classification

Abstract

This specification describes technologies relating to biometric authentication based on images of the eye. In general, one aspect of the subject matter described in this specification can be embodied in methods that include obtaining first image of an eye including a view of the white of the eye. The method may further include determining metrics for the first image, including a first metric for reflecting an extent of one or more connected structures in the first image that represents a morphology of eye vasculature and a second metric for comparing the extent of eye vasculature detected across different color components in the first image. A quality score may be determined based on the metrics for the first image. The first image may be rejected or accepted based on the quality score.

Claims

1. A computer-implemented method comprising:

obtaining a plurality of images of an eye, wherein the images each include a view of a portion of a vasculature of the eye;

determining a plurality of respective metrics for each of the images based on analyzing image data elements of the image, wherein the respective metrics include a first metric that represents a calculated area of one or more connected structures of programmatically enhanced vasculature in the image and a second metric that represents an extent of detected vasculature in the image based on a plurality of color difference signals determined from color components of the image;

calculating a respective first score for each of the images wherein the first score represents a comparison of the respective metrics of the image with corresponding metrics for a reference image;

calculating a second score based on, at least, a combination of the first scores; and

granting a user access to a device or a service based on the second score.

2. The method of claim 1, further comprising:

before calculating the respective first score for each of the images, determining a respective quality score for each of the images based on the metrics, wherein the quality score is a prediction of the second score assuming the image and the reference image include a view of a same person'"'"'s vasculature.

3. The method of claim 2, further comprising:

accepting or rejecting the image based on the respective quality score.

4. The method of claim 1 wherein calculating the second score based on, at least, the combination of the first scores comprises:

determining a respective weight for each of the first scores; and

combining the first scores weighted by their respective weights to determine the second score.

5. The method of claim 1, wherein calculating a respective first score for each of the images comprises:

a distance between the metrics for the image and the metrics for the reference image.

6. The method of claim 5 wherein the distance is a Euclidean distance, a correlation coefficient, a modified Hausdorff distance, a Mahalanobis distance, a Bregman divergence, a cosine similarity, a Kullback-Leibler distance, or a Jensen-Shannon divergence.

7. The method of claim 1 wherein determining the first metric comprises:

dilating the vasculature in the image so that one or more disconnected veins in the vasculature become connected;

thinning the dilated vasculature in the image; and

determining a portion of the image that contains the thinned dilated vasculature.

8. The method of claim 1 wherein the second metric is for comparing an extent of eye vasculature detected across different color components in the image, and wherein determining the second metric comprises:

determining a first color difference signal by subtracting a first color component of the image from a second color component of the image;

determining a second color difference signal by subtracting a third color component of the image from the first color component of the image; and

calculating a ratio of a first standard deviation of the first color difference signal to a second standard deviation of the second color difference signal to determine the second metric.

9. The method of claim 1 wherein the plurality of metrics includes a second metric based on an amount of specular reflection in the image.

10. The method of claim 1 wherein the plurality of metrics includes a second metric based on an amount of glare in the image.

11. The method of claim 1 wherein the plurality of metrics includes a second metric based on a number and types of occlusions in the image.

12. The method of claim 1 wherein the plurality of metrics includes a second metric based on a gaze angle of an eye depicted in the image.

13. The method of claim 1 wherein the plurality of metrics includes a second metric based on the segmentation quality of a sclera depicted in the image.

14. A system comprising:

one or more data processing apparatus programmed to perform operations comprising;

obtaining a plurality of images of an eye, wherein the images each include a view of a portion of a vasculature of the eye;

determining a plurality of respective metrics for each of the images based on analyzing image data elements of the image, wherein the respective metrics include a first metric that represents a calculated area of one or more connected structures of programmatically enhanced vasculature in the image and a second metric that represents an extent of detected vasculature in the image based on a plurality of color difference signals determined from color components of the image;

calculating a respective first score for each of the images wherein the first score represents a comparison of the respective metrics of the image with corresponding metrics for a reference image;

calculating a second score based on, at least, a combination of the first scores; and

granting a user access to a device or a service based on the second score.

15. The system of claim 14, wherein the operations further comprise:

before calculating the respective first score for each of the images, determining a respective quality score for each of the images based on the metrics, wherein the quality score is a prediction of the second score assuming the image and the reference image include a view of a same person'"'"'s vasculature.

16. The system of claim 15, wherein the operations further comprise:

accepting or rejecting the image based on the respective quality score.

17. The system of claim 14 wherein calculating the second score based on, at least, the combination of the first scores comprises:

determining a respective weight for each of the first scores; and

combining the first scores weighted by their respective weights to determine the second score.

18. The system of claim 14, wherein calculating a respective first score for each of the images comprises:

a distance between the metrics for the image and the metrics for the reference image.

19. The system of claim 18 wherein the distance is a Euclidean distance, a correlation coefficient, a modified Hausdorff distance, a Mahalanobis distance, a Bregman divergence, a cosine similarity, a Kullback-Leibler distance, or a Jensen-Shannon divergence.

20. The system of claim 14 wherein determining the first metric comprises:

dilating the vasculature in the image so that one or more disconnected veins in the vasculature become connected;

thinning the dilated vasculature in the image; and

determining a portion of the image that contains the thinned dilated vasculature.

21. The system of claim 14 wherein the second metric is for comparing an extent of eye vasculature detected across different color components in the image, and wherein determining the second metric comprises:

determining a first color difference signal by subtracting a first color component of the image from a second color component of the image;

determining a second color difference signal by subtracting a third color component of the image from the first color component of the image; and

calculating a ratio of a first standard deviation of the first color difference signal to a second standard deviation of the second color difference signal to determine the second metric.

22. The system of claim 14 wherein the plurality of metrics includes a second metric based on an amount of specular reflection in the image.

23. The system of claim 14 wherein the plurality of metrics includes a second metric based on an amount of glare in the image.

24. The system of claim 14 wherein the plurality of metrics includes a second metric based on a number and types of occlusions in the image.

25. The system of claim 14 wherein the plurality of metrics includes a second metric based on a gaze angle of an eye depicted in the image.

26. The system of claim 14 wherein the plurality of metrics includes a second metric based on the segmentation quality of a sclera depicted in the image.

27. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed by data processing apparatus, cause the data processing apparatus to perform operations comprising:

obtaining a plurality of images of an eye, wherein the images each include a view of a portion of a vasculature of the eye;

determining a plurality of respective metrics for each of the images based on analyzing image data elements of the image, wherein the respective metrics include a first metric that represents a calculated area of one or more connected structures of programmatically enhanced vasculature in the image and a second metric that represents an extent of detected vasculature in the image based on a plurality of color difference signals determined from color components of the image;

calculating a respective first score for each of the images wherein the first score represents a comparison of the respective metrics of the image with corresponding metrics for a reference image;

calculating a second score based on, at least, a combination of the first scores; and

granting a user access to a device or a service based on the second score.

28. The computer-readable storage medium of claim 27, wherein the operations further comprise:

before calculating the respective first score for each of the images, determining a respective quality score for each of the images based on the metrics, wherein the quality score is a prediction of the second score assuming the image and the reference image include a view of a same person'"'"'s vasculature.

29. The computer-readable storage medium of claim 28, wherein the operations further comprise:

accepting or rejecting the image based on the respective quality score.

30. The computer-readable storage medium of claim 27 wherein calculating the second score based on, at least, the combination of the first scores comprises:

determining a respective weight for each of the first scores; and

combining the first scores weighted by their respective weights to determine the second score.