Hand-based biometric analysis

• US 9,042,606 B2
• Filed: 06/18/2007
• Issued: 05/26/2015
• Est. Priority Date: 06/16/2006
• Status: Expired due to Fees

• Current Assignee: Board of Regents Nevada System of Higher Education (State of Nevada)
• Original Assignee: Board of Regents Nevada System of Higher Education (State of Nevada)
• Inventors: Bebis, George, Amayeh, Gholamreza
• Primary Examiner(s): DULANEY, KATHLEEN YUAN
• Application Number:
  US11/820,474
• Publication Number:
  US 20100021014A1
• Time in Patent Office: 2,899 Days
• Field of Search: 382/115, 382/173
• US Class Current: 382/115
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/1347 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/1365 Matching; Classification

Abstract

Hand-based biometric analysis systems and techniques are described which provide robust hand-based identification and verification. An image of a hand is obtained, which is then segmented into a palm region and separate finger regions. Acquisition of the image is performed without requiring particular orientation or placement restrictions. Segmentation is performed without the use of reference points on the images. Each segment is analyzed by calculating a set of Zernike moment descriptors for the segment. The feature parameters thus obtained are then fused and compared to stored sets of descriptors in enrollment templates to arrive at an identity decision. By using Zernike moments, and through additional manipulation, the biometric analysis is invariant to rotation, scale, or translation or an in put image. Additionally, the analysis utilizes re-use of commonly-seen terms in Zernike calculations to achieve additional efficiencies over traditional Zernike moment calculation.

Claims

1. A method of determining identity using a computing system that implements a biometric analysis tool, the method comprising:

with the computing system that implements the biometric analysis tool, performing biometric analysis on an image of a hand to produce plural feature parameters without requiring a particular orientation of the hand during image capture or for the biometric analysis, wherein the biometric analysis includes;

determining a silhouette representation from the image of the hand;

segmenting the silhouette representation into plural segment images representing palm and plural fingers of the hand without using landmark points during the segmenting, the plural fingers including a thumb, wherein the palm is segmented from the thumb;

determining the plural feature parameters from the plural segment images, respectively, each of the plural feature parameters indicating geometry of a different part among the palm and the plural fingers of the hand; and

making an identity decision based at least in part on the plural feature parameters and stored descriptors representing one or more previously-analyzed hand images, wherein a different weight is associated with each of the plural feature parameters, respectively.

2. The method of claim 1, wherein the plural feature parameters resulting from the biometric analysis are invariant to rotation, scale and translation.

3. The method of claim 2 wherein the image of the hand is received from an image acquisition device that lacks pegs to guide the orientation of the hand.

4. The method of claim 1 wherein the image represents a back view of the hand, such that the image lacks lines or other features of the plural fingers and the palm that characterize a front view of the hand.

5. The method of claim 1 wherein the biometric analysis is performed without reference to direct physical measurements of the image of the hand or the silhouette representation, and wherein the biometric analysis is performed without reference to landmark points within the image of the hand or the silhouette representation.

6. The method of claim 1 wherein the identity decision is a verification decision, and wherein the making the identity decision comprises:

selecting a particular descriptor among the stored descriptors; and

verifying identity using the plural feature parameters and the particular descriptor.

7. The method of claim 1 wherein the identity decision is an identification decision, and wherein the making the identity decision comprises:

identifying a matching descriptor among the stored descriptors using the plural feature parameters and each of the stored descriptors, respectively, until the matching descriptor is identified.

8. The method of claim 1 wherein the determining the silhouette representation comprises, for each pixel value of plural pixel values of the image:

comparing the pixel value to a threshold;

if the pixel value satisfies the threshold, assigning the pixel value a first binary value; and

otherwise, assigning the pixel value a second binary value.

9. The method of claim 1 wherein the making the identity decision uses feature-level fusion, score-level fusion and/or decision-level fusion.

10. The method of claim 1 wherein the determining the plural feature parameters from the plural segment images comprises determining Zernike moment values.

11. The method of claim 10 wherein the Zernike moment values are high-order Zernike moment values characterized by an order n, and wherein n is at least 10.

12. The method of claim 11 wherein the order of the Zernike moment values is pre-determined.

13. The method of claim 1 wherein the making the identity decision uses a threshold, the method further comprising setting the threshold depending on security level.

14. The method of claim 1 wherein the making the identity decision is further based at least in part on separate fingerprint data, other biometric data and/or other identity data.

15. The method of claim 1 further comprising adjusting the different weight associated with each of the plural feature parameters, a threshold and/or other setting of the biometric analysis tool based at least in part on the identity decision.

16. The method of claim 1 wherein the biometric analysis further includes, before the segmenting the silhouette representation into plural segment images:

segmenting the image of the hand from an input image that includes the image of the hand and an image of at least part of a forearm.

17. The method of claim 1 wherein the segmenting the silhouette representation uses morphological closing operations.

18. The method of claim 1 wherein the biometric analysis further includes, before the plural feature parameters are determined from the plural segment images:

smoothing of the plural segment images.

19. The method of claim 1 wherein the making the identity decision uses feature-level fusion and includes:

combining the plural feature parameters into feature vector, including using the different weight associated with each of the plural feature parameters as part of the combining the plural feature parameters into the feature vector; and

for a given stored descriptor of the stored descriptors, comparing the feature vector with a stored vector for the given stored descriptor, wherein the identity decision is based at least in part on the comparing the feature vector with the stored vector for the given stored descriptor.

20. The method of claim 1 wherein the making the identity decision uses score-level fusion and includes, for a given stored descriptor of the stored descriptors:

for each feature parameter of the plural feature parameters;

comparing the feature parameter to a corresponding parameter for the given stored descriptor; and

calculating a score value for the feature parameter based at least in part on the different weight associated with the feature parameter and the comparing the feature parameter to the corresponding parameter for the given stored descriptor;

calculating an overall score value based at least in part on the score values for the respective feature parameters; and

comparing the overall score value to a threshold, wherein the identity decision is based at least in part on the comparing the overall score value to the threshold.

21. The method of claim 1 wherein the making the identity decision uses score-level fusion and includes, for a given stored descriptor of the stored descriptors:

for each feature parameter of the plural feature parameters, comparing the feature parameter to a corresponding parameter for the given stored descriptor; and

using support vector machine classification to map results of the comparing for the plural feature parameters, respectively, to the identity decision.

22. The method of claim 1 wherein the making the identity decision uses decision-level fusion and includes, for a given stored descriptor of the stored descriptors:

for each feature parameter of the plural feature parameters;

comparing the feature parameter to a corresponding parameter for the given stored descriptor to produce a feature score value; and

determining whether the feature score value satisfies one or more thresholds;

wherein the identity decision is based at least in part on the determination of whether the feature score values for the plural feature parameters satisfy the one or more thresholds.

23. A method comprising:

with a computing system that implements a biometric analysis tool, performing biometric analysis on an image of a hand to produce plural Zernike moment values, wherein the biometric analysis includes;

determining a silhouette representation from the image of the hand; and

using the silhouette representation to determine the plural Zernike moment values, the plural Zernike moment values indicating geometry of the hand, including;

storing plural common terms; and

reusing the stored terms, thereby reducing overall computational complexity; and

making an identity decision based at least in part on the plural Zernike moment values and stored descriptors representing one or more previously-analyzed hand images.

24. The method of claim 23 wherein at least some of the plural common terms are computed without reference to an image function and represent terms of a Zernike radial polynomial that depend on order of the Zernike moment values.

25. The method of claim 23 wherein at least some of the plural common terms are computed with reference to an image function and represent terms for particular projections of the image function that are independent of order of the Zernike moment values.

26. A computing system that implements a biometric analysis tool, the computing system including:

a processing unit; and

memory storing computer-executable instructions for causing the computing system to perform a method comprising;

performing biometric analysis on an image of a hand to produce plural Zernike moment values, wherein the biometric analysis includes;

determining a silhouette representation from the image of the hand; and

using the silhouette representation to determine the plural Zernike moment values, the plural Zernike moment values indicating geometry of the hand, including;

storing plural common terms; and

reusing the stored terms, thereby reducing overall computational complexity; and

making an identity decision based at least in part on the plural Zernike moment values and stored descriptors representing one or more previously-analyzed hand images.

27. The computing system of claim 26 wherein at least some of the plural common terms are computed without reference to an image function and represent terms of a Zernike radial polynomial that depend on order of the Zernike moment values.

28. The computing system of claim 26 wherein at least some of the plural common terms are computed with reference to an image function and represent terms for particular projections of the image function that are independent of order of the Zernike moment values.

29. A computing system that implements a biometric analysis tool, the computing system including:

a processing unit; and

memory storing computer-executable instructions for causing the computing system to perform a method comprising;

performing biometric analysis on an image of a hand to produce plural feature parameters without requiring a particular orientation of the hand, wherein the biometric analysis includes;

determining a silhouette representation from the image of the hand;

segmenting the silhouette representation into plural segment images representing palm and plural fingers of the hand without using landmark points during the segmenting, the plural fingers including a thumb, wherein the palm is segmented from the thumb; and

determining the plural feature parameters from the plural segment images, respectively, each of the plural feature parameters indicating geometry of a different part among palm and plural fingers of the hand; and

making an identity decision based at least in part on the plural feature parameters and stored descriptors representing one or more previously-analyzed hand images, wherein a different weight is associated with each of the plural feature parameters, respectively.

30. The computing system of claim 29 wherein the making the identity decision uses feature-level fusion, score-level fusion and/or decision-level fusion.

31. The computing system of claim 29 wherein the biometric analysis further includes, before the segmenting the silhouette representation into plural segment images:

segmenting the image of the hand from an input image that includes the image of the hand and an image of at least part of a forearm.

32. The computing system of claim 29 wherein the segmenting the silhouette representation uses morphological closing operations.

33. The computing system of claim 29 wherein the biometric analysis further includes, before the plural feature parameters are determined from the plural segment images:

smoothing of the plural segment images.

34. A computing system that implements a biometric analysis tool, the computing system including:

a processing unit; and

memory storing computer-executable instructions for causing the computing system to perform a method comprising;

performing biometric analysis on an image of a hand to produce plural feature parameters without requiring a particular orientation of the hand during image capture or for the biometric analysis, wherein the biometric analysis includes;

determining a silhouette representation from the image of the hand;

segmenting the silhouette representation, including;

filtering out plural fingers of the hand from the silhouette representation to identify a segment image for a palm of the hand, wherein the filtering out the plural fingers uses morphological closing operations;

removing the palm from the silhouette representation to identify segment images for the plural fingers, respectively; and

determining the plural feature parameters from the segment image for the palm and the segment images for the plural fingers, respectively, each of the plural feature parameters indicating geometry of a different part among the palm and the plural fingers of the hand; and

making an identity decision based at least in part on the plural feature parameters and stored descriptors representing one or more previously-analyzed hand images, wherein a different weight is associated with each of the plural feature parameters, respectively.

35. The computing system of claim 34 wherein the making the identity decision uses feature-level fusion, score-level fusion and/or decision-level fusion.

36. The computing system of claim 34 wherein the biometric analysis further includes:

segmenting the image of the hand from an input image that includes the image of the hand and an image of at least part of a forearm.

37. The computer system of claim 34 wherein the biometric analysis further includes, before the plural feature parameters are determined:

smoothing of the segment images for the plural fingers, respectively.

38. A computing system that implements a biometric analysis tool, the computing system including:

a processing unit; and

memory storing computer-executable instructions for causing the computing system to perform a method comprising;

performing biometric analysis on an image of a hand to produce plural feature parameters without requiring a particular orientation of the hand during image capture or for the biometric analysis, wherein the image further includes part of a forearm, and wherein the biometric analysis includes;

determining a silhouette representation from the image of the hand, wherein the silhouette representation further represents the part of the forearm;

segmenting the silhouette representation, including;

identifying a shape over a palm of the hand inside the silhouette representation;

using an intersection between the shape over the palm and the silhouette representation to identify the part of the forearm from the silhouette representation;

filtering out plural fingers of the hand from the silhouette representation to identify a segment image for the palm;

removing the palm from the silhouette representation to identify segment images for the plural fingers, respectively; and

smoothing the segment images for the plural fingers; and

determining the plural feature parameters from the segment image for the palm and the segment images for the plural fingers, respectively, each of the plural feature parameters indicating geometry of a different part among the palm and the plural fingers of the hand; and

making an identity decision based at least in part on the plural feature parameters and stored descriptors representing one or more previously-analyzed hand images, wherein a different weight is associated with each of the plural feature parameters, respectively.