System and method based on hybrid biometric detection

• US 9,195,900 B2
• Filed: 02/24/2015
• Issued: 11/24/2015
• Est. Priority Date: 11/21/2011
• Status: Active Grant

• Current Assignee: PixArt Imaging Incorporated
• Original Assignee: PixArt Imaging Incorporated
• Inventors: Gu, Ren-Hau, Kao, Ming-Tsan, Huang, Sen-Huang
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US14/629,764
• Publication Number:
  US 20150193669A1
• Time in Patent Office: 273 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 2207/30076 Plethysmography
• CPC Class Codes: G06V 40/14 Vascular patterns
• CPC Class Codes: G06V 40/145 Sensors therefor
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system and method based on hybrid biometric detection capture first images of a user that is projected by first light of different wavelengths, extract various biometric informations from the first images, analyze and compare for each of the biometric informations to generate a matching score, determine an identity for the user according to all of the matching scores, generate second images and PPG signals from dispensed second light from the user, generate a time and PPG variation signal and a space and PPG variation signal for each frame of the second images, convert the time and PPG variation signals into frequency domain signals, determine a reference frequency according to the space and PPG variation signals, retrieve energy of the frequency domain signals at the reference frequency, and establish a three-dimensional energy distribution from the retrieved energy.

Claims

1. A system based on hybrid biometric detection, comprising:

a first light source being configured to provide light of different wavelengths under control to project on a user;

a first image sensor being configured to capture images of the user to generate image signals;

a recognition module being coupled to the image sensor and configured to receive the image signals, extract various biometric informations from the images, and analyze and compare for each of the biometric informations to generate a matching score;

an analysis unit being coupled to the recognition module and configured to determine an identity for the user according to all of the matching scores generated by the recognition module; and

a biometric detection system which comprises;

a second light source being configured to emit to illuminate a skin surface of the user;

a second image sensor being configured to receive dispensed light from the user for generating PPG signals;

a time frequency reducing unit being coupled to the second image sensor and configured to generate a time and PPG variation signal for each frame captured by the second image sensor;

a space frequency reducing unit being coupled to the second image sensor and configured to generate a space and PPG variation signal for each frame captured by the second image sensor;

a converting unit being coupled to the time frequency reducing unit and the space frequency reducing unit, and configured to convert the time and PPG variation signals into frequency domain signals and determine a reference frequency according to the space and PPG variation signals;

a capturing unit being coupled to the converting unit and configured to retrieve energy of the frequency domain signals at the reference frequency; and

a processing unit being coupled to the capturing unit and configured to establish a three-dimensional energy distribution.

2. The system of claim 1, wherein the various biometric informations comprise a fingerprint feature and a vein feature.

3. The system of claim 2, wherein the recognition module comprises:

a finger detection unit being coupled to the first image sensor and configured to analyze the first images by a finger feature or a brightness variation of the first images to detect presence and location of a finger, and extract the fingerprint feature and the vein feature from the first images;

a fingerprint recognition unit being coupled to the finger detection unit and configured to analyze and compare the fingerprint feature to generate a fingerprint matching score; and

a vein recognition unit being coupled to the finger detection unit and configured to analyze and compare the vein feature to generate a vein matching score.

4. The system of claim 3, wherein the analysis unit compares a sum of the fingerprint matching score and the vein matching score with a threshold to determine the identity of the user.

5. The system of claim 3, wherein the analysis unit compares the fingerprint matching score and the vein matching score with two thresholds, respectively, to determine the identity of the user.

6. The system of claim 1, wherein the various biometric informations comprise a face feature and an iris feature.

7. The system of claim 6, wherein the recognition module comprises:

a face detection unit being coupled to the first image sensor and configured to analyze the image by the face feature or a brightness variation of the first images to detect presence and location of a face, and extract the face feature from the first images;

a face recognition unit being coupled to the face detection unit and configured to analyze and compare the face feature to generate a face matching score;

an iris detection unit being coupled to the first image sensor and configured to extract the iris feature from the first images; and

an iris recognition unit being coupled to the iris detection unit and configured to analyze and compare the iris feature to generate an iris matching score.

8. The system of claim 7, wherein the analysis unit compares a sum of the face matching score and the iris matching score with a threshold to determine the identity of the user.

9. The system of claim 7, wherein the analysis unit compares the face matching score and the iris matching score with two thresholds, respectively, to determine the identity of the user.

10. The system of claim 1, wherein the various biometric informations comprise a fingerprint feature, a vein feature, and a face feature.

11. The system of claim 10, wherein the recognition module comprises:

a finger detection unit being coupled to the first image sensor and configured to analyze the first images by a finger feature or a brightness variation of the first images to detect presence and location of a finger, and extract the fingerprint feature and the vein feature from the first images;

a fingerprint recognition unit being coupled to the finger detection unit and configured to analyze and compare the fingerprint feature to generate a fingerprint matching score;

a vein recognition unit coupled to the finger detection unit and configured to analyze and compare the vein feature to generate a vein matching score;

a face detection unit being coupled to the image sensor and configured to analyze the image by the face feature or a brightness variation of the first images to detect presence and location of a face, and extract the face feature from the first images; and

a face recognition unit being coupled to the face detection unit and configured to analyze and compare the face feature to generate a face matching score.

12. The system of claim 11, wherein the analysis unit compares a sum of the fingerprint matching score, the vein matching score, and the face matching score with a threshold to determine the identity of the user.

13. The system of claim 11, wherein the analysis unit compares the fingerprint matching score, the vein matching score, and the face matching score with three thresholds, respectively, to determine the identity of the user.

14. The system of claim 1, further comprising a light controller being coupled to the first light source and configured to adjust a light intensity of the first light source.

15. The system of claim 1, further comprising an autofocus lens module between the first image sensor and the user.

16. A method based on hybrid biometric detection, comprising steps of:

a.) providing first light of different wavelengths to project on a user;

b.) capturing first images of the user;

c.) extracting various biometric informations from the first images;

d.) analyzing and comparing for each of the biometric informations to generate a matching score;

e.) determining an identity for the user according to all of the matching scores generated in the step d;

f.) providing second light to emit to illuminate a skin surface of the user;

g.) receiving dispensed second light from the user for generating second images and PPG signals;

h.) generating a time and PPG variation signal for each frame of the second images;

i.) generating a space and PPG variation signal for each frame of the second images;

j.) converting the time and PPG variation signals into frequency domain signals and determining a reference frequency according to the space and PPG variation signals;

k.) retrieving energy of the frequency domain signals at the reference frequency from the signals generated in the step j; and

l.) establishing a three-dimensional energy distribution from the retrieved energy generated in the step k.

17. The method of 16, wherein the step c comprises extracting a fingerprint feature and a vein feature.

18. The method of 17, wherein the step d comprises:

analyzing and comparing the fingerprint feature to generate a fingerprint matching score; and

analyzing and comparing the vein feature to generate a vein matching score.

19. The method of 18, wherein the step e comprises comparing a sum of the fingerprint matching score and the vein matching score with a threshold to determine the identity of the user.

20. The method of 18, wherein the step e comprises comparing the fingerprint matching score and the vein matching score with two thresholds, respectively, to determine the identity of the user.

21. The method of 16, wherein the step c comprises extracting a face feature and an iris feature.

22. The method of 21, wherein the step d comprises:

analyzing and comparing the face feature to generate a face matching score; and

analyzing and comparing the iris feature to generate an iris matching score.

23. The method of 22, wherein the step e comprises comparing a sum of the face matching score and the iris matching score with a threshold to determine the identity of the user.

24. The method of 22, wherein the step e comprises comparing the face matching score and the iris matching score with two thresholds, respectively, to determine the identity of the user.

25. The method of 16, wherein the step c comprises extracting a fingerprint feature, a vein feature, and a face feature.

26. The method of 25, wherein the step d comprises:

analyzing and comparing the fingerprint feature to generate a fingerprint matching score;

analyzing and comparing the vein feature to generate a vein matching score; and

analyzing and comparing the face feature to generate a face matching score.

27. The method of 26, wherein the step e comprises comparing a sum of the fingerprint matching score, the vein matching score, and the face matching score with a threshold to determine the identity of the user.

28. The method of 18, wherein the step e comprises comparing the fingerprint matching score, the vein matching score, and the face matching score with three thresholds, respectively, to determine the identity of the user.

29. The method of 16, further comprising generating a control signal according to a brightness of the first images for adjusting an intensity of the first light.

30. The method of 16, wherein the step b comprises adjusting a focal length for capturing the first images from a different depth of field.