Multimodal ocular biometric system

• US 20080044063A1
• Filed: 05/14/2007
• Published: 02/21/2008
• Est. Priority Date: 05/15/2006
• Status: Active Grant

• Current Assignee: Idemia Identity & Security USA, LLC (Advent International Corporation)
• Original Assignee: Retica Systems, Inc. (Advent International Corporation)
• Inventors: Accomando, Nicholas, Marshall, John, Muller, David, Tosa, Yasunari, Yansen, Don, McNerney, Tim, Usher, David, Casaverde, Pablo, Heacock, Greg, Friedman, Marc
• Granted Patent: US 8,014,571 B2
• Time in Patent Office: Days
• US Class Current: 382/117
• CPC Class Codes: A61B 3/1216 for diagnostics of the iris
• CPC Class Codes: A61B 3/14 Arrangements specially adapted for eye photography apparatus or arrangements for taking photographs per se G03B
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A multimodal biometric identification system captures and processes images of both the iris and the retina for biometric identification. Another multimodal ocular system captures and processes images of the iris and/or the from both eyes of a subject. Biometrics based on data provided by these systems are more accurate and robust than using biometrics that include data from only the iris or only the retina from a single eye. An exemplary embodiment emits photons to the iris and the retina of both eyes, an iris image sensor that captures an image of the iris when the iris reflects the emitted light, a retina image sensor that captures an image of the retina when the retina reflects the emitted light, and a controller that controls the iris and the retina illumination sources, where the captured image of the iris and the captured image of the retina contain biometric data.

Claims

1. A system for multimodal biometric identification, the system comprising:

at least one iris imaging system, each iris imaging system including;

an iris illumination source adapted to emit iris photons to an iris of a right eye or a left eye; and

an iris image sensor adapted to capture an image of the iris when the iris reflects the iris photons, the image of the iris having iris biometric data;

at least one retina imaging system, each retina imaging system including;

a retina illumination source adapted to emit retina photons to a retina of the right eye or the left eye; and

a retina image sensor adapted to capture an image of the retina when the retina reflects the retina photons, the image of the retina having retinal biometric data; and

a controller adapted to control the at least one iris imaging system and the at least one retina imaging system,

wherein the iris image sensor of the at least one iris imaging system captures the image of the iris according to operation of the corresponding iris illumination source, and the retina image sensor of the at least one iris imaging system captures the image of the retina according to operation of the corresponding retina illumination source.

2. The system according to claim 1, wherein the controller pulses the iris illumination source of the at least one iris imaging system and the retina illumination source of the at least one retina imaging system.

3. The system according to claim 2, wherein the controller pulses, with a synchronized offset, the iris illumination source and the retina illumination source.

4. The system according to claim 3, wherein the iris photons emitted by the iris illumination source and the retina photons emitted by the retina illumination source have a same wavelength.

5. The system according to claim 2, wherein the iris illumination source emits the iris photons with a first wavelength and the retina illumination source emits the retina photons with a second wavelength.

6. The system according to claim 5, wherein the controller pulses the iris illumination source and the retina illumination source with a same frequency.

7. The system according to claim 5, wherein the controller pulses the iris illumination source at a first frequency and the retina illumination source at a second frequency.

8. The system according to claim 2, wherein the controller pulses the iris illumination source and the retina illumination source during a same period, and the iris illumination source emits the iris photons with a first wavelength and the retina illumination source emits the retina photons with a second wavelength.

9. The system according to claim 1, wherein the controller controls the iris illumination source of the at least one iris imaging system to emit the iris photons in a continuous wave and the retina illumination source of the at least one retina imaging system to emit the retina photons in a continuous wave, and the iris illumination source emits the iris photons with a first wavelength and the retina illumination source emits the retina photons with a second wavelength.

10. The system according to claim 1, wherein the iris photons emitted by the iris illumination source of the at least one iris imaging system and the retina photons emitted by the retina illumination source of the at least one retina imaging system have a near-infrared wavelength.

11. The system according to claim 1, wherein the iris illumination source of the at least one iris imaging system emits the iris photons with more than one wavelength, and the retina illumination source of the at least one retina imaging system emits the retina photons with more than one wavelength.

12. The system according to claim 2, wherein the controller alternately pulses the iris illumination source and the retina illumination source, while having the iris illumination source step through a first series of wavelengths for emission of the iris photons with each pulse, and having the retina illumination source step through a second series of wavelengths for emission of the retina photons with each pulse.

13. The system according to claim 1, wherein at least one of the iris illumination source of the at least one iris imaging system and the retina illumination source of the at least one retina imaging system comprises a light emitting diode (LED) array.

14. The system according to claim 1, wherein at least one of the iris illumination source of the at least one iris imaging system and the retina illumination source of the at least one retina imaging system comprises a laser diode.

15. The system according to claim 1, wherein at least one of the iris image sensor of the at least one iris imaging system and the retina image sensor of the at least one retina imaging system comprises a complementary metal-oxide semiconductor (CMOS) detector.

16. The system according to claim 1, wherein at least one of the iris image sensor of the at least one iris imaging system and the retina image sensor of the at least one retina imaging system comprises a charge-coupled device (CCD) detector.

17. The system according to claim 1, wherein at least one of the iris photons emitted by the iris illumination source of the at least one iris imaging system and the retina photons emitted by the retina illumination source of the at least one retina imaging system passes through a refractive lens.

18. The system according to claim 1, wherein at least one of the iris photons emitted by the iris illumination source of the at least one iris imaging system and the retina photons emitted by the retina illumination source of the at least one retina imaging system reflect off a reflective mirror.

19. The system according to claim 1, further comprising a processor adapted to measure a focus of the image of the iris captured by the at least one iris imaging system.

20. The system according to claim 1, further comprising a processor adapted to determine a position for a pupil of the eye from the image of the iris captured by the at least one iris imaging system.

21. The system according to claim 20, wherein the retina illumination source of one of the at least one retina imaging system emits the retina photons to a corresponding retina of the eye based on the determined position for the pupil of the eye.

22. The system according to claim 20, wherein the retina illumination source of one of the at least one retina imaging system comprises an array of LED'"'"'s, each element of the array corresponding to a set of pupil positions, and the retina illumination source of the retina imaging system emits the retina photons to a corresponding retina of the eye, the retina photons being emitted from an element of the array according to the determined position for the pupil of the eye.

23. The system according to claim 1, wherein the controller applies auto gain to correct for iris and retina reflectance differences.

24. The system according to claim 1, wherein the controller pulses at least one of the iris illumination source of the at least one iris imaging system and the retina illumination source of the at least one retina imaging system through a cycle of more than one illumination power settings to correct for iris and retina reflectance differences.

25. The system according to claim 1, wherein the controller pulses at least one of the iris illumination source of the at least one iris imaging system and the retina illumination source of the at least one retina imaging system through a cycle of more than one pulse durations to correct for iris and retina reflectance differences.

26. The system according to claim 1, further comprising an auto focus system for at least one of the at least one iris imaging system and the at least one retina imaging system including an imaging lens and a motorized lens adapted to move the focus of the imaging lens.

27. The system according to claim 26, wherein the motorized lens moves the focus of the imaging lens according to a corresponding focus measurement of at least one of the iris and the retina.

28. The system according to claim 1, further comprising an auto focus system for at least one of the at least one iris imaging system and the at least one retina image sensor of the at least one retina imaging system comprising a processor adapted to apply digital filters to the captured image based on wavefront coding technology.

29. The system according to claim 1, further comprising an auto focus system for at least one of the at least one iris imaging system and the at least one retina imaging system comprising an electro-active optical element.

30. The system according to claim 29, wherein the electroactive optical element comprises a liquid crystal in between two pieces of glass with an electrode configuration.

31. The system according to claim 1, further comprising a fixation system to position at least one of the right eye and the left eye of a user.

32. The system according to claim 31, wherein the fixation system further comprises at least one exit pupil that substantially matches an entrance pupil of the right eye or the left eye for a given eye relief.

33. The system according to claim 31, wherein the fixation system further comprises at least one elliptical exit pupil that accommodates interpupillary distance, to maintain vertical alignment of the user and to allow vergence by the user to maintain horizontal alignment.

34. The system according to claim 33, further comprising a viewing target for the user.

35. The system according to claim 31, wherein the fixation system provides visual and aural signals to the user based on a determined position of a pupil and on a focus measurement of at least one of the iris and the retina of the right eye or the left eye.

36. The system according to claim 31, wherein the fixation system comprises:

a processor adapted to determine a position of a pupil of a user and to measure a focus of at least one of the iris and the retina; and

a display with a first visual indicator indicating a nominal position for the user, and a second visual indicator indicating the position of the user determined by the processor,

wherein the second visual indicator moves on the display as the user moves, and overlaps with the first visual indicator when the user moves into the nominal position.

37. The system according to claim 36, wherein at least one of the first visual indicator and the second visual indicator comprises cross hairs.

38. The system according to claim 37, wherein the second visual indicator further comprises a circle, the circle having a diameter that increases or decreases according to movement by the user relative to the nominal position.

39. The system according to claim 36, further comprising aural signals indicating the position of the user relative to the nominal position.

40. The system according to claim 31, wherein the fixation system accommodates eyeglasses.

41. The system according to claim 1, further comprising a personal identification number (PIN) entry system that accepts a user'"'"'s PIN by tracking the position of the user'"'"'s pupil as the user focuses on symbols on a display.

42. The system according to claim 1, wherein a single illumination source includes the iris illumination source of the at least one iris imaging system and the retina illumination source of the at least one retina imaging system, and a single image sensor includes the iris image sensor of the at least one iris imaging system and the retina image sensor of the at least one retina imaging system.

43. The system according to claim 42, further comprising a compensating lens, an reflective mirror, and a beamsplitter to form the iris image and the retina image on the single camera sensor.

44. The system according to claim 1, wherein the at least one iris imaging system includes two iris imaging systems, the at least one retina imaging system includes two retina imaging systems, and the two iris imaging systems and the two retina imaging systems operate at least substantially simultaneously to capture a set of iris images and retina images from both the right eye and the left eye, the set of iris images and retina images providing biometric data.

45. The system according to claim 44, further comprising a processor adapted to determine at least one of interpupillary distance and limbus diameter from the biometric data.

46. The system according to claim 45, further comprising:

means for creating subsets of data, from reference data in a biometric database, according to ranges of at least one of interpupillary distance and limbus diameter;

means for determining at least one of an interpupillary distance measurement and a limbus diameter measurement for the user; and

means for searching one of the subsets of data containing at least one of the interpupillary distance measurement and the limbus diameter measurement for a biometric match within the reference data.

47. The system according to claim 1, wherein the at least one iris imaging system includes one iris imaging system corresponding to both the right eye and the left eye, the at least one retina imaging system includes two retina imaging systems corresponding to the right eye and the left eye, respectively, and the controller controls the one iris imaging systems to operate with one of the two retina imaging systems to capture a set of iris images and retina images from one of the right eye and the left eye, the set of iris images and retina images providing biometric data.

48. A system for multimodal biometric identification, the system comprising:

two imaging systems corresponding with a right eye and a left eye, respectively, each imaging system including;

an illumination source that emits photons to the corresponding eye; and

an image sensor that, according to the operation of the illumination source, detects the photons that are reflected from the corresponding eye, whereby the image sensor captures an image of the corresponding eye having biometric data.

49. The system according to claim 48, wherein the illumination source of each of the two imaging systems directs photons to an iris of the corresponding eye and the corresponding image sensor detects photons reflected from the iris to capture an iris image for biometric data.

50. The system according to claim 48, wherein the illumination source of each of the two imaging systems directs photons to a retina of the corresponding eye and the corresponding image sensor detects photons reflected from the retina to capture a retina image for biometric data.

51. A system for biometric identification, the system comprising:

a housing;

at least one user window on a first side of the housing, the at least one user window adapted to accommodate at least one eye of a user positioned on a first side of the housing;

at least one opposing window on a second side of the housing, the at least one opposing window aligned with the at least one user window, wherein transmission of images of objects external to the housing occur between the at least one user window and the at least one opposing window;

at least one illumination source in the housing emitting photons through the at least one user window to be reflected from the at least one eye; and

at least one image sensor in the housing for capturing an image according to the photons reflected from the at least one eye, the image having biometric identification data.

52. The system of claim 51, wherein the at least one user window comprises two user windows, and two exit pupils correspond respectively with the two user windows and are configured to be visually fused by a vergence of the user when the two eyes are aligned with respect to the user windows for image capture by the at least one image sensor.

53. The system according to claim 52, wherein the at least two eyes includes a right eye and a left eye of the user, and the at least one image sensor captures at least one of an iris image and an retina image from each of the right eye and the left eye.

54. The system according to claim 51, wherein the at least one illumination source includes a near-infrared illumination source.

55. The system according to claim 54, further comprising at least one beamsplitter in the housing adapted to direct near-infrared illumination reflected from the at least one eye to the at least one image sensor and to direct visible light to the at least one opposing window.

56. The system according to claim 55, wherein the at least one illumination source includes a white light illumination source to close down a pupil of the at least one eye and to illuminate the at least one eye and provide an image of the at least one eye to the at least one opposing window.

57. The system according to claim 51, further comprising at least one of a horizontal diffraction grating and a vertical diffraction grating at the least one user windows.

58. The system according to claim 51, further comprising a semitransparent target in the housing to provide a further visual indicator for alignment of the at least one eye.

59. A method of using a system for biometric identification including:

a housing;

at least one user window on a first side of the housing, the at least one user window adapted to accommodate at least one eye of a user positioned on a first side of the housing;

at least one opposing window on a second side of the housing, the at least one opposing window aligned with the at least one user window, wherein transmission of images of objects external to the housing occur between the at least one user window and the at least one opposing window;

at least one illumination source in the housing for emitting photons through the at least one user window to be reflected from the at least one eye; and

at least one image sensor in the housing for capturing an image according to the photons reflected from the at least one eye, the image having biometric identification data,

the method comprising;

positioning the user at the first side of the housing;

viewing, while positioned at the second side of the housing, the at least one eye of the user through the at least one opposing window and the at least one user window;

aligning the at least one eye of the user with the at least one user window;

illuminating, with photons, the at least one eye with the at least one illumination source; and

and capturing the image according to the photons reflected from the at least one eye.

60. A method of using a system for biometric identification including:

a housing;

at least one user window on a first side of the housing, the at least one user window adapted to accommodate at least one eye of a user positioned on a first side of the housing;

at least one opposing window on a second side of the housing, the at least one opposing window aligned with the at least one user window, wherein transmission of images of objects external to the housing occur between the at least one user window and the at least one opposing window;

at least one illumination source in the housing for emitting photons through the at least one user window to be reflected from the at least one eye; and

at least one image sensor in the housing for capturing an image according to the photons reflected from the at least one eye, the image having biometric identification data,

the method comprising;

viewing with the at least one eye, while positioned at the first side of the housing, a target object through the at least one user window and the at least one opposing window;

aligning the at least one eye with the at least one user window;

illuminating, with photons, the at least one eye with the at least one illumination source; and

and capturing the image according to the photons reflected from the at least one eye.