Long distance multimodal biometric system and method

• US 8,577,093 B2
• Filed: 02/20/2012
• Issued: 11/05/2013
• Est. Priority Date: 09/15/2006
• Status: Active Grant

• Current Assignee: Idemia Identity & Security USA, LLC (Advent International Corporation)
• Original Assignee: Identix, Inc. (Advent International Corporation)
• Inventors: Friedman, Marc D., Accomando, Nicholas A., Bashir, Faisal, Casaverde, Pablo, Daly, Stephen F., Hitchcock, David J., Jose, Romina Marie Johnson, McNerney, Tim, Muller, David, Ruzhitsky, Vladimir, Tosa, Yasunari, Usher, David
• Primary Examiner(s): Seth, Manav
• Application Number:
  US13/400,499
• Publication Number:
  US 20120200689A1
• Time in Patent Office: 624 Days
• Field of Search: 382/103, 382115-127, 348135-161
• US Class Current: 382/115
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

A system for multimodal biometric identification has a first imaging system that detects one or more subjects in a first field of view, including a targeted subject having a first biometric characteristic and a second biometric characteristic; a second imaging system that captures a first image of the first biometric characteristic according to first photons, where the first biometric characteristic is positioned in a second field of view smaller than the first field of view, and the first image includes first data for biometric identification; a third imaging system that captures a second image of the second biometric characteristic according to second photons, where the second biometric characteristic is positioned in a third field of view which is smaller than the first and second fields of view, and the second image includes second data for biometric identification. At least one active illumination source emits the second photons.

Claims

1. A system for capturing biometric data from one or more subjects, comprising:

a first imaging system having a first field of view and capturing a plurality of scene images from the first field of view, each scene image including a background image and a foreground image, the foreground image containing one or more subject images of the one or more subjects;

a second imaging system having a second field of view;

a third imaging system having a third field of view;

at least one programmable device that detects, in each scene image, the foreground image relative to the background image to detect the one or more subject images; and

an adjustment system coupled to the second imaging system and the third imaging system, the adjustment system being movable according to a position of a selected one of the one or more subjects detected in the first field of view, movement of the adjustment system causing at least one of a face of the selected subject to be positioned in the second field of view and eyes of the selected subject to be positioned in the third field of view, the second imaging system capturing at least one facial image corresponding to the face of the selected subject when the face of the selected subject is positioned in the second field of view, and the third imaging system capturing at least one eye images corresponding to the eyes of the selected subject when the eyes of the selected subject are positioned in the third field of view, the at least one eye images being determined from the at least one facial image and providing biometric data for the subject.

2. The system according to claim 1, wherein the adjustment system pans about a vertical axis of rotation and tilts about a horizontal axis of rotation.

3. The system according to claim 2, wherein (x, y) positions for pixels in the first field of view of the first imaging system are mapped to pan angles about the vertical axis of rotation and tilt angles about the horizontal axis of rotation such that the (x, y) positions are positioned in the second field of view of the second imaging system.

4. The system according to claim 1, further comprising an illuminator that propagates an illumination beam, the illuminator being coupled to the adjustment device, the movement of the adjustment system causing the illumination beam to be directed at the selected subject.

5. The system according to claim 4, wherein the illuminator propagates the illumination beam according to a vertical direction and a horizontal direction, the vertical direction and the horizontal direction being independently adjustable to move the illumination beam.

6. The system according to claim 4, wherein the illuminator is a laser illuminator that propagates a collimated beam having a substantially uniform illumination profile over a distance to the selected subject.

7. The system according to claim 1, wherein the adjustment system is moved in a sequence according to the position of each subject in the scene images to position at least one of the face of the selected subject in the second field of view and the eyes of the selected subject in the third field of view, the sequence being determined by the at least one programmable device.

8. The system according to claim 7, wherein the at least one programmable device determines the sequence according to one of physical characteristics, behavioral characteristics, and other biometric characteristics of the subjects.

9. The system according to claim 1, wherein the first imaging system captures images of a fixed scene.

10. The system according to claim 9, wherein the first imaging system includes a plurality of cameras substantially overlapping and the first field of view is 360-degrees.

11. The system of claim 1, wherein the second imaging system captures a plurality of facial images from the selected subject, the plurality of facial images providing eye tracking information for the subject.

12. The system according to claim 1, wherein the eye images captured by the third imaging system includes iris images from the selected subject, the iris images providing biometric data.

13. The system according to claim 11, wherein a subject-servo-loop tracks the movement of the adjustment system and a motion of the selected subject, the adjustment system being moved according to the motion of the subject to allow the second imaging system to capture the plurality of facial images and the third imaging system to capture the at least one eye images.

14. The system according to claim 13, wherein position data from the adjustment system is determined according to a frequency and provides input for a time-based movement model that estimates past and future positions and velocities for the adjustment system.

15. The system according to claim 11, further comprising a rangefinder, wherein the adjustment system is further coupled to the rangefinder, the movement of the adjustment system causing the rangefinder to be directed at the selected subject, and the rangefinder provides range information that is used in combination with the eye tracking information to model the motion of the selected subject, the range information indicating the motion of the subject in a z-direction and the eye tracking information indicating the motion of the subject in x, y-directions.

16. The system according to claim 1, wherein the at least one programmable device receives the plurality of scene images from the first field of view, detects the one or more subject images in the plurality of scene images, and detects a position of the selected subject in the first field of view, and in response, the adjustment system causes the second imaging device to track the face of the selected subject.

17. The system according to claim 16, wherein the programmable device tracks the faces of the one or more subjects in the plurality of scene images.

18. The system of claim 16, wherein the programmable device receives the at least one facial image from the second field of view and detects the eyes in the at least one facial image, and in response, the adjustment system causes the third imaging system to locate the eye images.

19. The system of claim 1, wherein the programmable device detects the biometric data in the eye images from the third field of view.

20. The system of claim 1, wherein the plurality of scene images represent movement of the one or more subjects through the first field of view.