Infrared and visible fusion face recognition system
First Claim
1. A detection system comprising:
- a first array for providing a first image having a field-of-view of a scene in a lower reflective infrared band;
a second array for providing a second image having the field-of-view of the scene in an upper reflective infrared band;
a third array for providing a third image having the field-of-view of the scene in a visible band;
a subtractive mechanism for determining the differences of intensities of elements of the first and second images and forming a fourth image of elements having the differences of intensities and having the field-of-view;
a thresholder for nulling the elements of the fourth image having differences of intensities that do not meet a certain threshold intensity value;
a feature selector for finding facial features in the fourth image and detecting a face with the features;
a framer for placing a frame around the face in the fourth image;
a first integrator for inserting the frame that surrounds that face in the first image; and
a second integrator for inserting the frame that surrounds the face in the third image.
1 Assignment
0 Petitions
Accused Products
Abstract
A face detection and recognition system having several arrays imaging a scene in the infrared and visible spectrums. The system may use weighted subtracting and thresholding to distinguish human skin in a sensed image. A feature selector may locate a face in the image. The image may be cropped with a frame or border incorporating essentially only the face. The border may be superimposed on images from an infrared imaging array and the visible imaging array. Sub-images containing the face may be extracted from within the border on the infrared and visible images, respectively, and compared with a database of face information to attain recognition of the face. Confidence levels of recognition for infrared and visible imaged faces may be established. A resultant confidence level of recognition may be determined from these confidence levels. Infrared lighting may be used as needed to illuminate the scene.
-
Citations
45 Claims
-
1. A detection system comprising:
-
a first array for providing a first image having a field-of-view of a scene in a lower reflective infrared band;
a second array for providing a second image having the field-of-view of the scene in an upper reflective infrared band;
a third array for providing a third image having the field-of-view of the scene in a visible band;
a subtractive mechanism for determining the differences of intensities of elements of the first and second images and forming a fourth image of elements having the differences of intensities and having the field-of-view;
a thresholder for nulling the elements of the fourth image having differences of intensities that do not meet a certain threshold intensity value;
a feature selector for finding facial features in the fourth image and detecting a face with the features;
a framer for placing a frame around the face in the fourth image;
a first integrator for inserting the frame that surrounds that face in the first image; and
a second integrator for inserting the frame that surrounds the face in the third image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A human detection system comprising:
-
a multi-band camera having first, second and third outputs;
a subtractor connected to the first and second outputs;
a thresholder connected to the subtractor;
a feature selector connected to the thresholder;
a framer connected to the thresholder;
a first pixel integrator connected to the framer and the first output;
a second pixel integrator connected to the framer and the third output;
a first extractor connected to the first integrator;
a second extractor connected to the second integrator;
a first recognition system connected to the first extractor; and
a second recognition system connected to the second extractor. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A detection system comprising:
-
a first array of detector pixels having a field of view of a scene;
a second array of detector pixels having the field of view;
a third array of detector pixels having the field of view;
a subtractor connectable to the first and second arrays;
a comparator connected to the subtractor; and
wherein;
the first array of detector pixels has a sensitivity to light in a lower portion of a reflective infrared spectrum;
the second array of detector pixels has a sensitivity to light in an upper portion of a reflective infrared spectrum;
the third array of detector pixels has a sensitivity to light in a visible spectrum;
a pixel trio includes a first pixel at a location of the first array of detector pixels which has a one-to-one correlation with a second pixel of the pixel trio at a corresponding location of the second array of detector pixels, and which has a one-to-one correlation with a third pixel of the pixel trio at a corresponding location of the third array of detector pixels;
the subtractor may detect the differences of magnitudes of output signals from the first and second pixels of each pixel trio and output a magnitude difference signal of the first and second pixels for each pixel trio; and
a comparator may compare the magnitude difference signals to a certain threshold value and select the pixel trios with the first and second pixels having magnitude difference values on one side of the threshold value. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29, 30)
-
-
31. A method for detecting a face in a scene, comprising:
-
capturing a first image the scene with a first sensing array sensitive to a first band of reflective infrared light;
capturing a second image of the scene with a second sensing array sensitive to a second band of reflective infrared light; and
capturing a third image of the scene with a third sensing array sensitive to a band of visible light; and
wherein;
the first image comprises m×
n pixels;
the second image comprises m×
n pixels;
the third image comprises m×
n pixels;
the first, second and third images have the same field of view of the scene;
each pixel P(i,j)1 of the first image is located at an ith row and a jth column;
each pixel P(i,j)2 of the second image is located at an ith row and a jth column;
each pixel P(i,j)1 of the third image is located at an ith row and a jth column;
1≦
i≦
m;
1≦
j≦
m;
each pixel P(i,j)1 of the first image has a counterpart pixel P(i,j)2 in the second image in a one-to-one mapping of the first image to the second image;
each pixel P(i,j)1 of the second image has a counterpart pixel P(i,j)2 in the third image in a one-to-one mapping of the second image to the third image;
a difference intensity pixel Δ
IP(i,j) may be determined from an intensity of each pixel IP(i,j)1 of the first image and each counterpart pixel IP(i,j) of the second image, for all of the pixels of the first and second images;
each difference intensity pixel Δ
IP(i,j) has an intensity value that may be measured against an intensity threshold value and has its value nullified if it does not meet a certain range of intensity values relative to the intensity threshold value, and becomes a thresholded difference intensity pixel TΔ
IP(i,j);
each thresholded difference intensity pixel together with each other thresholded difference intensity pixel forms a fourth image having a one-to-one mapping of pixels to the first and second images; and
features of a face are sought, and if found, a face is detected in the fourth image and a frame is scribed as frame pixels in the fourth image around the face. - View Dependent Claims (32, 33, 34, 35, 36, 37, 38)
-
-
39. Means for detecting faces, comprising:
-
means for obtaining a first image with a first field of view of a scene at a lower reflective infrared band of light;
means for obtaining a second image with the first field of view of the scene at an upper reflective infrared band of light;
means for obtaining a third image with the first field of view of the scene at a visible band of light;
means for subtractively combining the first and second images into a fourth image;
means for thresholding the pixels of the fourth image to result in a fifth image having only the pixels meeting a set threshold value;
means for finding features of a face in the fifth image;
means for inserting a frame around the face based on the features;
means for transferring the frame to be around the face in the first image; and
means for transferring the frame to be around the face in the third image. - View Dependent Claims (40, 41, 42, 43, 44, 45)
-
Specification