Apparatus, systems and methods for improved facial detection and recognition in vehicle inspection security systems

• US 9,953,210 B1
• Filed: 05/30/2017
• Issued: 04/24/2018
• Est. Priority Date: 05/30/2017
• Status: Active Grant

• Current Assignee: Gatekeeper, Inc. (OSI Systems Incorporated)
• Original Assignee: Gatekeeper, Inc. (OSI Systems Incorporated)
• Inventors: Rozploch, Robert, Garrido, Diego, Hansen, Marc
• Primary Examiner(s): Conner, Sean
• Assistant Examiner(s): Patel, Pinalben
• Application Number:
  US15/608,422
• Time in Patent Office: 329 Days
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: G06V 20/625 License plates
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G07C 9/253 visually

Abstract

Devices, systems, and methods provide for improved facial detection and facial recognition in vehicle interior inspections. In various embodiments, one or more high-resolution cameras having one or more lens and filter attachments operate in conjunction with one or more auxiliary illumination devices and a related computer system. According to various embodiments, an auxiliary illumination device can be synchronized to one or more cameras, and configured to supply auxiliary illumination to facilitate capture of accurate and usable images. The filter(s) and advanced image processing solutions assist with facial detection and identifying individuals inside a vehicle, removing light glare and undesired reflections from a window surface, and capturing an image through a tinted window, among other things. Further, embodiments can compare a captured image to an authenticated image from a database, in order to confirm the identity of a vehicle occupant.

Claims

1. A method for detecting a vehicle occupant, comprising the steps of:

providing an apparatus comprising a camera and an illumination device, wherein the camera comprises a linear polarization filter secured adjacent a camera lens, wherein the camera lens has a fixed field of view;

detecting the presence of an oncoming vehicle, wherein the vehicle includes at least one vehicle window separating a vehicle interior enclosure from an external environment, wherein the at least one vehicle window has a frame surrounding the at least one vehicle window;

triggering the automatic capture of a plurality of current facial images of at least one vehicle occupant present within the vehicle interior enclosure when the at least one vehicle window frame is maximized in the fixed field of view, wherein each of the plurality of current facial images is captured automatically via the camera through the linear polarization filter, and wherein each of the plurality of current facial images is further captured from a different distance to the oncoming vehicle;

obtaining, by a processing unit, at least one archived image of at least one individual;

comparing, by the processing unit, at least one of the current facial images with the at least one archived image; and

determining whether the at least one vehicle occupant and the at least one individual are the same.

2. The method of claim 1, wherein the step of comparing at least one of the current facial images with the at least one archived image is performed by the processing unit using facial recognition programming.

3. The method of claim 1, wherein the step of comparing at least one of the current facial images with the at least one archived image comprises determining, by the processing unit, whether the at least one vehicle occupant in the at least one of the current facial images is the same individual as the at least one individual from the at least one archived image.

4. The method of claim 1, further including the step of activating the illumination device when capturing each of the plurality of current facial images, and sequencing the activating and capturing steps according to an image processing protocol that specifies the relative timing of the activating and capturing steps.

5. The method of claim 1, wherein the camera lens has a field of view, wherein the at least one window frame is a trapezoidal frame of a front windshield of the oncoming vehicle.

6. The method of claim 1, wherein the step of triggering the automatic capture is further performed when at least a portion of the at least one vehicle occupant is in the field of view.

7. The method of claim 1, wherein the camera further comprises an optical bandpass filter, and wherein capturing the plurality of current facial images is performed by the camera through the optical bandpass filter.

8. The method of claim 7, further including an objective lens secured to the camera between the optical bandpass filter and the linear-polarization filter.

9. The method of claim 1, wherein the camera and the illumination device are located in the external environment.

10. The method of claim 1, wherein the step of triggering the automatic capture is performed through optical flow algorithmic image analysis.

11. The method of claim 1, including the step of authenticating the at least one vehicle occupant for access to an access-controlled asset based upon the step of comparing, and further based upon one or more of:

a detected license plate number, an undervehicle image, and a readable tag on the vehicle.

12. A method, comprising the steps of:

providing a camera having a lens facing a fixed field of view, a linear polarization filter secured adjacent the lens and an optical bandpass filter secured adjacent the lens;

providing an illumination device for illuminating the field of view;

providing an image processing component for synchronizing the activation of the illumination device with activation of the camera;

detecting the presence of an oncoming vehicle, wherein the vehicle includes at least one front windshield separating a vehicle interior enclosure from an external environment, wherein the at least one front windshield has a frame surrounding the at least one front windshield;

upon the oncoming vehicle entering the field of view and the at least one front windshield frame being maximized in the fixed field of view, activating the illumination device while capturing, via the camera through the linear polarization filter, the optical bandpass filter and the at least one window, a plurality of current facial images of at least one vehicle occupant present within the vehicle interior enclosure, wherein each of the plurality of current facial images is captured from a different distance to the oncoming vehicle;

obtaining, by a processing unit, at least one archived image of at least one individual previously associated with the detected vehicle identifier;

comparing, by the processing unit, the at least one present image with the at least one archived image; and

determining whether the at least one vehicle occupant and the at least one individual are the same.

13. The method of claim 12, wherein the camera and the illumination device are located in the external environment.

14. The method of claim 12, including the step of determining, by the processing unit, the number of vehicle occupants in the vehicle interior enclosure based upon the captured plurality of current facial images.

15. The method of claim 12, including the step of authenticating the at least one vehicle occupant for access to an access-controlled asset based upon the step of comparing, and further based upon one or more of:

a detected license plate number, an undervehicle image, and a readable tag on the vehicle.

16. The method of claim 12, wherein the at least one window has a frame, and wherein the step of capturing the plurality of current facial images is performed while the frame of the at least one window is within the field of view.

17. A system for detecting a vehicle occupant, comprising:

a camera comprising a linear polarization filter secured adjacent a camera lens, and a lens facing a fixed field of view;

at least one illumination device;

at least one processor; and

at least one memory device storing a plurality of instructions which, when executed by the at least one processor, cause the at least one processor to;

store one or more images of at least one individual person;

synchronize the activation of the at least one illumination device with the camera;

automatically trigger the activation of the camera when a trapezoidal frame of a front windshield of a moving vehicle is maximized within the fixed field of view;

compare at least one image captured by the camera of at least one vehicle occupant present within a vehicle interior enclosure of a vehicle, with the one or more stored images of the at least one individual person, wherein the at least one image is captured by the camera through the linear polarization filter and a window of a vehicle; and

determine whether the at least one vehicle occupant and the at least one individual person are the same.

18. The system of claim 17, wherein the at least one image captured by the camera is taken from a plurality of current facial images of the at least one vehicle occupant, and wherein each of the plurality of current facial images is captured from a different distance to the vehicle.

19. The system of claim 18, wherein the plurality of instructions, when executed by the at least one processor, further cause the at least one processor to determine the number of vehicle occupants in the vehicle interior enclosure based upon the captured plurality of current facial images.

20. The system of claim 17, wherein the camera further includes an optical bandpass filter secured such that the lens is secured between the optical bandpass filter and the linear-polarization filter.

21. The system of claim 17, wherein the plurality of instructions, when executed by the at least one processor, further cause the at least one processor to authenticate the at least one vehicle occupant for access to an access-controlled asset based upon the step of comparing, and further based upon one or more of:

a detected license plate number, an undervehicle image, and a readable tag on the vehicle.

22. The system of claim 17, wherein the camera and the illumination device are located external to the vehicle.