Apparatus and method for multispectral based detection

• US 9,372,118 B1
• Filed: 06/25/2014
• Issued: 06/21/2016
• Est. Priority Date: 03/07/2011
• Status: Active Grant

• Current Assignee: FluxData, Inc. (Halma PLC)
• Original Assignee: FluxData, Inc. (Halma PLC)
• Inventors: Spiliotis, Pano A., Taplin, Lawrence A.
• Primary Examiner(s): Geisel, Kara E
• Assistant Examiner(s): Ayub, Hina F
• Application Number:
  US14/314,469
• Time in Patent Office: 727 Days
• US Class Current: 1/1
• CPC Class Codes: G01J 2003/2806 Array and filter array
• CPC Class Codes: G01J 2003/2826 Multispectral imaging, e.g. filter imaging
• CPC Class Codes: G01J 3/2803 using photoelectric array detector
• CPC Class Codes: G01J 3/2823 Imaging spectrometer
• CPC Class Codes: G01J 3/36 Investigating two or more bands of a spectrum by separate detectors
• CPC Class Codes: G01J 3/42 Absorption spectrometry; Double beam spectrometry; Flicker spectrometry; Reflection spectrometry beam switching arrangements G01J3/08
• CPC Class Codes: G01J 3/51 using colour filters
• CPC Class Codes: G01N 2223/422 windows within the image

Abstract

An apparatus for spatially characterizing an illumination source of interest in a scene comprised of at least one optical element configured to form an image on a focal plane; a single plane sensing array comprising at least two types of pixels having different spectral sensitivity bands, the pixels located at spatially non-overlapping regions of the sensing array; a multi-bandpass filter spectrally narrowing light received from the scene within at least two of the different spectral sensitivity bands corresponding to features that distinguish the illumination source of interest from other sources in the scene; and a processor in signal communication with the sensing array and containing an algorithm to interpolate at least two levels of signals received from at least one spatial location on the sensing array and to determine the presence of the specific illumination source of interest from the relative intensities of the two levels.

Claims

1. An apparatus for spatially characterizing a specific illumination source of interest in a scene, the apparatus comprising:

a) at least one optical element configured to form an image of the scene including the specific illumination source of interest on a focal plane;

b) a single plane sensing array covered by a color filter array and having a field of view, and positioned at the focal plane and comprising at least two types of pixels having different spectral sensitivity bands, the pixels located at spatially non-overlapping regions of the sensing array;

c) a multi-bandpass filter disposed between the scene and the sensing array, the filter separated from the sensing array and spectrally transmitting light received from the scene in pass bands, the pass bands having a maximum peak transmissivity corresponding to at least one of the at least two different pixel spectral sensitivity bands, and the different pixel spectral sensitivity bands corresponding to spectral absorption, reflection, or emission features that distinguish the specific illumination source of interest from other illumination sources in the scene;

d) a secondary optical sensor having different spectral sensitivity bands than the single plane sensing array and fewer total sensing elements; and

e) a processor in signal communication with the sensing array and the optical sensor and containing an algorithm executable by the processor to process individual image data received from the sensing array, and for each individual image defined by the received image data, to interpolate at least two levels of signals received from at least one spatial location on the sensing array, and to process signals received from the secondary optical sensor to estimate a range of expected responses that indicate detection of the illumination source of interest, and to determine the presence of the specific illumination source of interest from the relative intensities of the at least two levels and the expected response range.

2. The apparatus of claim 1, wherein the algorithm includes determining the quantity of the specific illumination source of interest present in the scene.

3. The apparatus of claim 1, wherein the scene includes a plurality of illumination sources of interest, and the algorithm includes classifying the specific illumination sources of interest present in the scene.

4. The apparatus of claim 1, wherein the spectral sensitivity bands of the multi-bandpass filter correspond to spectral absorption or reflection features of hemoglobin or melanin.

5. The apparatus of claim 1, wherein the spectral sensitivity bands of the multi-bandpass filter correspond to the emission from a discharge of a weapon.

6. The apparatus of claim 1, wherein the multi-bandpass filter is disposed between the at least one optical element and the scene.

7. The apparatus of claim 1, wherein the multi-bandpass filter is disposed between the at least one optical element and the sensing array.

8. The apparatus of claim 1, wherein the multi-bandpass filter is a dichroic reflector configured to reflect light towards the sensing array.

9. The apparatus of claim 1, wherein peak wavelengths of the multi-bandpass filter are adjustable by rotation of the filter to a non-parallel position with respect to the focal plane.

10. The apparatus of claim 1, wherein the optical sensor is a diffuse light sensor having a field of view, and wherein the scene includes sky, and the field of view of the sensor is the sky.

11. The apparatus of claim 1, wherein the optical sensor is a directional light sensor having a field of view, and wherein the field of view of the sensor and the field of view of the single plane sensing array are the same field of view.

12. The apparatus of claim 1, wherein the scene is an outdoor scene containing the specific illumination source of interest and the other illumination sources.

13. The apparatus of claim 1, wherein the algorithm further comprises instructions to demosaic the individual image data, to separate one of the at least two levels of signals representative of a material of interest in the scene from another of the at least two levels of signals representative of a background of the scene, to segment between the background and the material of interest based on intra-band pixel values and parameters, and if the signal of a segmented region representative of a material of interest exceeds a user-defined threshold, outputting a signal indicative of detection of the material of interest.

14. A method for spatially characterizing a specific illumination source of interest in a scene, the method comprising:

a) predetermining wavelengths of light corresponding to the specific illumination source of interest that may be present in the scene;

b) directing light from the scene through a multi-bandpass filter to cause narrowing of the light within at least two different spectral sensitivity bands that distinguish the illumination source of interest from other illumination sources in the scene;

c) projecting the filtered light to form an image of the scene, including the specific illumination source of interest, through a color filter array covering a single plane sensing array, the single plane sensing array separate from the multi-bandpass filter and comprising at least two types of pixels having different spectral sensitivity bands corresponding to spectral absorption, reflection, or emission predetermined wavelengths that distinguish the illumination source of interest from other illumination sources in the scene; and

d) processing signals defining individual images from the sensing array, and for each individual image, interpolating at least two levels of signals received from at least one spatial location on the sensing array and determining the presence of the specific illumination source of interest from the relative intensities of the two levels.

15. The method of claim 14, further comprising determining the quantity of the specific illumination source of interest present in the scene.

16. The method of claim 14, wherein the scene includes a plurality of specific illumination sources of interest, and the method includes predetermining wavelengths of light corresponding to each illumination source of the plurality of illumination sources of interest and classifying the specific illumination sources of interest present in the scene.

17. The method of claim 14, wherein the scene includes human skin, and the illumination source of interest is at least one of hemoglobin or melanin contained in human skin, and the method includes predetermining wavelengths of light corresponding to spectral absorption and reflection from the at least one of the hemoglobin or melanin, and detecting the spectral absorption and reflection from the at least one of the hemoglobin or melanin present in the human skin in the scene.

18. The method of claim 14, wherein the illumination source of interest in the scene is a weapon discharge, and the method includes predetermining wavelengths of light corresponding to the weapon discharge detecting the emission of the discharge present in the scene.

19. The method of claim 14, further comprising adjusting peak wavelengths of the multi-bandpass filter.

20. An apparatus for spatially characterizing a specific illumination source of interest in a scene, the apparatus comprising:

a) at least one optical element configured to form an image of the scene including the specific illumination source of interest on a focal plane;

b) a single plane sensing array covered by a color filter array, and positioned at the focal plane and comprising at least two types of pixels each having different spectral sensitivity bands and a range of sensitivities which do not overlap at least one of the sensitivity bands of at least one other pixel type, wherein the pixels are located at spatially non-overlapping regions of the sensing array;

c) a multi-bandpass filter disposed between the scene and the sensing array, the filter separated from the sensing array and spectrally narrowing light received from the scene within at least two of the different spectral sensitivity band ranges corresponding to predetermined spectral absorption, reflection, or emission features that distinguish the specific illumination source of interest from other illumination sources in the scene; and

d) a processor in signal communication with the sensing array and containing an algorithm executable by the processor to process individual image data received from the sensing array, and for each individual image defined by the received image data, to interpolate at least two levels of signals received from at least one spatial location on the sensing array and to determine the presence of the specific illumination source of interest from the predetermined spectral absorption, reflection, or emission features of the specific illumination source of interest and from the relative intensities of the two levels.