Spectral imaging system for remote and noninvasive detection of target substances using spectral filter arrays and image capture arrays

• US 9,551,616 B2
• Filed: 06/17/2015
• Issued: 01/24/2017
• Est. Priority Date: 06/18/2014
• Status: Active Grant

• Current Assignee: Innopix Incorporated
• Original Assignee: Innopix Incorporated
• Inventors: McQuilkin, Gary L., Engelke, Gregory L.
• Primary Examiner(s): Chowdhury, Tarifur
• Assistant Examiner(s): Rahman, Md M
• Application Number:
  US14/742,074
• Publication Number:
  US 20160069743A1
• Time in Patent Office: 587 Days
• Field of Search: 356/416
• US Class Current: 1/1
• CPC Class Codes: A22B 5/007 Non-invasive scanning of carcasses, e.g. using image recognition, tomography, X-rays, ultrasound analysing meat, e.g. search for foreign embedded objects G01N33/12; image analysis G06T7/00
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/14507 specially adapted for measuring characteristics of body fluids other than blood devices for taking samples of body liquids A61B10/0045
• CPC Class Codes: A61B 5/14542 for measuring blood gases A61B5/14551 takes precedence
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: G01J 2003/1213 Filters in general, e.g. dichroic, band
• CPC Class Codes: G01J 2003/123 Indexed discrete filters
• CPC Class Codes: G01J 2003/1239 and separate detectors
• CPC Class Codes: G01J 2003/2826 Multispectral imaging, e.g. filter imaging
• CPC Class Codes: G01J 3/0205 Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
• CPC Class Codes: G01J 3/0272 Handheld
• CPC Class Codes: G01J 3/0297 Constructional arrangements for removing other types of optical noise or for performing calibration
• CPC Class Codes: G01J 3/12 Generating the spectrum; Monochromators
• CPC Class Codes: G01J 3/2803 using photoelectric array detector
• CPC Class Codes: G01J 3/2823 Imaging spectrometer
• CPC Class Codes: G01J 3/36 Investigating two or more bands of a spectrum by separate detectors
• CPC Class Codes: G01N 2021/1793 Remote sensing
• CPC Class Codes: G01N 2021/3137 with selection of wavelengths after the sample
• CPC Class Codes: G01N 21/255 Details, e.g. use of specially adapted sources, lighting or optical systems
• CPC Class Codes: G01N 21/31 : Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry G01N21/72 takes precedence
• CPC Class Codes: G01N 2201/129 : Using chemometrical methods
• CPC Class Codes: G02B 5/201 : in the form of arrays
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing

Abstract

An approach to noninvasively and remotely detect the presence, location, and/or quantity of a target substance in a scene via a spectral imaging system comprising a spectral filter array and image capture array. For a chosen target substance, a spectral filter array is provided that is sensitive to selected wavelengths characterizing the electromagnetic spectrum of the target substance. Elements of the image capture array are optically aligned with elements of the spectral filter array to simultaneously capture spectrally filtered images. These filtered images identify the spectrum of the target substance. Program instructions analyze the acquired images to compute information about the target substance throughout the scene. A color-coded output image may be displayed on a smartphone or computing device to indicate spatial and quantitative information about the detected target substance. The system desirably includes a library of interchangeable spectral filter arrays, each sensitive to one or more target substances.

Claims

1. A spectral imaging system for remotely and noninvasively detecting the presence and location of one or more target substances in a scene, said system comprising:

a) an image capture array comprising a plurality of image capturing elements, wherein each image capturing element independently captures an image of the scene;

b) a plurality of spectral filter arrays that are independently selectable and alignable on demand with the image capture array, wherein;

(i) each of the spectral filter arrays is pre-associated with at least one corresponding target substance;

(ii) each of the spectral filter arrays includes a plurality of spectral filtering elements, wherein each spectral filtering element of said plurality of spectral filtering elements selectively passes a pre-selected bandwidth portion of the electromagnetic spectrum that is pre-associated with a spectral characteristic of the corresponding target substance;

(iii) each of the spectral filter arrays is selectable and positionable on demand to be aligned with the image capture array such that each of at least two or more of the image capturing elements is optically aligned with at least one corresponding spectral filtering element in a manner effective to capture spectrally filtered image information comprising image pixels in a manner such that the image capture array captures image information for one or more independent spectrally filtered images; and

c) program instructions that use the spectrally filtered image information to determine if image pixels are associated with spectral responses matching the target substance and to determine and output information indicative of the presence and location of the at least one associated target substance in the scene.

2. The system of claim 1, further comprising program instructions that control a filtering bandwidth for one or more electronic spectral filtering elements.

3. A spectral imaging system for remotely and noninvasively detecting the presence and location of one or more target substances in a scene, said system comprising:

a) an image capture array comprising a plurality of image capturing elements, wherein each image capturing element independently captures an image of the scene;

b) one or more spectral filter arrays that are independently selectable and alignable on demand with the image capture array, wherein;

(i) each spectral filter array is pre-associated with at least one corresponding target substance; and

(ii) each spectral filter array includes a plurality of spectral filtering elements, wherein each spectral filtering element of said plurality of spectral filtering elements selectively passes a pre-selected bandwidth portion of the electromagnetic spectrum that is pre-associated with a spectral characteristic of the corresponding target substance;

(iii) each of the plurality of spectral filter arrays is selectable and positionable on demand to be aligned with the image capture array such that each of at least two or more of the image capturing elements is optically aligned with at least one corresponding spectral filtering element in a manner effective to capture spectrally filtered image information in a manner such that the image capture array captures image information for a plurality of independent spectrally filtered images in a manner such that image pixels of the filtered images that match the spectral characteristics of the target substance indicate the presence and location of the target substance in a scene.

4. The system of claim 3, further comprising program instructions that use the captured image information to identify at least one spatial location of the target substance in the scene, and wherein the programming instructions align captured image information corresponding to the spatial position of objects in the scene.

5. The system of claim 4, wherein the program instructions comprise instructions to perform an illumination calibration.

6. The system of claim 4, wherein the program instructions comprise instructions to calibrate image information corresponding to at least one captured image to account for a variation in a sensor sensitivity.

7. The system of claim 4, wherein the program instructions comprise instructions to calibrate image information corresponding to at least one captured image to account for a variation in filter transmission efficiency.

8. The system of claim 4, wherein the program instructions recognize the filter array being used and automatically select an associated algorithm to detect a pre-associated target substance.

9. The system of claim 4, wherein the program instructions use the captured image information to generate an output that comprises information indicative of a quantity of the target substance.

10. The system of claim 9, comprising a colormap to compute a color intensity indicative of a quantity of the target substance at a given location in an output image.

11. The imaging system of claim 4, wherein the program instructions use captured image information to compute at least one of the following:

a) information indicative of at least one ratio of spectral amplitude information at two or more wavelengths;

b) information indicative of at least one difference of spectral amplitude information at two or more wavelengths;

c) information indicative of at least one area associated with spectral information;

d) a computation, using spectral image information, wherein the computation is selected from one or more of the following;

eigenvector, basis function, least squares, principle component analysis, matched filter, neural networks, cross-correlation, multivariate analysis; and

e) a computation, using spectral information, wherein a mathematical formula relates spectral amplitude information at two or more wavelengths.

12. The imaging system of claim 4, wherein the program instructions compute an illumination calibration;

and wherein the program instructions comprise information indicative of a listing comprising a plurality of predetermined calibration curves for a plurality of light sources.

13. The imaging system of claim 12, wherein the light sources include at least one sunlight, incandescent light, fluorescent light, mercury vapor light, ultraviolet light, and an LED source.

14. The system of claim 4, wherein the program instructions generate an output indicative of the presence of a target substance at one or more locations in the scene, and wherein the output comprises an image of the scene comprising color information to indicate the presence and location of the target substance.

15. The system of claim 14, wherein portions of the output image at which the target substance is not located are shown in grayscale.

16. The system of claim 14, wherein a non-natural color is assigned to pixels of the output image that correspond to locations of the target substance in the scene.

17. The system of claim 14, comprising an in-frame reference that provides image information indicative of a known amount of a detected target substance.

18. The system of claim 14, wherein the captured image information comprises captured reflected image information from the scene.

19. The system of claim 14, comprising capturing transmission image information from the scene.

20. The system of claim 3, wherein the filter array comprises a plurality of spectral filter elements incorporated into a card.

21. The system of claim 3, further comprising a smartphone, tablet computer, laptop computer, desktop computer, head-mounted computer, or mobile computing device, communicatively coupled to the image capture array.

22. The system of claim 3, comprising an in-frame reference that provides image information indicative of an intensity of an illumination source.

23. The system of claim 3, comprising an in-frame reference that provides image information to calibrate the spectral imaging system.

24. The system of claim 3, wherein the system comprises a plurality of interchangeable filter cards, wherein each filter card comprises a spectral filter array, wherein each spectral filter array comprises a plurality of spectral filtering elements, and wherein each filter card is pre-associated with at least one corresponding target substance.

25. The imaging system of claim 24, wherein at least one filter card is pre-associated with two or more corresponding target substances.

26. The system of claim 3, further comprising information indicative of a spectral characteristic of a target substance within each of a plurality of distinct bandwidth portions of the electromagnetic spectrum, each of said bandwidth portions having a wavelength span of up to about 30 nm.

27. The system of claim 26, wherein each wavelength span is up to about 10 nm.

28. The system of claim 26, wherein the spectral filter system comprises program instructions that control a filtering bandwidth for one or more electronic spectral filtering elements.

29. The system of claim 3, wherein the spectral filter array comprises an interchangeable spectral filter card comprising a plurality of spectral filter elements having individual wavelength spans ranging from about 10 nm to about 30 nm.