Methods and apparatus for coaxial imaging of multiple wavelengths

• US 9,354,115 B2
• Filed: 07/16/2014
• Issued: 05/31/2016
• Est. Priority Date: 06/05/2012
• Status: Active Grant

• Current Assignee: Hypermed Imaging Incorporated
• Original Assignee: Hypermed Imaging Incorporated
• Inventors: Darty, Mark Anthony
• Primary Examiner(s): Chowdhury, Tarifur
• Assistant Examiner(s): Amara, Mohamed K
• Application Number:
  US14/333,406
• Publication Number:
  US 20150308896A1
• Time in Patent Office: 685 Days
• Field of Search: 356/326, 356/328, 356/300, 356/51, 356/73, 356/317, 356/445, 356/451, 356/302, 356/332, 250/226, 250/339.07, 250/458.1, 250/372, 250/574, 422/82.05, 422/82.08, 422/82.07
• US Class Current: 1/1
• CPC Class Codes: A61B 2090/309 using white LEDs
• CPC Class Codes: A61B 2090/3618 with a mirror
• CPC Class Codes: A61B 2560/0425 Ergonomically shaped housings A61B2560/0418 takes precedence
• CPC Class Codes: A61B 2562/0233 Special features of optical sensors or probes classified in A61B5/00
• CPC Class Codes: A61B 2562/028 Microscale sensors, e.g. electromechanical sensors [MEMS]
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/443 Evaluating skin constituents, e.g. elastin, melanin, water
• CPC Class Codes: A61B 5/447 specially adapted for aiding the prevention of ulcer or pressure sore development, i.e. before the ulcer or sore has developed
• CPC Class Codes: A61B 5/4869 Determining body composition
• CPC Class Codes: A61B 90/30 Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: G01J 2003/1213 Filters in general, e.g. dichroic, band
• CPC Class Codes: G01J 2003/2826 Multispectral imaging, e.g. filter imaging
• CPC Class Codes: G01J 3/0208 using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction
• CPC Class Codes: G01J 3/021 using plane or convex mirrors, parallel phase plates, or particular reflectors
• CPC Class Codes: G01J 3/0224 using polarising or depolarising elements
• CPC Class Codes: G01J 3/0291 Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
• CPC Class Codes: G01J 3/10 Arrangements of light sources specially adapted for spectrometry or colorimetry
• CPC Class Codes: G01J 3/12 Generating the spectrum; Monochromators
• CPC Class Codes: G01J 3/2803 using photoelectric array detector
• CPC Class Codes: G01J 3/2823 : Imaging spectrometer
• CPC Class Codes: G01J 3/36 : Investigating two or more bands of a spectrum by separate detectors
• CPC Class Codes: G01J 3/447 : Polarisation spectrometry
• CPC Class Codes: G01N 2021/4709 : Backscatter
• CPC Class Codes: G01N 21/255 : Details, e.g. use of specially adapted sources, lighting or optical systems
• CPC Class Codes: G01N 21/31 : Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry G01N21/72 takes precedence
• CPC Class Codes: G01N 21/47 : Scattering, i.e. diffuse reflection G01N21/25, G01N21/41 take precedence G01N21/55 takes precedence
• CPC Class Codes: G06F 18/2135 : based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06T 2207/10036 : Multispectral image; Hyperspectral image
• CPC Class Codes: G06T 2207/30064 : Lung nodule
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders

Abstract

A hyperspectral/multispectral imager comprising a housing is provided. At least one light source is attached to the housing. An objective lens, in an optical communication path comprising originating and terminating ends, is further attached to the housing and causes light to (i) be backscattered by the tissue of a subject at the originating end and then (ii) pass through the objective lens to a beam steering element at the terminating end of the communication path inside the housing. The beam steering element has a plurality of operating modes each of which causes the element to be in optical communication with a different optical detector in a plurality of optical detectors offset from the optical communication path. Each respective detector filter in a plurality of detector filters covers a corresponding optical detector in the plurality of optical detectors thereby filtering light received by the corresponding detector from the beam steering element.

Claims

1. A hyperspectral/multispectral imaging device, comprising:

A) a housing having an exterior and an interior;

B) at least one light source disposed on the exterior of the housing;

C) at least one objective lens attached to or within the housing, the at least one objective lens disposed in an optical communication path, the optical communication path comprising an originating end and a terminating end, wherein the at least one light source is offset from the optical communication path and positioned so that light from the at least one light source directly illuminates a tissue of a subject positioned at the originating end of the optical communication path and wherein backscattered light from the directly illuminated tissue of the subject is passed from the originating end of the optical communication path, through the at least one objective lens, and to the terminating end of the optical communication path;

D) a plurality of optical detectors, wherein each optical detector in the plurality of optical detectors is offset from the optical communication path and within the housing;

E) a beam steering element within the interior of the housing, wherein the beam steering element comprises a mirror mounted on an actuator, the actuator configured to position the beam steering element into each operating mode in a plurality of operating modes, the beam steering element in optical communication with the at least one objective lens and positioned at the terminating end of the optical communication path, wherein each respective operating mode in the plurality of operating modes causes the mirror to be in optical communication with a different optical detector in the plurality of optical detectors, wherein;

when the beam steering element is in a first operating mode in the plurality of operating modes, the minor is in optical communication with a first optical detector and not in optical communication with a second optical detector in the plurality of optical detectors, and

when in the beam steering element is in a second operating mode in the plurality of switchable operating modes, the mirror is in optical communication with the second optical detector and not in optical communication with the first optical detector;

F) a plurality of detector filters within the housing, each respective detector filter in the plurality of detector filters fixedly covering a corresponding optical detector in the plurality of optical detectors thereby filtering light before it is received by the corresponding optical detector from the beam steering element;

G) at least one processor within the interior of the housing, wherein the at least one processor is in electrical communication with the at least one light source, the actuator, and the plurality of optical detectors; and

H) a memory within the interior of the housing, wherein at least one program is non-transiently stored in the memory and executable by the at least one processor, the at least one program comprising instructions for;

i) operating the at least one light source,

ii) switching said beam steering element between operating modes in the plurality of operating modes, and

iii) controlling each optical detector in said plurality of optical detectors.

2. The hyperspectral/multispectral imaging device of claim 1, wherein the at least one light source is a white light-emitting diode.

3. The hyperspectral/multispectral imaging device of claim 2, further comprising a first light source filter covering the white light-emitting diode.

4. The hyperspectral/multispectral imaging device of claim 1, further comprising a first light source polarizer covering the at least one light source.

5. The hyperspectral/multispectral imaging device of claim 1, wherein the at least one light source comprises a plurality of light emitting diodes.

6. The hyperspectral/multispectral imaging device of claim 1, wherein the at least one light source comprises a first light source configured to emit radiation of a first spectral band and a second light source configured to emit radiation of a second spectral bandwidth, wherein said first and second spectral bands are different.

7. The hyperspectral/multispectral imaging device of claim 1, wherein the mirror is a single-surface mirror.

8. The hyperspectral/multispectral imaging device of claim 1, wherein the mirror is a two-axis micro electro-mechanical (MEMS) mirror.

9. The hyperspectral/multispectral imaging device of claim 1, wherein the mirror comprises an array of micromirrors.

10. The hyperspectral/multispectral imaging device of claim 9, wherein the array of micromirrors comprises a digital micromirror device.

11. The hyperspectral/multispectral imaging device of claim 1, wherein the plurality of optical detectors comprises at least four optical detectors.

12. The hyperspectral/multispectral imaging device of claim 11, wherein each respective optical detector in the plurality of optical detectors detects different frequency of radiation.

13. The hyperspectral/multispectral imaging device of claim 11, wherein at least one optical detector in the plurality of optical detectors is not covered by a detector filter in the plurality of detector filters.

14. The hyperspectral/multispectral imaging device of claim 13, wherein the at least one optical detector that is not covered by a detector filter is configured for focusing an image of said surface of the subject acquired by at least one respective optical detector in said plurality of optical detectors.

15. The hyperspectral/multispectral imaging device of claim 1, wherein the at least one light source is a plurality of light sources disposed on the exterior of the housing, each respective light source in the plurality of light sources corresponding to an optical detector in the plurality of optical detectors, and each respective detector filter in the plurality of detector filters allows radiation emitted from a corresponding light source in the plurality of light sources to pass through to the corresponding optical detector.

16. The hyperspectral/multispectral imaging device of claim 1, wherein the at least one program stored in the memory and executable by the at least one processor comprises instructions for:

i.) turning on a first light source in the at least one light source, and

ii.) placing the beam steering element in an operating mode in the plurality of operating modes that causes the beam steering element to be in optical communication with a corresponding optical detector in the plurality of optical detectors.

17. The hyperspectral/multispectral imaging device of claim 1, wherein:

the at least one light source is a plurality of light sources;

each respective optical detector in the plurality of optical detectors corresponds to a respective light source in the plurality of light sources; and

the at least one program further comprises instructions for;

sequentially turning on and off each respective light source in the plurality of light sources, and

sequentially switching the beam steering element to each respective operating mode in the plurality of operating modes such that each respective optical detector in the plurality of optical detectors is in optical communication with the beam steering element when the corresponding light source is turned on.

18. The hyperspectral/multispectral imaging device of claim 1, wherein the communication interface comprises a docking station for a mobile device having a mobile device display.

19. The hyperspectral/multispectral imaging device of claim 1, further comprising a housing display disposed on the exterior of the housing, the housing display in electronic communication with the at least one processor,

wherein the at least one program further comprises instructions for displaying an image captured by a respective optical detector in the plurality of optical detectors on the housing display.

20. The hyperspectral/multispectral imaging device of claim 1, wherein the actuator comprises a tip-tilt actuator that rotates the beam steering element on two axes.

21. The hyperspectral/multispectral imaging device of claim 1, wherein the actuator comprises a MEMS actuator.

22. The hyperspectral/multispectral imaging device of claim 1, wherein the actuator comprises a comb type MEMS actuator.

23. The hyperspectral/multispectral imaging device of claim 1, wherein the actuator and mirror comprises a single-surfaced gimbaled mirror.

24. The hyperspectral/multispectral imaging device of claim 1, wherein each detector in the plurality of detectors is a two-dimensional detector.

25. The hyperspectral/multispectral imaging device of claim 1, further comprising a communication interface in electrical communication with the at least one processor.

26. The hyperspectral/multispectral imaging device of claim 1 wherein the light source is a plurality of light sources arranged around the objective lens.

27. The hyperspectral/multispectral imaging device of claim 26, wherein the plurality of light sources and the objective lens are coplanar to each other.

28. A hyperspectral/multispectral imaging device, comprising:

A) a housing having an exterior and an interior;

B) at least one light source disposed on the exterior of the housing;

C) at least one objective lens attached to or within the housing, the at least one objective lens disposed in an optical communication path, the optical communication path comprising an originating end and a terminating end, wherein the at least one light source is offset from the optical communication path and positioned so that light from the at least one light source directly illuminates a subject positioned at the originating end of the optical communication path and wherein backscattered light from the directly illuminated subject is passed from the originating end of the optical communication path, through the at least one objective lens, and to the terminating end of the optical communication path;

D) a plurality of two-dimensional optical detectors, wherein each respective optical detector in the plurality of two-dimensional optical detectors is offset from the optical communication path and within the housing;

E) a beam steering element within the interior of the housing, wherein the beam steering element comprises a mirror mounted on an actuator, the actuator configured to position the beam steering element into each operating mode in a plurality of operating modes, the beam steering element in optical communication with the at least one objective lens, wherein each respective operating mode in the plurality of operating modes causes the mirror to be in optical communication with a different optical detector in the plurality of two-dimensional optical detectors, wherein;

when the beam steering element is in a first operating mode in the plurality of operating modes, the mirror is in optical communication with a first optical detector and not in optical communication with a second optical detector in the plurality of optical detectors, and

when in the beam steering element is in a second operating mode in the plurality of switchable operating modes, the mirror is in optical communication with the second optical detector and not in optical communication with the first optical detector;

F) a plurality of detector filters within the housing, each respective detector filter in the plurality of detector filters fixedly covering a corresponding optical detector in the plurality of two-dimensional optical detectors thereby filtering light before it is received by the corresponding optical detector from the beam steering element;

G) at least one processor within the interior of the housing, wherein the at least one processor is in electrical communication with the at least one light source, the actuator, and the plurality of optical detectors; and

H) a memory within the interior of the housing, wherein at least one program is non-transiently stored in the memory and executable by the at least one processor, the at least one program comprising instructions for;

i) operating the at least one light source,

ii) switching said beam steering element between operating modes in the pluralit of operating modes, and

iii) controlling each optical detector in said plurality of two-dimensional optical detectors.

29. The hyperspectral/multispectral imaging device of claim 28, wherein the mirror comprises a digital micromirror device.

30. The hyperspectral/multispectral imaging device of claim 28, wherein the plurality of optical detectors comprises at least four optical detectors.

31. The hyperspectral/multispectral imaging device of claim 28, wherein the at least one light source is a plurality of light sources disposed on the exterior of the housing, each respective light source in the plurality of light sources corresponding to an optical detector in the plurality of optical detectors, and each respective detector filter in the plurality of detector filters allows radiation emitted from a corresponding light source in the plurality of light sources to pass through to the corresponding optical detector.

32. The hyperspectral/multispectral imaging device of claim 28, wherein the at least one program stored in the memory and executable by the at least one processor comprises instructions for:

i.) turning on a first light source in the at least one light source, and

ii.) placing the beam steering element in an operating mode in the plurality of operating modes that causes the beam steering element to be in optical communication with a corresponding optical detector in the plurality of optical detectors.

33. The hyperspectral/multispectral imaging device of claim 28, wherein:

the at least one light source is a plurality of light sources;

each respective optical detector in the plurality of optical detectors corresponds to a respective light source in the plurality of light sources; and

the at least one program further comprises instructions for;

sequentially turning on and off each respective light source in the plurality of light sources, and

sequentially switching the beam steering element to each respective operating mode in the plurality of operating modes such that each respective optical detector in the plurality of optical detectors is in optical communication with the beam steering element when the corresponding light source is turned on.

34. A hyperspectral/multispectral imaging device, comprising:

A) a housing having an exterior and an interior;

B) at least one light source disposed on the exterior of the housing;

C) at least one objective lens attached to or within the housing, the at least one objective lens disposed in an optical communication path, the optical communication path comprising an originating end and a terminating end, wherein the at least one light source is offset from the optical communication path and positioned so that light from the at least one light source directly illuminates a subject positioned at the originating end of the optical communication path and wherein backscattered light from the directly illuminated tissue of the subject is passed from the originating end of the optical communication path, through the at least one objective lens, and to the terminating end of the optical communication path;

D) a plurality of two-dimensional optical detectors, wherein each respective optical detector in the plurality of two-dimensional optical detectors is offset from the optical communication path and within the housing;

E) a beam steering element within the interior of the housing, wherein the beam steering element comprises a single-surfaced gimbaled mirror configured to position the beam steering element into each operating mode in a plurality of operating modes, the beam steering element in optical communication with the at least one objective lens, wherein each respective operating mode in the plurality of operating modes causes the beam steering element to be in optical communication with a different optical detector in the plurality of two-dimensional optical detectors, wherein;

when the beam steering element is in a first operating mode in the plurality of operating modes, the single-surfaced gimbaled minor is in optical communication with a first optical detector and not in optical communication with a second optical detector in the plurality of optical detectors, and

when in the beam steering element is in a second operating mode in the plurality of switchable operating modes, the single-surfaced gimbaled minor is in optical communication with the second optical detector and not in optical communication with the first optical detector;

F) a plurality of detector filters within the housing, each respective detector filter in the plurality of detector filters fixedly covering a corresponding optical detector in the plurality of two-dimensional optical detectors thereby filtering light before it is received by the corresponding optical detector from the beam steering element;

G) at least one processor within the interior of the housing, wherein the at least one processor is in electrical communication with the at least one light source, the actuator, and the plurality of optical detectors; and

H) a memory within the interior of the housing, wherein at least one program is non-transiently stored in the memory and executable by the at least one processor, the at least one program comprising instructions for;

i) operating the at least one light source,

ii) switching said beam steering element between operating modes in the plurality of operating modes, and

iii) controlling each optical detector in said plurality of two-dimensional optical detectors.

35. The hyperspectral/multispectral imaging device of claim 34, wherein the plurality of optical detectors comprises at least four optical detectors.

36. The hyperspectral/multispectral imaging device of claim 34, wherein the at least one light source is a plurality of light sources disposed on the exterior of the housing, each respective light source in the plurality of light sources corresponding to an optical detector in the plurality of optical detectors, and each respective detector filter in the plurality of detector filters allows radiation emitted from a corresponding light source in the plurality of light sources to pass through to the corresponding optical detector.

37. The hyperspectral/multispectral imaging device of claim 34, wherein the at least one program stored in the memory and executable by the at least one processor comprises instructions for:

i.) turning on a first light source in the at least one light source, and

ii.) placing the beam steering element in an operating mode in the plurality of operating modes that causes the beam steering element to be in optical communication with a corresponding optical detector in the plurality of optical detectors.

38. The hyperspectral/multispectral imaging device of claim 34, wherein:

the at least one light source is a plurality of light sources;

each respective optical detector in the plurality of optical detectors corresponds to a respective light source in the plurality of light sources; and

the at least one program further comprises instructions for;

sequentially turning on and off each respective light source in the plurality of light sources, and

sequentially switching the beam steering element to each respective operating mode in the plurality of operating modes such that each respective optical detector in the plurality of optical detectors is in optical communication with the beam steering element when the corresponding light source is turned on.