System for detecting fluorescence and projecting a representative image

• US 10,517,483 B2
• Filed: 12/05/2013
• Issued: 12/31/2019
• Est. Priority Date: 12/05/2012
• Status: Active Grant

• Current Assignee: AccuVein LLC
• Original Assignee: AccuVein LLC
• Inventors: Wood, Fred, Yavid, Dmitry, Zott, Joe, Goldman, Ron
• Primary Examiner(s): Santos Rodriguez, Joseph M
• Application Number:
  US14/097,313
• Publication Number:
  US 20140187931A1
• Time in Patent Office: 2,217 Days
• Field of Search: None
• CPC Class Codes: A61B 18/20 using laser
• CPC Class Codes: A61B 2018/00577 Ablation
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence

Abstract

A fluorescence imaging device detects fluorescence in parts of the visible and invisible spectrum, and projects the fluorescence image directly on the human body, as well as on a monitor, with improved sensitivity, video frame rate and depth of focus, and enhanced capabilities of detecting distribution and properties of multiple fluorophores. Direct projection of three-dimensional visible representations of florescence on three-dimensional body areas advantageously permits viewing of it during surgical procedures, including during cancer removal, reconstructive surgery and wound care, etc. A NIR laser and a human visible laser (HVL) are aligned coaxially and scanned over the operating field of view. When the NIR laser passes over the area where the florescent dye is present, it energizes the dye which emits at a shifted NIR frequency detected by a photo diode. The HVL is turned on when emission is detected, providing visual indication of those positions.

Claims

1. A fluorescence imaging device for detecting fluorescence in biological tissues and projecting a representative three-dimensional image onto the biological tissues, comprising:

(a) a source of excitation light at an excitation wavelength, and means of delivering said excitation light to the biological tissues containing fluorescent substances;

(b) a light collection system comprising a light detector configured to detect light emitted by the fluorescent substances at an emitted wavelength;

(c) means of analyzing said detected light and establishing a three-dimensional spatial distribution of intensity of said light emitted by the fluorescent substances in the biological tissues;

(d) means of generating a three-dimensional image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances; and

(e) means of projecting said three-dimensional representative image onto the biological tissues using a human-visible wavelength.

2. The fluorescence imaging device of claim 1 further comprising a source of ablation light and a processing unit configured to controllably deliver said ablation light to the imaged fluorescent substances, using said means of delivering.

3. The fluorescence imaging device of claim 1 wherein said source of excitation light comprises one or more lasers, and wherein said means of delivering said excitation light is configured for scanning said excitation light in a raster pattern onto an outer surface of the biological tissues.

4. The fluorescence imaging device of claim 3 wherein said light collection system comprises a filter configured to pass only said light emitted by the fluorescent substances at said emitted wavelength.

5. The fluorescence imaging device of claim 3,

wherein said light detector comprises a scanning fluorescence detector configured to perform time domain analysis of multiple light emissions within the emitted light to distinguish fast-decaying fluorescent substances and slow-decaying florescent substances, each having identical emission spectra;

and

wherein said fluorescent imaging device further comprises a processing unit configured to drive said one or more lasers for said excitation light to be modulated to increase time resolution, said one or more lasers driven to modulate to emit pulses of a duration less than a duration of a scanned pixel.

6. The fluorescence imaging device of claim 3 wherein said detector is from the group of detectors consisting of:

(a) a photo-diode (PD);

(b) a avalanche photo-diode (APD);

(c) a photo-multiplier tube (PMT);

(d) a hybrid photo-multiplier (HPM); and

(e) a silicon photo-multiplier (SiPM).

7. The fluorescence imaging device of claim 3 further comprising a plurality of said light detectors, each configured to detect said emitted light, with said emitted light being at the same wavelength.

8. The fluorescence imaging device of claim 3 wherein the excitation light is delivered at a plurality of wavelengths configured to excite a plurality of different fluorescent substances in the biological tissues, for the fluorescent substances to emit a plurality of different wavelengths.

9. The fluorescence imaging device of claim 8 further comprising a plurality of said light detectors configured to respectively detect said plurality of different emitted wavelengths from the fluorescent substances.

10. The fluorescence imaging device of claim 3 wherein said excitation wavelength does not match the maximum absorption of the fluorescent substances in the biological tissues.

11. The fluorescence imaging device of claim 3 wherein the emitted wavelength of light comprises a wavelength that is not visible to the human eye.

12. The fluorescence imaging device of claim 3 where one or both of the excitation light and said emitted light is NIR light with said emitted wavelength between 700 nm and 1000 nm.

13. The fluorescence imaging device of claim 3 where said three-dimensional image representative of said spatial distribution is projected using a source of visible light projected onto the biological tissues using said means of delivering.

14. The fluorescence imaging device of claim 3 further comprising:

a processing unit; and

means for capturing an image of the biological tissues in a human-visible spectrum having a field of view with an area being substantially the same as an area covered by said raster pattern of said scanned excitation light; and

wherein said processing unit is configured to overlap said visible image of the biological tissues with said three-dimensional representative image of said spatial distribution of light intensity emitted by the fluorescent substances, and to display said overlapped images on a monitor.

15. The fluorescence imaging device of claim 5 further comprising a pixelated 2D image detector configured to capture one or more images of the biological area in a human-visible spectrum having a field of view with an area being substantially the same as an area covered by said raster pattern of said scanned excitation light;

and wherein said processing unit is configured to overlap said visible image of the biological tissues with said three-dimensional representative image of said spatial distribution of light intensity emitted by the fluorescent substances, and to display said overlapped images on a monitor.

16. The fluorescence imaging device of claim 14, where said field of view (FOV) of said means for capturing an image is coaxially aligned by optical means with said area covered by said raster pattern of said scanned excitation light.

17. The fluorescence imaging device of claim 15, where said field of view of said pixelated 2D image detector is coaxially aligned with said area covered by said raster pattern using an optical device.

18. The fluorescence imaging device of claim 17, where said optical device is from the group of optical devices consisting of:

one or more dichroic mirrors;

one or more polarizing mirrors; and

one or more semi-transparent mirrors.

19. The fluorescence imaging device of claim 17, where said pixelated 2D image detector is from the group of pixelated 2D image detectors consisting of a CCD camera;

and a CMOS camera.

20. The fluorescence imaging device of claim 15, where said field of view (FOV) of said pixelated 2D image detector and said area covered by said raster pattern of said scanned excitation light are partially aligned by optical means.

21. The fluorescence imaging device of claim 18, where said field of view of said camera and said area covered by said raster pattern of said scanned excitation light are partially aligned with a bounce mirror for said raster pattern just outside of the camera FOV.

22. The fluorescence imaging device of claim 18, where said field of view of said camera and said area covered by said raster pattern of said scanned excitation light are partially aligned with a bounce mirror for said camera just outside of the FOV of said raster pattern.

23. The fluorescence imaging device of claim 18, where a frame rate of said scanned raster pattern and a frame rate of said camera are synchronized.

24. The fluorescence imaging device of claim 23, where said camera is configured to capture images in between said modulated pulses of said one or more lasers.

25. The fluorescence imaging device of claim 23, where said camera is configured to capture images in two separate streams comprising:

a first stream of images captured in between said modulated pulses of said one or more lasers, and a second stream of images captured during said pulses of said one or more lasers.

26. The fluorescence imaging device of claim 25, where said processing unit is configured to compare said first and second streams and to extract alignment information to align said overlapped images.

27. The fluorescence imaging device of claim 5 where said pulses are shorter in duration than a duration of light collection for a single acquired pixel.

28. The fluorescence imaging device of claim 27 where a temporal distribution of fluorescent light in response to said short pulses is analyzed.

29. The fluorescence imaging device of claim 28 where the emitted light is detected by a single photon counter.

30. The fluorescence imaging device of claim 27 where said one or more lasers for said excitation light comprises a plurality of different lasers configured for said light to be delivered in a sequence of short pulses.

31. The fluorescence imaging device of claim 27 where information about a depth of the fluorescent substance in the biological tissue is extracted from a time delay between an emission of an excitation pulse and an arrival of the emission pulse.

32. The fluorescence imaging device of claim 27, where said one or more lasers for said excitation light is on for a first part of each pixel and is off for a second part of each pixel, and where said spatial distribution of light intensity emitted by the fluorescent substances collected during the second part is subtracted from said spatial distribution of light intensity collected during the first part to cancel out signals from non-fluorescent ambient light.

33. The fluorescence imaging device of claim 1 where said three-dimensional image representative of said spatial distribution of light intensity emitted by the fluorescent substances is enhanced by time variations of a brightness of various areas of said image.

34. The fluorescence imaging device of claim 1 where said three-dimensional image representative of said spatial distribution of light intensity emitted by the fluorescent substances is enhanced by indication of temporal changes in said three-dimensional spatial distribution of light.

35. The fluorescence imaging device of claim 1 where a bit resolution of said three-dimensional image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances is automatically adjusted to optimize a contrast and reduce visible noise.

36. The fluorescence imaging device of claim 1 where a dynamic range image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances is automatically adjusted to be always above the noise floor.

37. The fluorescence imaging device of claim 1 where multiple fluorescent images are averaged out to form the projected image with a lower level of noise.

38. The fluorescence imaging device of claim 1 where a bandwidth of the projected image is automatically adjusted to reduce a level of noise.

39. The fluorescence imaging device of claim 1 where polarized light is used for said means of projecting said image onto the biological tissues using said human-visible wavelength.

40. The fluorescence imaging device of claim 1 where said means of projecting is also used for general illumination of the biological tissues.

41. The fluorescence imaging device of claim 1 where an acquisition of said three-dimensional image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances and said projection of said image are separated in time.

42. The fluorescence imaging device of claim 1 configured to acquire said three-dimensional image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances of the 3D biological tissues, to project said three-dimensional image on one or more curved surfaces of the same biological tissues, to acquire a visible image of the same biological tissues, including at least part of said projected image, to co-analyze the acquired image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances and the acquired visible image, and to apply adjustments to said projected image to ensure an accurate positional match therebetween.

43. The fluorescence imaging device of claim 1 where an intensity of said excitation light spatially varies depending on an intensity of said three-dimensional image representative of said three-dimensional spatial distribution of light intensity emitted by the fluorescent substances.

44. A device for acquiring a three-dimensional image of targeted biological tissues from fluorescent light emitted by fluorophores contained therein, and for projecting a three-dimensional visible representation of the acquired image onto the targeted biological tissues, said device comprising:

a first laser configured to emit a beam of visible light;

a second laser configured to emit a beam of fluorescence excitation light at an excitation wavelength to cause emission by the fluorophores of an emitted wavelength of light;

means for coaxially aligning the beams of visible light and fluorescence excitation light;

means for scanning the coaxially aligned light beams in a pattern onto the targeted biological tissues;

a processing unit configured to drive said second laser to emit two or more pulses of the fluorescence excitation light within a duration less than a duration of each of a plurality of pixels scanned by said means for scanning;

a scanning fluorescence detector configured to synchronously collect two or more corresponding pulses of light emitted by the fluorophores, within each of said scanned pixels;

said scanning fluorescence detector further configured to perform time domain analysis of multiple light emissions within the emitted light to distinguish fast-decaying fluorescent substances and slow-decaying florescent substances, each having identical emission spectra;

wherein said processing unit is further configured to analyze the collected light to determine a depth of the fluorophores in the targeted biological tissues for each of said scanned pixels to establish a three-dimensional intensity distribution of the light emitted by the fluorophores;

said processing unit further configured to generate a three-dimensional image representative of the spatial distribution; and

wherein said first laser is configured to receive the representative three-dimensional image, and to project the three-dimensional image, using said means for scanning, onto the one or more outer surfaces of the targeted biological tissues to overlay and align with the spatial distribution of light emitted by the fluorophores.

45. The device according to claim 44 further comprising a source of ablation light;

and wherein said processing unit is further configured to controllably deliver said ablation light to the imaged fluorophores, using said means for coaxially aligning and said means for scanning.

46. The device according to claim 44 further comprising a pixelated 2D image detector configured to capture one or more images of the targeted biological tissues in a human-visible spectrum having a field of view substantially the same as an area covered by said pattern of said scanned light beams;

and wherein said processing unit is configured to overlap said visible image of the biological tissues with the three-dimensional image representative of the spatial distribution, and to display said overlapped images on a monitor.

47. The device according to claim 46 further comprising an optical device configured to coaxially align the field of view of said pixelated 2D image detector with the area covered by said scanned pattern.

48. The device according to claim 47 wherein said optical device is from the group of optical devices consisting of:

one or more dichroic mirrors;

one or more polarizing mirrors; and

one or more semi-transparent mirrors.

49. The device of claim 48, where said pixelated 2D image detector is from the group of pixelated 2D image detectors consisting of a CCD camera;

and a CMOS camera.

50. The device according to claim 44 wherein the fluorescence excitation light and the emitted light is at a wavelength between 700 nm and 1000 nm.

51. The device according to claim 44 wherein the depth of the fluorophores is determined from a time delay between at least one of said pulses of fluorescence excitation light from said first laser and arrival of the corresponding pulse of light emitted by the fluorophores.