Compact fluorescence endoscopy video system

• US 9,968,244 B2
• Filed: 02/23/2015
• Issued: 05/15/2018
• Est. Priority Date: 07/14/2000
• Status: Expired due to Fees

• Current Assignee: Stryker European Operations Limited (Stryker Corporation)
• Original Assignee: Novadaq Technologies ULC (Stryker Corporation)
• Inventors: Cline, Richard W., Fengler, John J. P., Boehm, Joachim W.
• Primary Examiner(s): Neal, Timothy J
• Assistant Examiner(s): FAIRCHILD, AARON BENJAMIN
• Application Number:
  US14/629,473
• Publication Number:
  US 20150230698A1
• Time in Patent Office: 1,177 Days
• Field of Search: 600109, 600160, 600476, 600477
• CPC Class Codes: A61B 1/00057 provided with means for testing or calibration
• CPC Class Codes: A61B 1/00186 with imaging filters
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/063 for monochromatic or narrow-band illumination
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/0646 with illumination filters
• CPC Class Codes: A61B 1/0669 at proximal end of an endoscope
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0084 for introduction into the body, e.g. by catheters A61B5/1459 takes precedence
• CPC Class Codes: G01N 21/6458 Fluorescence microscopy fluorescence microscopes per se G02B21/0076 and G02B21/16
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

A fluorescence endoscopy video system includes a multimode light source for producing white light, fluorescence excitation light, or fluorescence excitation light with a reference reflectance light. An endoscope directs light to illuminate a tissue sample and collects reflected light or fluorescence light produced by the tissue. A camera includes a high sensitivity color image sensor having a plurality of pixel elements. Each of the pixel elements has an integrated filter configured to block reflected excitation light from reaching the pixel elements and allow fluorescence and reflectance light to reach the pixel elements. A processor receives image signals from the image sensor, combines image signals from a first group of pixel elements to form a first image formed by fluorescence light, and combines image signals from a second group of pixel elements to form a second image formed by reflectance light. A video monitor simultaneously superimposes the first and second images.

Claims

1. A fluorescence endoscopy video system including:

a multimode light source configured to switch between a first mode for producing white light, a second mode for producing fluorescence excitation light distinct from white light, and a third mode for producing fluorescence excitation light with a reference reflectance light;

an endoscope for directing light from the light source to a patient to illuminate a tissue sample and to collect the reflected light or fluorescence light produced by the tissue;

a camera positioned to receive the light collected by the endoscope including;

a high sensitivity color image sensor having a plurality of pixel elements, each of the pixel elements having an integrated filter, the integrated filters being configured to block reflected excitation light from reaching the pixel elements and allow fluorescence light and reflectance light to reach the pixel elements, and

at least one optical imaging component that projects superimposed fluorescence and reflectance images onto the high sensitivity color image sensor in the third mode;

a processor that receives image signals from the high sensitivity color image sensor and (i) combines image signals from a first group of the pixel elements having integrated filters with a first filter characteristic to form a first image formed by the fluorescence light, and (ii) combines image signals from a second group of the pixel elements having integrated filters with a second filter characteristic to form a second image formed by the reflectance light; and

a video monitor for simultaneously superimposing the first image and the second image.

2. The system of claim 1, wherein the camera is attached to the portion of the endoscope that remains outside of the body.

3. The system of claim 1, wherein the camera is built into the insertion portion of the endoscope.

4. The system of claim 1, further comprising a light source filter positioned in the light path of the light source that simultaneously transmits the excitation light and an amount of reference reflectance light not in a fluorescence detection wavelength band, the amount of reference reflectance light transmitted by the filter being a fraction of the fluorescence excitation light, and wherein the light source filter blocks light from the light source at wavelengths in the fluorescence detection wavelength band from reaching the high sensitivity color image sensor to the extent that the light received by the first group of pixel elements is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source.

5. The system of claim 4, the camera further comprising a blocking filter selectively positioned in front of the high sensitivity color image sensor for passing the fluorescence light and the reflectance light and for blocking the excitation light.

6. The system of claim 5, wherein the blocking filter blocks reflected excitation light, and transmits fluorescence and reference light to the extent that the light received by the high sensitivity color image sensor is substantially composed of light resulting from tissue fluorescence and reflected reference light and minimally composed of excitation light.

7. The system of claim 5 wherein the fluorescence light transmitted by the blocking filter is green light.

8. The system of claim 7, wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter and the blocking filter is red light.

9. The system of claim 7, wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter and the blocking filter is near-infrared light.

10. The system of claim 5 wherein the fluorescence light transmitted by the blocking filter is red light.

11. The system of claim 10, wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter and the blocking filter is green light.

12. The system of claim 10, wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter and the blocking filter is near-infrared light.

13. The system of claim 1, further comprising a light source filter positioned in the light path of the light source that transmits the fluorescence excitation light and blocks light at wavelengths in the fluorescence detection wavelength bands from reaching the imaging areas of the high sensitivity color image sensor to the extent that the light received by the sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source.

14. The system of claim 1, further comprising a fluorescence/reflectance reference that produces known levels of fluorescence and reflectance light upon illumination with light from the multimode light source, wherein the processor is programmed to adjust the gain of the sensor in response to the levels of fluorescence and reflectance light produced.

15. The system of claim 14, wherein the fluorescence/reflectance reference comprises a dye and an amount of scatters in a solid.

16. The system of claim 1, wherein the processor includes:

a memory device that (i) stores a sequence of instructions that cause the processor to adjust the intensity of the fluorescence or reference image signal on a pixel by pixel basis as a function of an analysis of the signals received from the first group of the pixel elements and the second group of pixel elements, and (ii) encodes the adjusted image signals received from the sensors as a video signal; and

a video monitor for simultaneously superimposing the separate video images.

17. The system of claim 16, wherein the analysis of the image signals that the processor/controller carries out utilizes a ratio of an intensity of the reference reflectance light and the fluorescence light received from the tissue.

18. The system of claim 16, wherein the analysis of the image signals that the processor/controller carries out utilizes an intensity of pixels that neighbor the one or more pixels and adjusts the processed image signals based on the neighboring pixel intensities.