Compact fluorescence endoscopy video system

• US 6,821,245 B2
• Filed: 07/13/2001
• Issued: 11/23/2004
• Est. Priority Date: 07/14/2000
• Status: Expired due to Term

• Current Assignee: Stryker Corporation
• Original Assignee: Xillix Technologies Corp.
• Inventors: Fengler, John J. P., Cline, Richard W., Boehm, Joachim W.
• Primary Examiner(s): Leubecker, John P.
• Application Number:
  US09/905,642
• Publication Number:
  US 20020035330A1
• Time in Patent Office: 1,229 Days
• Field of Search: 600/160, 600/109, 600/476-478, 600/112, 600/178, 600/181
• US Class Current: 600/160
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/00057 provided with means for testing or calibration
• CPC Class Codes: A61B 1/00186 with imaging filters
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/051 Details of CCD assembly
• CPC Class Codes: A61B 1/063 for monochromatic or narrow-band illumination
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/0646 with illumination filters
• CPC Class Codes: A61B 1/0655 Control therefor
• CPC Class Codes: A61B 1/0669 at proximal end of an endoscope
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0084 for introduction into the body, e.g. by catheters A61B5/1459 takes precedence
• CPC Class Codes: G01N 21/6458 Fluorescence microscopy fluorescence microscopes per se G02B21/0076 and G02B21/16
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

A fluorescence endoscopy video system includes a multimode light source that produces light for color and fluorescence imaging modes. Light from the light source is transmitted through an endoscope to the tissue under observation. The system also includes a compact camera for color and fluorescence imaging. Images obtained through the endoscope are optically divided and projected onto one or more image sensors by a fixed beam splitter in the camera. The fixed beam splitter eliminates the need for inserting a movable mirror into the light path between the endoscope and the image sensors. Image signals from the camera are processed in the system processor/controller where a contrast enhancement function can be applied. The contrast enhancement function increases the color contrast between normal tissue and tissue suspicious for early cancer. Finally, the system also includes a calibration feature whereby the system performance can be maintained when used with different endoscopes.

Claims

1. A fluorescence endoscopy video system including:

a multimode light source for producing white light for use in a white light imaging mode, and fluorescence excitation light or fluorescence excitation light with a reference reflectance light for use in a fluorescence imaging mode;

an endoscope for directing the light from the light source into a patient to illuminate a tissue sample and to collect the reflected light or fluorescence light produced by the tissue;

a camera positioned to receive the light collected by the endoscope, the camera including;

a color image sensor;

a low light image sensor; and

a beam splitter for splitting the light received from the endoscope into at least two beams with the same spectrum and directing those beams onto the low light and color image sensors;

one or more filters positioned in front of the low light image sensor for passing light in an autofluorescence spectral band;

one or more filters that are positionable in front of the color image sensor and pass light within a desired wavelength band when the camera operates in the fluorescence imaging mode and are removable from the front of the color image sensor when the camera operates in the white light imaging mode;

one or more optical imaging components that project images onto both the color image sensor and the low light image sensor;

an image processor/controller for digitizing, processing and encoding the image signals received from the sensor(s) as a video signal, wherein the image processor/controller simultaneously displays or combines the image signals from the low light image sensor and the color image sensor when the camera operates in the fluorescence imaging mode; and

a video monitor for displaying the video signals.

2. The system of claim 1, wherein the camera is attached to the portion of the endoscope that remains outside of the body.

3. The system of claim 1, wherein the camera is built into the insertion portion of the endoscope.

4. The system of claim 2 or 3, wherein the beam splitter directs a greater percentage of light collected by the endoscope to the low light sensor and a lesser percentage to the color image sensor.

5. The system of claim 2 or 3, further comprising a filter positioned in the light path of the light source that simultaneously transmits the fluorescence excitation light and an amount of reference reflectance light not in a fluorescence detection wavelength band, wherein the amount of reference reflectance light transmitted is a fraction of the fluorescence excitation light, such that the intensity of the reflected reference light projected onto the color image sensor, results in a transduced image signal from the color image sensor with good signal-to-noise characteristics and without significant saturation, at the same time as maintaining sufficient fluorescence excitation such that the intensity of fluorescence projected onto the low light sensor results in a transduced image signal from the low light sensor with good signal-to-noise characteristics and without significant saturation, and wherein the light source filter blocks light from the light source at wavelengths in the fluorescence detection wavelength band, the filter characteristics being such that less than 0.001% of the light transmitted by the filter is in the fluorescence detection wavelength band.

6. The system of claim 5, wherein the one or more filters in front of the color image sensor blocks reflected excitation light and transmits reference reflectance light, the filter characteristics being such that the light transmitted outside of the reference reflectance wavelength band is no more than 0.1% of the light transmitted by the filter and the amount of reference reflectance light transmitted by the filter being such that the intensity of the reference light projected onto the color image sensor, results in a transduced image signal from the color image sensor with good signal-to-noise characteristics and without significant saturation, and the one or more filters in front of the low light image sensor blocks reflected excitation and reference light, and transmits fluorescence light, the filter characteristics being such that any light transmitted by the filter outside of the fluorescence detection wavelength band contributes no more than 0.1% to the light transmitted by the filter.

7. The system of claim 6, wherein the fluorescence, transmitted by the one or more filters in front of the low light image sensor, is green light.

8. The system of claim 7, wherein the reference reflectance light transmitted by the light source filter is red light.

9. The system of claim 7, wherein the reference reflectance light transmitted by the light source filter is near-infrared light.

10. The system of claim 7, wherein the reference reflectance light transmitted by the light source filter is blue light.

11. The system of claim 6, wherein the fluorescence, transmitted by the one or more filters in front of the low light image sensor, is red light.

12. The system of claim 11, wherein the reference reflectance light transmitted by the light source filter is green light.

13. The system of claim 11, wherein the reference reflectance light transmitted by the light source filter is near-infrared light.

14. The system of claim 11, wherein the reference reflectance light transmitted by the light source filter is blue light.

15. The system of claim 2 or 3, further comprising a filter positioned in the light path of the light source that transmits the fluorescence excitation light and blocks light at wavelengths in the detected fluorescence bands from reaching both the low light sensor and the color image sensor, the filter characteristics being such that of the light transmitted by the filter, less than 0.001% is in the detected fluorescence bands.

16. The system of claim 15, wherein the one or more filters in front of the low light image sensor blocks reflected excitation light and transmits fluorescence light in a green wavelength band to the extent that the light received by the low light sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source, and the one or more filters positionable in front of the color image sensor blocks reflected excitation light and transmits fluorescence light in a red wavelength band to the extent that the light received by the color image sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source.

17. A fluorescence endoscopy video system including;

a multimode light source for producing white light, fluorescence excitation light or fluorescence excitation light with a reference reflectance light;

an endoscope for directing the light from the light source into a patient to illuminate a tissue sample and to collect the reflected light or fluorescence light produced by the tissue;

a camera positioned to receive the light collected by the endoscope, the camera including;

a color image sensor;

a low light image sensor;

a beam splitter for splitting the light received from the endoscope into at least two beams and directing those beams onto the low light and color image sensors;

one or more filters positioned in front of the low light and color image sensors for selectively transmitting light of desired wavelengths; and

one or more optical imaging components that project images onto both the color image sensor and the low light image sensor;

a processor/controller for digitizing fluorescence and reference image signals received from the low light and color image sensors, the processor/controller including a memory device that stores a sequence of instructions that cause the processor/controller to adjust the intensity of the fluorescence or reference image signal on a pixel by pixel basis as a function of an analysis of the signals received from the low light and color image sensors, and then to encode the adjusted image signals received from the sensors as a video signal; and

a video monitor for displaying the images.

18. The system of claim 17, wherein the camera is attached to the portion of the endoscope that remains outside of the body.

19. The system of claim 17, wherein the camera is built into the insertion portion of the endoscope.

20. The system of claim 18 or 19, wherein the analysis of the digitized image signals that the processor/controller carries out utilizes a ratio of an intensity of the reference reflectance light and the fluorescence light received from the tissue.

21. The system of claim 18 or 19, wherein the analysis of the digitized image signals that the processor/controller carries out utilizes an intensity of pixels that neighbor the one or more pixels and adjusts the processed image signals based on the neighboring pixel intensities.