Open-field handheld fluorescence imaging systems and methods

• US 11,140,305 B2
• Filed: 05/10/2017
• Issued: 10/05/2021
• Est. Priority Date: 02/10/2017
• Status: Active Grant

• Current Assignee: Stryker Corporation
• Original Assignee: Stryker European Operations Limited (Stryker Corporation)
• Inventors: Westwick, Paul Roald
• Primary Examiner(s): Huang, Frank F
• Application Number:
  US15/591,909
• Publication Number:
  US 20180234603A1
• Time in Patent Office: 1,609 Days
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/06 with illuminating arrangements
• CPC Class Codes: A61B 46/10 specially adapted for instruments, e.g. microscopes
• CPC Class Codes: A61B 46/17 closed at the distal end
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: G01N 21/6456 Spatial resolved fluorescence measurements; Imaging
• CPC Class Codes: G03B 11/00 Filters or other obturators specially adapted for photographic purposes
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: G03B 2215/0585 Movable reflectors, e.g. change of illumination angle or direction
• CPC Class Codes: G03B 2215/0592 installed in front of light emitter
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/74 : by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/745 : Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination
• CPC Class Codes: H04N 25/13 : characterised by the spectral characteristics of the filter elements

Abstract

An imaging device having an imaging field of view, the imaging device including at least one illumination port configured to output light for illuminating a target; an imaging sensor to detect light traveling along an optical path to the imaging sensor; and a first movable window positioned upstream of the sensor with respect to a direction of travel of light along the optical path, wherein the first movable window is configured to move into the optical path in a deployed position for modifying light received from the target.

Claims

1. A system for imaging a target, the system comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for, within a period;

activating an excitation light source to generate an excitation pulse to illuminate the target;

receiving an ambient light intensity signal from a non-imaging sensor during a portion of the period in which the excitation light source is not activated;

exposing an image sensor for a fluorescent exposure time during the excitation pulse;

receiving outputs from the image sensor;

compensating for ambient light based on the ambient light intensity signal; and

storing a resultant image in the memory,

wherein the one or more programs include instructions for determining a periodic frequency of the ambient light intensity,

wherein compensating for ambient light comprises;

synthesizing or extracting, from one or more received ambient light intensity signals, a complete periodic cycle of ambient light intensity having the determined periodic frequency,

extending the ambient light intensity periodic cycle to a time period corresponding to the fluorescence exposure time,

calculating a first accumulated ambient light value corresponding to an area under the curve of ambient light intensity during a background exposure time,

calculating a second accumulated ambient light value corresponding to an area under the curve of the ambient light intensity during the fluorescence exposure time,

scaling the received image sensor output for the background exposure time and the received image sensor output for the fluorescence exposure time based on a ratio of the first and second accumulated ambient light values, and

subtracting the scaled image sensor output for the background exposure time from the scaled image sensor output for the fluorescence exposure time to form the resultant image.

2. The system of claim 1, wherein the one or more programs include instructions for, within the period:

activating a white light source to generate a white light pulse to illuminate the target such that the white light pulse does not overlap the excitation pulse; and

exposing the image sensor for a visible exposure time during at least one white light pulse.

3. The system of claim 1, wherein the one or more programs include instructions for exposing the image sensor for a background exposure time when the target is not illuminated.

4. The system of claim 1, wherein the one or more programs include instructions for receiving an ambient light intensity signal from the non-imaging sensor during the background exposure time.

5. The system of claim 1, wherein the one or more programs include instructions for extending the ambient light intensity periodic cycle to the time period corresponding to the fluorescence exposure time.

12. The system of claim 1, wherein the non-imaging sensor is configured to detect a periodic frequency of the ambient light intensity that results from a frequency of an ambient light power source.

6. A method for imaging a target, the method comprising:

at a system having one or more processors and memory;

activating an excitation light source to generate an excitation pulse to illuminate the target;

receiving an ambient light intensity signal from a non-imaging sensor during a portion of the period in which the excitation light source is not activated;

exposing an image sensor for a fluorescent exposure time during the excitation pulse;

receiving outputs from the image sensor;

determining a periodic frequency of the ambient light intensity;

compensating for ambient light based on the ambient light intensity signal, wherein compensating for ambient light comprises;

synthesizing or extracting, from one or more received ambient light intensity signals, a complete periodic cycle of ambient light intensity having the determined periodic frequency,

extending the ambient light intensity periodic cycle to a time period corresponding to the fluorescence exposure time,

calculating a first accumulated ambient light value corresponding to an area under the curve of ambient light intensity during a background exposure time,

calculating a second accumulated ambient light value corresponding to an area under the curve of the ambient light intensity during the fluorescence exposure time,

scaling the received image sensor output for the background exposure time and the received image sensor output for the fluorescence exposure time based on a ratio of the first and second accumulated ambient light values, and

subtracting the scaled image sensor output for the background exposure time from the scaled image sensor output for the fluorescence exposure time to form the resultant image; and

storing a resultant image in the memory.

7. The method of claim 6, further comprising, within the period:

activating a white light source to generate a white light pulse to illuminate the target such that the white light pulse does not overlap the excitation pulse; and

exposing the image sensor for a visible exposure time during at least one white light pulse.

8. The method of claim 6, further comprising exposing the image sensor for a background exposure time when the target is not illuminated.

9. The method of claim 6, further comprising receiving an ambient light intensity signal from the non-imaging sensor during the background exposure time.

10. The method of claim 6, further comprising extending the ambient light intensity periodic cycle to the time period corresponding to the fluorescence exposure time.

11. The method of claim 6, wherein the non-imaging sensor is configured to detect a periodic frequency of the ambient light intensity that results from a frequency of an ambient light power source.