Imaging a target fluorophore in a biological material in the presence of autofluorescence

• US 10,488,340 B2
• Filed: 10/31/2017
• Issued: 11/26/2019
• Est. Priority Date: 09/29/2014
• Status: Active Grant

• Current Assignee: Stryker Corporation
• Original Assignee: Novadaq Technologies ULC (Stryker Corporation)
• Inventors: Moriyama, Eduardo Hiroyuki, Sze, Chun Ho
• Primary Examiner(s): Lu, Tom Y
• Application Number:
  US15/799,727
• Publication Number:
  US 20180120230A1
• Time in Patent Office: 756 Days
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/7203 for noise prevention, reduction or removal
• CPC Class Codes: G01N 2021/6419 Excitation at two or more wavelengths
• CPC Class Codes: G01N 2021/6439 with indicators, stains, dyes, tags, labels, marks
• CPC Class Codes: G01N 21/6408 with measurement of decay time, time resolved fluorescence
• CPC Class Codes: G01N 21/6428 Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" in vivo A61B5/00; immunoassay G01N33/53
• CPC Class Codes: G01N 21/6456 Spatial resolved fluorescence measurements; Imaging
• CPC Class Codes: G01N 21/6458 Fluorescence microscopy fluorescence microscopes per se G02B21/0076 and G02B21/16
• CPC Class Codes: G01N 21/6486 Measuring fluorescence of biological material, e.g. DNA, RNA, cells G01N21/6428 takes precedence
• CPC Class Codes: G06T 2207/10064 Fluorescence image
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/0016 involving temporal comparison

Abstract

Methods and systems are disclosed for extracting an image of a target fluorophore in a biological material, which involve inducing both autofluorescence of the biological material and fluorescence of the fluorophore, acquiring an image arising from both the autofluorescence of the biological material and the fluorophore, and an image arising only from the autofluorescence, subtracting the two images to produce an image representing only the fluorophore, wherein relative intensities of the excitation light used to induce the autofluorescence and the fluorescence are modulated prior to acquiring the images.

Claims

1. A method for extracting an image of a target fluorophore in a biological material wherein a waveband for emission of the target fluorophore overlaps a waveband for emission of a second fluorophore in the biological material, the method comprising:

illuminating the biological material with a first excitation light to induce a first fluorescence emission arising from both fluorescence of the target fluorophore and fluorescence of the second fluorophore and with a second excitation light to induce a second fluorescence emission arising from only the fluorescence of the second fluorophore;

acquiring a first fluorescence image from the first fluorescence emission and a second fluorescence image from the second fluorescence emission; and

processing the first and second fluorescence images to extract a third fluorescence image representing the target fluorophore, wherein relative intensities of the first and second excitation lights are modulated prior to acquiring the first and second fluorescence images.

2. The method of claim 1, wherein the modulation of the relative intensities comprises:

identifying a wavelength region in the first and second fluorescence emissions, wherein the wavelength region is a region where emission arising from the fluorophore is present in the first fluorescence emission and absent in the second fluorescence emission;

selecting a waveband outside the wavelength region;

calculating at the selected waveband a ratio of relative intensities of the first and second fluorescence emissions; and

adjusting the relative intensities of the first and second excitation lights to adjust the corresponding first fluorescence emission, second fluorescence emission or both until a suitable calculated ratio is achieved.

3. The method of claim 2, wherein the waveband outside the wavelength region comprises one or more wavelengths in fluorescence spectra arising from the first and second fluorescence emissions.

4. The method of claim 2, wherein calculating the ratio of relative intensities of the first and second fluorescence emissions comprises dividing an area-under-the curve value corresponding to the first fluorescence emission by an area-under-the curve value corresponding to the second fluorescence emission.

5. The method of claim 1, wherein the first excitation light has a wavelength of about 405 nm and the second excitation light has a wavelength of about 450 nm when the target fluorophore is porphyrin.

6. The method of claim 2, wherein the selected waveband is about 600 nm and wherein the calculated ratio is about 1.

7. The method of claim 1, wherein processing the first and second fluorescence images to extract the third fluorescence image representing the target fluorophore comprises subtracting the second fluorescence image from the first fluorescence image.

8. The method of claim 1, wherein the biological material is pretreated by photobleaching.

9. The method of claim 1, wherein the target fluorophore is endogenous, exogenous, or a combination thereof.

10. The method of claim 9, wherein the endogenous fluorophore is porphyrin, a porphyrin precursor, a porphyrin analog, a porphyrin derivative, a porphyrin conjugate, a porphyrin liposome, a porphyrin nanovesicle, or a combination thereof.

11. The method of claim 10, wherein the porphyrin comprises a coproporphyrin, a uroporphyrin, a protoporphyrin, or a combination thereof.

12. The method of claim 11, wherein the exogenous fluorophore is a fluorescent dye, a fluorescence inducing agent, or a combination thereof.

13. Use of the method of claim 1 in hystochemistry, cytochemistry, or a combination thereof.

14. The method of claim 1, wherein the biological material comprises a biological tissue, a biological fluid, or a fraction thereof.

15. The method of claim 1, wherein the biological material comprises an organ, a cell, a cell line, a cell constituent derived from or located in a mammal.

16. The method of claim 1, wherein the biological material comprises healthy, diseased or malignant tissue.

17. The method of claim 1, wherein the biological material comprises a tissue section for use in histochemistry, immunohistochemistry, cytochemistry, immunofluorescence, immunoblotting, or a fluorescence-related imaging application.

18. The method of claim 1, comprising displaying images representing the target fluorophore as images from the first fluorescence emission and images of the second fluorescence emission are acquired.

19. A system for extracting an image of a target fluorophore in a biological material wherein a waveband for emission of the target fluorophore overlaps a waveband for emission of a second fluorophore in the biological material, the system comprising:

a light source configured to illuminate the biological material with a first excitation light to induce a first fluorescence emission arising from both fluorescence of the target fluorophore and fluorescence of the second fluorophore and with a second excitation light to induce a second fluorescence emission arising from only the fluorescence of the second fluorophore;

an image acquisition assembly configured to acquire a first fluorescence image from the first fluorescence emission and a second fluorescence image from the second fluorescence emission;

a modulator configured to modulate relative intensities of the first and second excitation lights prior to acquisition of the first and second fluorescence images; and

a processor assembly configured to process the first and second fluorescence images to extract a third fluorescence image representing the target fluorophore.

20. The system of claim 19, wherein the modulator is configured to:

identify a wavelength region in the first and second fluorescence emissions, wherein the wavelength region is a region where emission arising from the fluorophore is present in the first fluorescence emission and absent in the second fluorescence emission;

select a waveband outside the wavelength region;

calculate at the selected waveband a ratio of relative intensities of the first and second fluorescence emissions; and

adjust the relative intensities of the first and second excitation lights to adjust the corresponding first fluorescence emission, second fluorescence emission or both until a suitable calculated ratio is achieved.

21. The system of claim 20, wherein the waveband outside the wavelength region comprises one or more wavelengths in fluorescence spectra arising from the first and second fluorescence emissions.

22. The system of claim 20, wherein calculating the ratio of relative intensities of the first and second fluorescence emissions comprises dividing an area-under-the curve value corresponding to the first fluorescence emission by an area-under-the curve value corresponding to the second fluorescence emission.

23. The system of claim 19, wherein the first excitation light has a wavelength of about 405 nm and the second excitation light has a wavelength of about 450 nm when the target fluorophore is porphyrin.

24. The system of claim 20, wherein the selected waveband is about 600 nm and wherein the calculated ratio is about 1.

25. The system of claim 19, wherein the processor assembly configured to process the first and second fluorescence images to extract the third fluorescence image representing the target fluorophore is configured for subtracting the second fluorescence image from the first fluorescence image.

26. The system of claim 19, wherein the light source configured to illuminate the biological material comprises an illumination module comprising a fluorescence excitation source, the fluorescence excitation source operatively configured to generate the first and second excitation lights.

27. The system of claim 26, wherein the illumination module further comprises an optical element operatively configured to shape and guide the first and second excitation lights exiting the illumination module.

28. The system of claim 27, wherein the optical element comprises a lens, a light guide, a diffuser, or a combination thereof.

29. The system of claim 19, wherein the image acquisition assembly comprises a fluorescence emission acquisition module, the fluorescence emission acquisition module comprising an image sensor.

30. The system of claim 29, wherein the fluorescence emission acquisition module further comprises an optical element disposed in front of the image sensor operatively configured to capture, filter, and direct the first and second fluorescence emissions.

31. The system of claim 19, wherein the processor assembly comprises a processor module.

32. The system of claim 31, wherein the processor module is operatively configured to control an operation of the light source, to control an operation of the image acquisition assembly, or a combination thereof.

33. The system of claim 19, wherein the biological material is pretreated by photobleaching.

34. The system of claim 19, wherein the target fluorophore is endogenous, exogenous, or a combination thereof.

35. The system of claim 34, wherein the endogenous fluorophore is porphyrin, a porphyrin precursor, a porphyrin analog, a porphyrin derivative, a porphyrin conjugate, a porphyrin liposome, a porphyrin nanovesicle, or a combination thereof.

36. The system of claim 35, wherein the porphyrin comprises a coproporphyrin, a uroporphyrin, a protoporphyrin, or a combination thereof.

37. The system of claim 34, wherein the exogenous fluorophore is a fluorescent dye, a fluorescence inducing agent, or a combination thereof.

38. The system of claim 19, wherein the system is configured for displaying images representing the target fluorophore on a display as images from the first fluorescence emission and images of the second fluorescence emission are acquired.