Multifocal imaging systems and method

• US 10,598,597 B2
• Filed: 11/16/2017
• Issued: 03/24/2020
• Est. Priority Date: 05/25/2005
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Bahlman, Karsten, Kim, Ki-Hean, Ragan, Timothy, So, Peter T. C.
• Primary Examiner(s): Vo, Tung T
• Application Number:
  US15/815,536
• Publication Number:
  US 20180202935A1
• Time in Patent Office: 859 Days
• Field of Search: 348 82, 348 79
• CPC Class Codes: G01N 21/6452 Individual samples arranged in a regular 2D-array, e.g. multiwell plates
• CPC Class Codes: G01N 21/6458 Fluorescence microscopy fluorescence microscopes per se G02B21/0076 and G02B21/16
• CPC Class Codes: G01N 21/6486 Measuring fluorescence of biological material, e.g. DNA, RNA, cells G01N21/6428 takes precedence
• CPC Class Codes: G02B 21/002 Scanning microscopes scanning near field optical microscopes G01Q60/18
• CPC Class Codes: G02B 21/0032 Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers G02B21/0036 - G02B21/008; means for illumination of specimens in general G02B21/06
• CPC Class Codes: G02B 21/0076 arrangements using fluorescence or luminescence
• CPC Class Codes: G02B 21/16 adapted for ultraviolet illumination ; Fluorescence microscopes G02B21/0076 takes precedence

Abstract

In the systems and methods of the present invention a multifocal multiphoton imaging system has a signal to noise ratio (SNR) that is reduced by over an order of magnitude at imaging depth equal to twice the mean free path scattering length of the specimen. An MMM system based on an area detector such as a multianode photomultiplier tube (MAPMT) that is optimized for high-speed tissue imaging. The specimen is raster-scanned with an array of excitation light beams. The emission photons from the array of excitation foci are collected simultaneously by a MAPMT and the signals from each anode are detected using high sensitivity, low noise single photon counting circuits. An image is formed by the temporal encoding of the integrated signal with a raster scanning pattern. A deconvolution procedure taking account of the spatial distribution and the raster temporal encoding of collected photons can be used to improve decay coefficient. We demonstrate MAPMT-based MMM can provide significantly better contrast than CCD-based existing systems.

Claims

1. A multiphoton imaging system comprising:

a multiphoton light source emitting light for illuminating a biological material with multiphoton light excitation to induce a fluorescence emission at one or more foci;

a focusing lens system including an actuator coupled to an objective lens that receives light from the multiphoton light source is configured to place the one or more foci at selected depth positions within the biological material;

a scanner that provides relative movement between one or more foci receiving the illuminating light and the material to be imaged at the selected depth, the scanner configured to place the one or more foci at selected horizontal and vertical positions within the biological material, the placement of the one or more foci in horizontal, vertical, and depth positions enabling generation of three dimensional image data;

an optical system that couples light from the scanner onto a region of interest of the material, the optical system including a moveable lens to adjust focal depth in the biological material;

a detector system that detects light from the region of interest to generate image data at a plurality of different wavelengths, the detector system including a plurality of photomultiplier tube detector elements, including a first photomultiplier tube detector element that is optically coupled to the region of interest with a first optical fiber and a second photomultiplier tube detector element that is coupled to the region of interest with a second optical fiber;

a holder for the biological material, the holder being mounted on a controllable stage;

a sectioning system for sectioning the biological material;

a controller connected to the scanner, the light source, the focusing lens system, and the controllable stage to automatically control the imaging system; and

an image processor connected to the detector system that processes image data detected at different focal depths, different horizontal and vertical positions, and at different wavelengths in the biological material to generate the three dimensional image data.

2. The system of claim 1 wherein the detector system comprises a plurality of detector elements each detector element being optically coupled to the material with an optical fiber.

3. The system of claim 1 wherein each detector element detects light from a different focal location.

4. The system of claim 1 wherein each detector element comprises a photomultiplier tube.

5. The system of claim 1 wherein each detector element has a detection area and a detector spacing separating each detector element from an adjacent detector element.

6. The system of claim 1 wherein the detector system comprises a multi-anode photomultiplier tube imaging detector having at least 64 detector elements.

7. The system of claim 1 wherein the optical system illuminates at least 4 spatially separated foci in a 2×

2 scan pattern.

8. The system of claim 1 wherein the system performs spatially multiplexed imaging.

9. The system of claim 1, wherein the optical system simultaneously illuminates a plurality of spatially separated foci.

10. The system of claim 1 wherein controller alternates between excitation foci patterns and wherein the system illuminates foci at different depths.

11. The system of claim 1 wherein the detector system detects non-descanned light from the material in response to the illuminating light.

12. The system of claim 1 wherein the optical system comprises a diffractive optical element.

13. The system of claim 1, wherein the system illuminates foci at a first focal depth and a second focal depth.

14. The system of claim 1 wherein the scanning system scans a plurality of foci in a linear array.

15. The system of claim 1 further comprising a data storage device that stores image data and metadata including foci spacing, foci number, and scanner data.

16. The system of claim 1 further comprising recording of focal positions for the scanner position and the stage position at each focal position scanned by the scanner.

17. The system of claim 1 wherein the system is configured to perform time multiplexed illumination, the time multiplexed illumination comprising illuminating a plurality of focal locations in the material.

18. The system of claim 17 wherein a plurality of beam paths illuminate a plurality of foci, at least one beam path transmitting a first pulse that is temporally separated from a second pulse, and wherein the detector system detects the first pulse and the second pulse.

19. The system of claim 1 wherein the system is configured to perform time multiplexed detection.

20. The system of claim 1 wherein each optical fiber is coupled to a separate foci of a foci pattern.

21. The system of claim 1 further comprising an illumination fiber optic device that couples light from the light source to the material.

22. The system of claim 1 wherein light from each foci is coupled to the first or second optical fiber with a lens element.

23. The system of claim 1 wherein the scanner is a resonant mirror scanner.

24. A multifocal light detecting system comprising:

a multiphoton light source system that illuminates a material with a plurality of light pulses such that at least two photons at each of a plurality of focal locations located at a selected depth within the material induce fluorescence at each focal location;

a multifocal optical device that provides a plurality of pulsed light beams at a pulse rate at each of the plurality of focal locations;

an optical system including a focusing lens system having an actuator coupled to an objective lens that couples the plurality of pulsed light beams from the multifocal optical device onto a region of interest of the material at a plurality of focal locations at a selected adjustable depth within the material;

a scanner system configured to place the plurality of focal locations at selected horizontal and vertical positions on the material;

a control system connected to the multiphoton light source system, the scanner system, and the focusing lens system, the control system automatically controlling the multiphoton light source system output power as a function of light penetration depth in the material;

a detector device that detects fluorescent light from the plurality of focal locations in the region of interest with a plurality of detectors to generate three-dimensional image data at a plurality of different wavelengths, the detected fluorescent light being emitted in response to the pulsed light beam; and

a processor connected to the detector that processes the three-dimensional image data.

25. The system of claim 24 wherein the scanner system comprises a rotating mirror or a resonant mirror.

26. The system of claim 24 wherein each detector in the plurality of detectors has a collection area corresponding to a scattering distribution for a corresponding focal location in the plurality of focal locations.

27. The system of claim 24 wherein the detector device detects time resolved data for deconvolutions.

28. The system of claim 24 wherein the processor is configured to execute a computer program that processes time resolved data in combination with spectroscopic data to distinguish components of tissue.

29. A method for multifocal light detection in response to light from a multiphoton light source system comprising:

illuminating a region of interest with light from a multiphoton light source system using a plurality of scanning optical pathways to form a plurality of scanning focal locations at selected horizontal and vertical positions within the region of interest with a multifocal optical device including a focusing lens system having an actuator coupled to an objective lens to place the plurality of scanning focal locations at a selected adjustable depth within the region of interest, the scanning focal locations simultaneously moving in tissue in response to control signals from a controller;

simultaneously detecting fluorescent light from each of the plurality of focal locations in the region of interest in response to pulsed light illumination including at least two photons received at each focal location required to induce fluorescence at a given time during scanning, the fluorescent light being detected with a first detector array that detects a first spectral component having at least a first wavelength and a second detector array that detects a second spectral component having at least a second wavelength, the first spectral component being spectrally distinct from the second spectral component; and

processing the first spectral component and the second spectral component to generate a plurality of spectral images of the tissue including three dimensional image data at different wavelengths.

30. The method of claim 29 further comprising actuating relative movement between the pathways and a material by scanning with a rotating mirror or a resonant mirror.

31. The method of claim 29 further comprising detecting with the first detector array having a plurality of detector elements, each detector element having a collection area corresponding to a scattering distribution for each of the plurality of scanning focal locations and collecting time realized data and fluorescence data.

32. The method of claim 29 further comprising detecting light with the first detector array that comprises a plurality of photomultiplier tube detector elements.

33. The method of claim 29 further comprising actuating the multiphoton light source system that emits light at a wavelength such that at least two photons of light that are incident at a focal location of a material within the region of interest induce a fluorescence emission from a material.