INTRAOPERATIVE NEAR-INFRARED-I AND NEAR-INFRARED-II MULTI-SPECTRAL FLUORESCENT NAVIGATION SYSTEM AND METHOD OF USING THE SAME

• US 20200132599A1
• Filed: 08/20/2019
• Published: 04/30/2020
• Est. Priority Date: 10/30/2018
• Status: Active Grant

• Current Assignee: Institute Of Automation Chinese Academy Of Sciences
• Original Assignee: Institute Of Automation Chinese Academy Of Sciences
• Inventors: TIAN, Jie, HU, Zhenhua, CAO, Caiguang, ZHANG, Zeyu, CAI, Meishan
• Granted Patent: US 11,243,166 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/3614 using optical fibre
• CPC Class Codes: A61B 2090/3616 Magnifying glass
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/0036 including treatment, e.g., using an implantable medical device, ablating, ventilating
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/4887 Locating particular structures in or on the body
• CPC Class Codes: A61B 6/482 involving multiple energy imaging
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 Surgical systems with images on a monitor during operation
• CPC Class Codes: G01N 21/4795 spatially resolved investigating of object in scattering medium in vivo A61B
• CPC Class Codes: G01N 21/6456 Spatial resolved fluorescence measurements; Imaging
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system and method of using same includes a light source module for emitting white light and excitation light for illuminating tissue to be tested to generate an emission light. An optical information collection module includes a white light camera for collecting the white light image, and near infrared-I and near infrared-II fluorescence cameras for collecting the near infrared-I and near infrared-II fluorescence images. A central control module is coupled to the light source and the optical information collection modules. An image processing unit pre-processes the white light image, and the near infrared-I and near infrared-II fluorescence images, for de-noising and enhancement. The image processing unit performs a pseudo-color mapping on the images to obtain pseudo-color superimposed images of the near infrared-I and near infrared-II for a surgical region, and completes imaging of the intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system.

Claims

1. An intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system comprising:

a light source module configured to emit a white light and an excitation light, the white light and the excitation light illuminating a tissue to be tested, so as to generate an emission light;

an optical information collection module configured to collect a white light image, a near infrared-I image, and a near infrared-II image using the emission light; and

a central control module coupled to the light source module and the optical information collection module respectively, and configured to control the light source module and the optical information collection module.

2. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 1, wherein the light source module comprises:

a white light emission device configured to emit the white light;

a laser configured to emit the excitation light with a tunable wavelength;

a fiber configured to transmit the excitation light; and

an adaption device configured to couple the laser with the fiber.

3. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 2, wherein the light source module further comprises:

a beam expander disposed at an end of the fiber so as to diverge the excitation light transmitted from the fiber to a laser beam.

4. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 2, wherein the light source module further comprises:

a protective glass, wherein a beam expander is disposed between the fiber and the protective glass, so as to transmit the beam-expanded excitation light to the protective glass, and the protective glass is configured to limit the excitation light.

5. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 1, wherein the optical information collection module comprises:

a white light camera configured to collect the white light image;

a near infrared-I fluorescence camera configured to collect the near infrared-I fluorescence image;

a near infrared-II fluorescence camera configured to collect the near infrared-II fluorescence image; and

zoom lenses mounted on the white light camera, the near infrared-I fluorescence camera, and the near infrared-II fluorescence camera, through respective adaption rings, and configured to adjust the size of respective imaging area.

6. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 5, wherein the optical information collection module further comprises:

a first data line configured to transmit data of the white light camera;

a second data line configured to transmit data of the near infrared-I fluorescence camera;

a third data line configured to transmit data of the near infrared-II fluorescence camera; and

a power line configured to supply power to the white light camera, the near infrared-I fluorescence camera, and the near infrared-II fluorescence camera.

7. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 5, wherein the optical information collection module further comprises:

a first filter disposed between the near infrared-I fluorescence camera and a corresponding zoom lens, and configured to filter out optical signals outside the near infrared-I; and

a second filter disposed between the near infrared-II fluorescence camera and a corresponding zoom lens, and configured to filter out optical signals outside the near infrared-II.

8. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 1, wherein the central control module comprises:

a signal control unit configured to control the light source module and the optical information collection module;

a data reading unit configured to read data of the white light image, the near infrared-I fluorescence image, and the near infrared-II fluorescence image collected by the optical information collection module; and

an image processing unit configured to preprocess the white light image, the near infrared-I fluorescence image, and the near infrared-II fluorescence image, so as to obtain a pseudo-color superimposed image of the near infrared-I and a pseudo-color superimposed image of the near infrared-II with respect to a surgical region;

wherein the signal control unit, the data reading unit, and the image processing unit are communicatively coupled.

9. The intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 8, wherein the central control module further comprises:

an image display unit configured to display the white light image, the near infrared-I fluorescence image, the near infrared-II fluorescence image, the pseudo-color superimposed image of the near infrared-I, and the pseudo-color superimposed image of the near infrared-II,

wherein the image display unit is communicably coupled to the signal control unit, the data reading unit, and the image processing unit.

10. A method of using the intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system of claim 1, the method comprising:

step A;

turning on the white light emission device, and outputting a control signal to the white light camera by the signal control unit of the central control module, so as to enable collecting the white light image by the white light camera;

step B;

turning off the white light emission device, turning on the laser to output the excitation light, and outputting a control signal to the near infrared-I fluorescence camera and the near infrared-II fluorescence camera by the signal control unit of the central control module, so as to enable collecting the near infrared-I fluorescence image and the near infrared-II fluorescence image, respectively;

step C;

preprocessing, by the image processing unit of the central control module, the white light image, the near infrared-I fluorescence image and the near infrared-II fluorescence image collected in the step A and the step B for de-noising and enhancement;

step D;

performing, by the image processing unit of the central control module, a pseudo-color mapping on images after being preprocessed in the step C, so as to obtain a pseudo-color superimposed image of the near infrared-I and a pseudo-color superimposed image of the near infrared-II for a surgical region, and completing the imaging of the intraoperative near-infrared-I and near-infrared-II multi-spectral fluorescent navigation system.