Multi-spectral physiologic visualization (MSPV) using laser imaging methods and systems for blood flow and perfusion imaging and quantification in an endoscopic design

• US 10,390,718 B2
• Filed: 08/28/2017
• Issued: 08/27/2019
• Est. Priority Date: 03/20/2015
• Status: Active Grant

• Current Assignee: East Carolina University
• Original Assignee: East Carolina University
• Inventors: Chen, Cheng, Ferguson, Jr., T. Bruce, Jacobs, Kenneth Michael
• Primary Examiner(s): Koharski, Christopher
• Assistant Examiner(s): Patel, Natasha
• Application Number:
  US15/688,472
• Publication Number:
  US 20180020932A1
• Time in Patent Office: 729 Days
• CPC Class Codes: A61B 1/000095 for image enhancement
• CPC Class Codes: A61B 1/005 Flexible endoscopes
• CPC Class Codes: A61B 1/044 for absorption imaging
• CPC Class Codes: A61B 1/046 for infrared imaging
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/3132 for laparoscopy
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/0261 using optical means, e.g. infrared light
• CPC Class Codes: A61B 5/721 using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
• CPC Class Codes: A61B 5/7278 Artificial waveform generation or derivation, e.g. synthesising signals from measured signals A61B5/327 takes precedence
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

Multispectral imaging systems are provided including a first light source having a first wavelength configured to image a sample; a second light source, different from the first light source, having a second wavelength, different from the first wavelength, configured to image the sample; and at least a third light source, different from the first and second light sources, having a third wavelength, different from the first and second wavelengths, configured to image the sample. A camera is configured to receive information related to the first, second and at least third light sources from the sample. A processor is configured to combine the information related to the first, second and at least third light sources provided by the camera to image an anatomical structure of the sample, image physiology of blood flow and perfusion of the sample and/or synthesize the anatomical structure and the physiology of blood flow and perfusion of the sample in terms of a blood flow rate distribution. The imaging system is directed and focused on a field of view (FOV) in a region of interest of the sample using an endoscope.

Claims

1. A multispectral imaging system, the system comprising:

a first light source having a first wavelength configured to image a sample;

a second light source, different from the first light source, having a second wavelength, different from the first wavelength, configured to image the sample;

at least a third light source, different from the first and second light sources, having a third wavelength, different from the first and second wavelengths, configured to image the sample;

a multi-sensor camera having a plurality of sensors, each of the plurality of sensors configured to receive information related to one of the first, second and at least third light sources from the sample, wherein light at the first wavelength is configured to image a surface of the sample into a first of the plurality of sensors of the multi-sensor camera;

wherein light at the second wavelength is configured to penetrate the sample to a first depth and provide information related to the sample to a second of the plurality of sensors of the multi-sensor camera; and

wherein light at the at least third wavelength is configured to penetrate the sample at a second depth, different from the first depth of the light at the second wavelength, and provide information related to the sample to a third of the plurality of sensors of the multi-sensor camera, the information related to the first, second and third light sources being aligned and synchronized when provided to the first, second and third sensors of the multi-sensor camera; and

a processor configured to combine the information related to the first, second and at least third light sources provided by the multi-sensor camera to image an anatomical structure of the sample, image physiology of blood flow and perfusion of the sample and/or synthesize the anatomical structure and the physiology of blood flow and perfusion of the sample in terms of a blood flow rate distribution,

wherein the imaging system is directed and focused on a field of view (FOV) in a region of interest of the sample using an endoscope.

2. The system of claim 1, wherein the endoscope is configured to provide the information related to the first, second and at least third light sources to the processor and is included in an endoscopic imaging system, the endoscopic imaging system comprising:

the multi-sensor camera;

a control unit configured to control the multi-sensor camera and process images associated therewith;

an image management unit configured to display and manipulate the images associated with the multi-sensor camera; and

a system interface configured to translate the information related to the first, second and at least third light source to perform within the endoscopic imaging system such that the images associated therewith are displayed and manipulated.

3. The system of claim 2, wherein the endoscopic imaging system comprises at least one of:

a system for endoscopic surgery including at least one of laparoscopy, thorascoscopy, and cystoscopy;

a system for minimally invasive surgical procedures using the endoscope for illumination, visualizing, and manipulation; and

a system for robotic procedures using the endoscope for illumination, visualizing, and manipulation.

4. The system of claim 2, wherein the endoscopic imaging system is configured:

to illuminate cavity tissues and organs during a procedure;

to visualize cavity tissues and organs for surgical intervention; and

/or

for surgical manipulation of cavity tissues and organs for surgical intervention.

5. The system of claim 2, wherein the endoscopic imaging system is configured to illuminate the region of interest using fibers, fiber compositions, fiber arrangements, lenses, diffusers, collimators, and/or expanders.

6. The system of claim 2:

wherein the multi-sensor camera is configured to have speeds, focus, accuracy and fidelity to obtain images using the endoscopic imaging system; and

wherein the multi-sensor camera is coupled to optic fibers of the endoscope.

7. The system of claim 6, wherein the plurality of sensors of the multi-sensor camera are arranged along a continuum from an endoscope tip to a distance remote from the endoscope coupled by image capture cabling.

8. The system of claim 1, wherein the endoscope is one of a rigid endoscope, a semi-rigid endoscope or a flexible endoscope.

9. The system of claim 8, wherein the endoscope is one of a rigid endoscope having a flexible, navigable tip or a flexible endoscope having a flexible insertion tube.

10. The system of claim 1, wherein the at least third light source having the at least the third wavelength is configured to assess a defined physiologic parameter.

11. The system of claim 1, wherein the system comprises one or more of a hand-held system, a finger probe unit, a skin patch and a mobile system.

12. The system of claim 1, wherein the multispectral imaging system comprises different blood flow and perfusion measurement technologies in one system, wherein the blood flow and perfusion measurement technologies comprise one or more of laser speckle imaging (LSI), laser Doppler imaging (LDI), florescence imaging or reflectance imaging.

13. A method for multispectral imaging in a multispectral imaging system adapted for an endoscopic system, comprising:

imaging a sample using a first light source having a first wavelength and being delivered through an endoscopic system;

imaging the sample using a second light source, different from the first light source, having a second wavelength, different from the first wavelength and being delivered through the endoscopic system;

receiving information related to the first and second light sources from the sample at a multi-sensor camera having a plurality of sensors, wherein light at the first wavelength is configured to reflect off a surface of the sample into the a first of the plurality of sensors in the multi-sensor camera and light at the second wavelength is configured to penetrate the sample and provide information related to the sample to a second of the plurality of sensors in the multi-sensor camera through the endoscopic system, the light at the first and second wavelengths being aligned and synchronized when provided to the first and second sensors of the multi-sensor camera; and

combining the information related to the first and second light sources received by the multi-sensor camera using at least one processor to image an anatomical structure of the sample, image physiology of blood flow and perfusion of the sample and/or synthesize the anatomical structure and the physiology of blood flow and perfusion of the sample in terms of a blood flow rate distribution.

14. The method of claim 13:

wherein illumination, analysis and display is performed using the endoscopic system; and

wherein the endoscopic system is configured to communicate with a multi-spectral physiologic visualization (MSPV) operating system.

15. An endoscopic imaging system, comprising:

an endoscope;

a light source unit coupled to the endoscope, the light source unit providing first, second and at least a third light source,

wherein the first light source has a first wavelength configured to image a sample;

wherein the second light source, different from the first light source, has a second wavelength, different from the first wavelength, configured to image the sample; and

wherein the at least a third light source, different from the first and second light sources, has a third wavelength, different from the first and second wavelengths, configured to image the sample;

a cameral control unit coupled to the endoscope through a camera head of a multi-sensor camera having a plurality of sensors, the camera head being adapted to receive information related to the first, second and at least third light sources, wherein light at the first wavelength is configured to image a surface of the sample into a first of the plurality of sensors of the multi-sensor camera;

wherein light at the second wavelength is configured to penetrate the sample to a first depth and provide information related to the sample to a second of the plurality of sensors in the multi-sensor camera; and

wherein light at the third wavelength is configured to penetrate the sample to a second depth, different from the first depth, and provide information related to the sample to a third sensor of the plurality of sensors in the multi-sensor camera, the information related to the first, second and third wavelengths being aligned and synchronized when provided to the first, second and third sensors of the multi-sensor camera; and

an image processing unit coupled to endoscope configured to combine the information related to the first, second and at least third light sources provided by the camera head to image an anatomical structure of the sample, image physiology of blood flow and perfusion of the sample and/or synthesize the anatomical structure and the physiology of blood flow and perfusion of the sample in terms of a blood flow rate distribution.

16. The system of claim 15, wherein the endoscopic imaging system comprises at least one of:

a system for endoscopic surgery including at least one of laparoscopy, thorascoscopy, and cystoscopy;

a system for minimally invasive surgical procedures using the endoscope for illumination, visualizing, and manipulation; and

a system for robotic procedures using the endoscope for illumination, visualizing, and manipulation.

17. The system of claim 15, wherein the endoscopic imaging system is configured to:

illuminate cavity tissues and organs during a procedure;

visualize cavity tissues and organs for surgical intervention; and

/or

surgical manipulation of cavity tissues and organs for surgical intervention.

18. The system of claim 15, wherein the endoscopic imaging system is configured to illuminate a region of interest by using fibers, fiber compositions, fiber arrangements, lenses, diffusers, collimators, and/or expanders.

19. The system of claim 15, wherein the endoscope is one of a rigid endoscope having a flexible, navigable tip and or a flexible endoscope having a flexible insertion tube.

20. The system of claim 15, further comprising an accessory unit coupled to the endoscope through any of air, water and/or open channel tubes.