Integrated imaging apparatus

• US 6,640,130 B1
• Filed: 07/03/2000
• Issued: 10/28/2003
• Est. Priority Date: 07/02/1999
• Status: Expired due to Term

• Current Assignee: Hypermed, Inc. (Hypermed Imaging Incorporated)
• Original Assignee: Hypermed, Inc. (Hypermed Imaging Incorporated)
• Inventors: Lewis, Edgar Neil, Leventen, M., Mansfield, James, Hopmeier, Michael J., Freeman, Jenny E.
• Primary Examiner(s): Leung, Philip H.
• Application Number:
  US09/609,544
• Time in Patent Office: 1,212 Days
• Field of Search: 600/473, 600/474, 600/549, 600/476, 600/475, 600/477, 600/410, 600/412, 600/411, 600/407, 382/128, 382/130, 382/131, 382/234
• US Class Current: 600/474
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0073 by tomography, i.e. reconstruction of 3D images from 2D projections A61B5/0066 takes precedence
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/14535 for measuring haematocrit
• CPC Class Codes: A61B 5/1455 using optical sensors, e.g. spectral photometrical oximeters
• CPC Class Codes: A61B 5/415 the glands, e.g. tonsils, adenoids or thymus
• CPC Class Codes: A61B 5/418 lymph vessels, ducts or nodes
• CPC Class Codes: A61B 5/441 Skin evaluation, e.g. for skin disorder diagnosis
• CPC Class Codes: A61B 5/442 Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore

Abstract

The invention is directed to imaging methods for performing real-time or near real-time assessment and monitoring. Embodiments of these methods are useful in a plurality of settings including surgery, clinical procedures, tissue assessment, diagnostic procedures, forensic, health monitoring and medical evaluations.

Claims

1. A method for evaluating a biological system or stimulus comprising the steps of:

integrating spatial, spectral and temporal features, and optionally physiologic data, with a spectral and temporal multimodal imaging system;

fusing a thermal image or other imaging modalities with said multimodal imaging system;

registering multiple images acquired at various wavelengths and at different times in a hyperspectral cube so that each corresponding pixel in every plane images the same point in space; and

incorporating a high spatial and temporal resolution imaging device as a reference in which each spectral image in the cube is registered to evaluate said biological system or stimulus.

2. The method of claim 1 further comprising the step of interlacing thermal images and hyperspectral images with a time-dependent reference.

3. The method of claim 1 further comprising the step of selecting a wavelength to maximize diagnostic information for a specific tissue state or anticipated end diagnostic goal.

4. The method of claim 3 wherein the selection step is performed by multivariate image and spectral processing algorithms to extract information from the plurality of images and spectra for real-time or near real-time assessment.

5. The method of claim 1 wherein the biological system being evaluated is skin.

6. The method of claim 1 wherein the biological system being evaluated is an organ or a tissue.

7. The method of claim 1 further comprising an analysis step to determine the spatial distribution of oxyhemoglobin, deoxyhemoglobin and methemoglobin.

8. The method of claim 7 wherein the analysis step further determines a total hematocrit by calculating the area under the oxyhemoglobin, deoxyhemoglobin and methemoglobin spectrum or the intensity at their respective wavelengths, and a total blood volume by pairing a total hematocrit with perfusion data from a broadband thermal camera.

9. The method of claim 7 wherein the analysis step further determines a state of perfusion, demonstrates state of oxygen extraction, or a state of neurohumoral, physiological or pathological circumstances in spatial patterns.

10. The method of claim 1 further comprising the step of gating each image of a hyperspectral image set as well as the thermal image or other imaging modalities to a biological function, to allow data collection from moving samples.

11. The method of claim 1 further comprising an analysis step that identifies and classifies chemical species other than hemoglobins.

12. The method of claim 1, further comprising the step of utilizing automatic feature extraction techniques to localize landmarks throughout the hyperspectral imaging cube.

13. The method of claim 1, further comprising the step of registering and analyzing multiple hyperspectral image sets taken over time.

14. The method of claim 1, further comprising the step of registering a hyperspectral image set with a three dimensional spatial medical image.

15. The method of claim 14 wherein the fusion is performed with a real-time or near real-time hyperspectral imaging device and a 3D medical image.

16. The method of claim 14 wherein the three dimensional spatial medical image is selected from the group consisting of MR, CT, PET, SPECT, ultrasound, or combinations thereof.

17. The method of claim 1, further comprising the step of performing real-time or near real-time visualization of the full spectral information at a given location by registering a real-time or near real-time trackable instrument with the images.

18. The method of claim 10 wherein the biological function is selected from the group consisting of a cardiac cycle, breathing, a pulse, and a muscle contraction.