Method for providing a virtual contrast agent for augmented angioscopy

• US 6,711,433 B1
• Filed: 09/30/1999
• Issued: 03/23/2004
• Est. Priority Date: 09/30/1999
• Status: Expired due to Term

• Current Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Original Assignee: Siemens Corporate Research Incorporated (Siemens AG)
• Inventors: Geiger, Bernhard, Navab, Nassir
• Primary Examiner(s): Ruhl, Dennis
• Assistant Examiner(s): Pass, Barry
• Application Number:
  US09/408,930
• Time in Patent Office: 1,636 Days
• Field of Search: 378/98.11, 378/98.12, 378/98.2, 378/41, 378/62, 378/42, 600/431, 600/420, 600/458, 600/425, 606/130, 382/130
• US Class Current: 600/431
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/481 involving the use of contrast agents
• CPC Class Codes: A61B 6/504 for diagnosis of blood vessels, e.g. by angiography
• CPC Class Codes: A61B 6/5235 combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2211/404 Angiography

Abstract

A method for providing a virtual contrast agent for blood vessels in a body portion for angioscopy comprising deriving data from a 3D model using, for example, magnetic resonance imaging, computerized tomography (CT), and 3D angio. The data is segmented to provide a segmented 3D model of the blood vessels. A first procedure image is made with a contrast agent present. The 3D model is then registered with the first procedural image and “virtual camera parameters” are obtained. The 3D model is rendered and overlaid onto a second procedure image without contrast, whereby a virtual contrast is achieved.

Claims

1. A method for providing a virtual contrast agent for blood vessels in a body portion, comprising the steps of:

acquiring data for a 3D model from an imaging process;

segmenting said data to provide a segmented 3D model of said blood vessels;

obtaining a first procedure image of said body portion utilizing a radiation source and an image detector, said first procedure image including said blood vessels with contrast agent injection;

registering said segmented 3D model with said first procedure image, and deriving therefrom parameters relating positions of said body portion, said radiation source, said image detector, and said 3D model;

obtaining a second procedure image of said body portion utilizing said radiation source and said image detector, said second procedure image being obtained without contrast agent injection;

rendering said 3D model and overlaying a 2D projection of said 3D model onto said second procedure image; and

simulating a contrast agent injection on said second procedure image, said simulated injection being calculated by said 3D model.

2. A method for providing a virtual contrast agent as recited in claim 1 wherein said imaging process comprises one of magnetic resonance imaging, computerized tomography (CT), and 3D angio, and said first and second procedure images comprise one of magnetic resonance imaging, computerized tomography (CT), 3D angio, fluoroscopy, and ultrasound imaging.

3. A method for providing a virtual contrast agent as recited in claim 1 wherein said step of segmenting comprises labeling blood flow direction in said blood vessels.

4. A method for providing a virtual contrast agent as recited in claim 1, wherein said step of rendering comprises a step of finding a catheter tip in said second procedure image and rendering a subset of said segmented 3D model including said catheter tip and downstream blood vessel portions.

5. A method for providing a virtual contrast agent as recited in claim 4, wherein said step of finding a catheter tip comprises thresholding of said second procedure image to produce a thresholded image.

6. A method for providing a virtual contrast agent as recited in claim 5, comprising the step of identifying as the tip of said catheter as the end of a line that does not cross the image border and that is therefore located within the border of said thresholded second procedure image.

7. A method for providing a virtual contrast agent as recited in claim 6, wherein said step of finding a catheter tip comprises the steps of finding said catheter tip in said 3D model by:

deriving a straight line in 3D space from said parameters relating positions of said body portion, said radiation source, said image detector, and said 3D model and said tip of said catheter in said second procedure image; and

determining the intersection point of said straight line with said 3D model.

8. A method for providing a virtual contrast agent as recited in claim 4, wherein said step of finding a catheter tip comprises the steps of:

deriving a subtracted image by subtracting a previously stored image without contrast and without a catheter from said second procedure image with catheter;

thresholding said subtracted image; and

identifying as the tip of said catheter in said subtracted image as the end of a line that does not cross the image border and that is therefore located within the border of said subtracted image.

9. A method for providing a virtual contrast agent as recited in claim 8, wherein said step of finding a catheter tip comprises the steps of finding said catheter tip in said 3D model by:

deriving a straight line in 3D space from said parameters relating the positions of said body portion, said radiation source, said image detector, and said 3D model and said tip of said catheter In said subtracted image; and

determining an intersection point of said straight line with said 3D model.

10. A method for providing a virtual contrast agent as recited in claim 1, wherein said rendering and overlaying is selectively performed using virtual contrast.

11. A method for providing a virtual contrast agent as recited in claim 10, wherein said virtual contrast is performed utilizing a contrasting color.

12. A method for providing a virtual contrast agent as recited in claim 10, wherein said virtual contrast is performed utilizing intensity modulation.

13. A method for providing a virtual contrast agent for blood vessels in a body portion, comprising the steps of:

acquiring data for a 3D model from an imaging process;

segmenting said data to provide a segmented 3D model of said blood vessels;

obtaining a first procedure image of said body portion utilizing a radiation source and an image detector, said first procedure image including said blood vessels with contrast agent injection;

registering said segmented 3D model with said first procedure image, and deriving therefrom parameters relating the positions of said body portion, said radiation source, said image detector, and said 3D model by comparing said first procedure image with a number of precalculated projections of said 3D model;

obtaining a second procedure image of said body portion utilizing said radiation source and said image detector, said second procedure image being obtained without contrast agent injection;

rendering said 3D model by finding a catheter tip in said second procedure image by rendering a subset of said segmented 3D model including said catheter tip and downstream blood vessel portions; and

overlaying a 2D projection of said 3D model onto said second procedure image utilizing virtual contrast.

14. A method for providing a virtual contrast agent for blood vessels in a body portion, comprising the steps of:

deriving data for a 3D model;

segmenting said data to provide a segmented 3D model of said blood vessels;

generating a first procedure image with a contrast agent present;

registering said segmented 3D model with said first procedure image and thereby obtaining virtual camera parameters;

rendering said 3D model; and

overlaying a 2D projection of said 3D model onto a second procedure image without contrast, whereby a virtual contrast is achieved by simulating a contrast agent injection in said rendered 3D model.

15. A method for providing a virtual contrast agent for blood vessels in a body portion, comprising the steps of;

acquiring data for a 3D model from an imaging process;

segmenting said data to provide a segmented 3D model of said blood vessels;

obtaining a first procedure image of said body portion utilizing a radiation source and an image detector, said first procedure image including said blood vessels with contrast agent injection;

registering said segmented 3D model with said first procedure image, and deriving therefrom parameters relating positions of said body portion, said radiation source, said image detector, and said 3D model;

obtaining a second procedure image of said body portion utilizing said radiation source and said image detector, said second procedure image being obtained without contrast agent injection; and

rendering said 3D model and overlaying a 2D projection of said 3D model onto said second procedure image, wherein said step of rendering further comprises the step of finding a catheter Up in said second procedure image by deriving a subtracted image by subtracting a previously stored image without contrast and without a catheter from said second procedure image with said catheter, thresholding said subtracted image, and identifying as the tip of said catheter in said subtracted image as the end of a line that does not cross the subtracted image border and that is therefore located within the border of said subtracted image; and

rendering a subset of said segmented 3D model including said catheter tip and downstream blood vessel portions by deriving a straight line in 3D space from said parameters relating the positions of said body portion, said radiation source, said image detector, and said 3D model and said tip of said catheter in said subtracted image, and determining the intersection point of said straight line with said 3D model.