Computer aided treatment planning and visualization with image registration and fusion

• US 20030208116A1
• Filed: 04/15/2003
• Published: 11/06/2003
• Est. Priority Date: 06/06/2000
• Status: Active Grant

• Current Assignee: Arie Kaufman, Bin Li, Clemente T. Roque, Dongqing Chen, Eric E. Smouha, Kevin Kreeger, Mark R. Wax, Zhengrong Liang
• Original Assignee: Arie Kaufman, Bin Li, Clemente T. Roque, Dongqing Chen, Eric E. Smouha, Kevin Kreeger, Mark R. Wax, Zhengrong Liang
• Inventors: Kreeger, Kevin, Li, Bin, Liang, Zhengrong, Kaufman, Arie, Chen, Dongqing, Roque, Clemente T, Wax, Mark R, Smouha, Eric E
• Granted Patent: US 7,356,367 B2
• Time in Patent Office: Days
• US Class Current: 600/407
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/726 using Wavelet transforms
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for

Abstract

A computer based system and method of visualizing a region using multiple image data sets is provided. The method includes acquiring first volumetric image data of a region and acquiring at least second volumetric image data of the region. The first image data is generally selected such that the structural features of the region are readily visualized. At least one control point is determined in the region using an identifiable structural characteristic discernable in the first volumetric image data. The at least one control point is also located in the at least second image data of the region such that the first image data and the at least second image data can be registered to one another using the at least one control point. Once the image data sets are registered, the registered first image data and at least second image data can be fused into a common display data set. The multiple image data sets have different and complimentary information to differentiate the structures and the functions in the region such that image segmentation algorithms and user interactive editing tools can be applied to obtain 3d spatial relations of the components in the region. Methods to correct spatial inhomogeneity in MR image data is also provided.

Claims

1. A computer based method of visualizing a region using multiple image data sets comprising:

acquiring first volumetric image data of a region;

acquiring at least second volumetric image data of the region;

determining structural features of the region using the first volumetric image data

determining at least one control point in the region using at least one structural feature in the first volumetric image data;

identifying the at least one control point in the region in the at least second image data of the region;

registering the first image data and the at least second image data using said at least one control point; and

fusing the registered first image data and at least second image data into a common display data set.

2. The method of visualizing a region using multiple image data sets of claim 1, wherein the region includes a branched structure having a common section and at least two branches extending from the common section forming a bifurcation region and wherein said control point is the bifurcation point of the branched structure.

3. The method of visualizing a region using multiple image data sets of claim 2, wherein the bifurcation point is determined as the center of an imaginary maximal diameter sphere which is fit within the bifurcation region.

4. The method of visualizing a region using multiple image data sets of claim 3, wherein the branched structure in a blood vessel.

5. The method of visualizing a region using multiple image data sets of claim 1, wherein the at least second volumetric image data is acquired using a mode which is different from a mode used to acquire the first volumetric image data.

6. The method of visualizing a region using multiple image data sets of claim 5, wherein the mode used to acquire the at least second image data is selected to provide complimentary imaging characteristics to the mode used to acquire the first image data.

7. The method of visualizing a region using multiple image data sets of claim 1 wherein the second volumetric image data is acquired at a substantially different time from said first volumetric image data.

8. The method of visualizing a region using multiple image data sets of claim 1, wherein the second volumetric image data is acquired with the patient in an orientation which is different than an orientation used during acquisition of the first volumetric image data.

9. A method of visualizing and analyzing a region of artery comprising:

acquiring first volumetric image data of a region of artery using a first acquisition mode;

acquiring at least second volumetric image data of the region of artery using a second acquisition mode, said second acquisition mode being different than the first acquisition mode;

determining structural features of the artery using the first volumetric image data;

determining a bifurcation point in the artery using the first volumetric image data;

defining a coordinate system with the bifurcation point as the origin;

identifying the bifurcation point in the artery in the at least second image data of the region and applying the defined coordinate system to the at least second volumetric image data;

registering the first volumetric image data and the at least second volumetric image data using the bifurcation point and coordinate system; and

fusing the registered first volumetric image data and at least volumetric second image data into a common display data set.

10. The method of visualizing and analyzing a region of artery of claim 9, wherein the structural features include at least one region of stenosis resulting at least in part from a plaque deposit, and wherein the method further comprises the steps:

identifying the location of the at least one region of stenosis in the first volumetric image data;

using the location from the first volumetric image data, determining the location of the stenosis in the at least second volumetric image data.

11. The method of visualizing and analyzing a region of artery of claim 9, wherein the step of identifying the location of the at least one region of stenosis includes measuring the distance along at least one axis of the coordinate system from the bifurcation point to a point in the region of stenosis

12. The method of visualizing and analyzing a region of artery of claim 10, wherein the at least second acquisition mode is selected to delineate fatty components of the plaque deposits.

13. The method of visualizing and analyzing a region of artery of claim 10, wherein the at least second acquisition mode is selected to delineate calcification components of the plaque deposits.

14. The method of visualizing and analyzing a region of artery of claim 10, wherein the at least second acquisition mode includes second and third acquisition modes, at least one of the second and third acquisition modes being selected to delineate fatty components of plaque deposits and at least one of the second and third acquisition modes being selected to delineate calcification components of plaque deposits.

15. The method of visualizing and analyzing a region of artery of claim 14, wherein the first acquisition mode is Magnetic Resonance Angiograpy.

16. The method of visualizing and analyzing a region of artery of claim 14, wherein the first acquisition mode is ultrasound imaging.

17. The method of visualizing and analyzing a region of artery of claim 14, wherein the second acquisition mode is T₁-weighted MR imaging.

18. The method of visualizing and analyzing a region of artery of claim 14, wherein the second acquisition mode is T₂-weighted MR imaging.

19. The method of visualizing and analyzing a region of artery of claim 14, wherein the first acquisition mode is time-of-flight Magnetic Resonance Angiograpy, the second acquisition mode is T1-weighted MRI imaging, and the third acquisition mode is Computed Tomography imaging.

20. The method of visualizing and analyzing a region of artery of claim 9, further comprising analyzing a plaque deposit identified in the fused image data.

21. The method of visualizing and analyzing a region of artery of claim 20, wherein the analyzing step includes determining the composition of the plaque deposit.

22. The method of visualizing and analyzing a region of artery of claim 21, wherein the analyzing step includes determining the volume and position of fatty components in the plaque deposit.

23. The method of visualizing and analyzing a region of artery of claim 21, wherein the analyzing step includes determining the volume and position of calcification components in the plaque deposit.

24. The method of visualizing and analyzing a region of artery of claim 21, wherein the analyzing step includes determining the volume and position of blood components in the plaque deposit.

25. The method of visualizing and analyzing a region of artery of claim 20, wherein the analyzing step further comprises assessing the risk of rupture of the plaque deposit.

26. A method for correcting spatial inhomogeneity in magnetic resonance imaging data comprising:

acquiring MRI image data;

estimating a bias field associated with the MRI image data; and

applying the bias field to the MRI image data to provide corrected MRI image data.