Computer aided treatment planning and visualization with image registration and fusion

• US 7,356,367 B2
• Filed: 06/06/2001
• Issued: 04/08/2008
• Est. Priority Date: 06/06/2000
• Status: Expired due to Fees

• Current Assignee: The Research Foundation for The State University of New York (State University of New York)
• Original Assignee: The Research Foundation for The State University of New York (State University of New York)
• Inventors: Kreeger, Kevin, Li, Bin, Liang, Zhengrong, Wax, Mark R., Chen, Dongqing, Kaufman, Arie E., Smouha, Eric E., Roque, Clemente T.
• Primary Examiner(s): Casler; Brian L.
• Assistant Examiner(s): RAMIREZ, JOHN FERNANDO
• Application Number:
  US10/297,349
• Publication Number:
  US 20030208116A1
• Time in Patent Office: 2,498 Days
• Field of Search: None
• US Class Current: 600/407
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/726 using Wavelet transforms
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for

Abstract

A computer based system and method of visualizing a region using multiple image data sets is provided. The method includes acquiring first volumetric image data of a region and acquiring at least second volumetric image data of the region. The first image data is generally selected such that the structural features of the region are readily visualized. At least one control point is determined in the region using an identifiable structural characteristic discernable in the first volumetric image data. The at least one control point is also located in the at least second image data of the region such that the first image data and the at least second image data can be registered to one another using the at least one control point. Once the image data sets are registered, the registered first image data and at least second image data can be fused into a common display data set. The multiple image data sets have different and complimentary information to differentiate the structures and the functions in the region such that image segmentation algorithms and user interactive editing tools can be applied to obtain 3d spatial relations of the components in the region. Methods to correct spatial inhomogeneity in MR image data is also provided.

Claims

1. A computer based method of visualizing a region using multiple image data sets comprising:

acquiring first volumetric image data of a region;

acquiring at least second volumetric image data of the region;

determining structural features of the region using the first volumetric image data

determining at least one control point in the region using at least one structural feature in the first volumetric image data;

identifying the at least one control point in the region in the at least second image data of the region;

registering the first image data and the at least second image data using said at least one control point;

fusing the registered first image data and at least second image data into a common display data set; and

wherein the region includes a branched structure having a common section and at least two branches extending from the common section forming a bifurcation region and wherein a bifurcation point is determined as the center of an imaginary maximal diameter sphere which is fit within the bifurcation region.

2. The method of visualizing a region using multiple image data sets of claim 1, wherein the branched structure is a blood vessel.

3. The method of visualizing a region using multiple image data sets of claim 1, wherein the at least second volumetric image data is acquired using a mode which is different from a mode used to acquire the first volumetric image data.

4. The method of visualizing a region using multiple image data sets of claim 3, wherein the mode used to acquire the at least second image data is selected to provide complimentary imaging characteristics to the mode used to acquire the first image data.

5. The method of visualizing a region using multiple image data sets of claim 1 wherein the second volumetric image data is acquired at a substantially different time from said first volumetric image data.

6. The method of visualizing a region using multiple image data sets of claim 1, wherein the second volumetric image data is acquired with the patient in an orientation which is different than an orientation used during acquisition of the first volumetric image data.

7. A method of visualizing and analyzing a region of artery comprising:

acquiring first volumetric image data of a region of artery using a first acquisition mode;

acquiring at least second volumetric image data of the region of artery using a second acquisition mode, said second acquisition mode being different than the first acquisition mode;

determining structural features of the artery using the first volumetric image data;

determining a bifurcation point in the artery using the first volumetric image data, the bifurcation point being the center of an imaginary maximal diameter sphere inscribed within a bifurcation region of the artery;

defining a coordinate system with the bifurcation point as the origin;

identifying the bifurcation point in the artery in the at least second image data of the region and applying the defined coordinate system to the at least second volumetric image data;

registering the first volumetric image data and the at least second volumetric image data using the bifurcation point and coordinate system; and

fusing the registered first volumetric image data and at least volumetric second image data into a common display data set.

8. The method of visualizing and analyzing a region of artery of claim 7, wherein the structural features include at least one region of stenosis resulting at least in part from a plaque deposit, and wherein the method further comprises the steps:

identifying the location of the at least one region of stenosis in the first volumetric image data;

using the location from the first volumetric image data, determining the location of the stenosis in the at least second volumetric image data.

9. The method of visualizing and analyzing a region of artery of claim 8, wherein the step of identifying the location of the at least one region of stenosis includes measuring the distance along at least one axis of the coordinate system from the bifurcation point to a point in the region of stenosis.

10. The method of visualizing and analyzing a region of artery of claim 8, wherein the at least second acquisition mode is selected to delineate fatty components of the plaque deposits.

11. The method of visualizing and analyzing a region of artery of claim 8, wherein the at least second acquisition mode is selected to delineate calcification components of the plaque deposits.

12. The method of visualizing and analyzing a region of artery of claim 8, wherein the at least second acquisition mode includes second and third acquisition modes, at least one of the second and third acquisition modes being selected to delineate fatty components of plaque deposits and at least one of the second and third acquisition modes being selected to delineate calcification components of plaque deposits.

13. The method of visualizing and analyzing a region of artery of claim 12, wherein the first acquisition mode is Magnetic Resonance Angiograpy.

14. The method of visualizing and analyzing a region of artery of claim 12, wherein the first acquisition mode is ultrasound imaging.

15. The method of visualizing and analyzing a region of artery of claim 12, wherein the second acquisition mode is T₁-weighted MR imaging.

16. The method of visualizing and analyzing a region of artery of claim 12, wherein the second acquisition mode is T₂-weighted MR imaging.

17. The method of visualizing and analyzing a region of artery of claim 12, wherein the first acquisition mode is time-of-flight Magnetic Resonance Angiograpy, the second acquisition mode is T1-weighted MRI imaging, and the third acquisition mode is Computed Tomography imaging.

18. The method of visualizing and analyzing a region of artery of claim 7, further comprising analyzing a plaque deposit identified in the fused image data.

19. The method of visualizing and analyzing a region of artery of claim 18, wherein the analyzing step includes determining the composition of the plaque deposit.

20. The method of visualizing and analyzing a region of artery of claim 19, wherein the analyzing step includes determining the volume and position of fatty components in the plaque deposit.

21. The method of visualizing and analyzing a region of artery of claim 19, wherein the analyzing step includes determining the volume and position of calcification components in the plaque deposit.

22. The method of visualizing and analyzing a region of artery of claim 19, wherein the analyzing step includes determining the volume and position of blood components in the plaque deposit.

23. The method of visualizing and analyzing a region of artery of claim 18, wherein the analyzing step further comprises assessing the risk of rupture of the plaque deposit.