Apparatus and method for determining three-dimensional representations of tortuous vessels

• US 6,148,095 A
• Filed: 09/08/1997
• Issued: 11/14/2000
• Est. Priority Date: 09/08/1997
• Status: Expired due to Fees

• Current Assignee: University of Iowa Research Foundation
• Original Assignee: University of Iowa Research Foundation
• Inventors: Prause, Guido P. M., Sonka, Milan
• Primary Examiner(s): CHANG, JON CARLTON
• Application Number:
  US08/925,489
• Time in Patent Office: 1,163 Days
• Field of Search: 382/130, 382/131, 382/128, 600/463, 600/437, 600/467, 600/466, 128/916
• US Class Current: 382/131
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/481 involving the use of contrast agents
• CPC Class Codes: A61B 6/504 for diagnosis of blood vessels, e.g. by angiography
• CPC Class Codes: A61B 6/5247 combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
• CPC Class Codes: A61B 8/0883 for diagnosis of the heart
• CPC Class Codes: A61B 8/0891 for diagnosis of blood vessels
• CPC Class Codes: A61B 8/12 in body cavities or body tracts, e.g. by using catheters catheters per se A61M25/00
• CPC Class Codes: A61B 8/5261 combining images from different diagnostic modalities, e.g. ultrasound and X-ray
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: Y10S 128/916 Ultrasound 3-D imaging

Abstract

Three-dimensional reconstructions of tortuous vessels such as coronary arteries can be obtained by data fusion between biplane angiography and IVUS frames of a pullback sequence. The 3D course of the tortuous vessel is first determined from the angiograms and then combined with the 2D representations regarding the 3D course (e.g., segmented IVUS frames of a pullback sequence) using a data fusion apparatus and method: The determination of the 3D pullback path is represented by the external energy of the tortuous vessel and the internal energy of a line object such as a catheter.

Claims

1. An apparatus for determining three dimensional representations of a tortuous vessel, comprising:

an external information processing unit for receiving a first set of images of a line object in the tortuous vessel, determining external energy information of said first set of images and outputting said external energy information;

an internal information processing unit for receiving internal information related to the line object including a minimum bending radius, determining internal energy information of the line object and outputting said internal energy information;

a 3D pullback path determination unit for receiving said external energy information and said internal energy information and determining a 3D pullback path that is physically feasible based on the line object; and

means for receiving said 3D pullback path and for calculating three dimensional representations of the tortuous vessel based on said 3D pullback path, wherein the means for receiving and calculating receives 2D representations of the interior of the tortuous vessel at a plurality of points along the 3D pullback path, and wherein the means for receiving and calculating comprises a global interpolating means for interpolating using global behavior of the line object to approximate a local behavior between corresponding points of the plurality of 2D representations of the interior of the tortuous vessel, wherein the interpolating using the global behavior determines the three dimensional representations of the tortuous vessel.

2. The apparatus according to claim 1, wherein the external information processing unit receives the first set of images of the line object in the tortuous vessel from at least one of a biplane angiographic unit and an intravascular ultrasound imaging unit, and wherein the line object is a catheter.

3. The apparatus according to claim 1, wherein the external information processing unit determines the external energy information based on at least one of a plurality of 2D cross-sectional images of the tortuous vessel and multiple projection images with prescribed epipolar geometry of the tortuous vessel.

4. The apparatus according to claim 1, wherein the internal energy information represents physical properties of the line object.

5. The apparatus according to claim 1, wherein the internal information processing unit receives internal information including at least one of modulus of elasticity, cross-sectional shape, diameter, wall thickness, and stiffness.

6. The apparatus according to claim 1, wherein the internal information processing unit determines a 3D representation of the line object.

7. The apparatus according to claim 1, wherein the means for receiving and calculating comprises:

a catheter twist determination unit;

a correlation determination unit; and

an interpolation unit that uses Bezier curves to determine the three dimensional representations of the tortuous vessel between specifically determined positions, wherein the interpolation unit is the global interpolating means.

8. The apparatus according to claim 1, wherein the means for receiving and calculating comprises a calculation unit that determines with adjustable accuracy the three dimensional representations of the tortuous vessel between specific positions.

9. A method for determining three dimensional representations of a tortuous vessel, comprising:

determining external information of the tortuous vessel;

determining internal information of a line object sensor;

determining a 3D pullback path of the line object sensor based on the external information and the internal information; and

calculating three dimensional representations of the tortuous vessel based on the 3D pullback path, wherein the calculating step comprises,

receiving a plurality of 2D cross-sectional images of the interior of the tortuous vessel, and

interpolating using global behavior of the line object sensor,

wherein a local behavior between corresponding points of the plurality of 2D cross-sectional images is represented by an approximation utilizing behavior of the entire line object sensor to determine the three dimensional representations of the tortuous vessel between the corresponding points of the plurality of 2D cross-sectional images, and wherein the determining a 3D pullback path of the line object sensor step comprises,

constructing a 3D cost volume based on the external information of the tortuous vessel,

constructing a 3D representation of the line object sensor based on the internal information of the line object sensor including at least a minimum bending radius,

determining a low cost path of the line object sensor through the 3D cost volume that is physically feasible for the line object sensor, and

interpolating the physically feasible low cost path using the global behavior of the line object sensor.

10. The method of claim 9, wherein the corresponding points of the plurality of 2D cross-sectional images are border points of lumen in adjacent ones of the plurality of 2D cross-sectional images.

11. The method of claim 9, wherein the determining external information step comprises:

receiving a plurality of 2D representations of cross-sectional information along the 3D pullback path; and

receiving at least one set of multiple 2D projection images with prescribed epipolar geometry of the tortuous vessel, wherein the 2D representations of cross-sectional information are obtained using an intravascular ultrasound imaging unit, wherein the at least one set of multiple 2D projection images with prescribed epipolar geometry are initial and final images of the line object sensor in the tortuous vessel obtained using a biplane angiographic unit.

12. The method of claim 9, wherein the determining external information step comprises:

receiving a plurality of 2D representations of cross-sectional information along the 3D pullback path; and

receiving at least one set of multiple 2D projection images with prescribed epipolar geometry of the tortuous vessel, wherein the at least one set of multiple 2D projection images with prescribed epipolar geometry includes an initial position of the line object sensor in the tortuous vessel, and wherein the 2D cross-sectional images include at least one of lumen, plaque, wall and adventitia.

13. The method of claim 9, wherein the determining a 3D pullback path of the line object sensor step comprises:

determining 3D volume representation of the external information; and

determining optimal location of a representation of the line object sensor in the 3D volume representation.

14. The method of claim 9, further comprising:

determining a 3D volume representation of the external information; and

determining a low energy location of a 3D representation of the line object sensor in the 3D volume representation;

determining total internal energy of the line object sensor in the low energy location;

comparing the total internal energy of the line object sensor to a threshold; and

modifying the 3D volume representation and repeating the determining a low energy location through comparing the total internal energy steps when the total internal energy level is greater than the threshold.

15. The method of claim 9, wherein the calculating three dimensional representations of the tortuous vessel step comprises:

determining a centerline of the plurality of 2D cross-sectional images of the interior of the tortuous vessel; and

using a global smoothing process to perform local smoothing of the three dimensional representations of the tortuous vessel between points mapped to the 2D centerline.

16. The method of claim 9, wherein the global smoothing characteristics include variable levels of interpolation based on Bezier curves.