Method for determination of 3-D structure in biplane angiography

• US 4,875,165 A
• Filed: 11/27/1987
• Issued: 10/17/1989
• Est. Priority Date: 11/27/1987
• Status: Expired due to Term

• Current Assignee: University of Chicago
• Original Assignee: University of Chicago
• Inventors: Fencil, Laura E., Metz, Charles E., Doi, Kunio
• Primary Examiner(s): Smith, Jerry
• Assistant Examiner(s): BUI, KIM T
• Application Number:
  US07/126,266
• Time in Patent Office: 690 Days
• Field of Search: 364/413.22, 364/413.13, 364/413.23, 378/901, 358/111, 356/2
• US Class Current: 345/424
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

A novel method for determination of 3-D structure in biplane angiography, including determining the distance of a perpendicular line from the focal spots of respective x-ray sources to respective image planes and defining the origin of each biplane image as the point of intersection with the perpendicular line thereto, obtaining two biplane digital images at arbitrary orientations with respect to an object, identifying at least 8 points in both images which correspond to respective points in the object, determining the image coordinates of the 8 or more identified object points in the respective biplane images, constructing a set of linear equations in 8 unknowns based on the image coordinates of the object points and based on the known focal spot to image plane distances for the two biplane images; solving the linear equations to yield the 8 unknowns, which represent the fundamental geometric parameters of the biplane imaging system; using the fundamental parameters to calculate the 3-dimensional positions of the object points identified in the biplane images; and determination of the 3-D positions of the vessel segments between the object points.

Claims

1. A method for determination of 3-D structure of an object in biplane angiography, comprising:

providing first and second imaging systems including first and second x-ray sources each having a focal spot and respective first and second x-ray sensitive receivers each defining an image plane, said first x-ray source arranged to transmit x-rays from its focal spot in a first direction through said object to the image plane of said first receiver and said second x-ray source arranged to transmit x-rays from its focal spot in a second direction arbitrarily selected with respect to said first direction through said object to the image plane of said second receiver;

determining the distances (D, D'"'"') of perpendicular lines from the focal spot of each x-ray source to the image plane of the respective receiver;

determining the points on respective image planes where respective perpendicular lines from the respective focal spots to the respective image planes intersect the respective image planes and defining said points on respective image planes as the origins of respective two dimensional image coordinate systems (uv), (u'"'"'v'"'"') at the respective image planes, wherein said focal spots and the respective image planes define respective first and second three-dimensional coordinate systems having respective z axes coincident with said perpendicular lines (D, D'"'"') in the directions of respective image planes, x axes parallel to respective of the image plane axes (u, u'"'"') and y axes parallel to respective of the image plane axes (v,v'"'"'), where the relative geometry of said first three dimensional coordinate system with respect to said second three dimensional coordinate system is defined by

space="preserve" listing-type="equation">x.sub.1 '"'"'=[R]{x.sub.1 =-t},

where x₁ '"'"', is the position vector of the object point (x_i '"'"', y_i '"'"', z_i '"'"') in said second three dimensional coordinate system, x₁ is the position vector of the same object point (x_i, y_i,z_i) in said first three dimensional coordinate system, [R] is a rotation matrix defining the rotation in three-dimensional space between the first and second three-dimensional coordinate systems and t expresses, in the first coordinate system xyz, a unit translation vector that moves the origin of the first coordinate system xyz to the origin of the second coordinate system;

irradiating said object with x-rays from said x-ray sources and producing respective first and second images defined by digital image data based on the x-rays received by said first and second receivers;

determining from each of said first and second images the image coordinates ((u, v), (u'"'"', v'"'"')) in the respective coordinate systems of N objects points, where N≧

8, which correspond to the same object points in the object;

scaling the image coordinates (u_i, v_i), (u_i '"'"', v_i '"'"') of said eight points by respectively dividing said image coordinates by the respective distances (D, D'"'"') to obtain normalized image coordinates (ξ

_i, η

_i), (ξ

_i '"'"', η

_i'"'"'));

constructing N linear equations, one for each object point, containing only normalized image coordinates (ξ

_i, η

_i), (ξ

_i '"'"', η

_i) and nine unknown elements (q_kl), where q_kl represent an unknown relative geometry between the two imaging systems in terms of nonlinear combinations of the elements of the translation vector (t) and the rotation matrix [R];

solving the N linear equations for eight of the q_kl values relative to the ninth q_kl value to produce a matrix [Q*]; and

determining scaled three dimensional coordinate (x_i, y_i, z_i) of said N object points expressed in units of a unit translation vector t from the product matrix [Q*]^T [A*].

2. The method according to claim 1, further comprising:

defining at least two of said N object points as object points separated by a know distance;

determining the scaled distance between said at least two object points from the scaled three dimensional coordinates x₁, y₁, z₁ ;

x₂, y₂, z₂) of said at least two object points;

determining the ratio of the scaled distance between said at least two object points and the known separation distance therebetween to derive a scaling factor;

producing an absolute t vector based on the quotient of the unit t vector and said scaling factor; and

determining absolute three-dimensional coordinates of object points using said absolute t vector, said rotation matrix [R] and said image coordinates ((u_i, v_i), (ui'"'"', vi'"'"')) in said image planes.

3. The method according to claim 2, further comprising:

selecting plural of said N object points as bifurcation points between tracked vessels of a vascular tree of said object;

defining approximate centerlines of vessel segments between said bifurcation points in each of said biplane images;

determining corresponding points in the two biplane images along said centerlines; and

determining from said corresponding points, [R] and t three dimensional positions of the points along the vessel segments between said bifurcation points.

4. The method according to claim 3, comprising:

displaying said three dimensional positions of the points along the vessel between said bifurcation points.

5. The method according to claim 1, comprising:

determining the absolute distance between the focal spots of said x-ray sources; and

multiplying the scaled three dimensional coordinates (x_i, y_i, z_i) of said object points by the determined absolute distance between the focal spots to obtain absolute three-dimensional coordinates of said object points.

6. The method according to claim 5, further comprising:

selecting plural of said N object points as bifurcation points between track vessels of a vascular tree of said object;

defining approximate centerlines of vessel segments between said bifurcation points in each of said biplane images;

determining corresponding points in the two biplane images along said centerlines; and

determining from said corresponding points, [R] and t three dimensional positions of the points along the vessel segments between said bifurcation points.

7. The method according to claim 5, comprising:

displaying said three dimensional positions of the points along the vessel between said bifurcation points.

8. The method according to claim 1, further comprising:

selecting plural of said N object points as identifiable corresponding points of vascular structure in said first and second images;

tracking the approximate centerlines of the various vascular segments in both images between said identifiable corresponding points to define a complete vascular tree in both images;

determining polynominal fitting functions which represent the centerlines of said various vascular segments in both images;

selecting various points along the polynominal centerlines in one of said images;

for each of the selected various points, determining an auxiliary line which is a locus of points in the second of said images that represents the set of all possible points in the second image that correspond to the selected point in the first image;

determining mathematically the intersection of the corresponding polynominal centerlines in the second image with the auxiliary lines in the second image, in order to the determine the points in the said second image which corresponds with said selected various points in said first image;

determining from said corresponding points, [R] and t the absolute three dimensional positions of the said selected points along the vessel segments between said identifiable corresponding points.

9. The method according to claim 8, further comprising:

displaying the absolute three dimensional coordinates of all the selected points of said object;

displaying of absolute three dimensional information as a complete, connected vascular tree, composed of originally identified identifiable corresponding points, as well as selected points along vascular segment centerlines.

10. The method according to claim 8, further comprising:

displaying the absolute three dimensional coordinates of all the selected points of said object;

displaying of absolute three dimensional information as a complete, connected vascular tree, composed of originally identified identifiable corresponding points, as well as selected points along vascular segment centerlines.

11. A method for determination of 3-D structure of an object in biplane angiography, comprising:

providing first and second imaging systems including first and second x-ray sources having respective and second focal spots and respective first and second x-ray sensitive receivers each defining an image plane, said first x-ray source arranged to transmit x-ray from its focal spot in a first direction through said object to the image plane of said first receiver and said second x-ray source arranged to transmit x-rays from its focal spot in a second direction arbitrarily selected with respect to said first direction through said object to the image plane of said second receiver;

defining respective first and second three-dimensional coordinate systems, xyz and x'"'"'y'"'"'z'"'"', having respective origins located at respective of said first and second focal spots, and having respective z axes that are oriented toward the respective image planes and parallel to the respective line segments that are perpendicular to the respective image planes and intersecting the respective focal spots, where the relative geometry of said first three dimensional coordinate system with respect to said second three dimensional coordinate system is defined by

space="preserve" listing-type="equation">x.sub.i '"'"'=[R]{x.sub.i -t}

where, x_i '"'"' is the position vector of a point (x_i '"'"', y_i '"'"', z_i '"'"') in said second three dimensional coordinate system, x_i is the position vector of the same point (x_i, y_i, z_i) in said first three dimensional coordinate system, [R] is a rotation matrix defining the rotation in three-dimensional space between the first and second three-dimensional coordinate systems and t expresses, in the first coordinate system xyz, a unit translation vector that moves the origin of the first coordinate system xyz to the origin of the second coordinate system;

defining respective first and second image plane coordinate systems uvw and u'"'"'v'"'"'w'"'"', with origins located on the respective first and second image planes along the respective z and z'"'"' axes, and at distance D,and D'"'"', respectively, from the origins of xyz and x'"'"'y'"'"'z coordinate systems;

determining the distance D that separates the origin of the uvw coordinate system from the origin of the xyz coordinate system, and the distance D, that separates the origin of the u'"'"'v'"'"'w'"'"' coordinate system from the origin of the x'"'"'y'"'"'z'"'"' coordinate system, as being the respective perpendicular distances between said respective x-ray focal spots and image planes;

determining the positions on respective image planes where respective perpendicular lines from the respective focal spots to the respective image planes intersect the respective image planes and defining said points of intersection on respective image planes as the origins of the respective uvw and u'"'"'v'"'"'w'"'"' coordinate systems at the respective image planes;

irradiating said object with x-rays from said x-ray sources and producing respective first and second images defined by digital image data based on the x-rays received by said first and second receivers;

determining from each of said first and second images the image coordinates of N object points ((u_i, v_i), (u_i '"'"', v_i '"'"')) in terms of the respective image coordinate systems, where N >

8, which correspond to the same object points in the object;

scaling the said first and second image coordinates ((ui, vi), (ui'"'"', vi'"'"')) of said N points by respective dividing said image coordinates by the respective distances (D, D'"'"') to obtain normalized image coordinates ((ξ

_i, η

_i), (ξ

_i '"'"', η

_i '"'"');

constructing N linear equations, one of each object point, containing only normalized image coordinates (ξ

_i, η

_i), (ξ

_i '"'"', ξ

_i '"'"') and nine unknown elements (q_kl), and solving for the rotation matrix [R] and the unit translation vector t; and

determining the three-dimensional coordinates of said N object points (x₁, y₁, z₁ ;

x₂, y₂, z₂), scaled to the length of the translation vector from the normalized image coordinates ((ξ

_i, η

_i), (ξ

_i '"'"', η

_i '"'"')) the rotation matrix [R] and unit translation vector t.

12. The method according to claim 11, further comprising:

defining at least two of said N object points as object points separated by a know distance;

determining the scaled distance between said at least two object points from the scaled three dimensional coordinates (x₁, y₁, z₁ ;

x₂, y₂ ;

, z₂) of said at least two object points;

determining the ration of the scaled distance between said at least two object points and the known separation distance therebetween to derive a scaling factor;

producing an absolute t vector based on the quotient of the t vector and said scaling factor; and

determining absolute three-dimensional coordinates of object points using said absolute t vector, said rotation matrix [R] and said image coordinates ((u_i, vi), (u_i '"'"'m vi_i '"'"')) in said image planes.

13. The method according to claim 11, further comprising:

selecting plural of said N object points as identifiable corresponding points of vascular structure in said first and second images;

tracking the approximate centerlines of the various vascular segments in both images between said identifiable corresponding points to define a complete vascular tree in both images;

determining polynominal fitting functions which represent the said centerlines of said various vascular segments in both images;

selecting various points along the said polynominal centerlines in one of said images;

for each of the selected various points, determining an auxiliary line which is a locus of points in the second of said images that represents the set of all possible points in the second image that correspond to the selected point in the first image;

determining mathematically the intersection of the corresponding polynominal centerlines in the second image with the said auxiliary lines in the second image, in order to the determine the points in the said second image which corresponds with said selected various points in said first image;

determining from said corresponding points, [R] and t the absolute three dimensional positions of the said selected points along the vessel segments between said identifiable corresponding points.