Methods and apparatus for registering CT-scan data to multiple fluoroscopic images
First Claim
1. A method for registering two dimensional fluoroscopic images with a three dimensional model of a surgical tissue of interest, comprising steps of:
- (a) generating a three dimensional model of a surgical tissue of interest using a plurality of images of the surgical tissue of interest;
(b) obtaining at least two, two dimensional fluoroscopic images representing at least two views of the surgical tissue of interest, the images containing markers for associating an image coordinate system with a surgical coordinate system;
(c) detecting the presence of first contours of the surgical tissue of interest in each of the at least two views;
(d) deriving bundles of lines in three dimensional space that pass through the detected first contours; and
(e) iteratively matching points in three dimensional space on second contours obtained from the three dimensional model with the bundles of lines in three dimensional space until the three dimensional model is registered within the surgical coordinate system to a predetermined level of accuracy.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system is disclosed for registering two dimensional fluoroscopic images with a three dimensional model of a surgical tissue of interest. The method includes steps of: (a) generating, from CT or MRI data, a three dimensional model of a surgical tissue of interest; (b) obtaining at least two, two dimensional, preferably fluoroscopic, x-ray images representing at least two views of the surgical tissue of interest, the images containing radio-opaque markers for associating an image coordinate system with a surgical (robot) coordinate system; (c) detecting the presence of contours of the surgical tissue of interest in each of the at least two views; (d) deriving bundles of three dimensional lines that pass through the detected contours; and (e) interactively matching three dimensional points on three dimensional silhouette curves obtained from the three dimensional model with the bundles of three dimensional lines until the three dimensional model is registered within the surgical coordinate system to a predetermined level of accuracy. The step of iteratively matching includes steps of: defining a distance between surfaces of the model and a beam of three dimensional lines that approach the surfaces; and finding a pose of the surfaces that minimizes a distance to the lines using, preferably, a statistically robust method, thereby providing a desired registration between a surgical robot and a preoperative treatment plan.
683 Citations
35 Claims
-
1. A method for registering two dimensional fluoroscopic images with a three dimensional model of a surgical tissue of interest, comprising steps of:
-
(a) generating a three dimensional model of a surgical tissue of interest using a plurality of images of the surgical tissue of interest; (b) obtaining at least two, two dimensional fluoroscopic images representing at least two views of the surgical tissue of interest, the images containing markers for associating an image coordinate system with a surgical coordinate system; (c) detecting the presence of first contours of the surgical tissue of interest in each of the at least two views; (d) deriving bundles of lines in three dimensional space that pass through the detected first contours; and (e) iteratively matching points in three dimensional space on second contours obtained from the three dimensional model with the bundles of lines in three dimensional space until the three dimensional model is registered within the surgical coordinate system to a predetermined level of accuracy. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A robotically-assisted surgical system, comprising:
-
a robot having an effector that is controllably positioned within a robot coordinate system; a first imaging device for obtaining two dimensional radiographic images a tissue of interest, the images containing markers obtained from a calibration device that is located within a field of view of the first imaging device and that is separate from the tissue of interest the markers being used for associating an image coordinate system with the robot coordinate system; a second imaging device for obtaining images of slices through the tissue of interest; a data processor having an input coupled to an output of the first and second imaging devices and an output coupled to the robot, said data processor generating a three dimensional model of the tissue of interest from the output of the second imaging device, said data processor further detecting a presence of two dimensional contours of the tissue of interest in each of at least two views of the tissue and deriving bundles of lines in three dimensional space that pass through the detected two dimensional contours;
said data processor operating to iteratively match points in three dimensional space, that are located on three dimensional apparent contours that are associated with a surface of the three dimensional model, with the bundles of lines in three dimensional space until the three dimensional model is registered with the robot coordinate system to a predetermined level of accuracy, wherein said surface apparent contours are boundaries between visible and invisible surface triangles. - View Dependent Claims (15, 16, 17)
-
-
18. A system for registering two dimensional fluoroscopic images with a three dimensional model of a tissue of interest, comprising:
-
a model processor for generating a three dimensional model of a tissue of interest using as input a plurality of images taken through the tissue of interest; an imaging system for obtaining, in cooperation with a calibration device, at least two, two dimensional images representing at least two views of the tissue of interest, the images containing calibration markers for associating an image coordinate system with a second coordinate system; and an image processor having inputs coupled to outputs of said model processor and said imaging system for detecting the presence of first contours of the tissue of interest in each of the at least two views, said image processor operating to derive bundles of lines in three dimensional space that pass through the detected first contours, and further operating to match points on second contours obtained from the three dimensional model with the bundles of lines in three dimensional space until the three dimensional model is registered within the second coordinate system to a predetermined degree of accuracy. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A method for generating a three dimensional model of a tissue of interest and for aligning the three dimensional model with two dimensional images of the tissue of interest, comprising steps of:
-
performing a plurality of imaging scans through the tissue of interest to generate a plurality of two dimensional image slices; processing the image slices to generate a three dimensional model of a surface of the tissue of interest; obtaining a plurality of two dimensional images representing at least two views of the tissue of interest, the at least two views also comprising images of calibration markers for associating an image coordinate system with a second coordinate system; detecting first contours of the tissue of interest in each of the at least two views; deriving bundles of lines in three dimensional space that pass through the detected first contours; and matching points on second contours obtained from the surface of the three dimensional model with the bundles of lines until the three dimensional model is aligned within the second coordinate system to a predetermined level of accuracy. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34, 35)
-
Specification