Intra-operative image-guided neurosurgery with augmented reality visualization
First Claim
1. A method for image-guided surgery comprising:
- capturing 3-dimensional (3D) volume data of at least a portion of a patient;
processing said volume data so as to provide a graphical representation of said data;
capturing a stereoscopic video view of a scene including said at least a portion of said patient;
rendering said graphical representation and said stereoscopic video view in a blended manner so as to provide a stereoscopic augmented image; and
displaying said stereoscopic augmented image in a video-see-through display.
2 Assignments
0 Petitions
Accused Products
Abstract
Apparatus for image-guided surgery includes medical imaging apparatus. The imaging apparatus is utilized for capturing 3-dimensional (3D) volume data of patient portions in reference to a coordinate system. A computer processes the volume data so as to provide a graphical representation of the data. A stereo camera assembly captures a stereoscopic video view of a scene including at least portions of the patient. A tracking system measures pose data of the stereoscopic video view in reference to the coordinate system. The computer is utilized for rendering the graphical representation and the stereoscopic video view in a blended way in conjunction with the pose data so as to provide a stereoscopic augmented image. A head-mounted video-see-through display displays the stereoscopic augmented image.
-
Citations
50 Claims
-
1. A method for image-guided surgery comprising:
-
capturing 3-dimensional (3D) volume data of at least a portion of a patient;
processing said volume data so as to provide a graphical representation of said data;
capturing a stereoscopic video view of a scene including said at least a portion of said patient;
rendering said graphical representation and said stereoscopic video view in a blended manner so as to provide a stereoscopic augmented image; and
displaying said stereoscopic augmented image in a video-see-through display. - View Dependent Claims (3, 4, 5, 7, 8)
-
-
2. A method for image-guided surgery comprising:
-
capturing 3-dimensional (3D) volume data of at least a portion of a patient in reference to a coordinate system;
processing said volume data so as to provide a graphical representation of said data;
capturing a stereoscopic video view of a scene including said at least a portion of said patient;
measuring pose data of said stereoscopic video view in reference to said coordinate system;
rendering said graphical representation and said stereoscopic video view in a blended manner in conjunction with said pose data so as to provide a stereoscopic augmented image; and
displaying said stereoscopic augmented image in a video-see-through display. - View Dependent Claims (6)
-
-
9. Apparatus for image-guided surgery comprising:
-
means for capturing 3-dimensional (3D) volume data of at least a portion of a patient;
means for processing said volume data so as to provide a graphical representation of said data;
means for capturing a stereoscopic video view of a scene including said at least a portion of said patient;
means for rendering said graphical representation and said stereoscopic video view in a blended manner way so as to provide a stereoscopic augmented image; and
means for displaying said stereoscopic augmented image in a video-see-through display. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
10. Apparatus for image-guided surgery comprising:
-
means for capturing 3-dimensional (3D) volume data of at least a portion of a patient in reference to a coordinate system;
means for processing said volume data so as to provide a graphical representation of said data;
means for capturing a stereoscopic video view of a scene including said at least a portion of said patient;
means for measuring pose data of said stereoscopic video view in reference to said coordinate system;
means for rendering said graphical representation and said stereoscopic video view in a blended manner in conjunction with said pose data so as to provide a stereoscopic augmented image; and
means for displaying said stereoscopic augmented image in a video-see-through display.
-
-
20. Apparatus for image-guided surgery comprising:
-
medical imaging apparatus, said imaging apparatus being utilized for capturing 3-dimensional (3D) volume data of at least patient portions in reference to a coordinate system;
a computer for processing said volume data so as to provide a graphical representation of said data;
a stereo camera assembly for capturing a stereoscopic video view of a scene including said at least patient portions;
a tracking system for measuring pose data of said stereoscopic video view in reference to said coordinate system;
said computer being utilized for rendering said graphical representation and said stereoscopic video view in a blended way in conjunction with said pose data so as to provide a stereoscopic augmented image; and
a head-mounted video-see-through display for displaying said stereoscopic augmented image. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 40)
-
-
39. Apparatus for image-guided surgery comprising:
-
medical imaging apparatus, said imaging apparatus being utilized for capturing 3-dimensional (3D) volume data of at least patient portions in reference to a coordinate system;
a computer for processing said volume data so as to provide a graphical representation of said data;
a robot arm manipulator operable by user from a remote location;
a stereo camera assembly mounted on said robot arm manipulator for capturing a stereoscopic video view of a scene including said patient;
a tracking system for measuring pose data of said stereoscopic video view in reference to said coordinate system;
said computer being utilized for rendering said graphical representation and said stereoscopic video view in a blended way in conjunction with said pose data so as to provide a stereoscopic augmented image; and
a head-mounted video-see-through display for displaying said stereoscopic augmented image at said remote location.
-
-
41. A method for image-guided surgery utilizing captured 3-dimensional (3D) volume data of at least a portion of a patient, said method comprising:
-
processing said volume data so as to provide a graphical representation of said data;
capturing a stereoscopic video view of a scene including said at least a portion of said patient;
rendering said graphical representation and said stereoscopic video view in a blended manner so as to provide a stereoscopic augmented image; and
displaying said stereoscopic augmented image in a video-see-through display.
-
-
42. A method for image-guided surgery utilizing 3-dimensional (3D) volume data of at least a portion of a patient, said data having been captured in reference to a coordinate system, said method comprising:
-
capturing 3-dimensional (3D) volume data of at least a portion of a patient processing said volume data so as to provide a graphical representation of said data;
capturing a stereoscopic video view of a scene including said at least a portion of said patient;
measuring pose data of said stereoscopic video view in reference to said coordinate system;
rendering said graphical representation and said stereoscopic video view in a blended manner in conjunction with said pose data so as to provide a stereoscopic augmented image; and
displaying said stereoscopic augmented image in a video-see-through display. - View Dependent Claims (43, 44, 45, 46, 47, 48)
-
-
49. Apparatus for image-guided surgery utilizing captured 3-dimensional (3D) volume data of at least a portion of a patient, said apparatus comprising:
-
means for processing said volume data so as to provide a graphical representation of said data;
means for capturing a stereoscopic video view of a scene including said at least a portion of said patient;
means for rendering said graphical representation and said stereoscopic video view in a blended manner so as to provide a stereoscopic augmented image; and
means for displaying said stereoscopic augmented image in a video-see-through display.
-
-
50. Apparatus for image-guided surgery utilizing 3-dimensional (3D) volume data of at least a portion of a patient, said data having been captured in reference to a coordinate system, said apparatus comprising:
-
means for processing said volume data so as to provide a graphical representation of said data;
means for capturing a stereoscopic video view of a scene including said at least a portion of said patient;
means for measuring pose data of said stereoscopic video view in reference to said coordinate system;
means for rendering said graphical representation and said stereoscopic video view in a blended manner in conjunction with said pose data so as to provide a stereoscopic augmented image; and
means for displaying said stereoscopic augmented image in a video-see-through display.
-
Specification