Augmented reality guidance for spinal surgery and spinal procedures using stereoscopic optical see-through head mounted displays and inertial measurement units
First Claim
Patent Images
1. A system comprising:
- a stereoscopic optical see-through head mounted display;
at least one computing system, wherein the at least one computing system is configured to receive preoperative, intraoperative or preoperative and intraoperative image information of a physical spine of a patient; and
at least one marker configured to be attached to the patient,wherein the at least one computing system is configured to generate at least one graphical representation, wherein the at least one graphical representation is a three-dimensional (3D) virtual representation of a surgical guide, a surgical technique, a physical instrument, a physical device, an anatomical model, patient anatomic data derived from the image information of the physical spine or combinations thereof,wherein the at least one computing system is configured to register at least one image information in a common coordinate system, wherein the at least one image information comprises the preoperative, intraoperative or preoperative and intraoperative image information,wherein the at least one computing system is configured to register the physical spine of the patient using the at least one marker in the common coordinate system,wherein the at least one computing system is configured to register the at least one graphical representation in the common coordinate system,wherein the at least one computing system is configured to generate a 3D stereoscopic view displayed by the optical see-through head mounted display based on the at least one graphical representation,wherein the at least one computing system is configured to track movement from a first position to a second position of the physical spine during surgery in the common coordinate system,wherein the at least one computing system is configured to determine the location, orientation, or location and orientation of the optical see-through head mounted display in the common coordinate system using at least one inertial measurement unit,wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the location, orientation or location and orientation of the optical see-through head mounted display,wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the tracked movement from the first position to the second position of the physical spine,wherein the at least one computing system is configured to superimpose the 3D stereoscopic view on a target portion of the physical spine, andwherein the first and second positions of the physical spine of the patient are different.
1 Assignment
0 Petitions
Accused Products
Abstract
Embodiments disclose a real-time surgery method and apparatus for displaying a stereoscopic augmented view of a patient from a static or dynamic viewpoint of the surgeon, which employs real-time three-dimensional surface reconstruction for preoperative and intraoperative image registration. Stereoscopic cameras provide real-time images of the scene including the patient. A stereoscopic video display is used by the surgeon, who sees a graphical representation of the preoperative or intraoperative images blended with the video images in a stereoscopic manner through a see-through display.
-
Citations
30 Claims
-
1. A system comprising:
-
a stereoscopic optical see-through head mounted display; at least one computing system, wherein the at least one computing system is configured to receive preoperative, intraoperative or preoperative and intraoperative image information of a physical spine of a patient; and at least one marker configured to be attached to the patient, wherein the at least one computing system is configured to generate at least one graphical representation, wherein the at least one graphical representation is a three-dimensional (3D) virtual representation of a surgical guide, a surgical technique, a physical instrument, a physical device, an anatomical model, patient anatomic data derived from the image information of the physical spine or combinations thereof, wherein the at least one computing system is configured to register at least one image information in a common coordinate system, wherein the at least one image information comprises the preoperative, intraoperative or preoperative and intraoperative image information, wherein the at least one computing system is configured to register the physical spine of the patient using the at least one marker in the common coordinate system, wherein the at least one computing system is configured to register the at least one graphical representation in the common coordinate system, wherein the at least one computing system is configured to generate a 3D stereoscopic view displayed by the optical see-through head mounted display based on the at least one graphical representation, wherein the at least one computing system is configured to track movement from a first position to a second position of the physical spine during surgery in the common coordinate system, wherein the at least one computing system is configured to determine the location, orientation, or location and orientation of the optical see-through head mounted display in the common coordinate system using at least one inertial measurement unit, wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the location, orientation or location and orientation of the optical see-through head mounted display, wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the tracked movement from the first position to the second position of the physical spine, wherein the at least one computing system is configured to superimpose the 3D stereoscopic view on a target portion of the physical spine, and wherein the first and second positions of the physical spine of the patient are different. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system comprising:
-
a stereoscopic optical see-through head mounted display; at least one computing system configured to receive preoperative, intraoperative, or preoperative and intraoperative image information of at least two individual vertebrae of a physical spine of a patient; and at least one marker configured to be attached to the patient, wherein the at least one computing system is configured to generate at least one graphical representation, wherein the at least one graphical representation is a three-dimensional virtual representation of a surgical guide, a surgical technique, a physical instrument, a physical device, an anatomical model, patient anatomic data derived from the image information of the physical spine or combinations thereof; wherein the at least one computing system is configured to register at least one image information in a common coordinate system, wherein the at least one image information comprises the preoperative, intraoperative or preoperative and intraoperative image information, wherein the at least one computing system is configured to register the physical spine of the patient using the at least one marker in the common coordinate system, wherein the at least one computing system is configured to register the at least one graphical representation in the common coordinate system, wherein the at least one computing system is configured to generate a 3D stereoscopic view displayed by the optical see-through head mounted display based on the least one graphical representation, wherein the at least one computing system is configured to track movement from a first position to a second position of the physical spine during surgery by tracking the position of the at least one marker, wherein the at least one computing system is configured to determine the location, orientation, or location and orientation of the optical see-through head mounted display in the common coordinate system using at least one inertial measurement unit, wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the location, orientation, or location and orientation of the optical see-through head mounted display, wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the tracked movement from the first position to the second position of the physical spine, wherein the at least one computing system is configured to superimpose the 3D stereoscopic view on corresponding individual vertebrae of the physical spine, and wherein the first and second positions of the physical spine of the patient are different. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. A system comprising:
-
a stereoscopic optical see-through head mounted display; at least one computing system, wherein the at least one computing system is configured to receive preoperative, intraoperative or preoperative and intraoperative image information of a physical spine of a patient; and at least one marker configured to be attached to the patient, wherein the at least one computing system is configured to generate at least one graphical representation, wherein the at least one graphical representation is a three-dimensional (3D) virtual representation of a pin, a screw, a nail, a plate, a template of the physical instrument, a template of the physical device, a surgical guide for a physical instrument, a surgical guide for a physical device, a trajectory for a physical instrument, a trajectory for a physical device, a physical instrument, a physical device, an anatomical model, patient anatomic data derived from the image information of the physical spine or combinations thereof, wherein the at least one computing system is configured to register at least one image information in a common coordinate system, wherein the at least one image information comprises the preoperative, intraoperative or preoperative and intraoperative image information, wherein the at least one computing system is configured to register the physical spine of the patient using the at least one marker in the common coordinate system, wherein the at least one computing system is configured to register the at least one graphical representation in the common coordinate system, wherein the at least one computing system is configured to generate a 3D stereoscopic view displayed by the optical see-through head mounted display based on the at least one graphical representation, wherein the at least one computing system is configured to track movement from a first position to a second position of the physical spine during surgery in the common coordinate system, wherein the at least one computing system is configured to determine the location, orientation, or location and orientation of the optical see-through head mounted display in the common coordinate system using at least one inertial measurement unit, wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the location, orientation, or location and orientation of the optical see-through head mounted display, wherein the at least one computing system is configured to adjust in real time the 3D stereoscopic view based on the tracked movement from the first position to the second position of the physical spine, wherein the at least one computing system is configured to superimpose the 3D stereoscopic view on a target portion of the physical spine, and wherein the first and second positions of the physical spine of the patient are different.
-
Specification