Surgeon head-mounted display apparatuses
First Claim
1. An augmented reality surgical system for displaying multiple video streams to a user, the augmented reality surgical system comprising:
- a head mounted display comprising a see-through display screen that display images while allowing transmission of ambient light therethrough;
a motion sensor connected to the head mounted display and configured to output a head motion signal indicating measured movement of the head mounted display; and
a computer equipment configured to receive a plurality of video streams from one or more source devices and to control which of the video streams are output as a video signal to the display screen based on the head motion signalwherein the computer equipment selects a primary one of the video streams that is output as a video signal to the display screen of the head mounted display based on a pitch component of the head motion signal being less than a first threshold valuewherein based on the pitch component of the head motion signal being above the first threshold value and below a second threshold value, the computer equipment separately feeds different secondary ones of the video streams as a video signal to the display screen of the head mounted display responsive to a yaw component of the head motion signal satisfying different defined yaw threshold ranges, to display virtual floating panels at defined yaw and pitch coordinates relative to the user'"'"'s head.
3 Assignments
0 Petitions
Accused Products
Abstract
An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
-
Citations
20 Claims
-
1. An augmented reality surgical system for displaying multiple video streams to a user, the augmented reality surgical system comprising:
-
a head mounted display comprising a see-through display screen that display images while allowing transmission of ambient light therethrough; a motion sensor connected to the head mounted display and configured to output a head motion signal indicating measured movement of the head mounted display; and a computer equipment configured to receive a plurality of video streams from one or more source devices and to control which of the video streams are output as a video signal to the display screen based on the head motion signal wherein the computer equipment selects a primary one of the video streams that is output as a video signal to the display screen of the head mounted display based on a pitch component of the head motion signal being less than a first threshold value wherein based on the pitch component of the head motion signal being above the first threshold value and below a second threshold value, the computer equipment separately feeds different secondary ones of the video streams as a video signal to the display screen of the head mounted display responsive to a yaw component of the head motion signal satisfying different defined yaw threshold ranges, to display virtual floating panels at defined yaw and pitch coordinates relative to the user'"'"'s head. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification