EFFICIENT 3-D TELESTRATION FOR LOCAL ROBOTIC PROCTORING
First Claim
1. A method of three-dimensional telestration for a user, the method comprising:
- identifying selected points of interest of a first image;
displaying the first image on a user display with a first telestration mark at the selected points of interest;
selectively matching the selected points of interest to a second image to determine matched points of interest in response to the identification of the selected points of interest; and
displaying the second image on the user display with a second telestration mark at the matched points of interest such that the first telestration mark and the second telestration mark are presented to appear in three dimensions to the user.
2 Assignments
0 Petitions
Accused Products
Abstract
An apparatus is configured to show telestration in 3-D to a surgeon in real time. A proctor is shown one side of a stereo image pair, such that the proctor can draw a telestration line on the one side with an input device. Points of interest are identified for matching to the other side of the stereo image pair. In response to the identified points of interest, regions and features are identified and used to match the points of interest to the other side. Regions can be used to match the points of interest. Features of the first image can be matched to the second image and used to match the points of interest to the second image, for example when the confidence scores for the regions are below a threshold value. Constraints can be used to evaluate the matched points of interest, for example by excluding bad points.
160 Citations
32 Claims
-
1. A method of three-dimensional telestration for a user, the method comprising:
-
identifying selected points of interest of a first image; displaying the first image on a user display with a first telestration mark at the selected points of interest; selectively matching the selected points of interest to a second image to determine matched points of interest in response to the identification of the selected points of interest; and displaying the second image on the user display with a second telestration mark at the matched points of interest such that the first telestration mark and the second telestration mark are presented to appear in three dimensions to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A three-dimensional telestration display method comprising:
-
capturing a stereoscopic pair of images comprising a first image and a second image; receiving a telestration input for the first image; identifying selected first points of interest of the first image from the telestration input; matching the selected first points of interest in the first image to corresponding second points of interest in the second image; and outputting to a stereoscopic display; wherein the display comprises the first image with a first telestration mark associated with the first selected points of interest; wherein the display comprises the second image with a second telestration mark associated with the second points of interest; wherein the first and second images appear as a three-dimensional image in the display; and wherein the first and second telestration marks appear as a three-dimensional telestration mark in the display. - View Dependent Claims (27)
-
-
28. An apparatus to show three-dimensional telestration a user, the apparatus comprising:
-
a source of images comprising a first image and a second image; a first user display comprising a first display and a second display to present the first image and the second image in three-dimensional appearance to the user; a second user display configured to show at least one of the first image or the second image to a second user; a second user input device configured to receive input from the second user to draw first telestration marks on the first image shown on the second user display; and a processor system comprising a tangible medium configured to receive the input from the second user input device, identify selected points of interest of the first image in response to the input, and selectively match the selected points of interest to the second image to determine matched points of interest, wherein the processor system is configured to display second telestration marks at the matched points of interest such that the first telestration marks and the second telestration marks appear in three dimensions to the first user. - View Dependent Claims (29)
-
-
30. An apparatus to show three-dimensional telestration a user, the apparatus comprising:
-
a source of a pair of stereo images comprising a left image and a right image; a first user display comprising a left display and a right display to present the left image and the right image in three-dimensional appearance to the user; a first input device configured to receive input from the user; a second user display configured to show at least one of the left image or the right image to a second user; and a second input device configured to receive input from the second user to draw telestration marks on the at least one of the left image or the right image shown on the second user display; wherein the first input device and the second input device are each configured to select one of the left image or the right image for the second user to draw the telestration marks at the second user display. - View Dependent Claims (31, 32)
-
Specification