System and method for surgical telementoring
First Claim
1. A computer implemented method where one or more processors perform steps comprising:
- receiving one or more real time images via a computer network interface, wherein the one or more real time images are aligned to at least one virtual mesh comprising a plurality of vertices and wherein the one or more illustrations are aligned to the virtual mesh;
storing said one or more real time images in a non-transitory computer readable medium;
associating one or more illustrations with the one or more real time images;
aligning the one or more illustrations with the one or more real time images; and
successively presenting on a display the one or more real time images with the one or more illustrations overlayed on the one or more real time images in accordance with said aligning.
1 Assignment
0 Petitions
Accused Products
Abstract
Apparatus and method for receiving and transmitting streaming live imagery data and audio signals in real time is provided. Imagery data and audio signals are acquired through a telestreamer input device and streamed to one or more remote recipients, allowing remote operators to electronically collaborate by telestrating, annotating, and sketching image overlays. Streaming video images displayed on a monitor are superimposed onto a virtual mesh projected via computer graphics. Vertices of the virtual mesh move according to a computational physics engine. Virtual tools are also superimposed onto a virtual mesh projected via computer graphics. The virtual tools interact with the virtual mesh to deliver real time, realistic modifications of the streaming image data. Recursive positioning of mesh layers and creation of a multi-layered virtual mesh enhance the realistic nature of the modified streaming image data.
-
Citations
9 Claims
-
1. A computer implemented method where one or more processors perform steps comprising:
-
receiving one or more real time images via a computer network interface, wherein the one or more real time images are aligned to at least one virtual mesh comprising a plurality of vertices and wherein the one or more illustrations are aligned to the virtual mesh; storing said one or more real time images in a non-transitory computer readable medium; associating one or more illustrations with the one or more real time images; aligning the one or more illustrations with the one or more real time images; and successively presenting on a display the one or more real time images with the one or more illustrations overlayed on the one or more real time images in accordance with said aligning. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method comprising:
-
projecting video images onto a virtual mesh configured to move according to computational model of an object presented in the video images, wherein the virtual mesh is constructed by computer graphics as a rectangle comprising equilateral triangles having interconnected vertices, and wherein movement between vertices of the virtual mesh is calculated via physics-based calculations; and constructing a UV-map to project the video images onto the virtual mesh, wherein the projected video images are transformed as corresponding positions of the vertices of the equilateral triangles in the virtual mesh move based on the physics-based calculations. - View Dependent Claims (9)
-
Specification