Method and apparatus for virtual interactive medical imaging by multiple remotely-located users
First Claim
1. A method of enabling users of a plurality of networked computer systems to collaboratively view and manipulate images of an object, the method comprising:
- causing corresponding images of the object to be displayed on each of a plurality of computer systems at a first resolution;
receiving, at one of the computer systems, user input specifying a manipulation of the image;
transmitting information indicative of the user input to each of the other computer systems;
updating the image displayed on each of the other computer systems substantially simultaneously to depict the manipulation, including displaying the image at a second resolution lower than the first resolution while said manipulation is being depicted; and
displaying the image on each of the computer systems at the first resolution when depiction of the manipulation is complete.
1 Assignment
0 Petitions
Accused Products
Abstract
A virtual interactive imaging system allows the displaying of high-resolution, three-dimensional images of medical data to a user and allows the user to manipulate the images, including rotation of images in any of various axes. The system includes a mesh component that generates a mesh to represent a surface of an anatomical object, based on a set of data of the object, such as from a CT or MRI scan or the like. The mesh is generated so as to avoid tears, or holes, in the mesh, providing very high-quality representations of topographical features of the object, particularly at high-resolution. The system further includes a virtual surgical cutting tool that enables the user to simulate the removal of a piece or layer of a displayed object, such as a piece of skin or bone, view the interior of the object, manipulate the removed piece, and reattach the removed piece if desired. The system further includes a virtual collaborative clinic component, which allows the users of multiple, remotely-located computer systems to collaboratively and simultaneously view and manipulate the high-resolution, three-dimensional images of the object in real-time.
-
Citations
20 Claims
-
1. A method of enabling users of a plurality of networked computer systems to collaboratively view and manipulate images of an object, the method comprising:
-
causing corresponding images of the object to be displayed on each of a plurality of computer systems at a first resolution;
receiving, at one of the computer systems, user input specifying a manipulation of the image;
transmitting information indicative of the user input to each of the other computer systems;
updating the image displayed on each of the other computer systems substantially simultaneously to depict the manipulation, including displaying the image at a second resolution lower than the first resolution while said manipulation is being depicted; and
displaying the image on each of the computer systems at the first resolution when depiction of the manipulation is complete. - View Dependent Claims (2, 3, 4)
-
-
5. A method of enabling a plurality of geographically distributed users to collaboratively view and manipulate images of an object, the method comprising:
-
maintaining a data structure including data representing the object, the data structure including a plurality of variables shared by each of a plurality of remote processing systems, the data structure further including a plurality of models of the object, each model corresponding to a different image resolution;
multicasting data to each of the remote processing systems based on the data structure to allow the image to be displayed on each of the remote processing systems, including dynamically selecting from the plurality of models; and
coordinating transmission of user inputs and values of shared variables applied at each of the client systems to allow the image displayed on each of the client systems to be updated in real-time in response to user inputs applied at each other client system. - View Dependent Claims (6, 7, 8)
compressing the portion until the portion reaches the specified image size; and
combining the compressed portion into a packet with information indicating a position of said portion within the image.
-
-
9. A method of enabling a plurality of geographically distributed users to collaboratively view and manipulate images of an object in real-time, the method comprising, at a server:
-
maintaining a data structure including data representing the object, the data structure including a plurality of variables shared by each of a plurality of remote client systems, the data structure further including a plurality of models of the object, each model corresponding to a different image resolution;
sequentially preparing a packet of each of a plurality of consecutive portions of the data representing the object for transmission to the remote client systems, based on the data structure, including selecting said models of the object according to display capabilities of the remote client systems;
multicasting each packet that is ready for transmission to each of the remote client systems to allow each of the client systems to display the image of the object based on the packets; and
coordinating transmission of user inputs applied at each of the client systems to allow the image displayed on each of the client systems to be updated in real-time in response to user inputs applied at each of the other client systems. - View Dependent Claims (10, 11, 12, 13, 18)
compressing the portion until the portion reaches the specified image size;
combining the compressed portion into a packet with information indicating a position of said portion within the image; and
marking the packet as ready for transmission.
-
-
12. A method as recited in claim 9, wherein said multicasting further comprises regulating a data transmission rate to control the number of packets lost during transmission.
-
13. A method as recited in claim 9, wherein said coordinating comprises:
-
receiving values of said shared variables from each of the remote client systems, the values representing user inputs applied at each said remote client system; and
using the values to update the data structure.
-
-
18. An apparatus as recited in claim 11, further comprising means for selecting said models of the object for said multicasting so as to cause the image to be displayed on each of the client systems at a reduced resolution during a user manipulation of the image on one of the client systems.
-
14. A method of enabling a plurality of geographically distributed users to collaboratively view and manipulate images of an object in real-time, the method comprising, at a server processing system:
-
maintaining a data structure including data representing the object, the data structure including a plurality of properties of the object and variables shared by each of a plurality of remote client systems, the data structure further including a plurality of models of the object, each model representing an image of the object at a different resolution;
setting a specified image size;
sequentially preparing each of a plurality of consecutive portions of the data representing the object for transmission, based on the data structure, by compressing the portion using run length encoding until the portion reaches the specified image size, combining the compressed portion into a packet with information indicating a position of said portion within the image, and marking the packet as ready for transmission;
sequentially multicasting each said packet that is ready for transmission to each of the remote client systems to allow each of the client systems to display an image of the object based on the packets; and
coordinating transmission of user inputs applied at each of the client systems to allow the image displayed by each of the client systems to be updated in real-time in response to user inputs applied at each other client system, said coordinating including receiving values of said shared variables from each of the remote client systems, the values representing user inputs applied at each said remote client system, and using the values to update the data structure. - View Dependent Claims (15, 16)
-
-
17. An apparatus for enabling a plurality of geographically distributed users to collaboratively view and manipulate images of an object, the method comprising:
-
means for maintaining a data structure including data representing the object, the data structure including a plurality of variables shared by each of a plurality of remote processing systems, the data structure further including a plurality of models of the object, each model corresponding to a different image resolution;
means for multicasting data to each of the remote processing systems based on the data structure to allow the image displayed on each of the remote processing systems, including dynamically selecting from the plurality of models; and
means for coordinating transmission of user inputs applied at each of the client systems to allow the image displayed on each of the client systems to be updated in real-time in response to user inputs applied at each other client system. - View Dependent Claims (19, 20)
means for compressing each of a plurality of consecutive portions of the data representing the object until each said the portion reaches a specified image size; and
means for combining each compressed portion into a packet with information indicating a position of said portion within the image.
-
-
20. An apparatus as recited in claim 17, wherein said means for coordinating comprises:
-
means for receiving values of said shared variables from each of the remote processing systems, the values representing user inputs applied at each said remote client system; and
means for using the values to update the data structure.
-
Specification