Systems and methods for collaborative interactive visualization of 3D data sets over a network ("DextroNet")
First Claim
1. Apparatus for interactively manipulating a three-dimensional image, the image comprising volumetric data generated from imaging data regarding a subject, the apparatus being configured to:
- receive, over a communications link, positional data for one or more remote probes of one or more remote machines;
generate, for display on a local display, a combined three-dimensional scene comprising said at least one remote probe and the three-dimensional image;
manipulate the three-dimensional image in response to manipulations of a local probe by a user local to the apparatus; and
send, over the communications link, data regarding said manipulations by said user local to the apparatus sufficient to allow the said at least one remote machine to display a combined three-dimensional scene comprising an image of the local probe performing manipulations on said three-dimensional image.
1 Assignment
0 Petitions
Accused Products
Abstract
Exemplary systems and methods are provided by which multiple persons in remote physical locations can collaboratively interactively visualize a 3D data set substantially simultaneously. In exemplary embodiments of the present invention, there can be, for example, a main workstation and one or more remote workstations connected via a data network. A given main workstation can be, for example, an augmented reality surgical navigation system, or a 3D visualization system, and each workstation can have the same 3D data set loaded. Additionally, a given workstation can combine real-time imagining with previously obtained 3D data, such as, for example, real-time or pre-recorded video, or information such as that provided by a managed 3D ultrasound visualization system. A user at a remote workstation can perform a given diagnostic or therapeutic procedure, such as, for example, surgical navigation or fluoroscopy, or can receive instruction from another user at a main workstation where the commonly stored 3D data set is used to illustrate the lecture. A user at a main workstation can, for example, see the virtual tools used by each remote user as well as their motions, and each remote user can, for example, see the virtual tool of the main user and its respective effects on the data set at the remote workstation. For example, the remote workstation can display the main workstation'"'"'s virtual tool operating on the 3D data set at the remote workstation via a virtual control panel of said local machine in the same manner as if said virtual tool was a probe associated with that remote workstation. In exemplary embodiments of the present invention each user'"'"'s virtual tools can be represented by their IP address, a distinct color, and/or other differentiating designation. In exemplary embodiments of the present invention the data network can be either low or high bandwidth. In low bandwidth embodiments a 3D data set can be pre-loaded onto each user'"'"'s workstation and only the motions of a main user'"'"'s virtual tool and manipulations of the data set sent over the network. In high bandwidth embodiments, for example, real-time images, such as, for example, video, ultrasound or fluoroscopic images, can be also sent over the network as well.
203 Citations
33 Claims
-
1. Apparatus for interactively manipulating a three-dimensional image, the image comprising volumetric data generated from imaging data regarding a subject, the apparatus being configured to:
-
receive, over a communications link, positional data for one or more remote probes of one or more remote machines;
generate, for display on a local display, a combined three-dimensional scene comprising said at least one remote probe and the three-dimensional image;
manipulate the three-dimensional image in response to manipulations of a local probe by a user local to the apparatus; and
send, over the communications link, data regarding said manipulations by said user local to the apparatus sufficient to allow the said at least one remote machine to display a combined three-dimensional scene comprising an image of the local probe performing manipulations on said three-dimensional image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 24, 25, 26)
-
-
12. Apparatus for interactively manipulating a three-dimensional image, the image comprising volumetric data generated from imaging data regarding a subject, the apparatus being configured to:
-
receive, over a communications link, positional data for a remote probe of a remote machine;
receive positional data for a local probe;
generate, for display on a display, a combined three-dimensional scene comprising the remote probe, the local probe and the three-dimensional image; and
manipulate the three-dimensional image in response to manipulations of the remote probe in a manner substantially equivalent to manipulations of the three-dimensional image by a user local to the remote machine via the local probe. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 27, 28, 29, 30)
-
-
31. A system for interactively manipulating a three-dimensional image, the image comprising volumetric data generated from imaging data regarding a subject, the system comprising:
-
a main workstation comprising;
a first apparatus being configured to;
receive, over a communications link, positional data for one or more remote probes of one or more remote machines;
generate, for display on a local display, a combined three-dimensional scene comprising said at least one remote probe and the three-dimensional image;
manipulate the three-dimensional image in response to manipulations of a local probe by a user local to the apparatus; and
send, over the communications link, data regarding said manipulations by said user local to the apparatus sufficient to allow the said at least one remote machine to display a combined three-dimensional scene comprising an image of the local probe performing manipulations on said three-dimensional image;
one or more distant workstations, each comprising;
a second apparatus, configured to;
receive, over a communications link, positional data for a remote probe of a remote machine;
receive positional data for a local probe;
generate, for display on a display, a combined three-dimensional scene comprising the remote probe, the local probe and the three-dimensional image; and
manipulate the three-dimensional image in response to manipulations of the remote probe in a manner substantially equivalent to manipulations of the three-dimensional image by a user local to the remote machine via the local probe; and
a data network, wherein the main workstation and each of said one or more distant workstations are connected via the data network.
-
-
32. A method for interactively manipulating a three-dimensional image, the image comprising volumetric data generated from imaging data regarding a subject, the method comprising:
-
providing a first apparatus, said first apparatus being configured to;
receive, over a communications link, positional data for one or more remote probes of one or more remote machines;
generate, for display on a local display, a combined three-dimensional scene comprising said at least one remote probe and the three-dimensional image;
manipulate the three-dimensional image in response to manipulations of a local probe by a user local to the apparatus; and
send, over the communications link, data regarding said manipulations by said user local to the apparatus sufficient to allow the said at least one remote machine to display a combined three-dimensional scene comprising an image of the local probe performing manipulations on said three-dimensional image;
providing one or more second apparati, each of said second apparati being configured to;
receive, over a communications link, positional data for a remote probe of a remote machine;
receive positional data for a local probe;
generate, for display on a display, a combined three-dimensional scene comprising the remote probe, the local probe and the three-dimensional image; and
manipulate the three-dimensional image in response to manipulations of the remote probe in a manner substantially equivalent to manipulations of the three-dimensional image by a user local to the remote machine via the local probe; and
providing a data network and connecting the first apparatus and the one or more second apparati via the data network, wherein in operation a user at the first apparatus and a user at the one or more second apparati collaboratively visualize a common 3D data set. - View Dependent Claims (33)
-
Specification