3D display system and method
First Claim
Patent Images
1. An apparatus comprising:
- a 3D volumetric display system configured to generate 3D diagnostic displays of 3D volumetric data acquired from a patient by at least two of an imaging system, a picture archival and communication system (PACS) and an electronic medical record (EMR) system simultaneously in a virtual-reality environment, and wherein the display system is configured to permit a user to conduct diagnostic interpretation of images in the virtual-reality environment and to permit the user to interact with the 3D diagnostic displays, wherein the display system is configured to permit the user to conduct volumetric 3D diagnostic interpretation of images without post-processing the images, wherein post-processing includes having the images manipulated and compiled by a process of image review from the manner of acquisition and reconstruction of images,wherein the display system comprises a haptics-enhanced virtual-reality device so that the user can touch and interact with a virtual object, wherein the haptics-enhanced virtual-reality device includes a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display stereoscopic images that is projected on the overhead substantially opaque screen and is reflected in real-time 3D images on the transflective mirror,wherein the display system further comprises a haptic force feedback device having robotic manipulators that applies force to the user'"'"'s hand corresponding to the environment that a virtual effector is in and wherein the haptics force feedback device is used to indicate whether the user'"'"'s hand is in contact with a virtual anatomical structure of a patient'"'"'s body.
1 Assignment
0 Petitions
Accused Products
Abstract
A 3D volumetric display system is configured to generate 3D diagnostic displays of 3D volumetric data acquired from a patient by an imaging system in a virtual-reality environment and to permit a user to conduct diagnostic interpretation of images in the virtual-reality environment and to permit the user to interact with the 3D diagnostic displays.
52 Citations
32 Claims
-
1. An apparatus comprising:
-
a 3D volumetric display system configured to generate 3D diagnostic displays of 3D volumetric data acquired from a patient by at least two of an imaging system, a picture archival and communication system (PACS) and an electronic medical record (EMR) system simultaneously in a virtual-reality environment, and wherein the display system is configured to permit a user to conduct diagnostic interpretation of images in the virtual-reality environment and to permit the user to interact with the 3D diagnostic displays, wherein the display system is configured to permit the user to conduct volumetric 3D diagnostic interpretation of images without post-processing the images, wherein post-processing includes having the images manipulated and compiled by a process of image review from the manner of acquisition and reconstruction of images, wherein the display system comprises a haptics-enhanced virtual-reality device so that the user can touch and interact with a virtual object, wherein the haptics-enhanced virtual-reality device includes a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display stereoscopic images that is projected on the overhead substantially opaque screen and is reflected in real-time 3D images on the transflective mirror, wherein the display system further comprises a haptic force feedback device having robotic manipulators that applies force to the user'"'"'s hand corresponding to the environment that a virtual effector is in and wherein the haptics force feedback device is used to indicate whether the user'"'"'s hand is in contact with a virtual anatomical structure of a patient'"'"'s body. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A diagnostic apparatus comprising:
-
a display system including a graphical user interface (GUI) configured to be accessed simultaneously in at least two of a picture archiving and communication system (PACS), an image workstation, and an electronic medical record (EMR) system, and to navigate through a diagnostic image data and a patient'"'"'s data without post-processing of the diagnostic images, wherein the post-processing of the diagnostic images define having the images manipulated and compiled by a process of image review from the manner of acquisition and reconstruction of images, the display system including a haptics-enhanced virtual-reality device coupled to the PACS and the image workstation to display stereoscopic images so that a user can touch and interact with a virtual object, wherein the haptics-enhanced virtual-reality device includes a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display stereoscopic images that is projected on the overhead substantially opaque screen and is reflected in real-time 3D images on the transflective mirror, wherein the display system further comprises a haptic force feedback device having robotic manipulators that applies force to the user'"'"'s hand corresponding to the environment that a virtual effector is in and wherein the haptics force feedback device is used to indicate whether the user'"'"'s hand is in contact with a virtual anatomical structure of a patient'"'"'s body. - View Dependent Claims (20, 21, 22, 23)
-
-
24. A method of assisting medical diagnostic interpretation of images and data, the method comprising the steps of:
-
generating diagnostic images of a portion of patient'"'"'s body by using a display system during examination of the portion of patient'"'"'s body in accordance to symptoms; replicating the portion of patient'"'"'s body from the diagnostic images by using a haptics-enhanced virtual-reality device of the display system, wherein the replicating step includes retrieving the diagnostic images from at least two of a picture archival and communication system (PACS), an imaging system and an electronic medical record (EMR) system simultaneously without post-processing the diagnostic images, wherein the display system is configured to permit the user to conduct volumetric 3D diagnostic interpretation of images without having the images manipulated and compiled by a process of image review from the manner of acquisition and reconstruction of images; and displaying the replicated portion of the patient'"'"'s body in a virtual environment, wherein the haptics-enhanced virtual-reality device includes a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display stereoscopic images that is projected on the overhead substantially opaque screen and is reflected in real-time 3D images on the transflective mirror, wherein the display system further comprises a haptic force feedback device having robotic manipulators that applies force to the user'"'"'s hand corresponding to the environment that a virtual effector is in and wherein the haptics force feedback device is used to indicate whether the user'"'"'s hand is in contact with a virtual anatomical structure of a patient'"'"'s body. - View Dependent Claims (25, 26, 27, 28, 29, 30)
-
-
31. A diagnostic system comprising:
-
means for generating diagnostic real-time images of a portion of patient'"'"'s body during examination of the portion of patient'"'"'s body in accordance to symptoms; means for replicating the portion of patient'"'"'s body from the real-time images, wherein the means for replicating includes retrieving the real time images from any number of a picture archival and communication system (PACS), an imaging system and an electronic medical record (EMR) system simultaneously without post-processing the diagnostic images, wherein the display system is configured to permit the user to conduct volumetric 3D diagnostic interpretation of images without having the images manipulated and compiled by a process of image review from the manner of acquisition and reconstruction of images; and means for displaying the replicating portion of patient'"'"'s body in a virtual environment, wherein the means for displaying includes a haptics-enhanced virtual-reality device so that the user can touch and interact with a virtual object, wherein the haptics-enhanced virtual-reality device includes a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display stereoscopic images that is projected on the overhead substantially opaque screen and is reflected in real time 3D images on the reflective mirror, wherein the means for displaying further include a haptic force feedback device having robotic manipulators that applies force to the user'"'"'s hand corresponding to the environment that a virtual effector is in and wherein the haptics force feedback device is used to indicate whether the user'"'"'s hand is in contact with a virtual anatomical structure of a patient'"'"'s body. - View Dependent Claims (32)
-
Specification