3D display system and method

• US 20050285853A1
• Filed: 06/29/2004
• Published: 12/29/2005
• Est. Priority Date: 06/29/2004
• Status: Abandoned Application

• Current Assignee: GE Medical Systems Information Technologies Incorporated (GE Healthcare Technologies, Inc.)
• Original Assignee: GE Medical Systems Information Technologies Incorporated (GE Healthcare Technologies, Inc.)
• Inventors: Morita, Mark M., Fors, Steven L., Rai, Khal A.
• Application Number:
  US10/879,648
• Publication Number:
  US 20050285853A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

An apparatus configured to display 3D volumetric data acquired from a patient by an imaging system comprises a 3D volumetric display system configured to generate a real-time 3D diagnostic display of the 3D volumetric data. The 3D volumetric display system includes a graphical user interface configured to permit a user to access, view, and manipulate the 3D volumetric data. The graphical user interface also includes a plurality of 3D computer-aided diagnosis (CAD) markers, each plurality of 3D CAD markers having a delineator configured to navigate through the 3D volumetric data to locate pathology and to permit a user to compile and to prepare a report containing diagnosis information in a virtual-reality environment.

Claims

1. An apparatus configured to display 3D volumetric data acquired from a patient by an imaging system, the apparatus comprising:

a 3D volumetric display system configured to generate a real-time 3D diagnostic display of the 3D volumetric data, the 3D volumetric display system including a graphical user interface configured to permit a user to access, view, and manipulate the 3D volumetric data, the graphical user interface including a plurality of 3D computer-aided diagnosis (CAD) markers, each of the plurality of 3D CAD markers having a delineator configured to navigate through the 3D volumetric data to locate pathology and to permit a user to compile and to prepare a report containing diagnosis information in a virtual-reality environment.

2. The apparatus of claim 1, wherein the 3D volumetric display system includes a haptics-enhanced virtual-reality system, and wherein the plurality of 3D computer-aided diagnosis (CAD) markers is displayed with the haptics-enhanced virtual-reality system.

3. The apparatus of claim 2, wherein the haptics-enhanced virtual-reality system comprises a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display a stereoscopic image that is projected on the overhead substantially opaque screen and is reflected in the 3D volumetric data on the transflective mirror.

4. The apparatus of claim 1, wherein the 3D CAD marker includes a status indicator associated with the delineator to display diagnosis information in the virtual-reality environment.

5. The apparatus of claim 4, wherein the status indicator comprises a plurality of command buttons configured to receive a user input to compile the diagnostic report.

6. The apparatus of claim 1, wherein the display system further comprises a haptic glove configured to be worn by the user and wherein the plurality of command buttons comprise first and second command buttons defined by YES and NO command buttons, respectively and wherein the YES button enables the user wearing the haptic glove to receive the user input and to compile diagnostic report upon pressing the YES button and wherein the NO command button enables the user to receive the user input and to discard unwanted diagnosis information responsive to the user pressing the NO button.

7. The apparatus of claim 1, wherein the delineator is generated by a software program developed to communicate with the graphical user interface to locate pathology in the virtual-reality environment.

8. The apparatus of claim 1, wherein the 3D CAD marker is configured to be held by the user'"'"'s hand wearing the haptic glove when the 3D CAD maker is navigated through the 3D dataset.

9. The apparatus of claim 6, wherein the haptic glove including an actuator configured to output a tactile sensation to the hand of the user wearing the haptic glove in the virtual-reality environment.

10. The apparatus of claim 9, wherein the actuator outputs a force to the haptic glove to provide the tactile sensation to the hand of the user to simulate contact with the 3D CAD marker.

11. The apparatus of claim 9, wherein the actuator outputs the force to the haptic glove based on force information output by the 3D display system.

12. The apparatus of claim 1, wherein the graphical user interface comprises a virtual tool bar having a plurality of icons touchable by the user in the virtual reality environment.

13. A diagnostic apparatus comprising:

a display system configured to generate a stereoscopic image acquired from a patient by an imaging system, the display system including a graphical user interface configured to access simultaneously in a picture archiving and communication system (PACS) and an image workstation and to navigate through the stereoscopic image, the graphical user interface comprising a 3D CAD marker having a delineator generated by a software program, the delineator being configured to navigate through the stereoscopic image to indicate likelihood of an anomaly and to compile and to prepare a report containing diagnosis information in a virtual-reality environment.

14. The apparatus of claim 13, wherein the display system includes a haptics-enhanced virtual-reality system, and wherein the haptic tool bar is displayed with the haptics-enhanced virtual-reality system.

15. The apparatus of claim 13, wherein 3D CAD marker includes a color code feature which enables a user to display diagnosis information in various colors within the graphical user interface.

16. The apparatus of claim 13, wherein the 3D CAD marker comprises first and second command buttons that enable the user wearing a haptic glove to receive a user input and to interact with the first and second command buttons virtual-reality environment.

17. The apparatus of claim 16, wherein the first and second command buttons are defined as YES and NO buttons, respectively and wherein the YES button is configured to receive the user input and to accept diagnosis information responsive to the user pressing the YES button and wherein the NO button is configured to receive the user input and to discard unwanted diagnosis information responsive to the user pressing the NO button.

18. The apparatus of claim 13, wherein the delineator includes a 3D delineator having a boundary that defines a perimeter of the anomaly.

19. A method of assisting diagnostic interpretation of a stereoscopic image in a virtual-reality environment, the method comprising the steps of:

navigating a 3D CAD marker through the stereoscopic image responsive to operator inputs, the 3D CAD marker having a delineator and a status bar indicator including a plurality of command buttons;

indicating likelihood of an anomaly in the stereoscopic image of a patient by using the delineator of the 3D CAD marker;

displaying diagnosis information about the anomaly in the status bar;

receiving an operator input using one of the plurality of command buttons; and

generating a report containing the diagnosis information in the virtual-reality environment.

20. The method of claim 19, wherein the step of navigating the 3D CAD marker includes wearing a haptic glove by the operator while holding the 3D CAD marker.

21. The method of claim 19, wherein the step of indicating likelihood of the anomaly includes mapping boundary of the delineator with boundary of the anomaly within the stereoscopic image.

22. The method of claim 21, wherein the step of mapping boundary of the delineator using a coordinate mapping scheme with the stereoscopic image to generate diagnosis information about the anomaly of the stereoscopic image.

23. The method of claim 19 further comprising a user interface having a color code feature which enabling the operator to display diagnosis information in various colors within the user interface.

24. The method of claim 23, wherein the user interface permits the operator to search for changes in density of a patient'"'"'s anatomy organ for abnormality and if contrast from normal, the user interface allows the abnormality to be highlighted with various colors.

25. The method of claim 19, wherein the step of receiving an operator input using one of the plurality of command buttons includes first and second buttons that are defined as YES and NO buttons, respectively and wherein the YES button is configured to accept diagnosis information responsive to the user by pressing the YES button and wherein the NO button is configured to discard unwanted diagnosis information responsive to the user by pressing the NO button.

26. A system configured to display a stereoscopic image in a virtual-reality environment, the system comprising:

means for navigating a 3D CAD marker through the stereoscopic image responsive to operator inputs;

means for locating an anomaly in the stereoscopic image of a patient by using the 3D CAD marker;

means for displaying diagnosis information of the anomaly in the virtual-reality environment; and

means for compiling and preparing a report containing the diagnosis information in the virtual-reality environment.