3D display system and method

• US 20050285844A1
• Filed: 06/29/2004
• Published: 12/29/2005
• Est. Priority Date: 06/29/2004
• Status: Abandoned Application

• Current Assignee: GE Medical Systems Information Technologies Incorporated (General Electric Company)
• Original Assignee: GE Medical Systems Information Technologies Incorporated (General Electric Company)
• Inventors: Morita, Mark M., Fors, Steven L., Rai, Khal A.
• Application Number:
  US10/879,806
• Publication Number:
  US 20050285844A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: G01R 33/283 Intercom or optical viewing arrangements, structurally associated with NMR apparatus
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

An apparatus configured to display 3D volumetric data acquired from a patient by an imaging system comprises a 3D volumetric display system configured to generate a 3D diagnostic display of the 3D volumetric data. The 3D volumetric display system includes a graphical user interface (GUT) configured to permit a user to access, view, and manipulate the 3D volumetric data. The GUI includes a haptic toolbox having a plurality of icons, one of which is configured to permit the user to conduct measurement in a virtual-reality environment.

Claims

1. An apparatus configured to display 3D volumetric data acquired from a patient by an imaging system, the apparatus comprising:

a 3D volumetric display system configured to generate a 3D diagnostic display of the 3D volumetric data, the 3D volumetric display system including a graphical user interface configured to permit a user to access, view, and manipulate the 3D volumetric data, the graphical user interface including a haptic toolbox having a plurality of icons, one of the plurality of icons is configured to permit the user to conduct measurement in a virtual-reality environment.

2. The apparatus of claim 1;

wherein the 3D volumetric display system includes a haptics-enhanced virtual-reality system, and wherein the haptic toolbox is displayed with the haptics-enhanced virtual-reality system.

3. The apparatus of claim 1, wherein the haptics-enhanced virtual-reality system comprises a projector, a transflective mirror positioned at an angle, and an overhead substantially opaque screen, which all are coupled to one another to display a stereoscopic image that is projected on the overhead substantially opaque screen and is reflected in the 3D volumetric data on the transflective mirror.

4. The apparatus of claim 1, wherein the haptic toolbox is configured to produce 3D haptic annotation in the virtual reality environment.

5. The apparatus of claim 1, wherein the one of the plurality of icons includes a measurement tool comprises a rod having an opposed ends.

6. The apparatus of claim 5, wherein the display system further comprises a haptic glove configured, to be worn by the user and wherein the measurement tool is configured to be held in the virtual-reality environment by a hand of the user wearing the haptic glove and to be positioned on a patient'"'"'s anatomy to conduct measurement.

7. The apparatus of claim 5, wherein the measurement tool is configured to be linearly extended or contracted corresponding to a given size of the patient'"'"'s anatomy.

8. The apparatus of claim 5, wherein the opposed ends of the rod are generally triangular in shape.

9. The apparatus of claim 6, wherein the haptic glove includes an actuator configured to output a tactile sensation to the hand of the user wearing the haptic glove in the virtual-reality environment.

10. The apparatus of claim 9, wherein the actuator outputs a force to the haptic glove to provide the tactile sensation to the hand of the user to simulate contact with the haptic toolbar.

11. The apparatus of claim 9, wherein the actuator output the force to the haptic glove based on force information output by the 3D display system.

12. A diagnostic apparatus comprising:

a display system configured to generate a stereoscopic image acquired from a patient by an imaging system, the display system including a graphical user interface configured to access simultaneously in a picture archiving and communication system (PACS) and an image workstation and to navigate through the stereoscopic image, the graphical user interface comprising a haptic toolbox having a measurement tool, the measurement tool being configured to permit a user to conduct measurement and to display the measurement with a 3D image annotation in a virtual-reality environment.

13. The apparatus of claim 12, wherein the graphical user interface is configured to access, view, and manipulate the stereoscopic image.

14. The apparatus of claim 12, wherein the display system is a haptics-enhanced virtual-reality display system so that the user can conduct measurements and interact with the haptic toolbar.

15. The apparatus of claim 12, wherein the haptic toolbox comprises a plurality of icons including image and text icons touchable by the user in the virtual-reality environment.

16. The apparatus of claim 12, wherein the measurement tool is configured to be linearly extended or contracted corresponding to a given size of a patient'"'"'s anatomy.

17. The apparatus of claim 16, wherein the measurement tool uses an algorithm for edge detection executed within the display system to measure the linear dimension of the patient'"'"'s anatomy.

18. The apparatus of claim 12, wherein the display system further comprises a haptic glove configured to be worn by the user and wherein the measurement tool is configured to be held by a hand of the user wearing the haptic glove and to be positioned on a patient'"'"'s anatomy to conduct measurements.

19. A method of assisting diagnostic interpretation of a stereoscopic image in a virtual-reality environment, the method comprising the steps of:

receiving a user input associated with a graphical user interface to conduct measurements in the virtual-reality environment;

generating a haptic toolbox from the graphical user interface, the haptic toolbox comprising a measurement tool;

measuring a patient'"'"'s anatomy by using the virtual measurement tool; and

displaying a 3D haptic annotation by using the haptic toolbar to illustrate the measurement of the patient'"'"'s anatomy.

20. The method of claim 19, wherein the step of receiving a user input includes wearing a haptic glove by the user to interact with the graphical user interface.

21. The method of claim 19, wherein the haptic toolbox comprises a plurality of icons including image and text icons touchable by the user wearing the haptic glove in the virtual-reality environment.

22. The method of claim 19, wherein the step of measuring a patient'"'"'s anatomy includes linearly extending or contracting the measurement tool corresponding to a given size of the patient'"'"'s anatomy while the user is wearing the haptic glove and holding the measurement tool.

23. The method of claim 22, wherein the step of measuring the patient'"'"'s anatomy includes using an algorithm for edge detection for linearly aligning edges of the measurement tool with the edges of the patient'"'"'s anatomy.

24. A system configured to display a stereoscopic image in a virtual-reality environment, the system comprising:

means for permitting a user to conduct measurements of patient anatomy in the virtual-reality environment; and

means for displaying an image annotation when conducting measurements of patient anatomy in the virtual-reality environment.