METHOD FOR DISPLAYING AND/OR PROCESSING IMAGE DATA OF MEDICAL ORIGIN USING GESTURE RECOGNITION

• US 20090021475A1
• Filed: 07/18/2008
• Published: 01/22/2009
• Est. Priority Date: 07/20/2007
• Status: Abandoned Application

• Current Assignee: Brainlab AG
• Original Assignee: Brainlab AG
• Inventors: Gschwandtner, Michael, Steinle, Wolfgang, Frielinghaus, Nils, Hamilton, Christoffer
• Application Number:
  US12/176,027
• Publication Number:
  US 20090021475A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

A method for processing and/or displaying medical image data sets in or on a display device having a screen with a surface, including: detecting gestures performed on or in front of the screen surface; correlating the gestures to predetermined instructional inputs; and manipulating, generating, or retrieving, via computer support, the medical image data sets in response to the instructional inputs.

Claims

1. A method for processing and/or displaying medical image data sets in or on a display device having a screen with a surface, comprising:

detecting gestures performed on or in front of the screen surface;

correlating the gestures to predetermined instructional inputs; and

manipulating, generating, or retrieving, via computer support, the medical image data sets in response to the instructional inputs.

2. The method according to claim 1, further comprising a data processing unit integrated with the display device.

3. The method according to claim 1, wherein the instruction inputs comprise control inputs for displaying medical image data sets and/or medical data on the screen.

4. The method according to claim 1, wherein the screen is touch sensitive and the gestures are performed by making contact with the surface of the screen.

5. The method according to claim 1, wherein the screen is configured to detect presences near the surface of the screen and the gestures are performed without making contact with the surface of the screen.

6. The method according to claim 1, wherein the display device can identify a number of simultaneous contacts with the surface of the screen or a number of simultaneous presences near the surface of the screen.

7. The method according to claim 1, wherein correlating the gestures to predetermined instructional inputs comprises:

identifying a defined sequence of gestures and correlating the defined sequence of gestures to at least one instructional input,

identifying simultaneous gestures at a number of positions on the screen and correlating the simultaneous gestures to at least one instructional input, and/or

identifying individual gestures over a certain period of time and correlating the simultaneous gestures to at least one instructional input.

8. The method according to claim 1, wherein said gestures comprise differentiated punctual or planar contacts with the surface of the screen or presences near the surface of the screen.

9. The method according to claim 1, wherein the display device comprises at least two screens arranged next to each other and wherein one screen serves for retrieving and/or selecting image data sets or medical data and the other screen serves for manipulating or generating image data sets or medical data.

10. The method according to claim 1, further comprising:

interpreting gestures causing planar contact with the surface of the screen as different input commands to gestures causing punctual contact with the surface of the screen.

11. The method according to claim 10, wherein when the gestures causing contact with the screen are directed to a single input field on the screen.

12. The method according to claim 1, further comprising correlating gestures to instructional inputs defined to control image properties.

13. The method according to claim 12, wherein the image properties comprise zoom factor, brightness, contrast, and/or selection of screen fields.

14. The method according to claim 1, further comprising correlating the gesture(s) to an instructional input defined to enlarge an image region or a region of the screen.

15. The method according to claim 1, further comprising correlating the gesture(s) to an instructional input defined to generate a polygon.

16. The method according to claim 15, wherein the gesture(s) comprise simultaneous or consecutive punctual inputs and/or multiple planar contacts with the surface of the screen and wherein the polygon comprises delineating and/or defining image regions.

17. The method according to claim 1, further comprising correlating linear gesture(s) or a number of simultaneous linear input gestures to an instructional input defined to mirror an image.

18. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to retrieve a hidden input field and/or select an input command within the field.

19. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to retrieve and/or operate a displayed screen keyboard.

20. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to activate scroll bars at different scrolling speeds or to use different selection list criteria.

21. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to select a point or region in a linear or planar diagram, wherein:

the co-ordinates of the point or region are outputted on axes of the diagram or at an assigned area of the image;

the scale of the diagram is changed by a sequence of further gestures; and

/or

regions of the diagram are enlarged, reduced or shifted.

22. The method according to claim 1, further comprising correlating multiple or planar contacts with the surface of the screen or presences at the surface of the screen to an instructional input defined to set the correlation of subsequent gestures in a right-handed or left-handed framework.

23. The method according to claim 1, further comprising correlating two punctual inputs to an instructional input defined to insert a dimensioned line into the image or image data set, wherein the distance between the punctual inputs defines and/or alters the length of the line.

24. The method according to claim 1, further comprising correlating gestures comprising multiple or planar contacts with the surface of the screen, or presences near the surface of the screen, or simultaneous or consecutive punctual inputs to an instructional input defined to manipulate two-dimensional or three-dimensional representations of an image data set that has been produced using a medical imaging method.

25. The method according to claim 24, wherein the manipulation comprises:

rotating, tilting, or mirroring the representations;

defining or altering an incision plane in a displayed image, and/or correspondingly displaying a sectional representation of the image data set; and

/or

shifting the representation.

26. The method according to claim 1, further comprising correlating simultaneous or consecutive punctual inputs to an instructional input defined to assign image points in pairs or multiples.

27. The method according to claim 26, wherein the image points in pairs or multiples comprise the same image points in different views of an image data set.

28. The method according to claim 1, further comprising correlating gesture(s) to a instructional input(s) defined to confirm commands.

29. The method according to claim 1, further comprising identifying and/or gaging an object that is placed in contact with the screen after the object is left in contact with the screen for a defined period of time.

30. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to generate geometric figures or bodies as contours.

31. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to scale or adapt the size of objects.

32. The method according to claim 31, wherein the objects comprise implants.

33. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to affect an image content of an image region

34. The method according to claim 33, wherein the image content comprises the image brightness.

35. The method according to claim 33, wherein different gestures are correlated to different instructional inputs defined to execute a different control function that is different for different image contents.

36. The method according to claim 1, further comprising correlating simultaneous or consecutive punctual inputs to instructional inputs defined to activate and/or set and/or trigger a clock or countdown counter on the screen.

37. The method according to claim 1, further comprising further comprising correlating gesture(s) to an instructional input defined to input a signature.

38. The method according to claim 1, further comprising correlating gesture(s) to an instructional input defined to make a multiple selection of image elements by selecting a first and a final image element.

39. The method according to claim 38, wherein the image elements comprise files and a gesture is correlated to an instructional input defined to produce a compressed file from the files.

40. The method according to claim 38, wherein the image elements comprise images and a gesture is correlated to an instructional input defined to start an image sequence consisting of the selected image elements.

41. A computer program embodied on a computer readable medium for processing and/or displaying medical image data sets in or on a display device having a screen with a surface, comprising:

code for detecting gestures performed on or in front of the screen surface;

code for correlating the gestures to predetermined instructional inputs; and

code for manipulating, generating, or retrieving, via computer support, the medical image data sets in response to the instructional inputs.