Gesture-based reporting method and system

• US 20060007188A1
• Filed: 07/08/2005
• Published: 01/12/2006
• Est. Priority Date: 07/09/2004
• Status: Active Grant

• Current Assignee: Gesturerad Incorporated
• Original Assignee: Gesturerad Incorporated
• Inventors: Reiner, Bruce
• Granted Patent: US 7,421,647 B2
• Time in Patent Office: Days
• US Class Current: 345/179
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 70/60 relating to pathologies

Abstract

The present invention is directed to gesture-based reporting system and method, which includes a client computer with high-resolution image displaying device, and an input device which is a programmable stylus, where the predetermined information contained within the report is defined by a series of symbols or gestures, which are drawn directly onto the image displayed on the image displaying device, using the programmable stylus. The gestures or symbols used, utilize an economy of symbols that are diverse in nature and have broad based appeal to the population of end users. At the same time, they can be made applicable to a variety of different specific situations, modalities, pathologies, etc., in order to interpret the imaging study. Therefore, unlike a traditional text report (where the image and text report are distinct and separate from one another), the informational content contained within the image and the gesture-based report are inseparable.

Claims

1. A computer-implemented method of image reporting comprising:

displaying an image;

embedding said image with at least a first symbol corresponding to a predetermined information; and

storing said image with said embedded symbol thereon.

2. The method according to claim 1, further comprising:

embedding at least a second symbol corresponding to a predetermined information on said image.

3. The method according to claim 2, wherein said second symbol is a modifier symbol.

4. The method according to claim 2, wherein an input device is used to embed said at least first symbol and said second symbol.

5. The method according to claim 4, wherein said input device is a programmable stylus.

6. The method according to claim 3, further comprising:

providing said image from a plurality of images in an image study.

7. The method according to claim 6, wherein said image study can be provided for viewing in one of a static and a dynamic fashion.

8. The method according to claim 3, wherein said predetermined information corresponds to a pathology in a medical application.

9. The method according to claim 8, wherein said modifier identifies and quantifies said pathology.

10. The method according to claim 3, further comprising:

providing text correlating to said predetermined information next to said at least one of said first and said second symbol; and

confirming said text correctly denotes said at least one of said first and said second symbol.

11. The method according to claim 10, further comprising:

deleting said text and said corresponding symbol in response to a user command, when said text does not correctly denote said corresponding symbol.

12. The method according to claim 10, further comprising:

forwarding said image with said embedded symbol thereon, to a selected user.

13. The method according to claim 6, wherein said image with said embedded symbol thereon can be moved from said image to another image in said image study.

14. The method according to claim 3, further comprising:

applying automated decision support systems to interpret said image.

15. The method according to claim 14, wherein findings from said automated decision support systems can be shown on said image as embedded symbols in one of a format and a color which differs from said previously embedded symbols.

16. The method according to claim 12, further comprising:

generating a report on said image having said embedded symbols.

17. The method according to claim 1, wherein a database of said images having embedded symbols can be searched for a selected embedded symbol.

18. The method according to claim 16, further comprising:

generating another image by placing embedded symbols from a report, on said another image.

19. The method according to claim 6, wherein images with embedded symbols thereon are stored separately as key images from other images in said image study.

20. The method according to claim 19, wherein said key images are displayed in a pre-selected user format, which includes pre-selected variables.

21. The method according to claim 7, wherein said symbols are shown on said image in an order applied by a user.

22. The method according to claim 3, further comprising:

providing additional data to a user to assist in image interpretation.

23. The method according to claim 18, wherein a plurality of reports can be generated with symbols provided in differing formats and colors, and overlayed on said image with previously embedded symbols.

24. The method according to claim 23, wherein said medical application is radiology.

26. The method according to claim 1, wherein said symbol is one of a graphic and a numerical representation.

27. The method according to claim 23, wherein temporal subtraction can be applied to said reports to show changes in said image.

28. The method according to claim 1, wherein said image includes one of an x-ray, a digital representation, a photograph, a graphical representation, a blueprint, and a medical printout.

29. The method according to claim 14, wherein neural networks are applied to further define and interpret said image.

30. The method according to claim 2, further comprising:

tracking a frequency of symbols applied to said image to create a statistical profile of commonly used symbols to enhance accuracy of symbol recognition.

52. The method according to claim 1, wherein said displaying step is performed by a PACS.

53. The method according to claim 1, wherein said storing step is performed by a PACS.

57. The method according to claim 1, wherein said display is one of a touch screen, and a pair of goggles.

58. The method according to claim 23, further comprising:

storing a signature of a user on said image.

59. The method according to claim 58, wherein said reports can be sorted by said signature of said user on said image.

60. The method according to claim 58, wherein each said signature of said user can be allocated differing edit privileges of said images and reports.

31. A computer system having a program for performing image reporting, comprising:

means for displaying an image;

means for embedding at least a first symbol corresponding to a predetermined information on said image; and

means for storing said image with said embedded symbol thereon.

32. The computer system of claim 31, further comprising:

means for embedding at least a second symbol corresponding to a predetermined information on said image.

33. The computer system of claim 32, further comprising:

means for forwarding said image with said embedded symbol thereon, to a selected user.

34. The computer system according to claim 33, further comprising:

means for applying automated decision support systems to interpret said image.

37. The computer system according to claim 36, further comprising:

means for generating a report on said image having said embedded symbols.

38. The computer system according to claim 37, further comprising:

means for generating another image by placing embedded symbols from a report, on said another image.

39. The computer system according to claim 38, further comprising:

means for providing additional data to a user to assist in image interpretation.

40. The computer system according to claim 39, further comprising:

means for tracking a frequency of symbols applied to said image to create a statistical profile of commonly used symbols to enhance accuracy of symbol recognition.

41. A computer system for performing image reporting, comprising:

at least one memory containing at least one program comprising the steps of;

displaying an image;

embedding at least a first symbol corresponding to a predetermined information on said image; and

storing said image with said embedded symbol thereon; and

at least one processor for running the program.

42. An apparatus for performing image reporting, comprising:

a display, which displays an image;

an input device which inputs at least one symbol corresponding to a predetermined information on said image;

a storage device which stores said image with said embedded symbol thereon.

43. The apparatus according to claim 42, further comprising:

wherein said input device is a programmable stylus.

44. The apparatus according to claim 42, further comprising:

automated decision support systems to interpret said image.

45. The apparatus according to claim 42, wherein said display is a touch screen monitor.

46. The apparatus according to claim 42, wherein said display is part of a PACS.

47. The apparatus according to claim 42, wherein said storage device is part of a PACS.

48. The apparatus according to claim 42, further comprising:

a processor for recognizing said symbol and associating said symbol with corresponding text.

49. A computer-readable medium whose contents cause a computer system to perform image reporting, the computer system having a program comprising the steps of:

displaying an image;

embedding at least a first symbol corresponding to a predetermined information on said image; and

storing said image with said embedded symbol thereon.

50. A computer-readable memory device encoded with a data structure for image reporting using a computer system, the data structure having entries, each entry comprising:

a plurality of symbols corresponding to predetermined information.

51. The computer-readable memory device according to claim 50, further comprising:

text corresponding to said predetermined information.

54. A computer-implemented method of image reporting in a medical application, comprising:

displaying an image;

embedding said image with at least a first symbol corresponding to a pathology finding; and

storing said image with said embedded symbol thereon.

55. The method according to claim 54, further comprising:

embedding at least a second symbol corresponding to a modifier which identifies and quantifies said pathology, on said image.

56. The method according to claim 55, further comprising:

generating a report on said image having said embedded symbols.

61. A method of performing electronic consultation between at least two users, comprising:

displaying an image;

embedding said image with at least a first symbol corresponding to a predetermined information at a first user;

forwarding said image with said embedded symbol from said first user to at least a second user;

forwarding said image with at least a second symbol corresponding to a predetermined information from said at least second user to said first user;

modifying said image where necessary at said first user; and

forwarding said image back to said at least second user.