Image reporting method and system

• US 7,693,317 B2
• Filed: 11/12/2004
• Issued: 04/06/2010
• Est. Priority Date: 08/09/1999
• Status: Active Grant

• Current Assignee: Wake Forest University Health Sciences
• Original Assignee: Wake Forest University Health Sciences
• Inventors: Ahn, David K., Stelts, David R., Ge, Yaorong, Vining, David J.
• Primary Examiner(s): Carter; Aaron W
• Application Number:
  US10/987,195
• Publication Number:
  US 20050147284A1
• Time in Patent Office: 1,971 Days
• Field of Search: 382128-132, 382/305, 715/700, 128920-925, 707/104.1
• US Class Current: 382/128
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G11B 2020/10944 Real-time recording or reproducing, e.g. for ensuring seamless playback of AV data
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: Y10S 128/922 including image analysis
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method and system are provided to report the findings of an expert'"'"'s analysis of image data. The method and system are based on a reporting system that forms the basis of an image management system that can efficiently and systematically generate image reports, facilitate data entry into searchable databases for data mining, and expedite billing and collections for the expert'"'"'s services. The expert identifies a significant finding on an image and attaches a location:description code to the location of that finding in order to create a significant finding and an entry into a database. Further descriptions of that finding, such as dimensional measurements, audio descriptions, 3D rendered snapshots, etc., may be automatically appended to the finding as secondary attributes of the finding within the database. At the end of the expert'"'"'s evaluation of the image(s), the system sorts the findings in the database and presents the findings by prioritized categories. The expert edits and approves a multimedia report, which may be delivered to an Internet server for immediate access, archived in the database, sent by automated voice, fax or e-mail to an end-user, or any combination thereof.

Claims

1. A computer implemented method for analysis of an image comprising:

presenting an image of at least a selected portion of anatomy to a user for review;

associating a position descriptor with a selected feature of the anatomy, the position descriptor representing image coordinates;

presenting to the user a list of user-selectable items related to the image type;

selecting at least one item from the list, the item describing a characteristic of the feature; and

creating an image finding of the feature comprising the position descriptor and the at least one selected item,

wherein presenting the list comprises creating the list to contain items that are consistent with the selected portion of anatomy.

6. A method according to claim 1 or 2 wherein the presenting an image comprises presenting the image in a viewer and comprises associating a status of the viewer with the feature, the status comprising at least one of an orientation, a magnification, and a shading of the image.

7. A method according to claim 6, wherein the orientation comprises at least one of a translation state and a rotation state.

8. A method according to claim 6, wherein the magnification comprises a degree of image zoom.

9. A method according to claim 6, wherein the shading comprises at least one of a gray scale setting and opacity setting.

10. A method according to claim 6 wherein the image finding comprises the viewer status.

11. A method according to claim 1 or 2, comprising displaying a selected portion of the image and selecting of the displayed portion of the image to recall the associated diagnostic finding.

17. A method according to claim 1 or 2 wherein the image content information comprises one or more of a CPT code and a ICD code.

18. A method according to claim 1 or 2 comprising associating at least one of a dimensional measurement, mean voxel value, standard deviation of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered image, a video description, and a user-defined illustration with the finding.

19. A method according to claim 1 or 2 comprising assigning a priority to the image finding to denote the importance of the image finding.

20. A method according to claim 1 or 2 comprising assigning a recommendation to the image finding to denote a recommended action to be taken with respect to the image finding.

21. A method according to claim 1 or 2 comprising creating at least one thumbnail image of the feature and associating the thumbnail image with the image finding.

22. A method according to claim 1 or 2 comprising displaying the image in at least one of a two-dimensional viewer and a three-dimensional viewer.

23. A method according to claim 22 wherein the image is formed by at least one of volume rendering, surface rendering, and rendering about a point.

24. A method according to claim 1 or 2 wherein the image comprises a digital image.

25. A method according to claim 1 or 2 wherein the image is part of a series of two-dimensional images associated with a three-dimensional body.

26. A method according to claim 1 or 2 comprising identifying features in the image using computer analysis of the image to provide computer identified features.

27. A method according to claim 26 comprising correlating the computer identified features with the selected feature.

28. A method according to claim 26 wherein the computer analysis comprises computer assisted polyp detection.

29. A method according to claim 26 wherein the computer analysis comprises a transbronchial needle aspiration targeting scheme.

30. A method according to claim 1 or 2 comprising creating a plurality of image findings.

31. A method according to claim 30 comprising linking selected findings of the plurality of image findings to create a cumulative finding encompassing the plurality of image findings.

32. A method according to claim 30 comprising linking related findings to associate the related findings to render the associated findings retrievable as a unit.

33. A method according to claim 30 comprising assigning a priority to at least one of the image findings and sorting the image findings according to priority.

34. A method according to claim 30 comprising assigning a location-code to at least one of the image findings and sorting the image findings according to location-code.

35. A method according to claim 30 comprising assigning a description-code to at least one of the image findings and sorting the image findings according to the description-code.

36. A method according to claim 1 or 2 comprising

retrieving at least one prior finding from a previous analysis of an image and

linking the retrieved image finding to the image finding of the feature, whereby a set of findings is created describing a chronology of the image finding of the feature.

37. A method according to claim 1 or 2 comprising generating a report based on the image finding.

38. A method according to claim 37 wherein the report contains at least one of the image finding, a thumbnail image of an image finding, and a chronology of an image finding.

39. A method according to claim 1 or 2 comprising recording a cine clip showing a time varying characteristic of the feature.

2. A computer implemented method for analysis of an image comprising:

presenting an image of at least a selected portion of anatomy to a user for review;

associating a position descriptor with a selected feature of the anatomy, the position descriptor representing image coordinates;

presenting to the user a list of user-selectable items related to the image type;

selecting at least one item from the list, the item describing a characteristic of the feature; and

creating an image finding of the feature comprising the position descriptor and the at least one selected item,

wherein the at least one list item comprises a location-code which describes the location of the selected feature relative to an anatomical structure depicted in the image.

12. A method according to claim 2 wherein the location-code represents an anatomical location.

13. A method according to claim 2 wherein the location-code is selected from a predefined lexicon of location-codes.

14. A method according to claim 2 wherein the at least one list item comprises a description-code which describes at least one property of the feature.

15. A method according to claim 14 wherein the description-code is selected from a predefined lexicon of description-codes.

16. A method according to claim 14 wherein the property comprises a pathology of the feature.

3. A computer implemented method for analysis of an image comprising:

presenting an image of at least a selected portion of anatomy in an image viewer to a user for review;

associating a position descriptor with the location of a selected feature of the anatomy, the position descriptor comprising image coordinates of the selected feature;

associating a status of the viewer with the feature, the status comprising viewer information regarding how the image is displayed;

associating a location-code with the feature, the location-code selected from a list presented to the user and describing the location of the feature relative to structure depicted in the image;

associating a description-code with the feature to describe a characteristic of the feature, the description-code selected from a list presented to the user; and

creating an image finding of the feature comprising the position descriptor, the location-code, the viewer status, and the description-code.

40. A method according to claim 3 wherein the location-code represents an anatomical location.

41. A method according to claim 3 wherein the viewer information comprises at least one of an orientation, a magnification, and a shading of the image.

42. A method according to claim 3 wherein the list of location-codes is compiled from a predefined lexicon of location-codes.

43. A method according to claim 3 wherein the characteristic describes at least one physical property of the feature.

44. A method according to claim 3 wherein the list of description-codes is compiled from a predefined lexicon of description-codes.

45. A method according to claim 3 comprising associating a content-code with the image, the content-code denoting that at least one specific object is depicted within the image, and wherein the description-code list is assembled to contain description-codes that are consistent with the content-code.

46. A method according to claim 3 comprising associating a content-code with the image, the content-code denoting that at least one specific object is depicted within the image and wherein the location-code list is assembled to contain location-codes that are consistent with the content-code.

47. A method according to claim 3 wherein the characteristic comprises a pathology of the feature.

48. A method according to claim 3 comprising associating at least one of a dimensional measurement, mean voxel value, standard deviation of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered image, a video description, and a user-defined illustration with the finding.

49. A method according to claim 3 comprising creating at least one thumbnail image of the feature and associating the thumbnail image with the image finding.

50. A method according to claim 3 wherein displaying the image comprises display in at least one of a two-dimensional viewer and a three-dimensional viewer.

51. A method according to claim 3 wherein the image is formed by at least one of volume rendering, surface rendering, and rendering about a point.

52. A method according to claim 3 comprising displaying multiple images simultaneously.

53. A method according to claim 3 wherein the image comprises a digital image.

54. A method according to claim 3 wherein the image comprises a series of two-dimensional images associated with a three-dimensional body.

55. A method according to claim 3 comprising identifying features in the image using computer analysis of the image to provide computer identified features.

56. A method according to claim 55 comprising correlating the computer identified features with the selected feature.

57. A method according to claim 3 comprising creating a plurality of image findings.

58. A method according to claim 57 comprising generating a report based on the image findings.

59. A method according to claim 58 wherein generating the report comprises incorporating a cumulative finding by linking selected findings of the plurality of image findings to create the cumulative finding encompassing the plurality of image findings.

60. A method according to claim 58 wherein generating the report comprises incorporating a primary finding by linking related findings to associate the related findings to create the primary finding.

61. A method according to claim 58 wherein generating the report comprises assigning a priority to at least one of the image findings and sorting image findings according to priority.

62. A method according to claim 58 wherein generating the report comprises sorting image findings according to at least one of the location-code and the description-code.

63. A method according to claim 58 wherein generating the report comprises incorporating a chronology of an image finding by

retrieving at least one previous finding associated with the feature from a previous analysis and

linking the retrieved image finding to the image finding of the feature whereby the chronology of the image finding of the feature is created.

64. A method according to claim 58 wherein generating the report comprises computing a selected statistical measure of the report generation process.

65. A method according to claim 64 wherein the statistical measure comprises at least one of total review time, time per finding, number of findings, and diagnostic accuracy.

66. A method according to claim 58 comprising generating billing information to create a bill for the report.

67. A method according to claim 3, wherein the orientation comprises at least one of a translation state and a rotation state.

68. A method according to claim 3, wherein the magnification comprises a degree of image zoom.

69. A method according to claim 3, wherein the shading comprises at least one of a gray scale setting and opacity setting.

4. A computer program product, comprising a computer-readable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for analyzing an image of at least a selected portion of anatomy, said method comprising:

associating image coordinates with a selected feature of the image;

compiling a list of user-selectable items related to image content information describing the image type and for presenting the list to the user; and

creating an image finding of the feature comprising the image coordinates of the image feature and at least one item selected by the user from the list,

wherein the list items comprise a location-code which describes the location of the feature relative to an object depicted in the image.

70. A system according to claim 4, comprising a viewer for presenting the image to the user and comprising a viewer status recorder for associating a status of the viewer with the feature, the status comprising at least one of an orientation, a magnification, and a shading of the image.

71. A system according to claim 70, wherein the orientation comprises at least one of a translation state and a rotation state.

72. A system according to claim 70, wherein the magnification comprises a degree of image zoom.

73. A system according to claim 70, wherein the shading comprises at least one of a gray scale setting and opacity setting.

74. A system according to claim 4, wherein the location-code represents an anatomical location.

75. A system according to claim 4, wherein the location-code is selected from a predefined lexicon of location-codes.

76. A system according to claim 4, comprising a finding sorter for sorting a plurality of image findings according to location-code.

77. A system according to claim 4, wherein the list of items comprise a description-code which describes at least one property of the feature.

78. A system according to claim 77, comprising a finding sorter for sorting a plurality of image findings according to description-code.

79. A system according to claim 77, wherein the description-code is selected from a predefined lexicon of description-codes.

80. A system according to claim 77, wherein the property comprises a pathology of the feature.

81. A system according to claim 4, wherein the image content information comprises one or more of a CPT code and a ICD code.

82. A system according to claim 4, comprising a finding annotator for associating at least one of a dimensional measurement, mean voxel value, standard deviation of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered image, a video description, and a user-defined illustration with the finding.

83. A system according to claim 4, comprising a voice recognition unit for entering the selected item.

84. A system according to claim 4, wherein the finding generator is configured to associate a priority with the image finding to denote the importance of the image finding.

85. A system according to claim 84, wherein the finding generator is configured to sort the image findings according to priority.

86. A system according to claim 4, wherein the finding generator is configured to associate a recommendation with the image finding to denote a recommended action to be taken with respect to the image finding.

87. A system according to claim 4, comprising a thumbnail generator for creating at least one thumbnail image of the feature and associating the thumbnail image with the image finding.

88. A system according to claim 4, comprising at least one of a two-dimensional viewer and a three-dimensional viewer.

89. A system according to claim 4, comprising a renderer for generating the image by at least one of volume rendering, surface rendering, and rendering about a point.

90. A system according to claim 4, comprising an image analyzer for identifying features in the image using computer analysis of the image to provide computer identified features.

91. A system according to claim 90, wherein the image analyzer is configured to correlate the computer identified features with the selected feature.

92. A system according to claim 86, wherein the image analyzer is configured to perform computer assisted polyp detection.

93. A system according to claim 86, wherein the image analyzer is configured to perform a transbronchial needle aspiration targeting scheme.

94. A system according to claim 4, comprising a finding compositor for linking selected findings of a plurality of image findings to create a cumulative finding comprising the plurality of image findings.

95. A system according to claim 4, comprising a file loader for retrieving at least one prior finding from a previous analysis of an image and for linking the retrieved image finding to the image finding of the feature, whereby a set of findings is created describing a chronology of the image finding of the feature.

96. A system according to claim 4, comprising a report generator for generating a report based on the image finding.

97. A system according to claim 96, wherein the report contains at least one of the image finding, a thumbnail image of the image finding, and a chronology of the image finding.

98. A system according to claim 4, wherein the list of user-selectable items is at least a subset of a comprehensive list of user selectable items.

99. A system according to claim 4, comprising a communication interface for communication with at least one of the Internet, an e-mail system, a fax, a telephone, a wireless communications system, a pager, a cell phone, a hospital information system, a radiology information system, and a picture archiving and communication system.

5. A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for analyzing an image, said method comprising:

displaying of at least a selected portion of anatomy to a user for review;

associating a status of the viewer with the feature, the status comprising viewer information regarding how the image is displayed;

compiling a list of user-selectable location-codes describing the location of the feature relative to the object;

compiling a list of user-selectable description-codes describing a characteristic of the feature; and

creating an image finding of the feature comprising the image coordinates of the image feature, the viewer status, at least one location-code selected by the user from the location-code list, and at least one description-code selected by the user from the description-code list.

100. A system according to claim 5, wherein the viewer information comprises at least one of an orientation, a magnification, and a shading of the image.

101. A system according to claim 5, wherein the list of location-codes is compiled from a predefined lexicon of location-codes.

102. A system according to claim 5, wherein at least one of the location-code list and the description-code list is at least a subset of a comprehensive list of user selectable items.

103. A system according to claim 5, comprising a content-code retriever for retrieving a content-code, denoting what the image depicts, and for retrieving a reason-code, denoting a reason for creating the image.

104. A system according to claim 5 wherein the characteristic describes at least one physical property of the feature.

105. A system according to claim 5, wherein the characteristic comprises a pathology of the feature.

106. A system according to claim 5, wherein the list of description-codes is compiled from a predefined lexicon of description-codes.

107. A system according to claim 5, comprising a content-code retriever for retrieving a content-code and associating the content-code with the image, the content-code denoting that at least one specific object is depicted within the image, and wherein the location-code list is assembled to contain location-codes that are consistent with the content-code.

108. A system according to claim 5, comprising a content-code retriever for retrieving a content-code and associating the content-code with the image, the content-code denoting that at least one specific object is depicted within the image, and wherein the description-code list is assembled to contain description-codes that are consistent with the content-code.

109. A system according to claim 5, comprising a finding annotator for associating at least one of a dimensional measurement, mean voxel value, standard deviation of voxel values, an audio description, a two-dimensional image, a three-dimensional rendered image, a video description, and a user-defined illustration with the finding.

110. A system according to claim 5, comprising a thumbnail generator for creating at least one thumbnail image of the feature and associating the thumbnail image with the image finding.

111. A system according to claim 5, wherein the viewer comprises at least one of a two-dimensional viewer and a three-dimensional viewer.

112. A system according to claim 111, comprising a rendering means for rendering the image by at least one of volume rendering, surface rendering, and rendering about a point.

113. A system according to claim 5, comprising an image analyzer for identifying features in the image using computer analysis of the image to provide computer identified features.

114. A system according to claim 113, wherein the image analyzer is configured to correlate the computer identified features with the selected feature.

115. A system according to claim 5, comprising a report generator for generating a report based on the image finding.

116. A system according to claim 115, comprising a finding linking means for linking selected findings of a plurality of image findings to create a cumulative finding comprising the plurality of image findings.

117. A system according to claim 115, wherein the report generator is configured to assign a priority to at least one of a plurality of image findings and to sort the image findings according to priority.

118. A system according to claim 115, wherein the report generator is configured to sort image findings according to at least one of the location-code and the description-code.

119. A system according to claim 115, comprising a file loader for retrieving at least one prior finding from a previous analysis of an image and for linking the retrieved image finding to the image finding of the feature, whereby a set of findings is created describing a chronology of the image finding of the feature.

120. A system according to claim 115, wherein the report generator is configured to compute a selected statistical measure of the report generation process.

121. A system according to claim 120, wherein the statistical measure comprises at least one of total review time, time per finding, number of findings, and diagnostic accuracy.

122. A system according to claim 5, comprising a bill generator for creating a bill based on the diagnostic finding.

123. A system according to claim 5, wherein the finding generator is configured to associate a recommendation with the image finding to denote a recommended action to be taken with respect to the image finding.

124. A system according to claim 5, wherein the orientation comprises at least one of a translation state and a rotation state.

125. A system according to claim 5, wherein the magnification comprises a degree of image zoom.

126. A system according to claim 5, wherein the shading comprises at least one of a gray scale setting and opacity setting.