Image reporting method and system

• US 6,785,410 B2
• Filed: 11/21/2001
• Issued: 08/31/2004
• Est. Priority Date: 08/09/1999
• Status: Expired due to Term

• Current Assignee: Wake Forest University Health Sciences
• Original Assignee: Wake Forest University Health Sciences
• Inventors: Ge, Yaorong, Ahn, David K., Stelts, David R., Vining, David J.
• Primary Examiner(s): Johns, Andrew W.
• Assistant Examiner(s): NAKHJAVAN, SHERVIN K
• Application Number:
  US09/990,090
• Publication Number:
  US 20020131625A1
• Time in Patent Office: 1,014 Days
• Field of Search: 382/128, 382/180, 382/201, 382/203, 382/305, 707/1, 707/3, 707/4, 707/6, 707/102, 707/104.1, 711/161, 711/208, 128/920, 128/922, 128/923, 369/24.01, 369/27.01, 369/47.22, 348/107, 702/80, 725/115, 700/214, 700/215
• US Class Current: 382/128
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10944 Real-time recording or reproducing, e.g. for ensuring seamless playback of AV data
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: Y10S 128/922 including image analysis
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method and system are provided to report the findings of an expert'"'"'s analysis of image data. The method and system are based on a reporting system that forms the basis of an image management system that can efficiently and systematically generate image reports, facilitate data entry into searchable databases for data mining, and expedite billing and collections for the expert'"'"'s services. The expert identifies a significant finding on an image and attaches a location:description code to the location of that finding in order to create a significant finding and an entry into a database. Further descriptions of that finding, such as dimensional measurements, may be automatically appended to the finding as secondary attributes. After the evaluation, the system sorts the findings in the database and presents the findings by prioritized categories. The expert edits and approves a multimedia report which may be delivered by electronic means to an end-user.

Claims

1. A computer implemented method for the analysis of image data comprising the steps of:

presenting an actual image of an object to a user for analysis of the image contents;

analyzing the image to identify a feature of interest of the object;

identifying the feature using an input device to selectively mark a location on the actual image representing the identified feature;

associating a position descriptor with the feature representing image coordinates of the feature;

associating a location-code with the feature, the location-code selected from a list presented to the user and describing the location of the feature relative to a structure depicted in the image;

associating a description code with the feature to describe an attribute of the feature, the description code selected from a list presented to the user; and

storing the position descriptor, location-code, and description code in a computer database, whereby an image finding is created that comprises the position descriptor, location-code, and description code.

2. A method according to claim 1, wherein the image comprises anatomical information, and the location-code comprises a location of the feature relative to an anatomical structure depicted in the image.

3. A method according to claim 1, wherein the attribute includes a pathology of the feature.

9. A method according to any one of claims 1, 4, and 7, comprising retrieving a content-code associated with the image, the content-code specifying that a specific object is depicted within the image, and initializing a menu in response to the content-code, whereby menu items associated with the specific object are listed in a specified manner in the menu.

10. A method according to claim 9, wherein the content-code comprises at least one of an anatomical-location code and a pathology-description code.

11. A method according to any one of claims 1, 4, and 7, comprising retrieving a prior report containing a most recent description code, and initializing a menu in response to the most recent description code, whereby menu items associated with the most recent description code are listed in a specified manner in the menu.

12. A method according to any one of claims 1, 4, and 7, comprising retrieving a prior report containing a plurality of description codes, and initializing a menu in response to the most frequently used description code, whereby menu items associated with the most frequently used description code are listed in a specified manner in the menu.

13. A method according to any one of claims 1, 4, and 7, comprising retrieving a selected patient characteristic associated with the image, and initializing a menu in response to the patient characteristic, whereby menu items associated with the patient characteristic are listed in a specified manner in the menu.

14. A method according to claim 13, wherein the patient characteristic comprises the gender of the patient.

15. A method according to claim 13, wherein the menu comprises at least one of an anatomical-location menu and a pathology description menu.

16. A method according to claim 15 comprising retrieving a prior report containing a most recent description code, and initializing the menu in response to the most recent description code, whereby menu items associated with the most recent description code are listed in a specified manner in the menu.

17. A method according to claim 15, comprising retrieving a prior report containing a plurality of description codes, and the a menu in response to the most frequently used description code, whereby menu items associated with the most frequently used description code are listed in a specified manner in the menu.

18. A method according to any one of claims 1, 4, and 7, comprising retrieving a selected patient characteristic associated with the image, and initializing a menu in response to the patient characteristic, whereby menu items unrelated to the patient characteristic are not presented in the menu.

19. A method according to claim 18, wherein the patient characteristic comprises the gender of the patient.

20. A method according to any one of claims 1, 4, and 7, comprising creating a summary of prior findings.

21. A method according to claim 20, wherein the step of creating a summary comprises retrieving a prior report relating to a patient shown in the image and extracting a prior finding from the prior report.

22. A method according to claim 20, wherein the step of arranging the prior findings comprises omitting a selected prior finding from the summary.

23. A method according to claim 20, wherein the step of creating a summary comprises arranging the prior findings according to a selected significance of the prior findings.

24. A method according to claim 23, wherein the step of arranging the prior findings comprises at least one of grouping the prior findings within the summary and ranking the prior findings within the summary.

25. A method according to claim 23, wherein the significance of the prior findings includes at least one of a designated priority code, a designated anatomical feature, and an image modality.

26. A method according to claim 25, wherein the priority code is selected from the group consisting of “

life-threatening,”

“

significant,” and

“

incidental.”

27. A method according to claim 25, wherein the anatomical feature comprises a particular body structure.

28. A method according to claim 25, wherein the image modality includes at least one of an x-ray, a sonogram, an MRI, and a CAT scan.

29. A method according to any one of claims 1, 4, and 7, comprising retrieving a plurality of prior findings of the selected feature from at least one prior analysis of an image, and displaying an element of the prior findings in a graphical display to describe a chronology of the element.

30. A method according to claim 29, wherein the element comprises the size of the selected feature.

31. A method according to claim 30, wherein the size comprises at least one of an area, volume, and a distance of the selected feature.

4. A computer implemented method for creating a report pertaining to the diagnostic analysis of image data comprising the steps of:

displaying an actual image of an object from the image data to a user for analysis of the image contents;

creating in a computer memory a diagnostic finding comprising the steps of

a) identifying an object feature shown in the image,

b) recording in the computer memory a portion of the image containing the identified feature,

c) associating a description code selected from a list presented to the user with the identified feature representing attribute of the identified feature; and

generating a report comprising the diagnostic finding.

5. A method according to claim 4, wherein the image-detail comprises a snapshot of the feature.

6. A method according to claim 4, wherein the attribute includes a pathology of the feature.

7. A computer implemented method for analysis of an image comprising the steps of:

presenting an actual image of an object to a user for analysis of the image contents;

analyzing the image to identify a selected feature of interest of the object;

identifying the selected feature using an input device to selectively mark a location on the actual image representing the selected feature;

associating a position descriptor with the selected feature representing the image coordinates of the selected feature;

associating a description code with the feature to describe an attribute of the feature, the description code selected from a list presented to the user; and

storing the position descriptor and the description code in a database,

whereby an image finding is created that comprises the position descriptor and the description code.

8. A method according to claim 7, wherein the description code comprises a pathology description of the selected feature.

32. A system for the analysis of image data comprising:

an image database comprising an actual image of an object;

a display for presenting an image from the image database to a user for analysis of the image contents;

a position annotator for associating with a selected feature shown in the image a position descriptor representing the image coordinates of the selected feature;

a location annotator for presenting a list of location-codes to the user and for associating with the feature a location-code denoting the location of the feature relative to a structure depicted in the image in response to a selection by the user of a location-code from the list;

an attribute annotator for presenting a list of description codes to the user and for associating with the selected feature a description code selected by the user representing an attribute of the selected feature; and

a memory for storing the position descriptor, location-code, and description code in a computer database to create an image finding that comprises the position descriptor, location-code, and description code.

33. A system according to claim 32, wherein the image comprises anatomical information, and the location-code comprises a location of the selected feature relative to an anatomical structure depicted in the image.

34. A system according to claim 32, wherein the attribute includes a pathology of the selected feature.

37. A system according to claim 32 or claim 35, wherein the image comprises the content-code denoting that a specific object is depicted within the image, and the system comprises a menu initializer for initializing a menu in response to the content-code, whereby menu items associated with the specific object are listed in a specified manner in the menu.

38. A system according to claim 37, wherein the content-code comprises at least one of an anatomical-location code and a pathology-description code.

39. A system according to claim 32 or claim 35, comprising a report loader for retrieving a prior report containing a most recent description code and comprising a menu initializer for initializing a menu in response to the most recent description code, whereby menu items associated with the most recent description code are listed in a specified manner in the menu.

40. A system according to claim 32 or claim 35, comprising a report loader for retrieving a prior report containing a plurality of description codes and comprising a menu initializer for initializing a menu in response to a most frequently used description code, whereby menu items associated with the most frequently used description code are listed in a specified manner in the menu.

41. A system according to claim 32 or claim 35, comprising a menu initializer for retrieving a selected patient characteristic associated with the image and for initializing a menu in response to the patient characteristic, whereby menu items associated with the patient characteristic are listed in a specified manner in the menu.

42. A system according to claim 41, wherein the menu comprises at least one of an anatomical-location menu and a pathology description menu.

43. A system according to claim 41, wherein the patient characteristic comprises the gender of the patient.

44. A system according to claim 32 or claim 35, comprising a menu initializer for retrieving a selected patient characteristic associated with the image and for initializing a menu in response to the patient characteristic, whereby menu items unrelated to the patient characteristic are not presented in the menu.

45. A system according to claim 44, wherein the patient characteristic comprises the gender of the patient.

46. A system according to claim 32 or claim 35, comprising a finding analyzer for creating a summary of prior findings.

47. A system according to claim 46, wherein the finding analyzer comprises a file loader for retrieving a prior report relating to a patient shown in the image and for extracting a prior finding from the prior report.

48. A system according to claim 46, wherein the finding analyzer comprises a sorter for arranging the prior findings according to a selected significance of the prior findings.

49. A system according to claim 48, wherein the significance of the prior findings includes at least one of a designated priority code, a designated anatomical feature, and an image modality.

50. A system according to claim 49, wherein the priority code is selected from the group consisting of “

life-threatening”

, “

significant”

, and “

incidental.”

51. A system according to claim 49, wherein the anatomical feature comprises a particular body structure.

52. A system according to claim 49, wherein the image modality includes at least one of an x-ray, a sonogram, an MRI, and, a CAT scan.

53. A system according to claim 32 or claim 35, comprising a graph generator for retrieving a plurality of prior findings of the selected feature from at least one prior analysis of an image and for displaying an element of the prior findings in a graphical display to describe a chronology of the element.

54. A system according to claim 53, wherein the element comprises the size of the selected feature.

55. A system according to claim 54, wherein the size comprises at least one of an area, volume, and a distance of the selected feature.

35. A computer system for analysis of an image comprising:

an image selector for retrieving an image from a database and for presenting the image to a user for analysis of the image contents;

a position annotator for associating with a selected feature shown in the image a position descriptor representing the image coordinates of the selected feature;

an attribute annotator for presenting a list of description codes to the user and for associating with the selected feature a description code selected by the user representing an attribute of the selected feature; and

a memory for storing the position descriptor and the description code in a database to create an image finding that comprises the position descriptor and the description code.

36. A system according to claim 35, wherein the description code comprises at least one of a location description which describes the location of the selected feature relative to an object depicted in the image and a pathology description of the selected feature.

56. A system for the analysis of image data comprising:

a display for presenting an image of an object to a user for review;

a position annotator for associating with a selected feature shown in the image a position descriptor representing the position of the selected feature within the image;

a location annotator for associating with the feature a location-code denoting the location of the feature relative to a structure depicted in the image;

a physical property annotator for associating with the selected feature a physical property characteristic representing physical property of the selected feature;

a memory for storing the position descriptor, location-code, and physical property characteristic in a computer database to create an image finding; and

a finding analyzer for creating a summary of prior findings, wherein the finding analyzer comprises a sorter for arranging the prior findings according to a selected significance of the prior findings wherein the finding analyzer comprises a finding grouper for grouping the prior findings within the summary according to the selected significance.

57. A computer implemented method for the analysis of image data comprising the steps of:

presenting an image to a user for review;

associating a position descriptor with a selected feature of the object, the position descriptor representing the coordinate of the selected feature within the image;

associating a location-code with the feature, the location-code selected from a list presented to the user and describing the location of the feature relative to a structure depicted in the image;

associating a description code with the feature to describe an attribute of the feature, the description code selected from a list presented to the user; and

storing the position descriptor, location-code, and property characteristic in a computer database, whereby an image finding is created.

58. A method according to claim 57, wherein the image comprises anatomical information, and the location-code comprises a location of the selected feature relative to an anatomical structure depicted in the image.

59. A method according to claim 57, wherein the property includes a pathology of the selected feature.

60. A computer system for analysis of an image comprising:

a position annotator for associating with a selected feature shown in the image a position descriptor representing the position of the selected feature within the image;

a physical property annotator for associating with the selected feature a physical property characteristic representing a physical property of the selected feature;

a memory for storing the position descriptor and the physical property characteristic in a database to create an image finding; and

a finding analyzer for creating a summary of prior findings, the finding analyzer comprises a sorter for arranging the prior findings according to a selected significance of the prior findings wherein the finding analyzer comprises a finding grouper for grouping the prior findings within the summary according to the selected significance.

61. A computer implemented method for the analysis of image data of a patient comprising the steps of:

presenting an actual image of a patient to a user for image analysis in an interactive display;

analyzing the image to identify a feature of interest in the image;

identifying the feature using an input device to selectively mark a location on the actual image representing the identified feature;

assigning a position descriptor representing the coordinates of the feature within the image;

associating with the feature an anatomical code describing the anatomical location of the feature;

associating a pathology code with the feature representing a pathology of the feature; and

creating an image finding based on the image coordinates, the anatomical code, and the feature pathology.

62. The method of claim 61 comprising the step of creating a report relating to the image finding.