Systems and graphical user interface for analyzing body images

• US 7,130,457 B2
• Filed: 07/17/2001
• Issued: 10/31/2006
• Est. Priority Date: 07/17/2001
• Status: Expired due to Term

• Current Assignee: Merative US LP
• Original Assignee: AccuImage Diagnostics Corp. (International Business Machines Corporation)
• Inventors: Kaufman, Leon, Powers, Shelley, Goldhaber, David, Mineyev, Mikhail
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Kronenthal, Craig W.
• Application Number:
  US09/908,508
• Publication Number:
  US 20030016850A1
• Time in Patent Office: 1,932 Days
• Field of Search: 382128-134, 382115-118, 345/427, 715700-866
• US Class Current: 382/128
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 for local operation

Abstract

Systems and graphical user interfaces for analyzing body images. In an exemplary embodiment, the present invention provides a graphical user interface having a display coupled to a microprocessing device and a memory device. The graphical user interface has an electronic representation of a first body image and a second body image and an electronic map representing the position of nodules on the first body image and second body image.

Claims

1. A system for displaying a graphical user interface for analyzing quantitative changes in physical parameters of lung nodules over time, the system comprising:

a processor;

a memory configured to store at least one first body image taken at a first known time point (t₁) and at least one second body image taken at a second known time point (t₂), at least one of the first body images and at least one of the second body images being taken from at least one three-dimensional image set along substantially a common plane; and

a display configured to output the graphical user interface, the graphical user interface comprising;

the first body image corresponding to the common plane taken at t₁;

the second body image corresponding to the common plane taken at t₂;

a region for displaying quantitative information for one or more lung nodules imaged at t₁ along the common plane and determined using the at least one first body image and quantitative information for one or more corresponding lung nodules imaged at t₂ along the common plane and determined using the at least one second body image, the quantitative information comprising information related to at least one three-dimensional parameter associated with the one or more corresponding lung nodular; and

a region for displaying quantitative changes in at least one of the corresponding lung modules between the first and second time points, the quantitative changes including a rate of change in at least one three-dimensional parameter in at least one of the corresponding lung nodules between the first and second known time points computed automatically based on the first and second body images.

2. The system of claim 1 wherein the graphical user interface further comprises an electronic map representing the position of at least one nodule in the first body image and position of a corresponding nodule in the second body image.

3. The system of claim 2 wherein the electronic map comprises at least one marker.

4. The system of claim 3 wherein the marker is a number, a symbol, or a color.

5. The system of claim 1 wherein the composite image comprises an electronic representation of a subtraction of the first body image and the second body image.

6. The system of claim 1, the graphical user interface further comprising an electronic three dimensional representation of the first or second image.

7. The system of claim 1, the graphical user interface further comprising a toolbar for manipulating at least one of the first image and second image.

8. The system of claim 1 wherein the parameter comprises at least one of size, cross-sectional area, volume, surface area, roundness, density and standard deviation, and major and minor axes of a nodule.

9. The system of claim 1 wherein the comparison panel comprises a first portion for displaying quantitative information for nodules in the first image and a second portion for displaying quantitative information for the corresponding nodules in the second image.

10. The system of claim 9, the graphical user interface further comprising a third portion for displaying statistics of new nodules in the second image.

11. The system of claim 1 wherein the graphical user interface further comprises means for enabling the user to establish a correspondence between the first nodule in the first body image and another nodule in the second body image.

12. The system of claim 1, the graphical user interface comprising a report input button for generating a lung report.

13. The system of claim 1 wherein the correspondence between the first nodule in the first body image and the first nodule in the second body image is automatically determined by a program executed by a processor.

14. The system of claim 1 wherein the parameter is user-selectable.

15. The system of claim 1 further comprising an option enabling a user to dissociate the first nodule in the first body image from the first nodule in the second body image such that the first nodule in the second body image is no longer identified as corresponding to the first nodule in the first body image, whereby the display of quantitative changes is updated in response to the dissociation.

16. The system of claim 1 further comprising an option enabling a user to associate unassociated nodules in the first and second body images, whereby the display of quantitative changes is updated in response to the association.

17. The system of claim 1 wherein the rate of change is recalculated automatically upon changes in association of lung nodules in the first and second body images.

18. A system for analyzing quantitative changes in physical parameters of lesions over time, the system comprising:

a storage device for storing a first three-dimensional dataset of images captured at a first known time point and a second three-dimensional dataset of images captured at a second known time point, at least one of the images in each of the first and second datasets being taken along a substantially common plane;

an output device; and

a processor coupled to the storage device and the output device, the processor programmed to;

cause the output device to output an image from the first dataset and an image from the second dataset;

compare a lesion in the image from the first dataset and a lesion in the image from the second dataset that is determined by software code executed by a processor to match the lesion in the image from the first dataset;

cause the output device to display, based upon the comparison, one or more quantitative changes in the lesion between the first and second known time points, the quantitative changes including a rate of change in at least one three-dimensional parameter of the lesion between the first and second known time points; and

cause the output device to output an option that enables a user to indicate that the lesion in the image from the first dataset matches another lesion in the image from the second dataset instead of the lesion in the image from the second dataset determined by the software code to march the lesion in the image from the first dataset; and

compare the lesion in the image based upon the first dataset and the another lesion in the image from the second dataset.

19. The system of claim 18 wherein the processor is further programmed to produce a report.

20. The system of claim 19 wherein the processor is further programmed to electronically deliver the report over a communication network to a third party.

21. The system of claim 19 wherein the processor is further programmed to save the report on a computer readable medium.

22. The system of claim 19 further comprising a printer to print the report.

23. The system of claim 18 wherein the lesions comprise lung nodules.

24. The system of claim 18 wherein the first dataset is a baseline image scan taken at a known time t₁ and the second dataset is a follow-up image scan taken at a known time t₂.

25. The system of claim 18 wherein the processor is programmed to register the image from the first dataset and the image from the second dataset prior to comparing he lesions.

26. The system of claim 18 further comprising an imaging device for generating at least one of the first dataset or second dataset of images.

27. The system of claim 18 wherein the processor is programmed to compare a parameter value associated with the lesion in the image from the first dataset with a parameter value associated with the matching lesion in the image from the second dataset, wherein the parameter is at least one of cross-sectional area, volume, surface area, roundness, density and standard deviation, major and minor axes of the lesions.

28. The system of claim 18 wherein the processor displays the one or more differences by displaying an image generated by superimposing the image from the first dataset with the image from the second dataset.

32. The system of claim 18 wherein the processor is configured to:

cause the output device to output a panel that comprises information related to a parameter of the lesion in the image from the first dataset and information related to the parameter of the matching lesion in the image from the second dataset; and

cause the output device to output quantitative information indicating a change in the parameter for the lesion in the image from second dataset when compared to the matching lesion in the image from the second dataset.

29. A system for displaying body images on an output device, the system comprising:

means for displaying a first image of a first three-dimensional image set captured at a first known time point in a first image window;

means for displaying a second image of a second three-dimensional image set captured at a second known time point in a second image window;

means for displaying a third image in a third window, wherein the third image is one of a sum or a subtraction of the first and second image; and

means for displaying quantitative information for at least one lesion related to at least one three-dimensional parameter associated with the at least one lesion in the first and second images;

means for displaying a rate of change in the at least one three-dimensional parameter between the first and second time points; and

means for enabling a user to specify that a lesion in the first image corresponds to another lesion in the second image instead of the lesion in the second image previously determined to correspond to the lesion in the first image.

30. The system of claim 29 further comprising a toolbar displaying user actuatable icons.

31. The system of claim 29 further comprising means for creating a panel for displaying image information of the first image.

33. A method in a computer system for analyzing quantitative changes in physical parameters of lesions over time, the method comprising:

receiving a first body image of a first three-dimensional image set obtained at a first known time point, the first body image comprising one or more lesions;

receiving a second body image of a second three-dimensional image set obtained at a second known time point, the second body image comprising one or more lesions;

displaying quantitative information for at least one corresponding lesion in the first and second body images,

displaying rate of change information between the first and second known time points for at least ore three-dimensional parameter of at least one corresponding lesion determined based upon a comparison of the quantitative information;

enabling a user to change the correspondence between the at least one lesion in the first and second body images;

receiving a signal indicating that the correspondence has been changed; and

updating the change information responsive to receiving the signal.

34. The method of claim 33 wherein:

enabling the user to change the correspondence comprises enabling the user to indicate that at least one lesion in the first body image does not correspond to at least one lesion in the second body image; and

receiving the signal comprises receiving a signal indicating that the at least one lesion in the first body image does not correspond to at least one lesion in the second body image.

35. The method of claim 33 wherein:

enabling the user to change the correspondence comprises enabling the user to indicate that another lesion in the second body image corresponds to the at least one lesion in the first body image instead of the first lesion;

receiving the signal comprises receiving a signal indicating that the at least one lesion in the first body image corresponds to the another lesion in the second body image; and

updating the change information comprises displaying updated change information determined based upon a comparison of the quantitative information for the at least one lesion in the first body image and the corresponding another lesion in the second body image.

36. The method of claim 33 wherein the parameter is selectable by the user from a plurality of parameters.

37. The method of claim 36 wherein the plurality of parameters comprises one or more of size, cross-sectional area, volume, surface area, roundness, density and standard deviation, and major and minor axes of the lesions.

38. The method of claim 33 wherein the correspondence between the at least one lesion in the first body image and at least one lesion in the second body image is automatically determined by a program executed by a processor.

39. The method of claim 33 wherein the one or more lesions in the first body image and the second body image comprise one or more lung nodules.

40. The method of claim 33 wherein:

enabling the user to change the correspondence comprises enabling the user to indicate that the another lesion in the second body image does not correspond to any lesion in the first body image; and

receiving the signal comprises receiving a signal indicating that the another lesion in the second body image does not correspond to any lesion in the first body image.

41. A system for analyzing quantitative changes in three-dimensional parameters of nodules over time, the system comprising:

a storage device for storing a first three-dimensional dataset of images captured a a first known time point t₁ and a second three-dimensional dataset of images captured at a second known time point t₂, at least one of the images in each of the first and second datasets being taken along a substantially common plane;

an output device; and

a processor coupled to the storage device and the output device, the processor programmed to;

(a) automatically make a match for a first nodule in the first three-dimensional dataset captured at first known time point t₁ and a second nodule in the second three-dimensional dataset captured at second known time point t₂;

(b) automatically consider the first nodule captured at first known time point t₁ to be resolved;

(c) automatically consider the second nodule captured at second known time point t₂ to be new;

(d) automatically determine a rate of change of an operator-selectable three dimensional parameter for the matched first and second nodules between the first and second known time points;

(e) provide an operator with the opportunity to inspect the match and the ability to dissociate the matched first and second nodules;

(f) provide an operator with the ability to associate nodules in the first and second three-dimensional datasets to generate new matches; and

(g) automatically repeat steps (b)–

(d) each time an operator dissociates a match or associates a new match.