Method and system for displaying medical images

• US 5,987,345 A
• Filed: 11/29/1996
• Issued: 11/16/1999
• Est. Priority Date: 11/29/1996
• Status: Expired due to Term

• Current Assignee: ARCH Development Corporation (University of Chicago)
• Original Assignee: ARCH Development Corporation (University of Chicago)
• Inventors: Engelmann, Roger, Doi, Kunio, Hoffmann, Kenneth R., MacMahon, Heber
• Primary Examiner(s): Getzow, Scott M.
• Assistant Examiner(s): SHAW, SHAWNA JEANNINE
• Application Number:
  US08/757,611
• Time in Patent Office: 1,082 Days
• Field of Search: 600/407, 128/920, 128/922, 382/128, 382/130, 382/132, 382/305, 382/306, 382/307, 378/98, 378/62, 345/23, 345/55, 345/113, 345/115-117, 345/119, 345/156
• US Class Current: 600/407
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: Y10S 128/92 Computer assisted medical diagnostics

Abstract

A method and system for displaying medical images and computer output from various CAD schemes on the images. Images are loaded into the display system and displayed in a main viewing area. The system can display various CAD schemes, such as the automated detection of lung nodules, interstitial infiltrates, and heart size, in the case of a chest image, on the image. The method and system also display interval change (temporal subtraction) between images. Individual abnormality from CAD schemes can be viewed by clicking buttons with minified (postage stamp size) images with CAD annotation rendered into them. The images and results are then shown on a high-speed monitor. Interval change between the current and a previous image can also be chosen by clicking buttons containing minified images. Interval change between any other pair of images for a patient can be selected by choosing from minified subtraction images presented in a two-dimensional array format. A previewer next to the array permits rapid inspection of subtraction images before a subtraction set is chosen for detailed study.

Claims

1. A computerized method of displaying medical images, comprising:

obtaining a first medical image representative of an anatomy as said anatomy existed at a first point in time;

obtaining a second medical image representative of an anatomy as said anatomy existed at a second point in time temporally spaced from said first point in time;

obtaining a temporal subtraction image in which one of said first and second medical images of said anatomy is subtracted from the other thereof, said temporal subtraction image highlighting changes occurring in said anatomy between said first and second points in time;

obtaining at least one first diagnostic image of said first medical image, each diagnostic image including said first medical image having superimposed respective diagnostic annotations indicative of the results of computer aided diagnosis superimposed on said first medical image, said diagnostic annotations being displayed in spatial relation to respective portions of said anatomy;

displaying one of said first medical image, said second medical image, said temporal subtraction image and said first diagnostic image in a first display area of a first display screen; and

displaying said first medical image, said second medical image, said temporal subtraction image and said first diagnostic image including said respective diagnostic annotations in a second display area of said first display screen for visual comparison with the image displayed in said first display area.

2. A method as recited in claim 1, comprising:

displaying said first and second medical images, said temporal subtraction image and said first diagnostic image including said respective diagnostic annotations in miniature in said second display area in comparison with a size of the image displayed in said first display area.

3. A method as recited in claim 1, comprising:

obtaining a second medical image of said anatomy;

obtaining a subtraction image in which one of said first and second medical images of said anatomy is subtracted from the other thereof; and

displaying said subtraction image and said first and second medical images.

4. A method as recited in claim 3, comprising:

displaying said temporal subtraction image grouped with said first and second medical images.

5. A method as recited in claim 3, comprising:

displaying said first and second medical images, said temporal subtraction image and said first and second diagnostic images including said respective diagnostic annotations in miniature in said second display area in comparison with a size of the image displayed in said first display area.

6. A method as recited in claim 5, comprising:

displaying miniature of said first and second diagnostic images in association with respective miniature of said first and second medical images in said second display area.

7. A method as recited in claim 5, comprising:

displaying in said second display area respective display selection function buttons for each of said at least first and second medical images and said temporal subtraction image; and

displaying in said first display area a respective one of the first and second medical images and said temporal subtraction image upon activation of the respective display selection function button.

8. A method as recited in claim 7, comprising:

displaying said first and second medical images and said temporal subtraction image superimposed in miniature on respective of said display selection function buttons at least when the respective display selection function button is not activated.

9. A method as recited in claim 8, comprising:

altering the display of a miniature image in a selected display selection function button displayed in said second display area upon activation of the selected display selection function button.

10. A method as recited in claim 9, comprising:

providing in said second display area an all-three display selection function button which when activated results in display of the first and second medical images and said temporal subtraction image in said first display area; and

displaying said first and second medical images and said temporal subtraction image in said first display area upon activation of said all-three display selection function button.

11. A method as recited in claim 9, comprising:

indicating in at least one of said function buttons a diagnostic decision.

12. A method as recited in claim 5, comprising:

obtaining identification information corresponding to said medical image; and

displaying said identification information with said medical image.

13. A method as recited in claim 5 comprising:

displaying in said first screen diagnostic result information corresponding to the displayed diagnostic image displayed in said first display area.

14. A method as recited in claim 3, comprising:

displaying in said second display area a respective display selection function button for each diagnostic image and for said first and second medical images and for said temporal subtraction image such that upon activation of said display selection function button the respective image corresponding thereto is displayed in said first display area; and

displaying the image corresponding to the activated display selection function button in said first display area upon activation of the respective display selection function button.

15. A method as recited in claim 14, comprising:

displaying in miniature superimposed on each said display selection function button respective of said diagnostic images, said first and second medical images, and said temporal subtraction image in said second display area at least when the respective display selection function button is not activated.

16. A method as recited in claim 15, comprising:

altering the display of a miniature image superimposed on a selected display selection function button upon activation of the selected display selection function button.

17. A method as recited in claim 16, comprising:

indicating in at least one of said function buttons a diagnostic decision.

18. A method as recited in claim 15, comprising:

providing in said second display area an all-three display selection function button which when activated results in display of the first and second medical images and said temporal subtraction image in said first display area; and

displaying said first and second medical images and said temporal subtraction image in said first display area upon activation of said all-three display selection function button.

19. A method as recited in claim 15, comprising:

displaying in said second display area an other-images display selection function button which when activated produces a second screen in which plural images of said anatomy are arranged in a matrix, said matrix including a first row in which medical images of said anatomy obtained at different points in time are arranged, a second row including at one end of said second row a medical image laterally offset with respect to said medical images of said first row and temporal subtraction images respectively resulting when one of the medical images of the first row and the laterally offset image of said second row is subtracted from the other of the medical images of the first row and the laterally offset image of said second row, each temporal subtraction image being displayed vertically aligned in a column with the respective medical image of the first row from which the respective subtraction image was derived; and

displaying said second screen upon activation of said other-images display selection function button.

20. A method as recited in claim 19, comprising:

said second screen having first and second display areas;

displaying display selection function buttons in said second display area of said second screen for respective of said medical images and said temporal subtraction images,

displaying said medical images and said temporal subtraction images superimposed in miniature on respective of said display selection function buttons displayed in said second area of said second screen at least when the respective display selection function button is not activated; and

displaying in said first area of said second screen a selected of said medical images and said temporal subtraction images upon activation of a respective display selection function button displayed in said second display area of said second screen.

21. A method as recited in claim 20, comprising:

altering the display of a miniature image in a selected display selection function button displayed in said second display area of said second screen upon activation of the selected display selection function button.

22. A method as recited in claim 14, comprising:

indicating in at least one of said function buttons a diagnostic decision.

23. In a computerized system for displaying medical images, the improvement comprising:

a mechanism configured to obtain a first medical image representative of an anatomy as said anatomy existed at a first point in time;

a mechanism configured to obtain a second medical image representative of the anatomy as said anatomy existed at a second point in time;

a mechanism configured to obtain a temporal subtraction image in which one of said first and second medical images is subtracted from the other thereof;

a mechanism configured to obtain plural diagnostic images of said first and second medical images, each diagnostic image including said one of said first and second medical images having a respective diagnostic annotation, indicative of the results of computer aided diagnosis, superimposed on the respective of said first and second medical images in spatial relation to respective portions of said anatomy;

a mechanism configured to display at least one of said first and second medical images, said temporal subtraction image and said diagnostic images in a first display area of a first display screen; and

a mechanism configured to display said first and second medical images, said temporal subtraction image and said diagnostic images including said respective diagnostic annotations in a second display area of said first display screen for visual comparison with the image displayed in said first display area.

24. A system as recited in claim 23, comprising:

a mechanism configured to display said first and second medical images, said temporal subtraction image and said diagnostic images including said respective diagnostic annotations in miniature in said second display area in comparison with a size of the image displayed in said first display area.

25. A system as recited in claim 23, comprising:

a mechanism configured to display said temporal subtraction image grouped with said first and second medical images.

26. A system as recited in claim 23, comprising:

a mechanism configured to display plural of said diagnostic images including said respective diagnostic annotations in miniature in said second display area in comparison with a size of the image displayed in said first display area;

a mechanism configured to display said at least two medical images and said temporal subtraction image in said second display area in miniature in said second display area in comparison with a size of the image displayed in said first display area.

27. A system as recited in claim 26, comprising:

a mechanism configured to display in said second display area said plural of said miniature diagnostic images in association with respective of said miniature at least two medical images.

28. A system as recited in claim 26, comprising:

a mechanism configured to provide in said second display area an all-three display selection function button which when activated results in display of said first and second medical images and temporal subtraction image in said first display area; and

a mechanism configured to display said first and second medical images and temporal subtraction image in said first display area upon activation of said all-three display selection function button.

29. A system as recited in claim 28, comprising:

a mechanism configured to indicate in at least one of said function buttons a diagnostic decision.

30. A system as recited in claim 23, comprising:

a mechanism configured to display in said second display area a respective display selection function button for each diagnostic image, for said first and second medical images, and for said temporal subtraction image such that upon activation of said display selection function button, the respective image corresponding thereto is displayed in said first display area; and

a mechanism configured to display the image corresponding to the activated display selection function button in said first display area upon activation of the respective display selection function button.

31. A system as recited in claim 30, comprising:

a mechanism configured to display said first and second medical images, said temporal subtraction image and said diagnostic images including said respective diagnostic annotations in miniature in said second display area in comparison with a size of the image displayed in said first display area.

32. A system as recited in claim 31, comprising:

a mechanism configured to alter the display of a miniature image superimposed on a selected display selection function button upon activation of the selected display selection function button.

33. A system as recited in claim 32, comprising:

a mechanism configured to indicate in at least one of said function buttons a diagnostic decision.

34. A system as recited in claim 31, comprising:

a mechanism configured to display said first and second medical images and said temporal subtraction image superimposed in miniature on respective of said display selection function buttons at least when the respective display selection function button is not activated.

35. A system as recited in claim 34, comprising:

a mechanism configured to alter the display of a miniature image in a selected display selection function button displayed in said second display area upon activation of the selected display selection function button.

36. A system as recited in claim 30, comprising:

a mechanism configured to provide in said second display area an all-three display selection function button which when activated results in display of said first and second medical images and temporal subtraction image in said first display area; and

a mechanism configured to display said first and second medical images and subtraction image in said first display area upon activation of said all-three display selection function button.

37. A system as recited in claim 30, comprising:

a mechanism configured to display in said second display area an other-images display selection function button which when activated produces a second screen in which plural images of said anatomy are arranged in a matrix, said matrix including a first row in which medical images representative of said anatomy as said anatomy existed at different points in time are arranged, and a second row including at one end of said second row a medical image laterally offset with respect to said medical images of said first row and temporal subtraction images respectively resulting when one of the medical images of the first row and the laterally offset image of said second row is subtracted from the other of the medical images of the first row and the laterally offset image of said second row, each temporal subtraction image being displayed vertically aligned in a column with the respective medical image of the first row from which the respective temporal subtraction image was derived; and

a mechanism configured to display said second screen upon activation of said other-images display selection function button.

38. A system as recited in claim 37, comprising:

said second screen having first and second display areas;

a mechanism configured to display selection function buttons in said second display area of said second screen for respective of said medical images and said temporal subtraction images,

a mechanism configured to display said medical images and said temporal subtraction images superimposed in miniature on respective of said display selection function buttons displayed in said second area of said second screen at least when the respective display selection function button is not activated; and

a mechanism configured to display in said first area of said second screen a selected of said medical images and said temporal subtraction images upon activation of a respective display selection function button displayed in said second display area of said second screen.

39. A system as recited in claim 38, comprising:

a selection mechanism configured to select in said second screen a medical image displayed in said second screen, such that upon activation of said selection mechanism, the selected medical image and associated diagnostic images are displayed in said first screen.

40. A system as recited in claim 39, wherein said selection mechanism comprises:

a change screen display selection function button displayed in said first display area of said second screen and having said selected of said first and second medical images and said temporal subtraction image superimposed thereon, such that upon activation of said change screen display selection function the display mechanism is configured to display said first screen with said selected of said first and second medical images, respective diagnostic images, and said temporal subtraction image displayed in said second display area of said first screen.

41. A system as recited in claim 40, wherein said selection mechanism comprises:

change screen double selection display selection function buttons displayed in said second display area of said second screen and having respective of said medical images and said temporal subtraction images superimposed thereon in miniature, such that upon a double activation of one of said change screen double selection display selection function buttons, the display mechanism is configured to display said first screen with a selected of the medical images corresponding to the double activated change screen double selection display selection function button, and respective diagnostic and temporal subtraction images associated therewith, in said second display area of said first screen.

42. A system as recited in claim 39, wherein said selection mechanism comprises:

change screen double selection display selection function buttons displayed in said second display area of said second screen and having respective of said medical images and said temporal subtraction images superimposed thereon in miniature, such that upon a double activation of one of said change screen double selection display selection function buttons, the display mechanism is configured to display said first screen with a selected medical image corresponding to the double activated change screen double selection display selection function button, and respective diagnostic and temporal subtraction images associated therewith, in said second display area of said first screen.

43. A system as recited in claim 38, comprising:

a mechanism configured to alter the display of a miniature image in a selected display selection function button displayed in said second display area of said second screen upon activation of the selected display selection function button.

44. A system as recited in claim 37, comprising:

a selection mechanism configured to select in said second screen a medical image displayed in said second screen, such that upon activation of said selection mechanism, the selected medical image and associated diagnostic images are displayed in said first screen.

45. A system as recited in claim 30, comprising:

a mechanism configured to indicate in at least one of said function buttons a diagnostic decision.

46. A system as recited in claim 30, comprising:

a mechanism configured to obtain identification information corresponding to said medical image; and

a mechanism configured to display said identification information with said medical image.

47. A system as recited in claim 30, comprising:

a mechanism configured to display in said first screen diagnostic result information corresponding to the displayed diagnostic image displayed in said first display area.

48. A computerized system of displaying medical images, comprising:

a mechanism configured to obtain plural medical images representative of an anatomy as said anatomy existed at different points in time;

a mechanism for obtaining at least one temporal subtraction image formed by subtraction of a first of said plural medical images from at least a second of said plural medical images;

a display mechanism configured to display said medical images and said at least one temporal subtraction image arranged in a matrix, said matrix including a first row in which said second medical image is displayed, and a second row in which a temporal subtraction image and said first medical image are displayed with the temporal subtraction image arranged substantially vertically aligned in a column with the second medical image and horizontally aligned with the first medical image in said second row, said subtraction image having been derived by a subtraction operation performed between said first and second medical images.

49. A system as recited in claim 48, wherein said display mechanism is configured to display plural of said medical images in said first row of said matrix and plural temporal subtraction images obtained by subtraction between said first medical image and the medical images of said first row, said temporal subtraction images displayed vertically aligned in respective columns with respective medical images of said first row from which each respective temporal subtraction image was derived and in said row including said first medical image.

50. The system of claim 49, wherein said display mechanism comprises first and second display areas, wherein at least a selected one of said medical images and said temporal subtraction images is displayed in said first display area and said matrix including said medical images and temporal subtraction images is displayed in said second display area in miniature form relative to a size of the selected at least one image displayed in the first display area.

51. A system as in claim 50, wherein said display mechanism is further configured to display a display selection function button in association with each of said medical images and said at least one temporal subtraction image such that upon activation of one of said display selection function buttons, the respective medical image or temporal subtraction image associated therewith is displayed in said first display area.

52. A system as recited in claim 51, comprising:

said display mechanism configured to display said miniature medical images and temporal subtraction images displayed in said second display area superimposed over said display selection function buttons.

53. A system as recited in claim 52, comprising:

said display mechanism configured to alter display of a selected of said medical images and temporal subtraction images superimposed over a respective display selection function button upon activation of the selected display selection function button.

54. The system of claim 48, wherein said display mechanism comprises first and second display areas, wherein at least a selected one of said medical images and said at least one temporal subtraction image is displayed in said first display area and said matrix including said medical images and said at least one temporal subtraction image is displayed in said second display area in miniature form relative to a size of the selected at least one image displayed in the first display area.