Image handling and display in X-ray mammography and tomosynthesis

• US 7,577,282 B2
• Filed: 11/11/2005
• Issued: 08/18/2009
• Est. Priority Date: 11/27/2002
• Status: Active Grant

• Current Assignee: Hologic Incorporated
• Original Assignee: Hologic Incorporated
• Inventors: Shaw, Ian, Ruth, Christopher, Niklason, Loren, Stein, Jay A., Smith, Andrew P., Gkanatsios, Nikolaos A.
• Primary Examiner(s): Bella; Matthew C
• Assistant Examiner(s): Bayat; Ali
• Application Number:
  US11/271,050
• Publication Number:
  US 20060098855A1
• Time in Patent Office: 1,376 Days
• Field of Search: 382/128, 382/131, 382/132, 378/23, 378/37, 378/68, 378/154, 378/152, 378/163, 378/165, 378/101
• US Class Current: 382/128
• CPC Class Codes: A61B 5/0048 Detecting, measuring or recording by applying mechanical forces or stimuli A61B5/021, A61B5/4884 and A61B9/00 take precedence
• CPC Class Codes: A61B 5/7232 involving compression of the physiological signal, e.g. to extend the signal recording period
• CPC Class Codes: A61B 6/025 Tomosynthesis
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/464 involving a plurality of displays
• CPC Class Codes: A61B 6/465 adapted to display user selection data, e.g. graphical user interface, icons or menus
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: A61B 6/502 for diagnosis of breast, i.e. mammography
• CPC Class Codes: A61B 6/5235 combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
• CPC Class Codes: A61B 6/563 involving image data transmission via a network
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06T 11/003 Reconstruction from projections, e.g. tomography
• CPC Class Codes: G06T 11/006 Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10112 Digital tomosynthesis [DTS]
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/20108 Interactive selection of 2D slice in a 3D data set
• CPC Class Codes: G06T 2207/20212 Image combination
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 7/0012 : Biomedical image inspection

Abstract

A method and system for acquiring, processing, storing, and displaying x-ray mammograms Mp tomosynthesis images Tr representative of breast slices, and x-ray tomosynthesis projection images Tp taken at different angles to a breast, where the Tr images are reconstructed from Tp images.

Claims

1. A method of acquiring and displaying x-ray images comprising:

acquiring x-ray mammography image data Mp representative of projection mammography images of patients'"'"' breasts and x-ray tomosynthesis image data Tp representative of projection images Tp taken at different angles of an origin of imaging x-rays relative to the patients'"'"' breasts, from an acquisition unit configured to selectively acquire said mammography and tomosynthesis image data;

reconstructing at least a subset of the acquired Tp data into reconstructed tomosynthesis image data Tr representative of images of slices of the breasts that have selected orientations and thicknesses; and

displaying at least a selected subcombination of the Mp, Tr and Tp image data as respective Mp, Tp and/or Tr images for concurrent viewing while identifying the displayed images as Mp, Tr and/or Tp images, wherein the displayed images include at least two of said images, one of which is a Tr image or a Tp image.

2. A method as in claim 1 including generating computer aided detection (CAD) marks indicative of suspected abnormalities in said Mp images and displaying said marks at corresponding locations on Tr images associated by at least orientation with respective Mp images.

3. A method as in claim 1 including generating computer aided detection (CAD) marks indicative of suspected abnormalities in said Tr images and displaying said marks at corresponding locations on Mp images associated by at least orientation with respective Tr images.

4. A method as in claim 1 including generating computer aided detection (CAD) marks indicative of suspected abnormalities in at least some of said images, and displaying Tr images together with CAD marks associated therewith while suppressing concurrent displaying of Tr images that do not have CAD marks associated therewith.

5. A method as in claim 1 including storing Tp image data together with version information indicative of at least one of acquisition configuration used to acquire the Tp image data and reconstruction configuration used for previous reconstruction of Tr images from said Tp image data, thereby enabling later reconstruction of Tr images that match those previously reconstructed form the Tp image data.

6. A method as in claim 1 including storing said Tp image data together with version information related to the acquisition thereof, and further including reconstructing said Tp image data into Tr images using a reconstruction configuration that matches said version information.

7. A method as in claim 1 including storing said Tp image data together with version information and further including providing a reconstruction configuration having at least two different versions of reconstruction software and using a version of the reconstruction software that matches the version information of the Tp image data to reconstruct Tr images therefrom.

8. A method as in claim 1 including reconstruction Tr images from only a subset of the acquired Tp image data, said subset being related to only some of said different angles of at least the x-ray source relative to the breast platform.

9. A method as in claim 1 including reconstructing Tr images representative of at least two breast slices that differ in thickness.

10. A method as in claim 9 including using a MIP method to reconstruct at least one of said Tr images.

11. A method as in claim 9 using a summing method to reconstruct at least one of said Tr images.

12. A method as in claim 11 in which said summing method comprises a weighted summing method.

13. A method as in claim 9 including toggling between displays of Tr images representative of breast slices having different thicknesses.

14. A method as in claim 1 including computer-processing information contained in at least one of said Tr images to compute a volume of a lesion imaged therein.

15. A method as in claim 1 including concurrently displaying Tr images from a current acquisition of Tp image data and at least one Mp image obtained from a previous acquisition involving a different breast compression.

16. A method as in claim 1 including concurrently displaying on the same monitor or on different monitors that are concurrently viewable, at least Mp and Tr images.

17. A method as in claim 1 including selectively generating and displaying 3D images from said Tp and/or Tr image data.

18. A method as in claim 1 including providing as a part of said displaying, information indicative of status of loading Tr images for display.

19. A method as in claim 1 including selecting Mp and Tr images for display, detecting if the selected images conform to a selected pixel size, and converting any non-conforming ones of the selected images to the selected pixel size and concurrently displaying the selected images at the same pixel size.

20. A method as in claim 19 in which said converting includes up-converting to a smaller pixel size and thus a higher converted pixel count.

21. A method as in claim 19 in which said converting includes down-converting to a larger pixel size and thus a lower pixel count.

22. A method as in claim 1 including concurrently displaying at least Mp and Tr images and providing on the display non-numeric indications of respective levels of displayed Tr images.

23. A method as in claim 22 in which the non-numeric indications comprise cross-lines on a bar associated with a height of a patient'"'"'s breast imaged in the displayed Mp image.

24. A method as in claim 1 including concurrently displaying at least Mp and Tr images and providing on the display non-numeric indications of respective thicknesses of breast slices represented by displayed Tr images.

25. A method as in claim 24 in which the non-numeric indications of thicknesses comprise cross-bars of respective thickness on a bar related to an Mp image.

26. A method as in claim 1 including selectively displaying Mp and Tr images overlaid on each other.

27. A method as in claim 26 including selectively toggling between having one or the other of the overlaid images show on top of the other.

28. A method as in claim 1 including displaying at least some of the Tr images in ciné

mode.

29. A method as in claim 28 including selectively controlling a speed of changing from one displayed Tr image to another in said ciné

mode.

30. A method as in claim 28 including selectively controlling an order of displaying Tr images in said ciné

mode relative to an order in which they were reconstructed.

31. A method as in claim 30 further including selectively controlling a speed of changing from one Tr image to another in said ciné

mode.

32. A method as in claim 1 including providing at least two sets of Tr images reconstructed from Tp image data resulting from at least two different breast compressions, and including concurrently displaying said at least two sets of Tr images by scrolling through them in synchronism.

33. A method as in claim 1 including providing at least two different initial display modes relating to an order of display of Tr images relative to breast slices represented thereby, and selectively using one of said display modes to display Tr images.

34. A method as in claim 1 including providing at least two different initial display modes relating to thicknesses of breast slices represented thereby and selectively using one of said display modes to display Tr images.

35. A method as in claim 1 including providing at least two different initial display modes related to an order of displaying Tr images relative to breast slices represented thereby and further relating to thicknesses of breast slices represented thereby, and selectively using one of said display modes.

36. A method as in claim 1 including selectively displaying acquisition information related to techniques used to acquire the Tp images.

37. A method as in claim 1 including generating computer aided detection (CAD) marks indicative of suspected abnormalities in selected ones of said images, and selectively displaying said CAD marks at corresponding location on Mp images when Tr images of the same breast with CAD marks therein are displayed.

38. A method as in claim 1 including generating computer aided detection (CAD) marks indicative of suspected abnormalities in selected ones of said images, and displaying said CAD marks at corresponding locations on associated Tr images when Mp images of the same breast with CAD marks therein are displayed.

39. A method as in claim 1 including generating computer aided detection (CAD) marks indicative of suspected abnormalities in selected ones of said images, and displaying said CAD marks at corresponding locations on associated Tr or Mp images when Tp images of the same breast with CAD marks therein are displayed.

40. A method as in claim 1 including printing selected ones of said Tr images in an N×

M format, where N and M are positive integers.

41. A method as in claim 1 including printing at least said Tr images in a WISIWIG format relative to a concurrent display of said images on one or more monitors.

42. A method as in claim 1 including concurrently displaying at least two Mp images acquired at different pixel sizes or different fields of view.

43. A method as in claim 42 including converting said Mp images acquired at different pixel sizes or fields of view to display images that conform in pixel size to each other as displayed.

44. A method as in claim 1 including concurrently displaying at least two Tr or Tp images reconstructed or acquired at different pixel sizes.

45. A method as in claim 44 including converting said Tr or Tp images reconstructed or acquired at different pixel sizes to display images that conform to each other in pixel size as displayed.

46. A method as in claim 1 including concurrently displaying at least Mp and Tr images acquired or reconstructed at different pixel sizes.

47. A method as in claim 46 including automatically converting said Mp and Tr images acquired or reconstructed at different pixel sizes to display images that conform to each other in pixel size.

48. A method as in claim 1 including compressing Tp image data and storing resulting compressed versions thereof for future use.

49. A method as in claim 48 in which said compressing comprises selectively using lossless or lossy compression.

50. A method as in claim 49 including reconstructing Tr images from compressed versions of Tp image data resulting from use of said compression.

51. A method as in claim 50 including storing the reconstructed Tr images related to said use of compressed Tr images.

52. A method as in claim 1 including providing window/level controls for at least selected ones of the displayed Tr images.

53. A method as in claim 1 including providing window/level controls that selectively control only a selected subset of the displayed Tr images.

54. A method as in claim 1 including providing window/level controls that selectively control all of the displayed Tr images.

55. A method as in claim 1 including providing window/level controls that selectively control only a selected subset of the displayed Tr images or all of the displayed Tr images.

56. A method as in claim 1 including selectively magnifying regions of the displayed images and selectively automatically applying said window/level controls to the magnified regions.

57. A method as in claim 1 including storing the reconstructed Tr images in PACS storage.

58. A method as in claim 1 including storing said Tp image data in PACS storage.

59. A method as in claim 1 including asymmetric binning of said Tp image data prior to reconstructing Tr images therefrom, said asymmetric binning comprising coarser binning in a direction of relative motion between said source of imaging x-rays and a breast.

60. A method as in claim 1 in which said displaying comprises concurrent displaying of at least Mp and Tr images.

61. A method as in claim 1 in which said displaying comprises concurrent displaying of at least Mp and Tp images.

62. A method as in claim 1 in which said images Mp and Tp are acquired from the same breast of a patient while the breast remains immobilized under compression.

63. A method as in claim 1 in which said images Mp and Tp are acquired from the same breast of the patient but at different times and different compressions of the breast.

64. A method as in claim 1 in which the displayed images comprise an Mp image and at least one Tr image of the same breast, and said displaying comprises a non-numeric indication of a level of the at least one displayed Tr image.

65. A method as in claim 1, including displaying at least one non-numeric indication of a thickness of a breast slice represented by the at least one displayed Tr image.

66. A method as in claim 1 in which the displayed images comprise an Mp image and at least one Tr image of the same breast, and said displaying comprises a numeric indication of a level of the at least one displayed Tr image.

67. A method as in claim 1, including displaying at least one numeric indication of a thickness of a breast slice represented by the at least one displayed Tr image.

68. A method as in claim 1 including selectively displaying a magnified area of an Mp image and information representative of level and thickness of at least one Tr image displayed in association therewith.

69. A method as in claim 1 including selectively displaying an Mp image and a Tr image overlaid on each other.

70. A method as in claim 69 in which said selective displaying includes toggling between the overlaid images to select which image is displayed on top of the other.

71. A method as in claim 1 including generating and selectively showing on at least some of the displayed images, computer-aided detection (CAD) symbols indicative of suspected abnormalities in the displayed images.

72. A method as in claim 71 including showing on a displayed Mp image, CAD symbols generated by computer analysis of at least one Tr or Tp image.

73. A method as in claim 71 including showing on a displayed Tr or Tp image, CAD symbols generated by computer analysis of an Mp image.

74. A method as in claim 71 including showing on a Tr image, CAD symbols generated by computer analysis of at least one Tp image.

75. A method as in claim 71 including showing on a Tp image, CAD symbols generated by computer analysis of at least one Tr image.

76. A method as in claim 71 including at a displayed Mp image at least one non-numeric indication of associated Tr images that have generated CAD symbols as a result of computer analysis thereof.

77. A method as in claim 71 including automatically selecting for displaying only Tr images from which computer analysis has generated CAD symbols.

78. A method as in claim 71 including displaying in association with a displayed Mp image, a non-numeric indication of only those associated Tr images from which computer analysis has generated CAD symbol.

79. A method as in claim 1 including storing the Tr but not the Tp image data or Tp images in PACS storage, and obtaining the Tr images for display from the PACS storage.

80. A method as in claim 1 including storing the Tp imaged data or Tp images but not the Tr images reconstructed therefrom in PACS storage, and reconstructing the Tr images for display from the data or images stored in said PACS storage prior to displaying them.

81. A method as in claim 1 including storing said Tp imaged data or images together with an identification of an acquisition system that was used to acquire them.

82. A method as in claim 1 including storing said Tr images together with an identification of a reconstruction system that was used to reconstruct them.

83. A method as in claim 1 including reconstructing Tr images from only a subset of the acquired Tp image data or images.

84. A method as in claim 1 including reconstructing from said Tp image data or images at least two Tr images representative of breast slices that differ in thickness.

85. A method as in claim 1 including combining selected Tr images for display as a combined 2D image by a MIP method.

86. A method as in claim 1 including combining selected Tr images for display as a combined 2D image by a summing method.

87. A method as in claim 85 including weighting differently said selected Tr images in said summing method.

88. A method as in claim 1 including acquiring said Tp image data at two or more acquisition units and reconstructing said Tr images at a single reconstruction unit.

89. A method as in claim 1 including storing the acquired Tp image data or Tp images and reconstructing the stored data into Tr images only immediately prior to display of said Tr images.

90. A method as in claim 1 including reconstructing said tomosynthesis image data immediately after acquisition and storing the resulting Tr images for later display.

91. A system comprising:

an acquisition unit comprising a breast platform, a source of x-rays at one side of the platform and an x-ray imaging device at another side of the platform, said acquisition unit selectively acquiring x-ray mammography image data representative of projection mammography images Mp of patients'"'"' breasts on said platform and x-ray tomosynthesis image data representative of tomosynthesis projection images Tp taken at different angles of at least the x-ray source relative to the breast platform;

an image reconstruction unit coupled with the acquisition unit and receiving said image data therefrom and selectively reconstructing at least a subset of the acquired Tp images into reconstructed tomosynthesis images Tr representative of slices of the breasts that have selected orientations and thicknesses; and

a display unit displaying at least a selected subcombination of the Mp, Tr and Tp images for concurrent viewing while showing at or near the displayed images respective labeling symbols identifying them as Mp, Tr or Tp images.

92. A method of displaying x-ray images comprising:

providing x-ray mammography image data Mp representative of projection mammography images Mp of patients'"'"' breasts and tomosynthesis images Tr reconstructed from tomosynthesis image data Tp representative of projection images taken at different angles of an origin of imaging x-rays relative to the patients'"'"' breasts;

wherein said images Tr are representative of slices of the breasts that have selected orientations and thicknesses; and

displaying at least a selected subcombination of the Mp, Tr and Tp image data as respective Mp, Tp and/or Tr images for concurrent viewing of at least two displayed images, one of which is a Tp image or a Tr image, together with one or more computer aided detection (CAD) marks associated with suspected abnormalities in one or more of said images.

93. A method of displaying x-ray images comprising:

providing x-ray mammography image data Mp representative of projection mammography images Mp of patients'"'"' breasts and tomosynthesis images Tr reconstructed from tomosynthesis image data Tp representative of projection images taken at different angles of an origin of imaging x-rays relative to the patients'"'"' breasts;

wherein said images Tr are representative of slices of the breasts that have selected orientations and thicknesses; and

selectively displaying at least a selected subcombination of the Mp, Tr and Tp image data as respective Mp, Tp and/or Tr images for viewing, wherein the displayed subcombination includes at least two of said images, one of which is a Tr image or a Tp image.

94. A method of displaying x-ray images comprising:

providing x-ray mammography image data Mp representative of projection mammography images Mp of patients'"'"' breasts and tomosynthesis images Tr reconstructed from tomosynthesis image data Tp representative of projection images taken at different angles of an origin of imaging x-rays relative to the patients'"'"' breasts;

wherein said images Tr are representative of slices of the breasts that have selected orientations and thicknesses; and

selectively displaying one of an Mp image and a Tr image on top of the other for viewing, wherein the top image may be partly transparent or non-transparent.

95. A method as in claim 94 in which the Mp image is on top of the Tr image.

96. A method as in claim 94 in which the Tr image is on top of the Mp image.

97. A method as in claim 94 in which the image on top is partly transparent.