Appartus and method for visualizing digital breast tomosynthesis and other volumetric images

• US 10,395,398 B2
• Filed: 05/24/2018
• Issued: 08/27/2019
• Est. Priority Date: 07/28/2015
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Sherali, Ishrat I
• Application Number:
  US15/988,542
• Publication Number:
  US 20180268575A1
• Time in Patent Office: 460 Days
• Field of Search: 382128, 382131
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 2207/10112 Digital tomosynthesis [DTS]
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 2211/412 Dynamic
• CPC Class Codes: G06T 2211/436 Limited angle
• CPC Class Codes: G06T 7/0014 using an image reference approach

Abstract

Digital Breast Tomosynthesis allows for the acquisition of volumetric mammography images. The present invention allows for novel ways of viewing such images to detect microcalcifications and obstructions. In an embodiment a method for displaying volumetric images comprises computing a projection image using a viewing direction, displaying the projection image and then varying the projection image by varying the viewing direction. The viewing direction can be varied based on a periodic continuous mathematical function. A graphics processing unit can be used to compute the projection image and bricking can be used to accelerate the computation of the projection images.

Claims

1. A method comprising the steps of:

providing a computer including a graphics processing unit and a first memory, where the computer;

a) receives a 3-D volumetric image reconstructed from a plurality of measured 2-D projection images;

b) computes a first 2-D projection image based on a first viewing direction, where the first 2-D projection image is generated from a first position toward an object, where the first viewing direction is conicident with a first line between the first position and the object;

c) computes a second generated 2-D projection image based on a second viewing direction, where the second 2-D projection image is generated from a second position toward the object, where the second position is not the first position, where the second viewing direction is conicident with a second line between the second position and the object;

d) computes a third generated 2-D projection image based on a third viewing direction, where the third 2-D projection image is generated from a third position toward the object, where the third position is not the first position, where the third position is not the second position, where the third viewing direction is conicident with a third line between the third position and the object; and

e) sends the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image with viewing instructions to a remote device which includes a graphics display unit, where the viewing instructions determine that the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image are displayed sequentially on the graphics display unit.

2. The method of claim 1, where the computer has a first memory, where one or more of the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image are stored in the first memory.

3. The method of claim 1, where the remote device includes a second memory, where one or more of the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image are stored in the second memory.

4. The method of claim 1, where at least one of the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image enhances one or more features selected from the group consisting of:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification using direct comparison;

iv) an obstruction using direct comparison;

v) identification of the first generated 2-D projection image;

vi) identification of the second generated 2-D projection image;

vii) identification of a microcalcification;

viii) identification of an obstruction;

ix) direct comparison with the first generated 2-D projection image;

x) direct comparison with the second generated 2-D projection image;

xi) direct comparison of a microcalcification; and

xii) direct comparison of an obstruction.

5. The method of claim 1, where the 3-D volumetric image is a Digital Breast Tomosynthesis image.

6. The method of claim 1, where two or more of the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image comprise:

a video, where the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image are displayed sequentially;

a video, where the video displays a dynamic comparison;

viewing directions selected according to a periodic continuous mathematical function;

or

viewing directions spanning one period of the periodic continuous mathematical function.

7. The method of claim 6, where one or more of the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image are generated on a server.

8. The method of claim 3, where one or both the first memory and the second memory is a cache.

9. The method of claim 8, further comprising storing the viewing instructions in the cache.

10. The method of claim 8, further comprising using the viewing instructions to format the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image as a video.

11. The method of claim 8, further comprising storing the viewing instructions in the second memory as an executable file to display the first generated 2-D projection image, the second generated 2-D projection image and the third generated 2-D projection image as a video.

12. A method comprising the steps of:

providing a computer including a graphics processing unit and a first memory, where the computer;

a) receiving a first 3-D volumetric image of a first body part measured at a first time of measurement;

b) computing a plurality of 2-D projection images from the first 3-D volumetric image using a plurality of viewing directions;

c) comparing the plurality of computed 2-D projection images to identify a first viewing direction corresponding to a first 2-D projection image that identifies an obstruction;

d) receiving a second 3-D volumetric image, where the second 3-D volumetric image is selected from the group consisting of;

(i) a second 3-D volumetric image of the first body part measured before the first time of measurement;

(ii) a second 3-D volumetric image of the first body part measured after the first time of measurement,

(iii) a second 3-D volumetric image of a second body part measured at the first time of measurement, where the second body part is used to carry out a structural comparison of the first body part;

(iv) a second 3-D volumetric image of a second body part measured before the first time of measurement, where the second body part is used to carry out a structural comparison of the first body part; and

(v) a second 3-D volumetric image of a second body part measured after the first time of measurement, where the second body part is used to carry out a structural comparison of the first body part; and

e) computing a second 2-D projection image from the second 3-D volumetric image based on the first viewing direction;

f) sending the first 2-D projection image and the second 2-D projection image to a remote display device which includes a graphics display unit; and

g) displaying the first 2-D projection image and the second 2-D projection image on the graphics display unit.

13. The method of claim 12, where one or both the first 2-D projection image and the second 2-D projection image are stored on the first memory.

14. The method of claim 12, where the viewing instructions determine the orientation of the second 2-D projection image with respect to the first 2-D projection image.

15. The method of claim 12, where one or both the plurality of generated 2-D projection images and the second 2-D projection image enhances one or more features selected from the group consisting of:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification using direct comparison;

iv) an obstruction using direct comparison;

v) identification of the first generated 2-D projection image;

vi) identification of the second generated 2-D projection image;

vii) identification of a microcalcification;

viii) identification of an obstruction;

ix) direct comparison with the first generated 2-D projection image;

x) direct comparison with the second generated 2-D projection image;

xi) direct comparison of a microcalcification; and

xii) direct comparison of an obstruction.

16. The method of claim 12, where one or both the first 3-D volumetric image and the second 3-D volumetric image is a Digital Breast Tomosynthesis image.

17. The method of claim 12, where the plurality of generated 2-D projection images comprise:

a video, where the first generated 2-D projection image are displayed sequentially;

a video, where the video displays a dynamic comparison;

viewing directions selected according to a periodic continuous mathematical function;

or

viewing directions spanning one period of the periodic continuous mathematical function.

18. The method of claim 12, where the plurality of generated 2-D projection images are generated on a server.

19. A method comprising the steps of:

providing a computer including a graphics processing unit and a first memory, where the computer;

a) receiving a first 3-D volumetric image of a first body part measured at a first time of measurement;

b) computing a first plurality of 2-D projection images of the first 3-D volumetric image using a plurality of viewing directions;

c) comparing the first plurality of 2-D projection images computed in step (b) to identify a first viewing direction that identifies an obstruction in a first 2-D projection image;

d) receiving a second 3-D volumetric image, where the second 3-D volumetric image is selected from the group consisting of;

(i) a second 3-D volumetric image of the first body part measured before the first time of measurement;

(ii) a second 3-D volumetric image of the first body part measured after the first time of measurement,

(iii) a second 3-D volumetric image of a second body part measured at the first time of measurement, where the second body part is used to carry out a structural comparison of the first body part;

(iv) a second 3-D volumetric image of a second body part measured before the first time of measurement, where the second body part is used to carry out a structural comparison of the first body part; and

(v) a second 3-D volumetric image of a second body part measured after the first time of measurement, where the second body part is used to carry out a structural comparison of the first body part; and

e) computing a second plurality of generated 2-D projection images from the second 3-D volumetric image using the plurality of viewing directions;

f) identifying a second viewing direction that shows a second 2-D projection image which corresponds with the first 2-D projection image; and

g) displaying the first 2-D projection image and the second 2-D projection image on a remote display device which includes a graphics display unit.

20. The method of claim 19, where one or both the first plurality of generated 2-D projection images and the second plurality of generated 2-D projection images enhances one or more features selected from the group consisting of:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification using direct comparison;

iv) an obstruction using direct comparison;

v) identification of the first generated 2-D projection image;

vi) identification of the second generated 2-D projection image;

vii) identification of a microcalcification;

viii) identification of an obstruction;

ix) direct comparison with the first generated 2-D projection image;

x) direct comparison with the second generated 2-D projection image;

xi) direct comparison of a microcalcification; and

xii) direct comparison of an obstruction.