Apparatus and system for rule based visualization of digital breast tomosynthesis and other volumetric images

• US 10,070,839 B2
• Filed: 07/26/2016
• Issued: 09/11/2018
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US15/220,325
• Publication Number:
  US 20160345925A1
• Time in Patent Office: 777 Days
• CPC Class Codes: A61B 6/025 Tomosynthesis
• CPC Class Codes: A61B 6/027 characterised by the use of a particular data acquisition trajectory, e.g. helical or spiral
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/465 adapted to display user selection data, e.g. graphical user interface, icons or menus
• CPC Class Codes: A61B 6/502 for diagnosis of breast, i.e. mammography
• CPC Class Codes: A61B 6/5223 generating planar views from image data, e.g. extracting a coronal view from a 3D image
• CPC Class Codes: A61B 6/563 involving image data transmission via a network
• CPC Class Codes: G06T 11/003 Reconstruction from projections, e.g. tomography
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2211/412 Dynamic
• CPC Class Codes: G06T 2211/436 Limited angle
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

The invention provides, in some aspects, a system for implementing a rule derived basis to display volumetric image sets. In various embodiments of the invention, the selection of the images to be displayed, the generation of the 3-D volumetric image from measured 2-D images including the rendering parameters and styles, the choice of viewing directions and 2-D projection images based on the viewing directions, the layout of the projection images, and the formation of a video can be determined using a rule derived basis. In an embodiment of the present invention, the user is presented with sequential images making up a video displayed based on their preferences without having to first manually adjust parameters. The present invention allows for novel ways of viewing such images to detect microcalcifications and obstructions when reviewing Digital Breast Tomosynthesis and other volumetric mammography images.

Claims

1. A method comprising:

providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports;

the server;

a) receiving a patient ID from a remote computer from the one or more remote computers; and

b) executing a render server program which;

i) applies one or more of one or more Study Selection Rules based on the patient ID to select a Study from the plurality of medical diagnostic reports;

the render server program;

ii) applies one or more Protocol Selection Rules and one or more Image Set Rules to generate a volumetric image reconstructed from the Study;

iii) defines at least three viewing directions for the Study based on the one or more Protocol Selection Rules and the one or more Display Protocols;

iv) generates at least three projection images from the volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols; and

v) selects three or more images of the Study from the at least three projection images; and

c) sending the three or more images to the remote computer.

2. The method of claim 1, where in step v) one or more Protocol Selection Rules are used to select a viewing direction that identifies:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification includes two or more microcalcifications;

iv) an obstruction includes a microcalcification and an obstruction;

v) an obstruction includes two or more obstructions;

vi) a microcalcification using direct comparison; and

vii) an obstruction using direct comparison.

3. The method of claim 1, where in step v) one or more Protocol Selection Rules are used to select a viewing direction that improves:

i) identification of a projection image;

ii) comparison of a projection image;

iii) identification of a microcalcification;

iv) identification of an obstruction;

v) resolution of two microcalcifications;

vi) resolution of a microcalcification and an obstruction;

vii) resolution of two obstructions;

viii) direct comparison with a first projection image and a second projection image;

ix) direct comparison of a microcalcification; and

x) direct comparison of an obstruction.

4. The method of claim 1, where the Study is a Digital Breast Tomosynthesis scan.

5. The method of claim 1, where the three or more images are displayed as a video.

6. The method of claim 5, where the video displays a dynamic comparison.

7. The method of claim 1, where the viewing directions are selected according to a periodic continuous mathematical function.

8. The method of claim 7, where the three or more images are generated from viewing directions spanning one period of the periodic continuous mathematical function.

9. The method of claim 1, further comprising storing the three or more images.

10. A method comprising:

providing a display device in communication coupling with a server computer on which are stored a plurality of medical diagnostic reports, the display device including a display, a graphics processing unit and a memory to display three or more projection images including;

a) inputting a patient ID;

b) identifying a Study of the plurality of medical diagnostic reports corresponding to the patient ID based on one or more Study Selection Rules;

c) receiving at least three projection images generated at three or more viewing directions from a volumetric image reconstructed from the Study based on one or more Protocol Selection Rules and one or more Image Set Rules,

d) selecting three or more images from the at least three projection images; and

e) displaying the three or more images on the display.

11. The method of claim 10, where in step d) one or more Protocol Selection Rules are used to select a viewing direction that identifies:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification includes two or more microcalcifications;

iv) an obstruction includes a microcalcification and an obstruction;

v) an obstruction includes two or more obstructions;

vi) a microcalcification using direct comparison; and

vii) an obstruction using direct comparison.

12. The method of claim 10, where in step d) one or more Protocol Selection Rules are used to select a viewing direction that improves:

i) identification of an image;

ii) comparison of an image;

iii) identification of a microcalcification;

iv) identification of an obstruction;

v) resolution of two microcalcifications;

vi) resolution of a microcalcification and an obstruction;

vii) resolution of two obstructions;

viii) direct comparison with a first image and a second image;

ix) direct comparison of a microcalcification; and

x) direct comparison of an obstruction.

13. The method of claim 10, where the Study is a Digital Breast Tomosynthesis scan.

14. The method of claim 10, where the three or more images are displayed sequentially as a video.

15. The method of claim 14, where the video displays a dynamic comparison.

16. The method of claim 10, where the viewing directions are selected according to a periodic continuous mathematical function.

17. The method of claim 16, where the three or more images are generated from viewing directions spanning one period of the periodic continuous mathematical function.

18. The method of claim 10, further comprising storing the three or more images.

19. A method comprising:

providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports;

the server;

a) receiving a patient ID from a remote computer from the one or more remote computers

b) executing a render server program which applies;

one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports; and

one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports;

c) applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study;

d) defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols;

e) generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols;

f) selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images;

g) applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study;

h) using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images; and

i) sending the first Set of Images and the second Set of Images to the remote computer.

20. The method of claim 19, further comprising applying one or more Protocol Selection Rules to display the first Set of Images sequentially as a video.