Apparatus and system for rule based visualization of digital breast tomosynthesis and other volumetric images

• US 10,631,812 B2
• Filed: 07/30/2018
• Issued: 04/28/2020
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US16/049,801
• Publication Number:
  US 20180344279A1
• Time in Patent Office: 638 Days
• CPC Class Codes: A61B 6/025 Tomosynthesis
• CPC Class Codes: A61B 6/027 characterised by the use of a particular data acquisition trajectory, e.g. helical or spiral
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/465 adapted to display user selection data, e.g. graphical user interface, icons or menus
• CPC Class Codes: A61B 6/502 for diagnosis of breast, i.e. mammography
• CPC Class Codes: A61B 6/5223 generating planar views from image data, e.g. extracting a coronal view from a 3D image
• CPC Class Codes: A61B 6/563 involving image data transmission via a network
• CPC Class Codes: G06T 11/003 Reconstruction from projections, e.g. tomography
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2211/412 Dynamic
• CPC Class Codes: G06T 2211/436 Limited angle
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

The invention provides, in some aspects, a system for implementing a rule derived basis to display volumetric image sets. In various embodiments of the invention, the selection of the images to be displayed, the generation of the 3-D volumetric image from measured 2-D images including the rendering parameters and styles, the choice of viewing directions and 2-D projection images based on the viewing directions, the layout of the projection images, and the formation of a video can be determined using a rule derived basis. In an embodiment of the present invention, the user is presented with sequential images making up a video displayed based on their preferences without having to first manually adjust parameters. The present invention allows for novel ways of viewing such images to detect microcalcifications and obstructions when reviewing Digital Breast Tomosynthesis and other volumetric mammography images.

Claims

1. A method comprising:

a) receiving a primary Study of a patient from a remote computer; and

b) executing a render server program which;

I) applies one or more Study Selection Rules based on the patient to select a Study of the patient, where the Study can be used to construct a volumetric image of an anatomical region of the patient;

II) constructs the volumetric image of the anatomical region of step I);

III) defines at least three viewing directions to generate at least three projection images from the volumetric image constructed in step II) based on one or more Protocol Selection Rules; and

IV) displays a video using the at least three projection images generated in step III) based on one or more Display Protocols.

2. The method of claim 1, where in step III) the one or more Protocol Selection Rules are used to select a viewing direction that identifies:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification that includes two or more microcalcifications;

iv) an obstruction that includes a microcalcification and an obstruction;

v) an obstruction that includes two or more obstructions;

vi) a microcalcification using direct comparison; and

vii) an obstruction using direct comparison.

3. The method of claim 1, where in step III) one or more Protocol Selection Rules are used to select a viewing direction that improves:

i) identification of a projection image;

ii) comparison of a projection image;

iii) identification of a microcalcification;

iv) identification of an obstruction;

v) resolution of two microcalcifications;

vi) resolution of a microcalcification and an obstruction;

vii) resolution of two obstructions;

viii) direct comparison with a first projection image and a second projection image;

ix) direct comparison of a microcalcification; and

x) direct comparison of an obstruction.

4. The method of claim 1, where the Study is a Digital Breast Tomosynthesis scan.

5. The method of claim 1, where the video displays a dynamic comparison.

6. The method of claim 1, where the video displays a direct comparison.

7. The method of claim 1, where the at least three viewing directions are selected according to a periodic continuous mathematical function.

8. The method of claim 7, where the three or more images are generated from viewing directions spanning one period of the periodic continuous mathematical function.

9. The method of claim 1, further comprising storing the video.

10. A method comprising:

a) receiving a Study of a patient from a remote computer, where the Study can be used to construct a volumetric image of an anatomical region of the patient;

b) constructing the volumetric image of the anatomical region;

c) defining at least three viewing directions to generate at least three projection images from the volumetric image based on one or more Protocol Selection Rules;

d) generating a video using the at least three projection images based on one or more Display Protocols; and

e) displaying the video.

11. The method of claim 10, where in step c) the one or more Protocol Selection Rules are used to select a viewing direction that identifies:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification that includes two or more microcalcifications;

iv) an obstruction that includes a microcalcification and an obstruction;

v) an obstruction that includes two or more obstructions;

vi) a microcalcification using direct comparison; and

vii) an obstruction using direct comparison.

12. The method of claim 10, where in step c) one or more Protocol Selection Rules are used to select a viewing direction that improves:

i) identification of a projection image;

ii) comparison of a projection image;

iii) identification of a microcalcification;

iv) identification of an obstruction;

v) resolution of two microcalcifications;

vi) resolution of a microcalcification and an obstruction;

vii) resolution of two obstructions;

viii) direct comparison with a first projection image and a second projection image;

ix) direct comparison of a microcalcification; and

x) direct comparison of an obstruction.

13. The method of claim 10, where the Study is a Digital Breast Tomosynthesis scan.

14. The method of claim 10, where the video displays a dynamic comparison.

15. The method of claim 10, where the video displays a direct comparison.

16. The method of claim 10, where the at least three viewing directions are selected according to a periodic continuous mathematical function.

17. The method of claim 16, where the three or more images are generated from viewing directions spanning one period of the periodic continuous mathematical function.

18. The method of claim 16, further comprising storing the video.

19. A method comprising:

a) receiving a primary Study of a patient from a remote computer; and

b) executing a render server program which;

I) applies one or more Study Selection Rules based on the patient to select a Study of the patient, where the Study can be used to construct a volumetric image of an anatomical region of the patient;

II) constructs the volumetric image of the anatomical region;

III) defines at least three viewing directions to generate at least three projection images from the volumetric image based on one or more Protocol Selection Rules;

IV) generates a video based on the at least three projection images; and

V) displays the video.

20. The method of claim 19, where in step III) the one or more Protocol Selection Rules are used to select a viewing direction that identifies:

i) a microcalcification;

ii) an obstruction;

iii) a microcalcification that includes two or more microcalcifications;

iv) an obstruction that includes a microcalcification and an obstruction;

v) an obstruction that includes two or more obstructions;

vi) a microcalcification using direct comparison; and

vii) an obstruction using direct comparison.