METHODS AND SYSTEMS FOR MODEL DRIVEN MULTI-MODAL MEDICAL IMAGING

• US 20180260950A1
• Filed: 03/10/2017
• Published: 09/13/2018
• Est. Priority Date: 03/10/2017
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Samset, Eigil, Gerard, Olivier, Langeland, Stian
• Granted Patent: US 10,402,969 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/10088 Magnetic resonance imaging [MRI]
• CPC Class Codes: G06T 2207/10104 Positron emission tomography [PET]
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/10132 Ultrasound image
• CPC Class Codes: G06T 2207/20084 Artificial neural networks [ANN]
• CPC Class Codes: G06T 2207/30008 Bone
• CPC Class Codes: G06T 2207/30016 Brain
• CPC Class Codes: G06T 2207/30048 Heart; Cardiac
• CPC Class Codes: G06T 2207/30056 Liver; Hepatic
• CPC Class Codes: G06T 2207/30084 Kidney; Renal
• CPC Class Codes: G06T 2211/464 Dual or multimodal imaging, i.e. combining two or more imaging modalities
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/344 involving models

Abstract

Systems and methods are provided for a visualization of a multi-modal medical image for diagnostic medical imaging. The systems and methods receive first and second image data sets of an anatomical structure of interest, register the first and second image data sets to a geometrical model of the anatomical structure of interest to form a registered image. The geometrical model includes a location of an anatomical marker. The systems and methods further display the registered image.

Claims

1. A method for multi-modal imaging, the method comprising:

receiving first and second image data sets of an anatomical structure of interest;

registering the first and second image data sets to a geometrical model of the anatomical structure of interest to form a registered image, wherein the geometrical model includes a location of an anatomical marker; and

displaying the registered image.

2. The method for multi-modal imaging of claim 1, wherein the registering operation further includes identifying an anatomical marker of the first and second image data sets, and assigning a coordinate to the anatomical marker based on a parametric coordinate system defined by the geometrical model.

3. The method for multi-modal imaging of claim 1, further comprising displaying the first and second image data sets with the registered image.

4. The method for multi-modal imaging of claim 3, further comprising overlaying reference markers on the registered image and the first and second image data sets, and adjusting positions of the reference markers based on user selections.

5. The method for multi-modal imaging of claim 1, further comprising receiving a field of view of the anatomical structure of interest from a user interface, wherein the registered image corresponds to the field of view.

6. The method for multi-modal imaging of claim 5, further comprising displaying a view marker on a visualization, wherein the view marker represents the field of view with respect to the visualization.

7. The method for multi-modal imaging of claim 1, further comprising overlaying first and second boundaries on the registered image, wherein the first boundary is based on the first image data set and the second boundary is based on the second image data set.

8. The method for multi-modal imaging of claim 1, wherein the first image data set is associated with ultrasound imaging data.

9. The method for multi-modal imaging of claim 1, wherein the second image data set is associated with a radiological image data.

10. A multi-modal imaging system comprising:

a display;

a memory configured to store first and second image data sets and a geometrical model, wherein the geometrical model includes a location of an anatomical marker of an anatomical structure of interest;

one or more processors configured to execute the programmed instructions stored in the memory, wherein the one or more processors when executing the programmed instructions perform the following operations;

receive the first and second image data sets of an anatomical structure of interest;

register the first and second image data sets to the geometrical model of the anatomical structure of interest to form a registered image; and

display the registered image on the display.

11. The multi-modal imaging system of claim 10, wherein the one or more processors are further configured to perform the following operations of identifying an anatomical marker of the first and second image data sets, and assigning a coordinate to the anatomical marker based on a parametric coordinate system defined by the geometrical model.

12. The multi-modal imaging system of claim 10, wherein the one or more processors are further configured to perform the following operation of displaying the first and second image data sets with the registered image.

13. The multi-modal imaging system of claim 12, further comprising a user interface operably coupled to the one or more processors, wherein the one or more processors are further configured to perform the following operations of overlaying reference markers on the registered image and the first and second image data sets, and adjusting positions of the reference markers based on user selections received from the user interface.

14. The multi-modal imaging system of claim 10, further comprising a user interface operably coupled to the one or more processors, wherein the one or more processors are further configured to perform the following operation of receiving a field of view of the anatomical structure of interest from the user interface, wherein the registered image corresponds to the field of view.

15. The multi-modal imaging system of claim 14, wherein the one or more processors are further configured to perform the following operation of displaying a view marker on a visualization, wherein the view marker represents the field of view with respect to the visualization.

16. The multi-modal imaging system of claim 10, wherein the one or more processors are further configured to perform the following operation of overlaying first and second boundaries on the registered image, wherein the first boundary is based on the first image data set and the second boundary is based on the second image data set.

17. The multi-modal imaging system of claim 10, wherein the first image data set is associated with ultrasound imaging data.

18. The multi-modal imaging system of claim 10, wherein the second image data set is associated with a radiological image data.

19. A tangible and non-transitory computer readable medium comprising one or more computer software modules configured to direct one or more processors to:

receive first and second image data sets of an anatomical structure of interest, wherein the first image data set is associated with ultrasound imaging data and the second image data set is associated with a radiological image data;

register the first and second image data sets to a geometrical model of the anatomical structure of interest to form a registered image, wherein the geometrical model includes a location of an anatomical marker; and

display the registered image.

20. The tangible and non-transitory computer readable medium of claim 19, wherein the one or more processors are further directed to:

identify an anatomical marker of the first and second image data sets; and

assign a coordinate to the anatomical marker based on a parametric coordinate system defined by the geometrical model.