Coordinate transformation of graphical objects registered to a magnetic resonance image

• US 10,272,270 B2
• Filed: 03/28/2013
• Issued: 04/30/2019
• Est. Priority Date: 04/12/2012
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Vahala, Erkki Tapani
• Primary Examiner(s): Nguyen, Hien N
• Application Number:
  US14/391,183
• Publication Number:
  US 20150051517A1
• Time in Patent Office: 2,224 Days
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/374 NMR or MRI
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61N 2007/0052 using the same transducer for therapy and imaging
• CPC Class Codes: A61N 5/1039 using functional images, e.g. PET or MRI
• CPC Class Codes: A61N 7/00 Ultrasound therapy lithotripsy A61B17/22, A61B17/225; massage using supersonic vibration A61H23/00 ; using ultrasound for introducing media into the body A61M37/0092
• CPC Class Codes: A61N 7/02 Localised ultrasound hyperthermia hyperthermia in general A61F7/00
• CPC Class Codes: G01R 33/4814 MR combined with ultrasound
• CPC Class Codes: G06T 11/003 Reconstruction from projections, e.g. tomography

Abstract

A method of using a medical instrument (300, 400) comprising a magnetic resonance imaging (MRI) system (302). The MRI system acquires (100, 202) first magnetic resonance data (342) and reconstructs (102, 204) a first magnetic resonance image (344, 502). A registration (352) of multiple graphical objects (346, 510, 512) to the first magnetic resonance image is received which defines spatial positions of the multiple graphical objects in the first magnetic resonance image. The method further comprises repeatedly: acquiring (106, 210) second magnetic resonance data (354); reconstructing (108, 212) a second magnetic resonance image (356, 502′); receiving (110, 214) repositioning coordinates (358, 700) in the second magnetic resonance image for a first group (348, 510) selected from the multiple graphical objects; and determining (112, 216) a coordinate transformation (359, 702) of a second group (350, 512) selected from the multiple graphical objects by applying a coordinate transformation model (364) to the repositioning coordinates.

Claims

1. A medical instrument comprising:

a magnetic resonance imaging system and;

an ultrasound system with an adjustable focus,

a processor for controlling the medical instrument; and

a memory containing machine readable instructions for execution by the processor;

wherein execution of the instructions causes the processor to

acquire first magnetic resonance data with the magnetic resonance imaging system,

reconstruct a first magnetic resonance image using the first magnetic resonance data,

wherein a treatment plan is formed from the first magnetic resonance image, the treatment plan controlling the ultrasound system

wherein the formation of the treatment plan includes identification of one or more graphical objects in the first magnetic resonance image,

wherein execution of the instructions further causes the processor to

receive a registration of the one or more graphical objects to the first magnetic resonance image, wherein the registration defines spatial positions of the one or more graphical objects with respect to the first magnetic resonance image, and

wherein execution of the instructions further causes the processor to repeatedly;

acquire second magnetic resonance data using the magnetic resonance imaging system;

reconstruct a second magnetic resonance image using the second magnetic resonance data;

receive repositioning coordinates in the second magnetic resonance image for a first group of graphical objects selected from the one or more graphical objects, wherein the repositioning coordinates describe a repositioning of the first group of graphical objects in the second magnetic resonance image with respect to the first magnetic resonance image; and

determine a coordinate transformation of a second group of graphical objects selected from the one or more graphical objects by applying a coordinate transformation model to the repositioning coordinates and

wherein execution of the instructions further causes the processor to repeatedly modify the treatment plan using the repositioning coordinates and the coordinate transformation, and

control the ultrasound system in accordance with the modified treatment plan.

2. The medical instrument of claim 1, wherein the ultrasound system has an adjustable ultrasound intensity, wherein execution of the instructions further causes the processor to perform a sonication before acquisition of the first magnetic resonance data, wherein execution of the instructions causes the processor to check the registration using the first magnetic resonance image.

3. The medical instrument of claim 1, wherein the coordinate transformation model is a deformable shape model.

4. The medical instrument of claim 1, wherein each of the one or more graphical objects has a tag, wherein the coordinate transformation of the second group of graphical objects is determined at least partially using the tag of each of the graphical objects of the second group.

5. The medical instrument of claim 1, wherein the one or more graphical objects are any one of the following:

treatment cells, regions of interest, planned target volumes, and combinations thereof.

6. The medical instrument of claim 1, wherein the memory further contains an image segmentation module containing machine readable instructions for execution by the processor for segmenting the second magnetic resonance image to determine the repositioning coordinates, and wherein execution of the instructions further causes the processor to receive the repositioning coordinates from the segmentation module.

7. The medical instrument of claim 1, wherein execution of the instructions further causes the processor to repeatedly display the second magnetic resonance image on a display, and wherein the repositioning coordinates are received from a user interface in response to displaying the second magnetic resonance data.

8. The medical instrument of claim 7, wherein execution of the instructions further causes the processor to display the first magnetic resonance image on the display, and wherein the registration is received from the user interface in response to displaying the first magnetic resonance data.

9. A non-transitory computer-readable medium storing instructions that when executed by a processor cause the processor to execute a method of controlling a medical instrument, wherein the medical instrument comprises a magnetic resonance imaging system for acquiring magnetic resonance data from an imaging zone, and a ultrasound system with an adjustable focus, the method comprising:

acquiring first magnetic resonance data from the magnetic resonance imaging system;

constructing a first magnetic resonance image using the first magnetic resonance data;

forming, from the first magnetic resonance image, a treatment plan for controlling the ultrasound system, the treatment plan including identification of one or more graphical objects in the first magnetic resonance image;

receiving a registration of the one or more graphical objects to the first magnetic resonance image, wherein the registration defines spatial positions of the one or more graphical objects with respect to the first magnetic resonance image; and

after the acquiring, constructing, forming and receiving step repeating multiple times the steps of;

acquiring second magnetic resonance data using the magnetic resonance imaging system;

constructing a second magnetic resonance image using the second magnetic resonance data;

receiving repositioning coordinates in the second magnetic resonance image for a first group of graphical objects selected from the one or more graphical objects, wherein the repositioning coordinates describe a repositioning of the first group of graphical objects in the second magnetic resonance image with respect to the first magnetic resonance image;

determining a coordinate transformation of a second group of graphical objects selected from the one or more graphical objects by applying a coordinate transformation model to the repositioning coordinates;

modifying the treatment plan using the repositioning coordinates and the coordinate transformation; and

controlling the ultrasound system in accordance with the modified treatment plan.

10. A method, executed by a processor, of controlling a medical instrument, wherein the medical instrument comprises a magnetic resonance imaging system, and a ultrasound system with an adjustable focus, the method comprising:

acquiring first magnetic resonance data from the magnetic resonance imaging system;

constructing a first magnetic resonance image using the first magnetic resonance data;

forming, from the first magnetic resonance image, a treatment plan for controlling the ultrasound system, the treatment plan including identification of one or more graphical objects in the first magnetic resonance image;

receiving a registration of the one or more graphical objects to the first magnetic resonance image, wherein the registration defines spatial positions of the one or more graphical objects with respect to the first magnetic resonance image;

repeatedly acquiring second magnetic resonance data using the magnetic resonance imaging system;

repeatedly constructing a second magnetic resonance image using the second magnetic resonance data;

repeatedly receiving repositioning coordinates in the second magnetic resonance image for a first group of graphical objects selected from the one or more graphical objects, wherein the repositioning coordinates describe a repositioning of the first group of graphical objects in the second magnetic resonance image with respect to the first magnetic resonance image;

repeatedly determining a coordinate transformation of a second group of graphical objects selected from the one or more graphical objects by applying a coordinate transformation model to the repositioning coordinates;

repeatedly modifying the treatment plan using the repositioning coordinates and the coordinate transformation; and

repeatedly controlling the ultrasound system in accordance with the modified treatment plan.

11. The method of claim 10, wherein the coordinate transformation model is a deformable shape model.

12. The method of claim 10, wherein each of the one or more graphical objects has a tag and the coordinate transformation of the second group of graphical objects is determined at least partially using the tag of each graphical object of the second group.

13. The method of claim 10, wherein the one or more graphical objects are any one of the following:

treatment cells, regions of interest, planned target volumes, and combinations thereof.

14. The method of claim 10, further comprising:

repeatedly displaying the second magnetic resonance image on a display; and

receiving the repositioning coordinates from a user interface in response to displaying the second magnetic resonance data.

15. The method of claim 10, further comprising:

displaying the first magnetic resonance image on a display; and

receiving the registration from the user interface in response to displaying the first magnetic resonance data.