Device and process for multimodal registration of images

• US 8,145,012 B2
• Filed: 02/04/2005
• Issued: 03/27/2012
• Est. Priority Date: 02/20/2004
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: MEETZ, Kirsten, Schulz, Heinrich, Berg, Jens, Sabczynski, Joerg
• Primary Examiner(s): Lu, Tom Y
• Assistant Examiner(s): CONWAY, THOMAS A
• Application Number:
  US10/598,005
• Publication Number:
  US 20080107312A1
• Time in Patent Office: 2,608 Days
• Field of Search: None
• US Class Current: 382/294
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/10132 Ultrasound image
• CPC Class Codes: G06T 2207/30016 Brain
• CPC Class Codes: G06T 3/4061 by injecting details from different spectral ranges
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: Y10S 128/922 including image analysis

Abstract

The invention relates to a device and a process, with which images of different imaging methods can be registered, for example preoperatively obtained 3D X-ray images (A) and intra operatively obtained ultrasound images (B). First transformed images (A′,B′) are then generated in a data processing device (10), which are aligned to each other with regard to the peculiarities of each imaging method. Particularly from the three dimensional CT-image (A), can be generated a two dimensional image (A′) which adheres to the characteristic means of representation of an ultrasound system, while shaded areas behind bones and/or gas-filled volumes can be blended out. With a feature-based registration of the transformed images (A′, B′) errors are avoided, which are traced back to artifacts and peculiarities of the respective imaging methods.

Claims

1. A data processing device for registration of a first image of an object, which first image was obtained with a first imaging method having a second image of the object, which second image was obtained with a second imaging method different from the first imaging method, wherein the data processing device is equipped for executing the following steps:

a) generating a first transformed image from the first image, in which characteristic image features of the first imaging method are reduced or characteristic image features of the second imaging method are intensified, where the first transformed image and the first image are different images;

b) generating a second transformed image from the second image, in which, optionally characteristic image features of the second imaging method are reduced and optionally, characteristic image features of the first imaging method are intensified, where the second transformed image and the second image are different images, where areas of at least one of the transformed images are masked and where at least one of the imaging methods does not supply reliable information; and

c) registering the transformed images.

2. A data processing device as claimed in claim 1, wherein the imaging methods comprise the application of different modalities, wherein one of the modalities is a computer tomography, an X-ray projection, a magnetic resonance imaging method, an ultrasound method, an X-ray fluoroscopy or a CT-fluoroscopy and wherein the image obtained thereby is two dimensional or three dimensional.

3. A data processing device as claimed in claim 1, wherein the imaging methods were generated with the same modality with different imaging conditions.

4. A data processing device as claimed in claim 1, which is arranged for executing a feature-based registration of the transformed images.

5. A data processing device as claimed in claim 1, which is arranged for segmenting object areas with different material composition in at least one of the images.

6. A data processing device as claimed in claim 1, which is arranged for considering positions measured with the help of a position-measuring apparatus or a calibration of the images during the registration.

7. A data processing device as claimed in claim 1, being equipped for executing the following steps:

generating a first transformed image from the first image, in which characteristic image features of the first imaging method are reduced; and

generating a second transformed image from the second image, in which characteristic image features of the second imaging method are reduced.

8. A data processing device as claimed in claim 1, being equipped for executing the following steps:

generating a first transformed image from the first image, in which characteristic image features of the first imaging method are reduced; and

generating a second transformed image from the second image, in which, characteristic image features of the first imaging method are intensified.

9. A data processing device as claimed in claim 1, being equipped for executing the following steps:

generating a first transformed image from the first image, in which characteristic image features of the second imaging method are intensified; and

generating a second transformed image from the second image, in which, characteristic image features of the second imaging method are reduced.

10. A data processing device as claimed in claim 1, being equipped for executing the following steps:

generating a first transformed image from the first image, in which characteristic image features of the second imaging method are intensified; and

generating a second transformed image from the second image, in which characteristic image features of the first imaging method are intensified.

11. A data processing device as claimed in claim 1, where the first transformed image is an image type consistent with output of the first imaging method and where the second transformed image is an image type consistent with output of the second imaging method.

12. A data processing device as claimed in claim 1, where an output from registering the transformed images is configured for use during a surgical operation.

13. A data processing device as claimed in claim 1, where the first imaging method is an ultrasound imaging method and where the second imaging method is a Computer Tomography imaging method or a Magnetic Resonance imaging method.

14. A data processing device as claimed in claim 1, where an imaging method that does supply reliable information is an imaging method not performed in real time and where an imaging method that does not supply reliable information is an imaging method performed in real time.

15. A data processing device as claimed in claim 14, where the first imaging method is not performed in real time and where the second imaging method is performed in real time.

16. A data processing device as claimed in claim 1, which is arranged for using a flexible registration method.

17. A data processing device as claimed in claim 16, where the flexible registration method considers effects of deformation of a tissue of the object or considers an organ shift of an organ of the object.

18. A method, comprising:

generating a first transformed image from a first image obtained from a first imaging method;

generating a second transformed image from a second image obtained for a second imaging method, where characteristic image features of the first imaging method are reduced in the first transformed image or characteristic image features of the second imaging method are intensified in the first transformed image, where characteristic image features of the second imaging method are reduced in the second transformed image or characteristic image features of the first imaging method are intensified in the second transformed image, where the first transformed image and the first image are different images, where the second transformed image and the second image are different images, and where the first imaging method and the second imaging method are different imaging methods; and

registering the first transformed image and the second transformed image.

19. A method as claimed in claim 18, wherein generating the first transformed image, generating the second transformed image, and registering the first transformed image and the second transformed image are repeated at least a second time with variation of at least one of the transformed images, in order to maximize a degree of similarity between the transformed images.