Device and Process for Multimodal Registration of Images

• US 20080107312A1
• Filed: 02/04/2005
• Published: 05/08/2008
• Est. Priority Date: 02/20/2004
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.), Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Von Berg, Jens
• Granted Patent: US 8,145,012 B2
• Time in Patent Office: Days
• US Class Current: 382/128
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/10132 Ultrasound image
• CPC Class Codes: G06T 2207/30016 Brain
• CPC Class Codes: G06T 3/4061 by injecting details from different spectral ranges
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: Y10S 128/922 including image analysis

Abstract

The invention relates to a device and a process, with which images of different imaging methods can be registered, for example preoperatively obtained 3D X-ray images (A) and intra operatively obtained ultrasound images (B). First transformed images (A′,B′) are then generated in a data processing device (10), which are aligned to each other with regard to the peculiarities of each imaging method. Particularly from the three dimensional CT-image (A), can be generated a two dimensional image (A′) which adheres to the characteristic means of representation of an ultrasound system, while shaded areas behind bones and/or gas-filled volumes can be blended out. With a feature-based registration of the transformed images (A′, B′) errors are avoided, which are traced back to artifacts and peculiarities of the respective imaging methods.

Claims

1. A data processing device for registration of a first image of an object, which first image was obtained with a first imaging method, having a second image of the object, which second image was obtained with a second imaging method different from the first imaging method, wherein the data processing device is equipped for executing the following steps:

a) Generating a first transformed image from the first image, in which characteristic image features of the first imaging method are reduced and/or characteristic image features of the second imaging method are intensified;

b) Generating a second transformed image from the second imaged, in which, optionally characteristic image features of the second imaging method are reduced and optionally, characteristic image features of the first imaging method are intensified;

c) Registration of the transformed images.

2. A data processing device as claimed in claim 1, wherein the imaging methods comprise the application of different modalities, wherein one of the modalities is a computer tomography, an X-ray projection, a magnetic resonance imaging method, an ultrasound method, an X-ray fluoroscopy or a CT-fluoroscopy and wherein the image obtained thereby is two dimensional or three dimensional.

3. A data processing device as claimed in claim 1, wherein the imaging methods were generated with the same modality with different imaging conditions.

4. A data processing device as claimed in claim 1, which is arranged for executing a feature-based registration of the transformed images.

5. A data processing device as claimed in claim 1, which is arranged for segmenting object areas with different material composition in at least one of the images.

6. A data processing device as claimed in claim 1, which is arranged for masking areas of the transformed images, in which at least one of the imaging methods does not supply reliable information.

7. A data processing device as claimed in claim 1, which is arranged for considering the positions measured with the help of a position-measuring apparatus and/or a calibration of the images during the registration.

8. A data processing device as claimed in claim 1, which is arranged for using the flexible registration method.

9. A process for registration of a first image of an object, which first image was obtained with a first imaging method, with a second image of the object, which second image was obtained with the second imaging method, different from the first imaging method, comprising the following steps:

a) Generating of a first trans formed image from the first image, in which characteristic image features of the first imaging method are reduced and/or characteristic image features of the second imaging method are intensified;

b) Generating of a second transformed image from the second image, in which optionally characteristic image features of the second imaging method are reduced and optionally characteristic image features of the first imaging method are intensified;

c) Registration of the transformed images.

10. A process as claimed in claim 9, wherein, the steps a), b) and c) are repeated many times with variation of at least one of the transformed images, in order to maximize a degree of similarity between the transformed images.