Image processing device for matching images of a same portion of a body obtained by magnetic resonance and ultrasounds

• US 8,755,581 B2
• Filed: 03/25/2008
• Issued: 06/17/2014
• Est. Priority Date: 04/02/2007
• Status: Expired due to Fees

• Current Assignee: Inria Institut National de Recherche EN Informatique et EN Automatique
• Original Assignee: Inria Institut National de Recherche EN Informatique et EN Automatique
• Inventors: Coupe, Pierrick, Barillot, Christian, Morandi, Xavier, Hellier, Pierre
• Primary Examiner(s): Kao, Glen
• Application Number:
  US12/594,572
• Publication Number:
  US 20100119135A1
• Time in Patent Office: 2,275 Days
• Field of Search: 324306-309, 382/131, 382/132, 382/276, 382/294
• US Class Current: 382/131
• CPC Class Codes: G06T 2207/10088 Magnetic resonance imaging [MRI]
• CPC Class Codes: G06T 2207/10136 3D ultrasound image
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/30016 Brain
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06T 7/35 using statistical methods
• CPC Class Codes: G06T 7/38 Registration of image sequences
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image

Abstract

A device for processing of data including images of a portion of a body includes processing means capable of processing first data representative of elementary portions of an image obtained by magnetic resonance in a region of the body and second data representative of elementary portions of images obtained by ultrasounds in a portion of that region, by performing: i) generating first and second maps of the probability that the elementary portions belong to structures of interest of the portion of the region based at least on the intensities associated thereto and respectively defined by the first and second data; ii) estimating a conversion for shifting from one of the first and second maps to the other while maximizing for each of their elementary portion the joined probability that it belongs to a same structure of interest; and iii) resetting the structures of interest of one of the first and second maps relative to those of the other by the conversion.

Claims

1. A device for processing data that constitute images of a portion or portions of a body comprising:

processing means for processing first data representative of elementary parts of an image or images obtained by magnetic resonance in a region of a body and second data representative of elementary parts of an image or images obtained by ultrasound in a portion of said region, said processing means configured to

i) construct first and second maps of a probability of the elementary parts belonging to structures of interest in said portion of the region, as a function of at least intensities associated therewith and defined by the first and second data, respectively,

ii) estimate a transformation which makes it possible to move from one of said first and second maps to the other, while maximising, for each of the elementary parts, a joint probability that said each elementary part belongs to the same structure of interest, and

iii) register the structures of interest of one of the first and second maps relative to the structures of interest of the other map, by said transformation.

2. The device according to claim 1, wherein said processing means are arranged to maximise, for each elementary part, a joint probability which is a function of the product of the probability that said each elementary part belongs to a structure of interest of the magnetic resonance image(s) by the product of the probability that said each elementary part belongs to a structure of interest of the corresponding ultrasound image(s).

3. The device according to claim 2, wherein in the presence of two-dimensional ultrasound images, said processing means re arranged to construct said second map by constituting second data which define a three-dimensional ultrasound image from the second data defining said two-dimensional ultrasound images, then transforming the intensity of each elementary part of said three-dimensional ultrasound image into a probability of being part of a structure of interest between 0 and 1, and, wherein said processing means are further arranged to determine, for each elementary part of said second map, a probability of belonging to a structure of interest equal to the ratio between an intensity of said each elementary part and 2ⁿ, where n is equal to the number of bits of the ultrasound image(s).

4. The device according to claim 1, wherein in the presence of two-dimensional ultrasound images, said processing means are arranged to construct said second map by constituting second data which define a three-dimensional ultrasound image from the second data defining said two-dimensional ultrasound images, then transforming the intensity of each elementary part of said three-dimensional ultrasound image into a probability of being part of a structure of interest between 0 and 1.

5. The device according to claim 1, wherein in the presence of a three-dimensional magnetic resonance image representing a region including the portion represented by said second data, said processing means are arranged to construct a first intermediate map, while determining for each elementary part of said three-dimensional magnetic resonance image a local mean curvature of an intensity value, then constructing said first map from the local mean curvatures of said first intermediate map and auxiliary data relating to said region of the body.

6. The device according to claim 5, wherein said processing means are arranged so as to extract from said first intermediate map the part that corresponds to the portion of region that is represented by said second map, as a function of positional data obtained by means of navigation equipment.

7. The device according to claim 5, wherein said probability of belonging to a structure of interest is equal to a ratio between the local mean curvature of an elementary part of said first intermediate map and 2ⁿ, if it belongs to a healthy zone and if the local mean curvature is positive, n being equal to the number of bits in the three-dimensional magnetic resonance image, or to a parameter constituting auxiliary data attributed to the corresponding elementary part of the three-dimensional magnetic resonance image, subsequent to the determination of the positional data, if it belongs to a pathological zone, or to zero in every other case.

8. The device according to claim 1, wherein said processing means are arranged so as to maximise the joint probability by means of an optimising function that does not involve calculation of the partial derivatives of the objective matching function.

9. The device according to claim 1, wherein said processing means are arranged to estimate a rigid registration transformation.

10. The device according to claim 1, wherein said processing means are arranged to estimate a non-rigid registration transformation.

11. The device according to claim 1, wherein said processing means are arranged to construct first and second maps of a probability of belonging to a hyper-echo genic structures of interest.

12. The device according to claim 1, wherein said processing means are arranged to construct first and second maps of a probability of belonging to a hypo-echo genic structures of interest.

13. The device according to claim 1, being used for processing images of body and for being subjected to image assisted neurosurgical operations.