Elastic image registration functionality

• US 7,792,343 B2
• Filed: 11/04/2005
• Issued: 09/07/2010
• Est. Priority Date: 11/17/2004
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Pekar, Vladimir
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): Krasnic; Bernard
• Application Number:
  US11/719,406
• Publication Number:
  US 20080273779A1
• Time in Patent Office: 1,768 Days
• Field of Search: 382/128, 382/131, 382/173, 382/294
• US Class Current: 382/128
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 3/153 using elastic snapping
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration

Abstract

A current diagnostic image (A) and an archived diagnostic image (B) of a common region of a patient are loaded into a first memory and a second memory. The first and second diagnostic images (A, B) are automatically aligned and registered with one another. Three 2D orthogonal views through a selected crossing point in the current image (A) are concurrently displayed along with the same three orthogonal views through the corresponding crossing point in the archived image (B) on a display. A user manually corrects alignment in the first and second sets of slices that are currently displayed on the display using local tools.

Claims

1. An apparatus for manipulating diagnostic images, including:

a first memory which supplies a first 3D diagnostic image;

a second memory which supplies a second 3D diagnostic image;

a registration routine which automatically registers the first and second diagnostic 3D images from the first and second image memories;

a display unit which concurrently displays a spatially corresponding pair of 2D slices from the first 3D diagnostic image and the registered 3D diagnostic image;

manual tools which are employed by a user to generate 3D deformation parameters which deform one or more surfaces of the registered 2D slice images to bring them into closer correspondence; and

an image reformatting routine which (1) reformats only the concurrently displayed 2D slices of the registered 3D images in accordance with the deformation parameters, (2) controls the display to display the reformatted 2D slice images in real time, and (3) saves the deformation parameters for use in reformatting other slices of the 3D images.

2. The apparatus as set forth in claim 1, further including:

a segmentation unit which segments at least a surface of at least one corresponding region of interest (ROI) in both diagnostic 3D images, the manual tools deforming portions of the segmented surface which appear in the displayed 2D slice.

3. The apparatus as set forth in claim 1, further including:

as a user steps through the first and second 3D registered images correspondingly to display different 2D slices,

the image reformatting routine reformats each currently displayed different 2D slice in real time in accordance with manual transformation parameters generated during deformation of nearby 2D slices.

4. The apparatus as set forth in claim 1, wherein the registration routine includes:

an affine transformation unit which determines an affine transform representative of misalignment between the first and second 3D diagnostic images and operating on one of the first and second 3D diagnostic images in accordance with the determined affine transform to register the first and second images.

5. The apparatus as set forth in claim 4, wherein the registration routine further includes:

an elastic transformation unit which determines an elastic transform representative of misalignment between the first and second 3D diagnostic images and operating on one of the first and second 3D diagnostic images in accordance with the determined elastic transform.

6. The apparatus as set forth in claim 1, wherein the plurality of manual tools include:

a pull tool which deforms a portion of the surface in the registered 2D slice by pulling the portion along a predefined smooth curve; and

a push tool which deforms a portion of the surface in the registered 2D slice by pushing a predefined smooth curve against the portion.

7. The apparatus as set forth in claim 6, wherein the predefined smooth curve is one of a Gaussian, a sphere, or an ellipse.

8. The apparatus as set forth in claim 1, wherein an input device which includes at least one of a keyboard and a mouse controls the manual tools.

9. A diagnostic imaging system, including:

the apparatus for manipulating diagnostic images as set forth in claim 1;

a diagnostic imager connected with the first memory which acquires the first 3D diagnostic image and transfers the acquired image to the first memory; and

an image archive from which the second 3D diagnostic image, taken at an earlier time, is transferred to the second memory , the second 3D diagnostic image being a 3D segmented image.

10. A method of diagnostic imaging including:

supplying a first diagnostic 3D image of a region of interest;

supplying a second diagnostic 3D image of the region of interest;

automatically registering the first and second diagnostic 3D images;

concurrently displaying at least one pair of corresponding 2D slices of the first and second registered 3D diagnostic images, each pair corresponding to a selected corresponding crossing point;

with manual tools, inputting 3D deformation parameters which deform one or more surfaces of one or more of the registered 3D images which surfaces are in at least one displayed 2D slice and nearby not displayed 2D slices; and

performing an image reformatting routine which (1) reformats only the concurrently displayed 2D slices of the registered 3D images in accordance with the deformation parameters, (2) controls the display to display the reformatted 2D slice images in real time, and (3) saves the deformation parameters for use in reformatting other slices of the 3D images.

11. The method as set forth in claim 10, further including:

prior to registration, segmenting at least one surface of the region of interest (ROI) in at least one of the diagnostic 3D images.

12. The method as set forth in claim 11, wherein the step of inputting 3D deformation parameters includes:

controlling the manual tools by a user via an input device to deform at least one of the segmented surfaces of the concurrently displayed pair of 2D slices.

13. The method as set forth in claim 12, wherein the manual tools include:

deforming a portion of the segmented surface of at least one of the concurrently displayed 2D slices by pulling the portion along a predefined smooth curve; and

deforming a portion of the segmented surface of at least one of the concurrently displayed 2D slices by pushing a predefined smooth curve against the portion.

14. The method as set forth in claim 10, further including:

concurrently stepping the 2D slice pairs through the first and second registered 3D images correspondingly; and

concurrently updating the stepped, currently displayed 2D slices in accordance with deformation parameters input by manual tools on a nearby 2D slice.

15. The method as set forth in claim 10, wherein the step of registering includes:

determining an affine transform representative of misalignment between the first and second diagnostic 3D images; and

operating on one of the first and second diagnostic 3D images in accordance with the determined affine transform to register the first and second images.

16. The method as set forth in claim 15, wherein the step of registering further includes:

determining an elastic transform representative of misalignment between the first and second diagnostic 3D images; and

operating on one of the first and second diagnostic 3D images in accordance with the determined elastic transform.