Image processing system and method for registration of two-dimensional with three-dimensional volume data during interventional procedures

• US 7,912,262 B2
• Filed: 03/09/2006
• Issued: 03/22/2011
• Est. Priority Date: 03/10/2005
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Mielekamp, Pieter Maria, Homan, Robert Johannes Frederik, Timmer, Jan
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US11/817,801
• Publication Number:
  US 20080192996A1
• Time in Patent Office: 1,839 Days
• Field of Search: 382/10, 382/128, 382/129, 382/130, 382/131, 382/132, 128/922, 378 4- 27
• US Class Current: 382/128
• CPC Class Codes: A61B 6/4441 the rigid structure being a C-arm or U-arm
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/35 using statistical methods
• CPC Class Codes: Y10S 128/922 including image analysis

Abstract

Prior to an intervention, a 3D rotational scan is acquired (at block 10) in respect of a body volume and reconstructed. In addition, three-dimensional image data in respect of the body volume is acquired (at block 12) using another modality, such as computerised tomography (CT) or magnetic resonance (MR), reconstructed, and prepared for visualisation. During the actual intervention, live two-dimensional fluoroscopic images are acquired (at block 14), using the imaging system employed to acquire the 3D rotational scan, and processed for visualisation. The 2D image data is registered (at block 16) to the 3D rotational image data acquired and reconstructed in respect of the body volume of interest, and then a 3D-3D registration process is employed (at block 18) to register the 3D image data acquired in respect of the same body volume using, for example, CT or MR imaging systems to the 3D rotational image data, and a display module (20) is used to align the 2D fluoroscopic image and the 3D MR/CT image as a fused or composite image and display the image.

Claims

1. A system for displaying image data acquired during an intervention procedure in respect of a body volume, said system comprising means (10) for receiving three-dimensional image data of said body volume acquired using a first imaging system, means (14) for receiving two-dimensional image data in respect of said body volume acquired using said first imaging system during an intervention procedure, means (16) for mapping said two -dimensional image data onto a corresponding region of said three-dimensional image data acquired using said first imaging system, means (12) for receiving three-dimensional image data of said body volume acquired using a second imaging system of a different modality to said first imaging system, means (18) for registering said three-dimensional image data acquired using said second imaging system with said three-dimensional data acquired using said first imaging system and thereby mapping said two-dimensional image data onto a corresponding region of said three-dimensional image data acquired using said second imaging system, and means (20) for displaying said two-dimensional image data within said corresponding region of said three-dimensional image data of said body volume acquired using said second imaging system.

2. A system according to claim 1, wherein the three-dimensional image data acquired using the first and/or second imaging systems is acquired prior to the interventional procedure.

3. A system according to claim 1, wherein the two-dimensional image data is live and displayed substantially in real time within said corresponding region of said three -dimensional image data of said body volume acquired using said second imaging system.

4. A system according to claim 1, wherein said three-dimensional image data acquired by the first imaging means is acquired by means of a 3D rotational scan.

5. A system according to claim 1, wherein said two-dimensional image data is acquired by means of X-ray fluoroscopic imaging means.

6. A system according to claim 1, wherein the three-dimensional image data acquired by the second imaging means is acquired by means of a computerised tomography or magnetic resonance imaging system.

7. A system according to claim 1, wherein live two-dimensional image data is superimposed on the three-dimensional image data only where two-dimensional image data is present.

8. A system according to claim 7, comprising blending means, wherein two-dimensional pixel density is used as a blending factor.

9. A method for displaying image data acquired during an intervention procedure in respect of a body volume, the method comprising receiving three-dimensional image data of said body volume acquired using a first imaging system, receiving two-dimensional image data in respect of said body volume acquired using said first imaging system during an intervention procedure, mapping said two-dimensional image data onto a corresponding region of said three-dimensional image data acquired using said first imaging system, receiving three-dimensional image data of said body volume acquired using a second imaging system of a different modality to said first imaging system, registering said three -dimensional image data acquired using said second imaging system with said three-dimensional data acquired using said first imaging system and thereby mapping said two-dimensional image data onto a corresponding region of said three-dimensional image data acquired using said second imaging system, and displaying said two-dimensional image data within said corresponding region of said three-dimensional image data of said body volume acquired using said second imaging system.