Method for automatically merging a 2D fluoroscopic C-arm image with a preoperative 3D image with one-time use of navigation markers

• US 20050027193A1
• Filed: 05/21/2004
• Published: 02/03/2005
• Est. Priority Date: 05/21/2003
• Status: Abandoned Application

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: Rahn, Norbert, Ritter, Dieter, Mitschke, Matthias
• Application Number:
  US10/851,259
• Publication Number:
  US 20050027193A1
• Time in Patent Office: Days
• US Class Current: 600/427
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 6/12 Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 6/4441 the rigid structure being a C-arm or U-arm
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/38 Registration of image sequences

Abstract

In a method and apparatus for the automatic merging of 2D fluoroscopic C-arm images with preoperative 3D images with a one-time use of navigation markers, markers in a marker-containing preoperative 3D image are registered relative to a navigation system, a tool plate fixed on the C-arm system is registered in a reference position relative to the navigation system, a 2D C-arm image (2D fluoroscopic image) that contains the image of at least a medical instrument is obtained in an arbitrary C-arm position, a projection matrix for a 2D-3D merge is determined on the basis of the tool plate and the reference position relative to the navigation system, and the 2D fluoroscopic image is superimposed with the 3D image on the basis of the projection matrix.

Claims

1. A method for automatically merging a 2D fluoroscopic image, obtained with a C-arm apparatus having a movable C-arm and having a tool plate fixed on the C-arm, with a preoperative 3D image, comprising the steps of:

before undertaking a medical interventional procedure on a patient involving interaction of a medical instrument with the patient, making a marker-containing preoperative 3D image, obtained prior to the medical intervention, available to a computer and, in the computer, automatically registering the markers in the preoperative 3D image relative to a navigation system;

registering the tool plate on the C-arm in a reference position relative to the navigation system;

without using markers, obtaining a 2D fluoroscopic image of a region of the patient in which said medical instrument is disposed with said C-arm in an arbitrary position;

in said computer, determining a projection matrix for merging said 2D fluoroscopic image and said preoperative 3D image dependent on said reference position and said projection matrix relative to the navigation system; and

merging said 2D fluoroscopic image with said preoperative 3D image using said projection matrix.

2. A method as claimed in claim 1 wherein the step of making said marker-containing preoperative 3D image available to said computer comprises making said maker-containing preoperative 3D image electronically available to said computer from a memory in which said marker-containing preoperative 3D image is stored as a pre-existing image.

3. A method as claimed in claim 1 comprising obtaining said marker-containing preoperative 3D image using said C-arm apparatus.

4. A method as claimed in claim 3 comprising employing artificial markers as said markers, and comprising setting said artificial markers relative to the patient prior to obtaining said marker-containing preoperative 3D image using said C-arm apparatus.

5. A method as claimed in claim 4 wherein the step of setting said artificial markers comprises surgically opening the patient and setting said artificial markers in the opened patient.

6. A method as claimed in claim 4 wherein the step of setting said artificial markers comprises fixing said artificial markers to a body surface of the patient.

7. A method as claimed in claim 3 comprising employing anatomical markers as said markers.

8. A method as claimed in claim 1 comprising obtaining said reference position of said tool plate with said C-arm apparatus in a fixed position with 0°

angulation and 0°

orbital angle of said C-arm.

9. A method as claimed in claim 1 comprising obtaining said marker-containing preoperative 3D image using an imaging modality selected from the group consisting of magnetic resonance tomography, computed tomography, ultrasound, positron emission tomography, and a nuclear medicine procedure, and storing said preoperative 3D image in a memory accessible by said computer.

10. EDIT An apparatus for automatically merging a 2D fluoroscopic image, obtained with a C-arm apparatus having a movable C-arm and having a tool plate fixed on the C-arm, with a preoperative 3D image, comprising the steps of:

before undertaking a medical interventional procedure on a patient involving interaction of a medical instrument with the patient, making a marker-containing preoperative 3D image, obtained prior to the medical intervention, available to a computer and, in the computer, automatically registering the markers in the preoperative 3D image relative to a navigation system;

registering the tool plate on the C-arm in a reference position relative to the navigation system;

without using markers, obtaining a 2D fluoroscopic image of a region of the patient in which said medical instrument is disposed with said C-arm in an arbitrary position;

in said computer, determining a projection matrix for merging said 2D fluoroscopic image and said preoperative 3D image dependent on said reference position and said projection matrix relative to the navigation system; and

merging said 2D fluoroscopic image with said preoperative 3D image using said projection matrix.