METHOD AND SYSTEM FOR DETERMINING AN IMAGING DIRECTION AND CALIBRATION OF AN IMAGING APPARATUS

• US 20130094742A1
• Filed: 07/14/2010
• Published: 04/18/2013
• Est. Priority Date: 07/14/2010
• Status: Abandoned Application

• Current Assignee: Brainlab AG
• Original Assignee: Brainlab AG
• Inventors: Feilkas, Thomas
• Application Number:
  US13/806,230
• Publication Number:
  US 20130094742A1
• Time in Patent Office: Days
• US Class Current: 382/131
• CPC Class Codes: A61B 2017/00707 Dummies, phantoms; Devices simulating patient or parts of patient
• CPC Class Codes: A61B 2017/00725 Calibration or performance testing
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 6/4441 the rigid structure being a C-arm or U-arm
• CPC Class Codes: A61B 6/584 determining position of components of the apparatus or device using images of the phantom
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/10121 Fluoroscopy
• CPC Class Codes: G06T 2207/10124 Digitally reconstructed radiograph [DRR]
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/0014 using an image reference approach
• CPC Class Codes: G06T 7/75 involving models
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

The present invention relates to a method for determining an imaging direction of an imaging apparatus (10), such as an x-ray apparatus, with a radiation source or an imaging source (12) that emits an imaging beam (14) to an imaging detector (16) along a beam path, comprising the steps of imaging an object (18) from a first direction to obtain a first 2D image; providing 3D reference data, for example a generic or statistical 3D model or an earlier obtained 3D data set, of the imaged object (18); performing a 2D/3D matching of the first 2D image with the 3D reference data to determine a position of an imaging plane (20, 22, 24) of the first 2D image relative to the 3D reference data; and determining the imaging direction of the imaging apparatus (10) relative to the object (18) based on the position of the imaging plane (20, 22, 24) relative to the 3D reference data, as well as to a navigation system for computer-assisted surgery comprising the imaging system of the preceding claim; a tracking system (11), such as optical or IR tracking means; detection devices (13, 15) such as e.g. radiopaque markers (13) detectable by the imaging system and markers (15) detectable by the tracking system (11) attachable to an object (18), wherein the navigation system is adapted to detect a position of the object (18) based on the detection devices (13, 15), in order to generate detection signals and to supply the detection signals to the computer (17) such that the computer can determine point data on the basis of the detection signals received; a calibration object such as a patient body or a phantom bearing detection devices for calibrating the navigation system.

Claims

1. Method for determining an imaging direction of an imaging apparatus, such as an x-ray apparatus, with a radiation source or an imaging source that emits an imaging beam to an imaging detector along a beam path, comprising the steps of:

imaging an object from a first direction to obtain a first 2D image;

providing 3D reference data, for example a generic or statistical 3D model or an earlier obtained 3D data set, of the imaged object;

performing a 2D/3D matching of the first 2D image with the 3D reference data to determine a position of an imaging plane of the first 2D image relative to the 3D reference data; and

determining the imaging direction of the imaging apparatus relative to the object based on the position of the imaging plane relative to the 3D reference data.

2. Method according to claim 1, further comprising the steps of:

obtaining or generating a plurality of preferably virtual 2D projections from the 3D reference data; and

selecting from the plurality of 2D projections a first best match projection which best matches the imaged first 2D image.

3. Method according to claim 2, further comprising the step of:

performing a 2D/2D registration of the imaged first 2D image and the first best match projection to obtain a transformation matrix or distortion matrix which allows a mapping of the first 2D image to the first best match projection.

4. Method according to claim 3, further comprising the step of:

performing the 2D/2D registration of the first 2D image and the first best match projection as a rigid and/or non-rigid registration.

5. Method according to claim 2, further comprising the step of:

generating 2D projections as Digitally Reconstructed Radiographs (DRRs) from the 3D reference data.

6. Method according to claim 2, further comprising the steps of:

using landmarks such as singular structural points of the object or fiducial markers attached to the surface or skin of the object or implanted in the object for the 2D/2D registration; and

/or

performing the 2D/2D registration of the first 2D image and the first best match projection of the 3D reference data as a multi-modality registration, wherein the 3D reference data is obtained with a different imaging modality than the first 2D image.

7. Method for calibrating a 2D imaging apparatus, such as an x-ray apparatus, comprising the steps of:

imaging an object from a first direction and determining an imaging direction of the imaging apparatus relative to the object according to claim 1;

determining a first transformation matrix between the first best match projection which best matches the first 2D image, and the first 2D image, the first best match projection obtained from the 3D reference data being related to or taken from the first imaging direction of the imaging apparatus; and

determining first image calibration parameters of the imaging apparatus from the first transformation matrix to compensate an imaging distortion of the imaging apparatus.

8. Method according to claim 7, further comprising the step of:

determining the first image calibration parameters of the imaging apparatus as an inverse matrix of the first transformation matrix.

9. Method according to claim 7, further comprising the steps of:

imaging the object from a second direction and determining a second imaging direction of the imaging apparatus relative to the object according to claim 1;

determining a second transformation matrix between a second best match projection which best matches the second 2D image, and the second 2D image, the second best match projection obtained from the 3D reference data being related to or taken from the second imaging direction of the imaging apparatus; and

determining interpolation parameters for transformation matrices, associated with further directions between the first and second direction, based on the first transformation matrix corresponding to the first imaging direction and the second transformation matrix corresponding to the second imaging direction.

10. Method according to claim 7, further comprising the steps of:

adjusting the interpolation parameters by imaging the object from a further direction and determining a further imaging direction of the imaging apparatus.

11. Method according to claim 7, wherein after imaging the object to obtain a 2D image the following steps are executed:

determining an imaging direction of the imaging apparatus relative to the object to determine image the calibration parameters calculated or predetermined for the imaging direction;

processing the 2D image with the calibration parameters to correct the 2D image.

12. Program which, when running on a computer or when loaded onto a computer, causes the computer to perform the method according to claim 7.

13. Program storage medium on which the program of claim 12 is in particular non-transitory stored.

14. Imaging system comprising:

an imaging apparatus, such as an x-ray apparatus, with an imaging source that emits an imaging beam to an imaging detector, for obtaining 2D images of an object; and

a computer on which the program of claim 12 is running or loaded, the computer being operatively coupled to the imaging apparatus to calibrate the imaging apparatus according to claim 7 and/or to compensate or equalize subsequently generated 2D images of an object.

15. Navigation system for computer-assisted surgery comprising:

the imaging system of claim 14.

a tracking system, such as optical or IR tracking means;

detection devices such as e.g. radiopaque markers detectable by the imaging system and markers detectable by the tracking system attachable to an object, wherein the navigation system is adapted to detect a position of the object based on the detection devices, in order to generate detection signals and to supply the detection signals to the computer such that the computer can determine point data on the basis of the detection signals received;

a calibration object such as a patient body or a phantom bearing detection devices for calibrating the navigation system.