Method for the improved display of co-registered 2D-3D images in medical imaging

• US 8,078,000 B2
• Filed: 07/25/2006
• Issued: 12/13/2011
• Est. Priority Date: 07/28/2005
• Status: Expired due to Fees

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: Böhm, Stefan, Finkler, Klaus, Pfister, Marcus, Seissl, Johann
• Primary Examiner(s): Wu, Jingge
• Assistant Examiner(s): YENTRAPATI, AVINASH
• Application Number:
  US11/492,432
• Publication Number:
  US 20070025605A1
• Time in Patent Office: 1,967 Days
• Field of Search: None
• US Class Current: 382/274
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2207/10121 Fluoroscopy
• CPC Class Codes: G06T 2207/10124 Digitally reconstructed radiograph [DRR]
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction

Abstract

The present invention relates to a method, which assists a doctor for instance in orientation in 2D fluoroscopy images. The present invention relates here to a method for displaying co-registered 2D-3D images in medical imaging, comprising the following steps: determine a 3D or 2D projection which is congruent with a 2D image from a 3D image data set, and overlaid display of the 2D image with the 3D or 2D projection on a monitor, characterized in that the two image parts of the two overlaid images can be adjusted and a shift in the two overlaid images which can be adjusted in at least one direction is enabled.

Claims

1. A method for improving a 3D visualization of both a vascular insert and a vessel anatomy surrounding the insert in a patient using a radiography during a medical intervention procedure, comprising:

determining a 2D projection to obtain a first 2D image from a 3D image data set, which includes a view of at least said vessel anatomy of the patient, and which is obtained with a first imaging device prior to the medical intervention procedure, said 2D image containing a view of the vessel anatomy and congruent with a second 2D image obtained with a second imaging device during the intervention procedure, said second 2D image containing a view of the insert and the vessel anatomy surrounding the insert, wherein the view of the insert in the second 2D image has a first-contrast value, wherein a view of the first 2D image has a second-contrast value, wherein the second-contrast value is sufficiently high relative to the first-contrast value to cover the view of the insert when the first and second 2D images are overlaid;

overlaying the second 2D image with the first 2D image on a single window display on a monitor,

adjusting a cross fading of at least two image parts of the overlaid images, wherein at least one of said at least two image parts contains the view of the insert and the vessel anatomy surrounding the insert, wherein at least another one of said at least two image parts is transparent relative to said at least one of said at least two image parts;

manually adjusting a transparency stage of at least one of the overlaid images to provide a blended view of the vessel anatomy surrounding the insert but covering the view of the insert due to the second contrast value of the second 2D image being sufficiently high relative to the first contrast value of the insert in the first 2D image;

generating respective cursors linked to said at least two image parts;

simultaneously displaying the respective linked cursors on said single window display;

spatially shifting within said single window display in response to commands from a user at least one of the two image parts of the overlaid images on said single window display along a first axial direction;

arranging the spatial shifting of said at least one of the two image parts of the overlaid images on said single window display to cause a sufficient spatial separation between said at least one of said at least two image parts containing the view of the insert, and said at least another one of said at least two image parts covering the view of the insert so that the view of the insert is no longer covered, said at least two image parts providing respective views of the vessel anatomy surrounding the insert; and

using relative movement of the respective cursors displayed on said single window display as a visual cue to the user for performing said spatial shifting, wherein the respective cursors displayed on said single window display are configured to point to an identical position marked in both the shifted and unshifted images and wherein the marked identical position is selected by the user.

2. The method as claimed in claim 1, wherein the user commands are carried out via a manual input device.

3. The method as claimed in claim 2, wherein the manual input device is a joystick.

4. The method as claimed in claim 1, wherein the spatial shifting further comprises spatially shifting along a second axis direction, which is orthogonal to the first axis direction.

5. The method as claimed in claim 1, wherein the second 2D image is a 2D fluoroscopy image obtained with the second imaging device.

6. The method as claimed in claim 1, wherein the 3D image data set is recorded using the second imaging device to obtain an image selected from the group consisting of:

a CT image, a 3D angiography image, and an MRT image.

7. A device for improving a 3D visualization of both a vascular insert and a vessel anatomy surrounding the insert in a patient using a radiography during a medical intervention procedure, comprising:

a fluoroscopy device for recording a first 2D image containing a view of the insert and the vessel anatomy surrounding the insert;

a memory for storing a 3D image data set, which includes a view of at least said vessel anatomy of the patient and which is recorded prior to the procedure;

a processing device for determining a 2D projection to obtain a second 2D image from the 3D image data set, the second 2D image containing a view of the vessel anatomy and congruent with the first 2D image and overlaying the first 2D image with the second 2D image, wherein the view of the insert in the first 2D image has a first-contrast value, wherein a view of the second 2D image has a second-contrast value, wherein the second-contrast value is sufficiently high relative to the first-contrast value to cover the view of the insert when the first and second 2D images are overlaid;

a monitor for displaying at least two images parts of the overlaid images on a single window display on the monitor, wherein at least one of said at least two image parts contains the view of the insert and the vessel anatomy surrounding the insert, wherein at least another one of said at least two image parts is transparent relative to said at least one of said at least two image parts;

a user-interface device to manually adjust a transparency stage of at least one of the overlaid images and provide a blended view of the vessel anatomy surrounding the insert but covering the view of the insert due to the second contrast value of the second 2D image being sufficiently high relative to the first contrast value of the insert in the first 2D image;

a cross-fading adjuster configured to adjust a cross fading of the two image parts of the overlaid images;

a spatial shifter configured to spatially shift within said single window display in response to commands from a user at least one of the two image parts of the overlaid images on said single window display along a first axis direction, wherein the spatial shifter is further configured to cause a sufficient spatial separation between said at least one of said at least two image parts containing the view of the insert, and said at least another one of said at least two image parts covering the view of the insert so that the view of the insert is no longer covered, said at least two image parts providing respective views of the vessel anatomy surrounding the insert; and

a cursor generator configured to generate respective cursors linked to said at least two image parts, wherein the respective linked cursors are simultaneously displayed on said single window display, wherein relative movement of the respective cursors displayed on said single window display provided a visual cue to the user for performing said spatial shifting, wherein the respective cursors displayed on said single window display are configured to point to an identical position is selected by the user.

8. The device as claimed in claim 7, wherein the user commands are carried out via a manual input device.

9. The device as claimed in claim 8, wherein the manual input device is a joystick.

10. The device as claimed in claim 7, wherein the spatial shifter is further configured to spatially shift along a second axis direction, which is orthogonal to the first axis direction.

11. The device as claimed in claim 7, wherein the first 2D image is recorded intraoperatively.