Virtual Penetrating Mirror Device for Visualizing Virtual Objects in Angiographic Applications

• US 20100152570A1
• Filed: 04/11/2007
• Published: 06/17/2010
• Est. Priority Date: 04/12/2006
• Status: Active Grant

• Current Assignee: Nassir Navab
• Original Assignee: Nassir Navab
• Inventors: Navab, Nassir
• Granted Patent: US 8,090,174 B2
• Time in Patent Office: Days
• US Class Current: 600/411
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/372 Details of monitor hardware
• CPC Class Codes: A61B 2090/374 NMR or MRI
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: A61B 6/504 for diagnosis of blood vessels, e.g. by angiography
• CPC Class Codes: A61B 6/5235 combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
• CPC Class Codes: A61B 6/547 involving tracking of position of the device or parts of the device
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/41 Medical

Abstract

A virtual mirror device for visualizing virtual objects in angiographic applications, having an interactive virtual mirror, a 3D or 4D medical image of a patient'"'"'s anatomy co-registered with a calibrated 2D X-ray image of the patient'"'"'s anatomy, and a displaying device provided such that the 2D X-ray image of the patient'"'"'s anatomy, the co-registered 3D or 4D medical image of the patient'"'"'s anatomy and the interactive virtual mirror viewed from the viewpoint of the X-ray source of the X-ray imaging system, are presented in a common coordinate system, providing full integration and combined visualization of the reconstruction of 3D or 4D medical image of the patient'"'"'s anatomy, the 2D X-ray image of the patient'"'"'s anatomy and the virtual mirror onto the displaying device.

Claims

1. A device for visualizing virtual objects in angiographic applications adapted to display a 3D or 4D medical image and a corresponding calibrated 2D X-ray image on a displaying device, wherein the 3D or 4D medical image is co-registered with the calibrated 2D X-ray image, wherein the device is adapted to display the 2D X-ray image, the co-registered 3D or 4D medical image and an interactive virtual mirror viewed from the viewpoint of the X-ray source of the X-ray imaging system in a common coordinate system, and the device is further adapted to provide on the displaying device full integration and combined visualization of the 3D or 4D medical image, the 2D X-ray image and the virtual mirror, which reflects the 3D or 4D medical image.

2. The device according to claim 1, characterized in that the 2D X-ray image is a subtracted X-ray angiography image.

3. The device according to any one of the preceding claims, characterized in that the virtual mirror visualizes digitally reconstructed radiographs generated from the 3D or 4D medical image.

4. The device according to any one of the preceding claims, characterized in that the virtual mirror visualizes a maximum intensity projection generated from the 3D or 4D medical image.

5. The device according to any one of the preceding claims, characterized in that the 3D or 4D medical image is obtained by an Ultrasound Imaging Device.

6. The device according to any one of the preceding claims, characterized in that the 3D or 4D medical image is obtained by a Magnetic Resonance Imaging system.

7. The device according to any one of the preceding claims, characterized in that the 3D or 4D medical image is obtained by a Computer Tomography imaging system.

8. The device according to any one of the preceding claims, characterized in that the 3D or 4D medical image of is obtained by a mobile or stationary X-ray C-arm.

9. The device according to any one of the preceding claims, characterized in that the position, orientation, size, scaling and color of the angiographic virtual mirror is controllable interactively.

10. A computer implemented method for visualizing virtual objects in angiographic applications comprising:

acquiring image data corresponding to a scene, wherein first image data of the scene includes two dimensions and second image data of the scene includes at least three dimensions;

determining calibrated first image data using the first image data;

co-registering the calibrated first image data and the second image data; and

displaying co-registered calibrated first image data and second image data and a virtual mirror, wherein the interactive virtual mirror reflects the second image data.

11. The computer implemented method of claim 10, wherein the virtual mirror reflects second image data relative to a projection geometry of the first image data.

12. The computer implemented method of claim 10, further comprising receiving an input adapted to position the virtual mirror for viewing different portions of the second image data without changing a view of the first image data.

13. The computer implemented method of claim 10, further comprising receiving an input adapted to position the virtual mirror for viewing different portions of the second image data without changing an alignment of the co-registered calibrated first image data and second image data.