MEDICAL NAVIGATION IMAGE OUTPUT COMPRISING VIRTUAL PRIMARY IMAGES AND ACTUAL SECONDARY IMAGES

• US 20100295931A1
• Filed: 03/31/2010
• Published: 11/25/2010
• Est. Priority Date: 03/31/2009
• Status: Active Grant

• Current Assignee: Brainlab AG
• Original Assignee: Brainlab AG
• Inventors: SCHMIDT, Robert
• Granted Patent: US 9,925,017 B2
• Time in Patent Office: Days
• US Class Current: 348/65
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 1/042 characterised by a proximal camera, e.g. a CCD camera
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/07 using light-conductive means, e.g. optical fibres
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/06 Devices, other than using radiation, for detecting or locating foreign bodies for removing same A61B17/50 ; determining position of probes within or on the body of the patient
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: G02B 21/365 Control or image processing arrangements for digital or video microscopes G02B21/361, G02B21/362 take precedence
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes

Abstract

The invention relates to an image output method for medical navigation in which the positional relationship of an instrument with respect to a part of a patient'"'"'s body is ascertained, and in which the instrument and the part of the patient'"'"'s body are displayed in the correct positional relationship on an image output, wherein the display of the part of the patient'"'"'s body is based on the one hand on virtual image data captured by means of a medical imaging method and on the other hand on actual images captured during navigation, wherein the virtual image data is displayed on the image output primarily and as the basis of the image, and the actual images are superimposed on it merely as an addition and secondarily. It also relates to an image generating and image output device for medical navigation.

Claims

1. An image output method for medical navigation in which the positional relationship of an instrument with respect to a part of a patient'"'"'s body is ascertained, and in which the instrument and the part of the patient'"'"'s body are displayed in the correct positional relationship on an image output, wherein the display of the part of the patient'"'"'s body is based on the one hand on virtual image data captured by means of a medical imaging method and on the other hand on actual images captured during navigation, wherein the virtual image data is displayed on the image output primarily and as the basis of the image, and the actual images are superimposed on them merely as an addition and secondarily.

2. The method according to claim 1, wherein the virtual image data is weighted more heavily than the actual images when assembling the output image.

3. The method according to claim 1, wherein the virtual image data comprises image data which is captured before or during navigation by means of computed tomography, magnetic resonance tomography, an x-ray recording or fluoroscopic recording, a PET or SPECT recording or another medical imaging method.

4. The method according to claim 1, wherein the actual images are images which can be visually captured.

5. The method according to claim 4, wherein the actual images are images which correspond to an actual view of a region of interest or which directly image reality.

6. The method according to claim 4, wherein the actual images comprise images which are implemented by video capture apparatuses or by an object lens and are captured in real time.

7. The method according to claim 1, wherein the actual images are provided by a microscope or an endoscope.

8. The method according to claim 1, wherein the actual images are provided by a video image capture unit which is arranged on the instrument.

9. The method according to claim 8, wherein the video image capture unit is a camera or a camera light recorder.

10. The method according to claim 8, wherein the instrument is a medical treatment instrument.

11. The method according to claim 10, wherein medical treatment instrument is a pointer, a pair of tweezers, a scalpel or a clamp.

12. The method according to claim 1, wherein the instrument is an instrument which is equipped for medical navigation.

13. The method according to claim 12, wherein the instrument is an instrument which can be positionally detected by means of a tracking system.

14. The method according to claim 12, wherein the instrument is provided with a tracking reference.

15. The method according to claim 1, wherein the instrument is an instrument which is pre-calibrated for navigation with a navigation system used.

16. The method according to claim 8, wherein a plurality of instruments are used which are each provided with a video image capture unit, wherein the actual image data thus obtained is used to reciprocally observe or monitor the instruments and/or to produce supplementary images.

17. The method according to claim 8, wherein non-visible light wavelengths are also detected using the video image capture unit, which are then used for image optimization.

18. The method according to claim 1, wherein the combination of the virtual image data and the actual images is used to positionally register the virtual image data.

19. The method according to claim 18, wherein the combination of the virtual image data and the actual images is used for elastic image data registration.

20. The method according to claim 1, wherein the combination of the virtual image data and the actual images is used for updating the virtual image data.

21. The method according to claim 1, wherein image information for assembling the image to be output is tested for relevance and weighted, wherein less important image constituents are then omitted from the image and/or more important image constituents are intensified or highlighted in the image.

22. A program which, when it is running on a computer or is loaded on a computer, causes the computer to perform a method in accordance with claim 1.

23. A computer program storage medium comprising a program according to claim 22.

24. An image generating and image output device for medical navigation in which the positional relationship of an instrument with respect to a part of a patient'"'"'s body is ascertained, comprising:

an image output on which the instrument and the part of the patient'"'"'s body are displayed in the correct positional relationship; and

an image processor which generates a display of the part of the patient'"'"'s body on the basis of virtual image data captured by means of a medical imaging method on the one hand and on the basis of actual images captured during navigation on the other hand, comprising;

a video image capture unit which is arranged on the instrument and provides the actual images; and

by

an image display control which displays the virtual image data on the image output primarily and as the basis of the image, wherein the actual images are superimposed on it merely as an addition and secondarily.