Apparatus for Navigation and for Fusion of Ecographic and Volumetric Images of a Patient Which Uses a Combination of Active and Passive Optical Markers

• US 20080033283A1
• Filed: 07/19/2005
• Published: 02/07/2008
• Est. Priority Date: 07/20/2004
• Status: Abandoned Application

• Current Assignee: Politecnico di Milano
• Original Assignee: Politecnico di Milano
• Inventors: Pedotti, Antonio, Aliverti, Andrea, Dellaca, Raffaele
• Application Number:
  US11/632,862
• Publication Number:
  US 20080033283A1
• Time in Patent Office: Days
• US Class Current: 600/424
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2034/2072 Reference field transducer attached to an instrument or patient
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/1127 using markers
• CPC Class Codes: A61B 6/03 Computed tomography [CT] echo-tomography A61B8/14
• CPC Class Codes: A61B 6/5247 combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
• CPC Class Codes: A61B 8/00 Diagnosis using ultrasonic, sonic or infrasonic waves imaging of objects using sonar G01S15/00
• CPC Class Codes: A61B 8/0833 involving detecting or locating foreign bodies or organic structures
• CPC Class Codes: A61B 8/0841 for locating instruments
• CPC Class Codes: A61B 8/14 Echo-tomography
• CPC Class Codes: A61B 8/4245 involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
• CPC Class Codes: A61B 8/4263 using sensors not mounted on the probe, e.g. mounted on an external reference frame
• CPC Class Codes: A61B 8/5238 for combining image data of patient, e.g. merging several images from different acquisition modes into one image for image registration algorithms G06T7/30

Abstract

The invention concerns an apparatus for fusion and navigation of ecographic and volumetric images of a patient (1) and for localization of an ecographic probe (2) connected with an ecographer (7) and/or of a surgical instrument (3) operating on the same patient. The unit comprises a plurality of passive (3) active optical markers (4) positionable on the body of the patient and a plurality of active optical markers (5, 6) located on the ecographic probe and/or on the surgical instrument, sensors of optical signal (8) provided with devices (9) for activation of said passive markers, which sensors (8) are suitable for reception of optical signals produced by reflection of said passive markers and/or coming from said active markers, a turning on device (11) for said active markers and said devices for the activation of the passive markers, a movement analysis device (10) suitable to process the signals emitted by said sensors (8) as a function of the optical signals received in order to obtain from them the coordinates of said markers, a decoding device (12) suitable to distinguish the coordinates of the active markers from the ones of the passive markers, a data processing device (13) for localization of the ecographic probe (2) and/or the surgical instrument (3) and for definition of the movement of the patient, a device (14) for acquisition of the ecographic images in synchronism with the position of the ecographic probe (2) and/or the surgical instrument (3) and a device (15) for fusion and the navigation of the ecographic images with volumetric images coming from other systems (16) for acquisition of images.

Claims

1-14. -14. (canceled)

15. Apparatus for fusion of ecographic and volumetric images of a patient (1) and for navigation and localization of an ecographic probe (2) and a surgical instrument (3) operating on the same patient, comprising a plurality of passive optical markers (4) positionable on the body of the patient and a plurality of active optical markers (5, 6) located on the ecographic probe and on the surgical instrument, sensors of optical signals (8) provided with devices (9) for activation of said passive markers, said sensors (8) being suitable to reception of optical signals produced by reflection of said passive markers and/or coming from said active markers, a turning on device (11) for said active markers and said devices (9) for the activation of the passive markers, a movement analysis device (10) suitable to process the signals emitted by said sensors (8) as a function of optical signals being received in order to obtain from them the coordinates of said markers, a decoding device (12) suitable to distinguish the coordinates of the active markers from the ones of the passive markers, a data processing device (13) for localization of the ecographic probe (2) and the surgical instrument (3) and for definition of the movement of the patient, a device (14) for acquisition of the ecographic images in synchronism with the position of the ecographic probe (2) and of the surgical instrument (3) and a device (15) for fusion and navigation of the ecographic images with volumetric images coming from other systems (16) for acquisition of images, characterised in that said turning on device (11) control the turning on of the active markers and of the activation devices (9) as an alternative to each other.

16. Apparatus according to claim 15, characterised in that active optical markers are also positionable on the body of the patient (1).

17. Apparatus according to claim 15, characterised in that said active markers are made up of high luminosity LED devices.

18. Apparatus according to claim 15, characterised in that the markers (4) located on the body of the patient (1), the markers (5) located on the probe (2) and the markers (6) located on the surgical instrument (3) are in number at least equal to three.

19. Apparatus according to claim 15, characterised in that said sensors (8) are made up of video cameras and said activation devices (9) are made up of optical illuminators.

20. Apparatus according to claim 19, characterised in that said illuminators (9) are of the infrared light type.

21. Apparatus according to claim 15, characterised in that said turning on device (1) controls the turning on of the active markers (5) located on the probe (2) as an alternative to the one of the active markers (6) located on the surgical instrument (3).

22. Apparatus according to claim 15, characterised in that said turning on device (11) comprises a microcontroller (MC) for the control of the turning on of said activation devices (9) and of the active markers and means (P1-P3) to vary the turning on times of said activation devices (9) and said active markers.

23. Apparatus according to claim 15, characterised in that said device (10) for the analysis of the movement operates on the basis of photogrammetry algorithms.

24. Apparatus according to claim 15, characterised in that said decoding device (12) carries out the calculation of the coordinates of the markers on the basis of stereophotogrammetry algorithms and it utilises procedures for the pursuit of the movements of the markers based on prediction algorithms based on analytical or functional criteria or on Kalman filtering.

25. Apparatus according to claim 15, characterised in that said data processing device (13) is capable to identify the parameters of the geometric transformations of the points belonging to the plane of the ecographic image produced by the probe (2) and to calculate the new co-ordinates of such points in the reference system of the laboratory.

26. Apparatus according to claim 15, characterised in that said device (14) for the acquisition of the ecographic images in synchronism with the position of the ecographic probe (2) and/or of the surgical instrument (3) comprises a digitalize of video signals controlled by a program that receives as an input a series of synchronization signals coming from said device of analysis (10).

27. Apparatus according to claim 15, characterised in that said device (15) for fusion and navigation of the ecographic images with volumetric images coming from other systems for the acquisition of images (16) comprises a calculation and visualization program that at each moment of the acquisition of the ecographic images, starting from the geometric parameters coming from said device of acquisition (14) and from the data relative to the position of the patient coming from said processing device (13),

a) calculates the position of each element of the ecographic image in the reference system of the patient;

b) it calculates the position of each element of the volumetric image in the reference system of the patient;

c) it represents on a screen, in a single spacial reference, the volumetric images, the ecographic images and possibly the surgical instrument.

28. Apparatus according to claim 16, characterised in that said active markers are made up of high luminosity LED devices.

29. Apparatus according to claim 21, characterised in that said turning on device (11) comprises a microcontroller (MC) for the control of the turning on of said activation devices (9) and of the active markers and means (P1-P3) to vary the turning on times of said activation devices (9) and said active markers.