Methods and apparatus for improved electromagnetic tracking and localization

• US 10,285,760 B2
• Filed: 02/04/2016
• Issued: 05/14/2019
• Est. Priority Date: 02/04/2015
• Status: Active Grant

• Current Assignee: Queen's University At Kingston
• Original Assignee: Queen's University At Kingston
• Inventors: Sadjadi, Hossein, Lugez, Elodie, Hashtrudi-Zaad, Keyvan, Fichtinger, Gabor
• Primary Examiner(s): Tran, Dzung
• Application Number:
  US15/015,517
• Publication Number:
  US 20160258782A1
• Time in Patent Office: 1,195 Days
• Field of Search: 702150
• CPC Class Codes: A61B 2017/3413 guided by ultrasound
• CPC Class Codes: A61B 2034/102 Modelling of surgical devices, implants or prosthesis
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: G01D 18/008 with calibration coefficients stored in memory

Abstract

An apparatus for electromagnetic (EM) tracking or localization is described which includes one or more EM transmitters and receivers (sensors, or trackers), an indication of relative locations of the one or more transmitter and sensor with respect to one or more instrument, optionally, a model of the one or more instrument flexibility, a measurement uncertainty analyzer that reports an uncertainty associated with each measurement, an equation of motion or dynamic model with motion constraints that describes an expected behavior of the one or more instrument, a probabilistic simultaneous localization and mapping (SLAM) algorithm that simultaneously estimates a pose of one or more instrument and updates a field distortion map, or parameters of a field distortion model, a field distortion estimator that uses currently-available information of the field distortion map and estimates field distortion in the vicinity of the one or more instrument, to be used for future measurement compensation, a transient analyzer that constantly observes variations in the field distortion map over time in order to differentiate regions with continuous changes from regions with constant field distortion, and provides feedback to the field distortion estimator, including indicating to what degree each region of the map is expected to change, wherein simultaneous field distortion mapping and electromagnetic tracking or localization of the one or more instrument is provided in real time.

Claims

1. Apparatus for electromagnetic (EM) tracking or localization in a workspace, comprising:

one or more EM transmitter and two or more EM sensors, wherein one EM sensor is a redundant EM sensor that is adapted to be mounted on an instrument during a procedure such that the redundant sensor moves with the instrument during, the procedure;

a processor that receives signals from the two or more EM sensors, and

(i) estimates uncertainty associated with each EM sensor measurement,

(ii) determines an indication of relative locations of the two or more EM sensors with respect to the instrument, and

(iii) generates a field distortion map of the workspace of procedure;

wherein a field distortion estimator uses currently-available information of the field distortion map and estimates field distortion for the workspace, including a location of the instrument;

wherein information from the redundant sensor is used with the field distortion estimator to produce an output that compensates for field distortion at a location of the instrument in real time during the procedure; and

wherein a transient analyzer continuously observes variations in the field distortion map over time in order to differentiate regions with continuous changes from regions with constant field distortion, and provides feedback to the field distortion estimator, including predicting how the field distortion map is expected to change;

wherein the estimates of uncertainty associated with each EM sensor measurements, the relative locations of the two or more EM sensors, and the output from the field distortion estimator are used by a probabilistic simultaneous localization and mapping (SLAM) algorithm that simultaneously estimates a location and pose of the workspace, and updates the field distortion map, in real time;

the apparatus further comprising an output device that outputs a location and pose of the instrument in in the workspace during the procedure;

wherein the location and pose of the instrument is substantially corrected for EM field distortion in real time.

2. The apparatus of claim 1, wherein the field distortion estimator estimates field distortion based on interpolating, or adjusting model parameters of the field distortion map.

3. The apparatus of claim 1, wherein the SLAM algorithm uses Bayesian inference for estimation and is implemented by one or more of a Kalman filter, a particle filter, and non-linear least squares.

8. The apparatus of claim 1, wherein measurements are combined or filtered with kinematic motion models and/or dynamic motion models, including but not limited to weighted averages, or a stochastic sensor fusion technique.

9. The apparatus of claim 8, including a Kalman filter.

10. The apparatus of claim 1, wherein the instrument is an object or feature being tracked or localized;

wherein the instrument comprises a gaming device, a tool, a surgical tool, an animal, a human, or a feature in a simulator.

13. The apparatus of claim 1, wherein the instrument is a catheter, a needle, a cutting tool, a cautery tool, or a guide-wire.

4. A method for electromagnetic (EM) tracking or localization in a workspace, comprising:

providing one or more EM transmitter and two or more EM sensors, wherein one EM sensor is a redundant EM sensor that is adapted to be mounted on an instrument during a procedure such that the redundant sensor moves with the instrument during the procedure;

receiving signals from the two or more EM sensors, and using a processor to

(i) estimate uncertainty associated with each EM sensor measurement,

(ii) determine an indication of relative locations of the two or more EM sensors with respect to the instrument, and

iii) generate a field distortion map of the workspace of the procedure;

the method further comprising;

implementing a field distortion estimator that uses currently-available information of the field distortion map to estimate field distortion for the workspace, including a location of the instrument;

using information from the redundant sensor with the field distortion estimator to produce an output that compensates for field distortion at a location of the instrument in real time during the procedure;

continuously observing variations in the field distortion map over time to differentiate regions with continuous changes from regions with constant field distortion, and providing feedback to the field distortion estimator, including predicting how the field distortion map is expected to change;

wherein the estimates of uncertainty associated with each EM sensor measurements, the relative locations of the two or more EM sensors, and the output from the field distortion estimator are used by a probabilistic simultaneous localization and mapping (SLAM) algorithm that simultaneously estimates a location and pose of the instrument in the workspace, and updates the field distortion map, in real time; and

outputting, a location and pose of the instrument in the workspace during the procedure;

wherein the location and pose of the instrument is substantially corrected for EM field distortion in real time.

5. The method of claim 4, wherein the field distortion estimator estimates field distortion based on interpolating, or adjusting model parameters of the field distortion map.

6. The method of claim 4, wherein the SLAM algorithm uses Bayesian inference for estimation and is implemented by one or more of a Kalman filter, a particle filter, and non-linear least squares.

11. The method of claim 4, wherein the instrument is an object or feature being tracked or localized;

wherein the instrument comprises a gaming device, a tool, a surgical tool, an animal, a human, or a feature in a simulator.

7. Programmed media for use with a computer and with EM sensor data, wherein the EM sensors comprise one or more EM transmitter and two or more EM sensors, wherein one EM sensor is a redundant EM sensor that is adapted to be mounted on an instrument during a procedure such that the redundant sensor moves with the instrument during the procedure, the programmed media comprising a computer program stored on non-transitory storage media compatible with the computer, the computer program containing instructions to direct the computer to perform one or more of;

(i) estimate uncertainty associated with each EM sensor measurement,

(ii) determine an indication of relative locations of the two or more EM sensors with respect to the instrument, and

(iii) generate a field distortion map of the workspace of the procedure;

implement a field distortion estimator that uses currently-available information of the field distortion map to estimate field distortion for the workspace, including a location of the instrument;

use information from the redundant sensor with the field distortion estimator to produce an output that compensates for field distortion at a location of the instrument in real time during the procedure;

continuously observe variation in the field distortion map over time to differentiate regions with continuous changes from regions with constant field distortion, and provide feedback to the field distortion estimator, including predicting how the field distortion map is expected to change;

wherein the estimates of uncertainty associated with each EM sensor measurements, the relative locations of the two or more EM sensors, and the output from the field distortion estimator are used by a probabilistic simultaneous localization and mapping (SLAM) algorithm that simultaneously estimates a location and pose of the instrument in the workspace, and updates the field distortion map, in real time; and

output a location and pose of the instrument in the workspace during the procedure;

wherein the location and pose of the instrument is substantially corrected for EM field distortion in real time.

12. The method of claim 7, wherein the instrument is an object or feature being tracked or localized;

wherein the instrument comprises a gaming device, a tool, a surgical tool, an animal, a human, or a feature in a simulator.