Hybrid registration method

• US 10,285,623 B2
• Filed: 02/29/2016
• Issued: 05/14/2019
• Est. Priority Date: 06/06/2008
• Status: Active Grant

• Current Assignee: Covidien LP (Medtronic Plc)
• Original Assignee: Covidien LP (Medtronic Plc)
• Inventors: Averbuch, Dorian, Zur, Oded, Weingarten, Oren
• Primary Examiner(s): Nguyen, Tu T
• Application Number:
  US15/055,698
• Publication Number:
  US 20160174874A1
• Time in Patent Office: 1,170 Days
• Field of Search: 382131
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 2017/00699 correcting for movement caused by respiration, e.g. by triggering
• CPC Class Codes: A61B 2034/2072 Reference field transducer attached to an instrument or patient
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/06 Devices, other than using radiation, for detecting or locating foreign bodies for removing same A61B17/50 ; determining position of probes within or on the body of the patient
• CPC Class Codes: A61B 5/064 using markers A61B5/062 takes precedence
• CPC Class Codes: A61B 5/066 Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging
• CPC Class Codes: A61B 5/7246 using correlation, e.g. template matching or determination of similarity
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: G06T 2207/10068 Endoscopic image
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/30061 Lung
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

A registration method whereby a sensor-based approach is used to establish initial registration and whereby upon the commencement of navigating an endoscope, image-based registration methods are used in order to more accurately maintain the registration between the endoscope location and previously-acquired images. A six-degree-of-freedom location sensor is placed on the probe in order to reduce the number of previously-acquired images that must be compared to a real-time image obtained from the endoscope.

Claims

1. A method of registering sensor location data to images of at least one body lumen, comprising:

generating location data corresponding to a location of a sensor;

registering the location of the sensor relative to a previously acquired image selected from a memory of a computing device storing a plurality of previously acquired images of at least one body lumen in a patient based on the location data;

parsing the plurality of previously acquired images based on the location data corresponding to the location of the sensor to generate a subgroup of the plurality of previously acquired images based on the location data; and

updating the registered location of the sensor based on an image selected from the subgroup.

2. The method according to claim 1, further comprising placing a probe including the sensor disposed thereon relative to the at least one body lumen.

3. The method according to claim 2, further comprising:

projecting a virtual beam from the probe to a landmark of the at least one body lumen; and

determining a location of the landmark relative to the at least one body lumen based on a display of the virtual beam.

4. The method according to claim 3, further comprising registering the location of the landmark relative to a previously acquired image selected from the plurality of previously acquired images of the at least one body lumen.

5. The method according to claim 1, further comprising sensing an electromagnetic field generated by an electromagnetic field generator.

6. The method according to claim 5, wherein generating location data includes generating location data corresponding to the location of the sensor in the electromagnetic field.

7. The method according to claim 1, further comprising selecting an image from the subgroup based on the location of the sensor.

8. The method according to claim 1, further comprising selecting an image from the subgroup that most accurately corresponds to the location of the sensor.

9. The method according to claim 1, wherein updating the registered location of the sensor includes performing an image-based registration.

10. The method according to claim 1, wherein registering the location of the sensor includes:

imaging a landmark of the at least one body lumen during at least one breathing cycle;

determining a position of at least one patient sensor disposed on the patient;

generating data corresponding to the landmark based on at least one of the image of the landmark, the position of the at least one patient sensor, and the location data; and

correlating the location of the sensor to a previously acquired image selected from the plurality of previously acquired images of the at least one body lumen based on the data corresponding to the landmark.

11. A system for registering sensor location data to images of at least one body lumen, comprising:

at least one sensor configured to generate location data corresponding to a location of the sensor relative to at least one body lumen in a patient; and

a computing device having a memory configured to store a plurality of previously acquired images of the at least one body lumen, the location of the sensor configured to be initially registered to an image selected from the plurality of previously acquired images and to parse the plurality of previously acquired images based on the location data corresponding to the location of the sensor to generate a subgroup of the plurality of previously acquired images based on an approximate location of the sensor, wherein an image of the subgroup is selected based on a comparison between the location of the sensor and the images of the subgroup to update the initial registration of the location of the sensor to the image selected from the plurality of previously acquired images.

12. The system of claim 11, wherein the at least one sensor is disposed on a probe configured to be placed relative to the at least one body lumen.

13. The system of claim 12, wherein the probe is a bronchoscope.

14. The system of claim 12, wherein the probe is configured to project a virtual beam to a landmark of the at least one body lumen, a location of the landmark relative to the at least one body lumen being determined based on a display of the virtual beam.

15. The system of claim 11, wherein the sensor is a six-degree-of-freedom sensor.

16. The system of claim 11, wherein the subgroup includes at least one image corresponding to the location of the sensor.