INTRAOPERATIVE CAMERA CALIBRATION FOR ENDOSCOPIC SURGERY

• US 20130281821A1
• Filed: 01/03/2012
• Published: 10/24/2013
• Est. Priority Date: 01/13/2011
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Liu, Xin, Xu, Sheng, Lu, Kongkuo
• Application Number:
  US13/978,167
• Publication Number:
  US 20130281821A1
• Time in Patent Office: Days
• US Class Current: 600/409
• CPC Class Codes: A61B 1/00 Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes examination of body cavities or body tracts using ultrasonic, sonic or infrasonic waves A61B8/12; endoscopic instruments for taking cell samples or for biopsy A61B10/04; for surgical purposes A61B17/00; endoscopic surgical cutting instruments A61B17/32; surgical instruments using a laser beam being directed along or through a flexible conduit A61B18/22; Illuminating arrangements therefor for the eyes A61B3/00
• CPC Class Codes: A61B 1/000096 using artificial intelligence
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00158 using magnetic field
• CPC Class Codes: A61B 1/0125 Endoscope within endoscope
• CPC Class Codes: A61B 1/04 combined with photographic or television appliances
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 2017/00725 Calibration or performance testing
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/062 using magnetic field
• CPC Class Codes: A61B 5/066 Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras

Abstract

A surgical navigation system employs an endoscope (30) and an imaging unit (80). The endoscope (30) include an electromagnetic tracker (40) within a working channel of endoscope (30) for generating electromagnetic sensing signals indicative of one or more poses of the endoscope (30) within an anatomical region, and an endoscopic camera (50) within an imaging channel of the endoscope (30) for generating endoscopic images of the anatomical region. The imaging unit (80) executes an intraoperative calibration of the electromagnetic tracker (40) and the endoscopic camera (50) as a function of an image registration between the preoperative scan image of a calibration site within the anatomical region and one or more endoscopic images of the calibration site within the anatomical region.

Claims

1. A surgical navigation system, comprising:

an endoscope (30) including

an electromagnetic tracker (40) within a working channel of the endoscope (30) for generating electromagnetic sensing signals indicative of at least one pose of the endoscope (30) within an anatomical region, and

an endoscopic camera (50) within an imaging channel of the endoscope (30) for generating endoscopic images of the anatomical region; and

an imaging unit (80) operable to generate an intraoperative calibration of the electromagnetic tracker (40) and the endoscopic camera (50) as a function of an image registration between a preoperative scan image of a calibration site within the anatomical region and at least one endoscopic image of the calibration site within the anatomical region.

2. The surgical navigation system of claim 1, wherein the image registration includes:

navigating the endoscope (30) to a first pose within the anatomical region relative to the calibration site;

acquiring a first endoscopic image of the calibration site corresponding to the first pose of the endoscope (30) within the anatomical region relative to the calibration site;

executing a virtual endoscopic flythrough of the preoperative scan image to the first pose of the endoscope (30) within the anatomical region relative to the calibration site;

acquiring a first endoluminal image of the calibration site corresponding to the first pose of the endoscope (30) within the anatomical region relative to the calibration site; and

registering the first endoluminal image of the calibration site and the first endoscopic image of the calibration site including a computation of a first image transformation matrix (T<sub>C←

T</sub>).

3. The surgical navigation system of claim 2, wherein the anatomical region is a bronchial tree and the calibration site is a main carina.

4. The surgical navigation system of claim 2, wherein the intraoperative calibration further includes:

computing a calibration transformation matrix (T<sub>C←

E</sub>) as a function of the first image transformation matrix (T<sub>C←

T</sub>), an electromagnetic tracker transformation matrix (T<sub>R←

E</sub>) from the endoscope (30) tracker to a global reference, and an electromagnetic reference transformation matrix (T<sub>T←

R</sub>) from the global reference to the preoperative scan image of the anatomical region.

5. The surgical navigation system of claim 2, wherein the image registration includes:

navigating the endoscope (30) to a second pose within the anatomical region relative to the calibration site;

acquiring a second endoscopic image of the calibration site corresponding to the second pose of the endoscope (30) within the anatomical region relative to the calibration site;

executing a virtual endoscopic flythrough of the preoperative scan image to the second pose of the endoscope (30) within the anatomical region relative to the calibration site;

acquiring a second endoluminal image of the calibration site corresponding to the second pose of the endoscope (30) within the anatomical region relative to the calibration site; and

registering the second endoluminal image of the calibration site and the second endoscopic image of the calibration site including a computation of a second image transformation matrix (T<sub>C←

T</sub>).

6. The surgical navigation system of claim 5, wherein the intraoperative calibration includes:

averaging the first image transformation matrix (T<sub>C←

T</sub>) and the second image transformation matrix (T<sub>C←

T</sub>); and

computing a calibration transformation matrix (T<sub>C←

E</sub>) as a function of the averaged image transformation matrix (T<sub>C←

T</sub>), an electromagnetic tracker transformation matrix (T<sub>R←

E</sub>) from the endoscope (30) tracker to a global reference, and an electromagnetic reference transformation matrix (T<sub>T←

R</sub>) from the global reference to the preoperative scan image of the anatomical region.

7. The surgical navigation system of claim 1, wherein the imaging unit (80) is further operable to display an image integration of the preoperative scan image of the anatomical region and the at least one endoscopic image of the anatomical region derived from the image registration.

8. The surgical navigation system of claim 7, wherein:

the endoscope (30) is operable to be navigated to a surgical pose within the anatomical region relative to a surgical site as displayed by the image integration;

the electromagnetic tracker (40) is operable to be removed from the working channel subsequent to the endoscope (30) being navigated to the surgical pose; and

a surgical instrument is operable to be inserted within the working channel subsequent to a removal of the electromagnetic tracker (40) from the working channel.

14. The surgical navigation system of claim 1, wherein the imaging unit (80) is further operable to display an image integration of the preoperative scan image of the anatomical region and the at least one endoscopic image of the anatomical region derived from the image registration.

15. The surgical navigation system of claim 14, wherein:

the endoscope (30) is operable to be navigated to a surgical pose within the anatomical region relative to a surgical site as displayed by the image integration;

the electromagnetic tracker (40) is operable to be removed from the working channel subsequent to the endoscope (30) being navigated to the surgical pose; and

a surgical instrument is operable to be inserted within the working channel subsequent to a removal of the electromagnetic tracker (40) from the working channel.

9. A surgical navigation system, comprising:

an endoscope (30) including

an electromagnetic tracker (40) within a working channel of the endoscope (30) for generating electromagnetic sensing signals indicative of at least one pose of the endoscope (30) within an anatomical region, and

an endoscopic camera (50) within an imaging channel of the endoscope (30) for generating endoscopic images of the anatomical region;

an electromagnetic tracking unit responsive to the electromagnetic signals to electromagnetic track the endoscope (30) within the anatomical region relative to a global reference; and

an imaging unit (80) operable to execute an intraoperative calibration of the electromagnetic tracker (40) and the endoscopic camera (50) as a function of an image registration between a preoperative scan image of a calibration site within the anatomical region and at least one endoscopic image of the calibration site within the anatomical region and as a function of an electromagnetic registration of the global reference and the preoperative scan image.

10. The surgical navigation system of claim 9, wherein the image registration includes:

navigating the endoscope (30) to a first pose within the anatomical region relative to the calibration site;

acquiring a first endoscopic image of the calibration site corresponding to the first pose of the endoscope (30) within the anatomical region relative to the calibration site;

executing a virtual endoscopic flythrough of the preoperative scan image to the first pose of the endoscope (30) within the anatomical region relative to the calibration site;

acquiring a first endoluminal image of the calibration site corresponding to the first pose of the endoscope (30) within the anatomical region relative to the calibration site; and

registering the first image of the calibration site and the first endoscopic image of the calibration site including a computation of a first image transformation matrix (T<sub>C←

T</sub>).

11. The surgical navigation system of claim 10, wherein the intraoperative calibration includes:

computing a calibration transformation matrix (T<sub>C←

E</sub>) as a function of the first image transformation matrix (T<sub>C←

T</sub>), an electromagnetic tracker (40) transformation matrix (T<sub>R←

E</sub>) from the endoscope (30) tracker to the global reference, and an electromagnetic reference transformation matrix (T<sub>T←

R</sub>) from the global reference to the preoperative scan image of the anatomical region.

12. The surgical navigation system of claim 10, wherein the image registration further includes:

navigating the endoscope (30) to a second pose within the anatomical region relative to the calibration site;

acquiring a second endoscopic image of the calibration site corresponding to the second pose of the endoscope (30) within the anatomical region relative to the calibration site;

executing a virtual endoscopic flythrough of the preoperative scan image to the second pose of the endoscope (30) within the anatomical region relative to the calibration site;

acquiring a second endoluminal image of the calibration site corresponding to the second pose of the endoscope (30) within the anatomical region relative to the calibration site; and

registering the second endoluminal image of the calibration site and the second endoscopic image of the calibration site including a computation of a second image transformation matrix (T<sub>C←

T</sub>).

13. The surgical navigation system of claim 12, wherein the intraoperative calibration includes:

averaging the first image transformation matrix (T<sub>C←

T</sub>) and the second image transformation matrix (T<sub>C←

T</sub>); and

computing a calibration transformation matrix (T<sub>C←

E</sub>) as a function of the averaged image transformation matrix (T<sub>C←

T</sub>), an electromagnetic tracker (40) transformation matrix (T<sub>R←

E</sub>) from the endoscope (30) tracker to a global reference, and an electromagnetic reference transformation matrix (T<sub>T←

R</sub>) from the global reference to the preoperative scan image of the anatomical region.

16. A surgical navigation method, comprising:

executing an intraoperative calibration of an electromagnetic tracker (40) and an endoscopic camera (50) as a function of an image registration of a preoperative scan image of a calibration site within an anatomical region to at least one endoscopic image of the calibration site within the anatomical region; and

displaying an image integration of the preoperative scan image of the anatomical region and the at least one endoscopic image of the anatomical region derived from the image registration.

17. The surgical navigation method of claim 16, wherein the image registration includes:

navigating the endoscope (30) to a first pose within the anatomical region relative to the calibration site;

acquiring a first endoscopic image of the calibration site corresponding to the first pose of the endoscope (30) within the anatomical region relative to the calibration site;

executing a virtual endoscopic flythrough of the preoperative scan image to the first pose of the endoscope (30) within the anatomical region relative to the calibration site;

acquiring a first endoluminal image of the calibration site corresponding to the first pose of the endoscope (30) within the anatomical region relative to the calibration site; and

registering the first endoluminal image of the calibration site and the first endoscopic image of the calibration site including a computation of a first image transformation matrix (T<sub>C←

T</sub>).

18. The surgical navigation method of claim 17, wherein the intraoperative calibration includes:

computing a calibration transformation matrix (T<sub>C←

E</sub>) as a function of the first image transformation matrix (T<sub>C←

T</sub>), an electromagnetic tracker (40) transformation matrix (T<sub>R←

E</sub>) from the endoscope (30) tracker to the global reference, and an electromagnetic reference transformation matrix (T<sub>T←

R</sub>) from the global reference to the preoperative scan image of the anatomical region.

19. The surgical navigation method of claim 17, wherein the image registration further includes:

navigating the endoscope (30) to a second pose within the anatomical region relative to the calibration site;

acquiring a second endoscopic image of the calibration site corresponding to the second pose of the endoscope (30) within the anatomical region relative to the calibration site;

executing a virtual endoscopic flythrough of the preoperative scan image to the second pose of the endoscope (30) within the anatomical region relative to the calibration site;

acquiring a second endoluminal image of the calibration site corresponding to the second pose of the endoscope (30) within the anatomical region relative to the calibration site; and

registering the second endoluminal image of the calibration site and the second endoscopic image of the calibration site including a computation of a second image transformation matrix (T<sub>C←

T</sub>).

20. The surgical navigation method of claim 19, wherein the intraoperative calibration includes:

averaging the first image transformation matrix (T<sub>C←

T</sub>) and the second image transformation matrix (T<sub>C←

T</sub>); and

computing a calibration transformation matrix (T<sub>C←

E</sub>) as a function of the averaged image transformation matrix (T<sub>C←

T</sub>), an electromagnetic tracker (40) transformation matrix (T<sub>R←

E</sub>) from the endoscope (30) tracker to a global reference, and an electromagnetic reference transformation matrix (T<sub>T←

R</sub>) from the global reference to the preoperative scan image of the anatomical region.