SYSTEM AND METHOD FOR IMAGE-BASED ALIGNMENT OF AN ENDOSCOPE

• US 20150223668A1
• Filed: 04/23/2015
• Published: 08/13/2015
• Est. Priority Date: 04/26/2004
• Status: Active Grant

• Current Assignee: Covidien LP (Medtronic Plc)
• Original Assignee: Covidien LP (Medtronic Plc)
• Inventors: GILBOA, PINHAS, GREENBURG, BENNY, BLECHER, DANNY
• Granted Patent: US 10,321,803 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00128 mechanical, e.g. for tubes or pipes
• CPC Class Codes: A61B 1/00137 End pieces at either end of the endoscope, e.g. caps, seals or forceps plugs
• CPC Class Codes: A61B 1/0014 Fastening element for attaching accessories to the outside of an endoscope, e.g. clips, clamps or bands
• CPC Class Codes: A61B 1/00147 Holding or positioning arrangements
• CPC Class Codes: A61B 1/0052 Constructional details of control elements, e.g. handles
• CPC Class Codes: A61B 1/012 characterised by internal passages or accessories therefor
• CPC Class Codes: A61B 1/018 for receiving instruments
• CPC Class Codes: A61B 1/042 characterised by a proximal camera, e.g. a CCD camera
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/06 Devices, other than using radiation, for detecting or locating foreign bodies for removing same A61B17/50 ; determining position of probes within or on the body of the patient
• CPC Class Codes: A61B 5/062 using magnetic field
• CPC Class Codes: A61B 5/415 the glands, e.g. tonsils, adenoids or thymus
• CPC Class Codes: A61B 5/418 lymph vessels, ducts or nodes
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/037 Emission tomography
• CPC Class Codes: A61B 8/13 Tomography A61B8/10, A61B8/12 take precedence; tomography for radiation diagnosis A61B6/02
• CPC Class Codes: A61B 90/50 : Supports for surgical instruments, e.g. articulated arms
• CPC Class Codes: A61B 90/57 : Accessory clamps

Abstract

Systems and methods for endoscopic procedures employ a first technique to ensure initial correct alignment of an endoscope (100) with a desired target (10). A reference image (51) is then acquired from an imaging arrangement associated with the endoscope. During a subsequent stage of the procedure, tracking of the endoscope position relative to the target is performed partially or entirely by image-based tracking by comparing features in real-time video image (52) produced by imaging arrangement with features in the reference image (51). The feature comparison may be performed visually by a user, or may be automated to offer more specific corrective suggestions to the user.

Claims

1. A method for confirming correct alignment of a distal end of an endoscope including an imaging arrangement during an endoscopic procedure, the method comprising:

(a) positioning the distal end of the endoscope adjacent to a target location and capturing a reference image using the imaging arrangement;

(b) sensing a real-time video image using the imaging arrangement; and

(c) comparing features of the real-time video image with the reference image to confirm correct alignment of the endoscope.

2. The method of claim 1, wherein said step of positioning employs a target location identified in three-dimensional image data of a region of a body to be treated.

3. The method of claim 2, wherein said three-dimensional image data is derived from an imaging technique selected from:

computerized tomography;

magnetic resonance imaging;

positron emission tomography; and

ultrasound.

4. The method of claim 2, wherein said step of positioning employs a position sensor associated with the distal end of the endoscope, said position sensor being part of a position measuring system.

5. The method of claim 4, wherein said step of positioning is performed by comparing the position of the distal end of the endoscope as measured by said position measuring system and the target location as identified in said image data.

6. The method of claim 4, wherein said position sensor is part of an elongated element deployed within a working channel of the endoscope, and wherein said elongated element is withdraw from the working channel prior to said comparing.

7. The method of claim 1, wherein said target location is not visible in said reference image.

8. The method of claim 1, further comprising displaying simultaneously said reference image and said real-time video image to facilitate performance of said comparing features visually by a user.

9. The method of claim 1, wherein said comparing includes co-processing said reference image and at least one frame from said real-time video to determine a measure of mismatch, the method further comprising generating an alarm signal if said measure of mismatch exceeds a predefined value.

10. The method of claim 1, wherein said comparing includes co-processing said reference image and at least one frame from said real-time video to determine a displacement correction required to compensate for erroneous movement of the endoscope, the method further comprising generating a display indicative to a user of said displacement correction required to compensate for the erroneous movement of the endoscope.

11. The method of claim 1, wherein said comparing includes co-processing said reference image and at least one frame from said real-time video to determine a transformation relating said real-time video frame to said reference image, the method further comprising generating a display corresponding to said real-time video with addition of an indication of a target location, position of said indication being derived at least in part by use of said transformation.

12. The method of claim 1, wherein the endoscope is a bronchoscope.

13. A system for ensuring correct alignment of an endoscope during performance of an endoscopic procedure, the system comprising:

(a) an endoscope having a distal end for insertion into a body;

(b) an imaging arrangement associated with said endoscope and configured to generate a real-time video image of a region beyond said distal end; and

(c) a processing system associated with said imaging arrangement and configured to;

(i) in an initial state of alignment with a target location, derive from said imaging arrangement a reference image corresponding to correct alignment with the target location, (ii) derive from said imaging arrangement real-time images of the region beyond said distal end, and (iii) co-process said reference image and said real-time images to determine a current alignment status of said endoscope with the target location.

14. The system of claim 13, wherein said processing system is configured to co-process said reference image and said real-time images to determine a measure of mismatch, said processing system further generating an alarm signal if said measure of mismatch exceeds a predefined value.

15. The system of claim 13, further comprising a display for displaying at least said real-time images to a user, wherein said processing system is configured to co-process said reference image and said real-time images to determine a displacement correction required to compensate for erroneous movement of the endoscope, said processing system further generating an indication on said display indicative to a user of said displacement correction required to compensate for the erroneous movement of the endoscope.

16. The system of claim 13, further comprising a display for displaying at least said real-time images to a user, wherein said processing system is configured to co-process said reference image and said real-time images to determine a transformation relating said real-time video frame to said reference image, said processing system further generating on said display an indication of a target location, position of said indication being derived at least in part by use of said transformation.

17. The system of claim 13, further comprising a position measuring system including a position sensor carried by an elongated element removably deployable along a working channel of said endoscope.

18. A method for facilitating performance of an endoscopic procedure on a target which is obscured from view by an imaging arrangement of an endoscope, the method comprising:

(a) generating real-time video from the imaging arrangement of the endoscope;

(b) determining a position of the target and a position of a distal end of the endoscope;

(c) generating a display including the real-time video and a simulated view of the target correctly positioned within the real-time video; and

(d) adjusting the display so as to maintain the target correctly positioned within the real-time video when the endoscope is moved.

19. The method of claim 18, wherein said adjusting includes comparing features from at least one frame of the real-time video with features from a reference image derived from the imaging arrangement during said step of determining, thereby deriving a transformation relating said real-time video frame to said reference image.

20. The method of claim 18, wherein said determining a position of a distal end of the endoscope is performed using position measuring system including a position sensor carried by an elongated element removably deployable along a working channel of said endoscope.