DYNAMIC 3D LUNG MAP VIEW FOR TOOL NAVIGATION INSIDE THE LUNG

• US 20190269462A1
• Filed: 05/21/2019
• Published: 09/05/2019
• Est. Priority Date: 07/02/2014
• Status: Active Grant

• Current Assignee: Covidien LP (Medtronic Plc)
• Original Assignee: Covidien LP (Medtronic Plc)
• Inventors: Weingarten, Oren P., Barak, Ron
• Granted Patent: US 10,646,277 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 2017/00809 Lung operations
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 90/37 Surgical systems with images on a monitor during operation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/30064 Lung nodule
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

A method for implementing a dynamic three-dimensional lung map view for navigating a probe inside a patient'"'"'s lungs includes loading a navigation plan into a navigation system, the navigation plan including a planned pathway shown in a 3D model generated from a plurality of CT images, inserting the probe into a patient'"'"'s airways, registering a sensed location of the probe with the planned pathway, selecting a target in the navigation plan, presenting a view of the 3D model showing the planned pathway and indicating the sensed location of the probe, navigating the probe through the airways of the patient'"'"'s lungs toward the target, iteratively adjusting the presented view of the 3D model showing the planned pathway based on the sensed location of the probe, and updating the presented view by removing at least a part of an object forming part of the 3D model.

Claims

1. (canceled)

2. A method for providing a map view of a lung for navigating a tool during a procedure comprising:

generating a three-dimensional (3D) model of the lung including at least one target;

receiving an indication of a target to be navigated to;

displaying a pathway through the 3D model of the lung to the target;

determining a location of a probe;

registering the determined location of the probe to the 3D model;

displaying a representation of the probe in the 3D model at the determined location;

determining a new location of the probe;

removing at least a first portion of the 3D model from the display;

altering a transparency of a different target displayed in the 3D model; and

altering the transparency of an airway displayed in the 3D model that obscures one or more of the pathway, an airway tree being navigated, the target, or a representation of the probe displayed in the 3D model.

3. The method of claim 2, wherein first portion includes a portion of the airway tree that is outside of a presented view on the 3D model.

4. The method of claim 3, wherein the display of the representation of the probe in the 3D model is automatically updated based on a determined position of a sensor.

5. The method of claim 4, wherein the sensor is an electromagnetic sensor.

6. The method of claim 3, wherein the removing is a function of an adjustment to a level of zoom of the 3D model.

7. A method comprising:

displaying a planned pathway to a target in a 3D model of a luminal network;

registering a determined location of a probe with the 3D model;

displaying a representation of the probe at the determined location in the 3D model;

detecting a new location of the probe;

adjusting a displayed view of the 3D model and planned pathway based on the new location; and

removing at least a portion of an object forming a part of the displayed view of the 3D model.

8. The method of claim 7, wherein the removing is performed in response to the adjusting.

9. The method of claim 8, wherein the object is at least one of another target, an area outside of a region of interest, a branch of an airway tree, or an item obscuring the region of interest.

10. The method of claim 7, wherein the displayed view is automatically updated based on data from a sensor in the probe.

11. The method of claim 7, further comprising adjusting transparency of an item obscuring at least one of the probe, an airway tree, a pathway, or the target.

12. The method of claim 7, wherein the removing is performed based on adjusting a level of zoom.

13. The method of claim 7, wherein the determined location is determined based on signals received from an electromagnetic sensor.

14. The method of claim 7, wherein the displayed view is a view orthogonal to a vector between the representation of the probe and the target in the 3D model.

15. The method of claim 7, wherein the displayed view is a viewpoint from a distal portion of the probe in a direction of the target.

16. A method for providing a map view of a lung for navigating a tool in a procedure comprising:

generating a three-dimensional (3D) model of the lung including at least one target;

displaying a pathway through the 3D model of the lung to arrive at the target;

determining a location of a probe;

registering the determined location of the probe to the 3D model;

displaying a representation of the probe in the 3D model at the determined location;

determining a new location of the probe; and

updating the display of the representation of the probe in the 3D model to the new location,

wherein updating the display includes hiding or ghosting out at least a portion of an object in the 3D model that at least one of obscures one or more of the pathway, an airway being navigated, the target, a representation of the probe, or is not relevant to the procedure.

17. The method of claim 16, wherein the hiding or the ghosting out is at least one of removal or altering a transparency of at least the portion of the object.

18. The method of claim 16, wherein the hiding or the ghosting out is altering an appearance of the 3D model.

19. The method of claim 16, further comprising removing a portion of the object from the display of the representation of the probe in the 3D model.

20. The method of claim 16, wherein the display of the representation of the probe in the 3D model is automatically updated based on a determined position of a sensor.

21. The method of claim 20, wherein the determined location of the probe is derived from signals received from an electromagnetic sensor.

22. The method of claim 16, wherein the display of the representation of the probe in the 3D model is updated upon detection of a direction of travel of a sensor.

23. The method of claim 16, wherein the display of the representation of the probe in the 3D model is updated to adjust a level of zoom when the probe approaches the target in the 3D model.