Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide

• US 10,368,952 B2
• Filed: 07/11/2017
• Issued: 08/06/2019
• Est. Priority Date: 06/27/2008
• Status: Active Grant

• Current Assignee: Intuitive Surgical Operations, Inc. (Intuitive Surgical Holdings, LLC)
• Original Assignee: Intuitive Surgical Operations, Inc. (Intuitive Surgical Holdings, LLC)
• Inventors: Tognaccini, Marc E., Gomez, Daniel H., Diolaiti, Nicola, Mustufa, Tabish, Mitra, Probal, Lilagan, Paul E.
• Primary Examiner(s): Getzow, Scott M.
• Application Number:
  US15/646,685
• Publication Number:
  US 20170304012A1
• Time in Patent Office: 756 Days
• CPC Class Codes: A61B 1/00183 for variable viewing angles
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 1/018 for receiving instruments
• CPC Class Codes: A61B 1/04 combined with photographic or television appliances
• CPC Class Codes: A61B 2034/101 Computer-aided simulation of surgical operations
• CPC Class Codes: A61B 2034/102 Modelling of surgical devices, implants or prosthesis
• CPC Class Codes: A61B 2034/104 Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2059 Mechanical position encoders
• CPC Class Codes: A61B 2034/301 for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
• CPC Class Codes: A61B 2034/302 specifically adapted for manipulations within body cavities, e.g. within abdominal or thoracic cavities
• CPC Class Codes: A61B 2034/303 specifically adapted for manipulations within body lumens, e.g. within lumen of gut, spine, or blood vessels
• CPC Class Codes: A61B 2034/305 Details of wrist mechanisms at distal ends of robotic arms
• CPC Class Codes: A61B 2034/306 Wrists with multiple vertebrae
• CPC Class Codes: A61B 2090/0811 for the position of a particular part of an instrument with respect to the rest of the instrument, e.g. position of the anvil of a stapling instrument
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/35 : for telesurgery
• CPC Class Codes: A61B 34/37 : Master-slave robots A61B34/35 takes precedence
• CPC Class Codes: A61B 90/00 : Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges protective face masks A41D13/11; surgeon's or patient's gowns or dresses A41D13/12; devices for carrying-off, for treatment of, or for carrying-over, body liquids A61M1/00
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation

Abstract

A medical robotic system includes an entry guide with surgical tools and a camera extending out of its distal end. To supplement the view provided by an image captured by the camera, an auxiliary view including articulatable arms of the surgical tools and/or camera is generated from sensed or otherwise determined information about their positions and orientations are displayed along with indications of range of motion limitations on a display screen from the perspective of a specified viewing point.

Claims

1. A medical system comprising:

an entry guide;

a display; and

a processor configured to;

receive information of states of the entry guide and a first articulatable instrument, the first articulatable instrument controllably extendable out of a distal end of the entry guide, the first articulatable instrument having a most proximal joint and a most distal joint;

generate a view by including a graphical representation of the most distal joint of the first articulatable instrument and a graphical representation of a spatial boundary for the first articulatable instrument when the most distal joint is disposed beyond the distal end of the entry guide, the spatial boundary being a function of a position of the most distal joint relative to the distal end of the entry guide, and the graphical representation being positioned in the view by using the received information and by using forward kinematics of the entry guide and the first articulatable instrument; and

cause the view to be displayed on the display.

2. The medical system according to claim 1, wherein the view is generated from a perspective looking in a distal direction from the distal end of the entry guide.

3. The medical system according to claim 2, wherein the first articulated instrument comprises:

first, second and third links; and

a second joint;

wherein the most proximal joint couples a distal end of the first link to a proximal end of the second link so that the second link is rotatable relative to the first link at the most proximal joint; and

wherein the second joint couples a distal end of the second link to a proximal end of the third link so that the third link rotates relative to the second link at the second joint in tandem with rotation of the most proximal joint in such a fashion that longitudinal axes of the first and third links are parallel to each other;

wherein the distal end of the entry guide has a first lumen;

wherein the first articulatable instrument extends through the first lumen;

wherein the generated view includes at least one of an outline of the distal end of the entry guide and a graphical representation of the most proximal joint of the first articulatable instrument; and

wherein the graphical representation of the most proximal joint of the first articulatable instrument appears in the generated view as a first object that is positioned in the generated view where the first lumen would be relative to the outline of the distal end of the entry guide when the generated view includes the graphical representation of the most proximal joint of the first articulatable instrument.

4. The medical system according to claim 3, wherein the first articulatable instrument comprises:

a first device having a proximal end and a distal tip;

wherein the most distal joint of the first articulatable instrument couples a distal end of the third link of the first articulatable instrument to the proximal end of the first device so that the first device is rotatable relative to the third link at the most distal joint;

wherein the graphical representation of the most distal joint of the first articulatable instrument appears as a second object that is positioned in the generated view so as to reflect at least one angle of rotation of the first link about a central axis of the first link, and a length of the second link.

5. The medical system according to claim 4, wherein the generated view includes a graphical representation of the distal tip of the first device as a third object that is positioned in the generated view so as to reflect at least one angle of rotation of the first device about the most proximal joint of the first articulatable instrument, an angle of rotation of the first link about the central axis of the first link, and a length that the distal tip of the first device extends from the most proximal joint of the first articulatable instrument.

6. The medical system according to claim 5, wherein the graphical representation of the spatial boundary comprises a boundary circle sharing a common center with the first object when the generated view includes the graphical representation of the most proximal joint of the first articulatable instrument.

7. The medical system according to claim 6, wherein the second object is depicted in the generated view as changing color as the second object approaches the boundary circle.

8. The medical system according to claim 6, wherein at least a portion of the boundary circle is depicted in the generated view as changing color as the second object approaches the boundary circle.

9. The medical system according to claim 5, wherein the first link of the first articulatable instrument instruments is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link is indicated in the generated view by lengths of rays emanating away from at least one of the first, second, and third objects.

10. The medical system according to claim 5, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link is indicated by a change in color of at least one of the first, second, and third objects.

11. The medical system according to claim 5, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link is indicated by a change in relative sizes between at least two of the first, second, and third objects.

12. The medical system according to claim 5, wherein the generated view further comprises graphical representations of a first segment connecting the first and second objects and a second segment connecting the second and third objects, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link is indicated by a change in color of at least one of the first and second segments.

13. The medical system according to claim 5, wherein the generated view further comprises graphical representations of a first segment connecting the first and second objects and a second segment connecting the second and third objects, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link is indicated by a change in size of at least one of the first and second segments.

14. The medical system according to claim 5, wherein the generated view further comprises graphical representations of a first segment connecting the first and second objects and a second segment connecting the second and third objects, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link is indicated by a change in shape of at least one of their corresponding first and second segments.

15. The medical system according to claim 5, wherein the first device of the first articulatable instrument includes a first element hinged to a second element so that the first and second elements are controllably opened and closed so as to result in an angle between the first and second elements, and wherein the third object corresponding to the first device has two jaws displayed so as to indicate the angle between the first and second elements.

16. The medical system according to claim 5, wherein the first device of the first articulatable instrument includes an image capturing element of an articulatable camera instrument, and wherein the displayed generated view supplements an image displayed on the display screen which is derived from an image captured by the articulatable camera instrument.

17. The medical system according to claim 16, wherein the third object corresponding to the image capturing element of the articulatable camera instrument has an area displayed on the display screen so as to indicate a field-of-view of the articulatable camera instrument.

18. A medical system comprising:

an entry guide;

an input device;

a display; and

a processor configured to assist an operator to reposition the entry guide to increase an available range of motion of at least one of a plurality of articulatable instruments when extending out of a distal end of the entry guide, wherein each of the plurality of articulatable instruments has a plurality of joints including a most distal joint, and wherein an available range of motion of each of the plurality of articulatable instruments is a function of a relative position of the most distal joint of the articulatable instrument to the distal end of the entry guide, by;

determining positions of the entry guide, the most distal joint of each of the plurality of articulatable instruments, and the available range of motion of each of the plurality of articulatable instruments;

causing graphical representations of the most distal joint and the available range of motion for each of the plurality of articulatable instruments to be displayed on the display according to their respectively determined positions; and

causing the entry guide to be moved according to operator manipulation of the input device so as to increase the available range of motion of at least one of the plurality of articulatable instruments while the operator is viewing the display and while the most distal joints of the plurality of articulatable instruments are being controllably held in place.

19. The medical system of claim 18,

wherein the processor is further configured to assist the operator to reposition the entry guide by:

causing an indication to be displayed on the display, the indication indicating that the at least one of the plurality of articulatable instruments is nearing a range of motion limit prior to moving the entry guide according to operator manipulation of the input device.

20. The medical system of claim 18,

wherein the processor is further configured to assist the operator to reposition the entry guide by:

causing the graphical representation of the available range of motion of each of the plurality of articulatable instruments to be displayed on the display by a first line style if the articulatable instrument is an operator manipulatable articulatable instrument; and

causing the graphical representation of the available range of motion of each of the plurality of articulatable instruments to be displayed on the display in a different manner than the first line style if the articulatable instrument is not an operator manipulatable articulatable instrument.