Medical robotic system providing an auxiliary view including range of motion limitations for articulatable instruments extending out of a distal end of an entry guide

• US 9,089,256 B2
• Filed: 06/23/2009
• Issued: 07/28/2015
• Est. Priority Date: 06/27/2008
• Status: Active Grant

• Current Assignee: Intuitive Surgical Operations, Inc. (Intuitive Surgical Holdings, LLC)
• Original Assignee: Intuitive Surgical Operations, Inc. (Intuitive Surgical Holdings, LLC)
• Inventors: Gomez, Daniel H., Diolaiti, Nicola, Mustufa, Tabish, Lilagan, Paul E., Tognaccini, Marc E., Mitra, Probal
• Primary Examiner(s): Rodjom, Katherine
• Assistant Examiner(s): OBU, KENDRA NNEAMAKA
• Application Number:
  US12/489,566
• Publication Number:
  US 20090326318A1
• Time in Patent Office: 2,226 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 1/00183 for variable viewing angles
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 1/018 for receiving instruments
• CPC Class Codes: A61B 1/04 combined with photographic or television appliances
• CPC Class Codes: A61B 2034/101 Computer-aided simulation of surgical operations
• CPC Class Codes: A61B 2034/102 Modelling of surgical devices, implants or prosthesis
• CPC Class Codes: A61B 2034/104 Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2034/2059 Mechanical position encoders
• CPC Class Codes: A61B 2034/301 for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
• CPC Class Codes: A61B 2034/302 specifically adapted for manipulations within body cavities, e.g. within abdominal or thoracic cavities
• CPC Class Codes: A61B 2034/303 specifically adapted for manipulations within body lumens, e.g. within lumen of gut, spine, or blood vessels
• CPC Class Codes: A61B 2034/305 Details of wrist mechanisms at distal ends of robotic arms
• CPC Class Codes: A61B 2034/306 Wrists with multiple vertebrae
• CPC Class Codes: A61B 2090/0811 for the position of a particular part of an instrument with respect to the rest of the instrument, e.g. position of the anvil of a stapling instrument
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/35 : for telesurgery
• CPC Class Codes: A61B 34/37 : Master-slave robots A61B34/35 takes precedence
• CPC Class Codes: A61B 90/00 : Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges protective face masks A41D13/11; surgeon's or patient's gowns or dresses A41D13/12; devices for carrying-off, for treatment of, or for carrying-over, body liquids A61M1/00
• CPC Class Codes: A61B 90/361 : Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation

Abstract

A medical robotic system includes an entry guide with surgical tools and a camera extending out of its distal end. To supplement the view provided by an image captured by the camera, an auxiliary view including articulatable arms of the surgical tools and/or camera is generated from sensed or otherwise determined information about their positions and orientations are displayed along with indications of range of motion limitations on a display screen from the perspective of a specified viewing point.

Claims

1. A method for providing a computer-generated view of at least a first articulatable instrument extending out of a distal end of an entry guide, the first articulatable instrument having a most proximal joint and a most distal joint, the most distal joint disposed beyond the distal end of the entry guide, the method comprising:

receiving information of states of the entry guide and the first articulatable instrument;

generating the computer-generated view to include a graphical representation of the most distal joint of the first articulatable instrument and a graphical representation of a spatial boundary for the first articulatable instrument, the spatial boundary being a function of a position of the most distal joint relative to the distal end of the entry guide, and the graphical representations being positioned in the computer-generated view by using the received information and by using forward kinematics of the entry guide and the first articulatable instrument; and

displaying the computer-generated view on a display screen.

2. The method according to claim 1, wherein the computer-generated view is generated from a perspective looking in a distal direction from the distal end of the entry guide.

3. The method according to claim 1, wherein the first articulatable instrument comprises:

first, second, and third links; and

a second joint;

wherein the most proximal joint couples a distal end of the first link to a proximal end of the second link so that the second link is rotatable relative to the first link at the most proximal joint;

wherein the second joint couples a distal end of the second link to a proximal end of the third link so that the third link rotates relative to the second link at the second joint in tandem with rotation of the most proximal joint in such a fashion that longitudinal axes of the first and third links are parallel to each other;

wherein the distal end of the entry guide has a first lumen;

wherein the first articulatable instrument extends through the first lumen;

wherein the computer-generated view includes at least one of an outline of the distal end of the entry guide and a graphical representation of the most proximal joint of the first articulatable instrument; and

wherein the graphical representation of the most proximal joint of the first articulatable instrument appears in the computer-generated view as a first object that is positioned in the computer-generated view where the first lumen would be relative to the outline of the distal end of the entry guide when the computer-generated view includes the graphical representation of the most proximal joint of the first articulatable instrument.

4. The method according to claim 1, wherein the first articulatable instrument comprises:

a first device having a proximal end and a distal tip;

wherein the most distal joint of the first articulatable instrument couples a distal end of the third link of the first articulatable instrument to the proximal end of the first device so that the first device is rotatable relative to the third link at the most distal joint; and

wherein the graphical representation of the most distal joint of the first articulatable instrument appears as a second object that is positioned in the computer-generated view so as to reflect at least one of;

an angle of rotation of the second link about the most proximal joint, an angle of rotation of the first link about a central axis of the first link, and a length of the second link.

5. The method according to claim 4, wherein the computer-generated view includes a graphical representation of the distal tip of the first device as a third object that is positioned in the computer-generated view so as to reflect at least one of:

an angle of rotation of the first device about the most proximal joint of the first articulatable instrument, an angle of rotation of the first link about the central axis of the first link, and a length that the distal tip of the first device extends from the most proximal joint of the first articulatable instrument.

6. The method according to claim 5, wherein the graphical representation of the spatial boundary comprises a boundary circle sharing a common center with the first object when the computer-generated view includes the graphical representation of the most proximal joint of the first articulatable instrument.

7. The method according to claim 6, wherein the second object is depicted in the computer-generated view as changing color as the second object approaches the boundary circle.

8. The method according to claim 6, wherein at least a portion of the boundary circle is depicted in the computer-generated view as changing color as the second object approaches the boundary circle.

9. The method according to claim 5, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link out of the distal end of the entry guide is indicated in the computer-generated view by lengths of rays emanating away from at least one of the first, second, and third objects.

10. The method according to claim 5, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link out of the distal end of the entry guide is indicated by a change in color of at least one of the first, second, and third objects.

11. The method according to claim 5, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link out of the distal end of the entry guide is indicated by a change in relative sizes between at least two of the first, second, and third objects.

12. The method according to claim 5, wherein the computer-generated view further comprises graphical representations of a first segment connecting the first and second objects and a second segment connecting the second and third objects, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link out of the distal end of the entry guide is indicated by a change in color of at least one of the first and second segments.

13. The method according to claim 5, wherein the computer-generated view further comprises graphical representations of a first segment connecting the first and second objects and a second segment connecting the second and third objects, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link out of the distal end of the entry guide is indicated by a change in size of at least one of the first and second segments.

14. The method according to claim 5, wherein the computer-generated view further comprises graphical representations of a first segment connecting the first and second objects and a second segment connecting the second and third objects, wherein the first link of the first articulatable instrument is extendable out of the distal end of the entry guide, and wherein a length of extension of the first link out of the distal end of the entry guide is indicated by a change in shape of at least one of the first and second segments.

15. The method according to claim 5, wherein the first device of the first articulatable instrument includes a first element hinged to a second element so that the first and second elements are controllably opened and closed so as to result in an angle between the first and second elements, and wherein the third object corresponding to the first device has two jaws displayed so as to indicate the angle between the first and second elements.

16. The method according to claim 5, wherein the first device of the first articulatable instrument includes an image capturing element of an articulatable camera instrument, and wherein the displayed computer-generated view supplements an image displayed on the display screen which is derived from an image captured by the articulatable camera instrument.

17. The method according to claim 16, wherein the third object corresponding to the image capturing element of the articulatable camera instrument has an area displayed on the display screen so as to indicate a field-of-view of the articulatable camera instrument.