Frame Mapping and Force Feedback Methods, Devices and Systems

• US 20140142593A1
• Filed: 10/08/2013
• Published: 05/22/2014
• Est. Priority Date: 04/16/2007
• Status: Active Grant

• Current Assignee: Deerfield Imaging Incorporated
• Original Assignee: Deerfield Imaging SA RL
• Inventors: Fielding, Tim, Newhook, Perry
• Granted Patent: US 9,044,257 B2
• Time in Patent Office: Days
• US Class Current: 606/130
• CPC Class Codes: A61B 2034/305 Details of wrist mechanisms at distal ends of robotic arms
• CPC Class Codes: A61B 2090/064 for measuring force, pressure or mechanical tension
• CPC Class Codes: A61B 34/30 Surgical robots
• CPC Class Codes: A61B 34/37 Master-slave robots A61B34/35 takes precedence
• CPC Class Codes: A61B 34/76 Manipulators having means for providing feel, e.g. force or tactile feedback
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: B25J 9/1689 Teleoperation
• CPC Class Codes: G05B 2219/40137 Force sensation feedback from simulated tool
• CPC Class Codes: G05B 2219/40182 Master has different configuration than slave manipulator
• CPC Class Codes: G05B 2219/40401 Convert workspace of master to workspace of slave
• CPC Class Codes: G05B 2219/45117 Medical, radio surgery manipulator

Abstract

Methods, devices, and systems for controlling movement of a slave manipulator by an operator controlling a master manipulator in a way that the motion of that slave manipulator can be presented via a display to the operator such that the displayed position of the slave manipulator is intuitive to the operator, regardless of the actual position and orientation of the slave manipulator. Methods, devices, and systems relating to force feedback associated with medical robotic procedures.

Claims

1-104. -104. (canceled)

105. A method for controlling movement of a robotic arm of a medical robot system, the robotic arm operatively associated with a tool, the medical robot system comprising:

a medical robot under operator control having at least one robotic arm,

a camera configured to provide an image of the tool, and

a reference structure having a fixed orientation relative to the camera, the method comprising;

determining a calculated motion of the tool wherein;

the determining of the calculated motion is based on an input value received from a controller device that provides input from a user; and

the calculated motion is expressed in an observer coordinate system that comprises a first axis oriented in fixed relation with an axis of the tool and a second axis oriented orthogonal to the first axis and such that its projection into a plane defined by X and Y axis of an orthogonal coordinate system defined relative to the reference structure is parallel to and pointing in the same direction as the X axis; and

outputting an actuation signal to move the robotic arm in accordance with the calculated motion.

107. The method of claim 105, further comprising:

determining a calculated observer force value that is expressed in the observer coordinate system and based on a virtual force value; and

outputting a feedback signal to the controller device in accordance with the calculated observer force value.

108. The method of claim 105, further comprising:

determining a calculated observer force value that is expressed in the observer coordinate system and based on a measured force value from the robotic arm; and

outputting a feedback signal to the controller device in accordance with the calculated observer force value.

109. The method of claim 108, wherein the calculated observer force value is also based on a virtual force value.

110. The method of claim 109, wherein calculation of the virtual force value comprises using one or more calculated virtual collisions, one or more joint limits, motion divergence or a combination thereof.

157. A computer readable medium comprising machine readable instructions for performing the method according to claim 105.

159. A control system for use in control of at least one medical robotic arm, the control system configured in accordance with the method according to claim 105.

106. (canceled)

111-117. -117. (canceled)

118. The method of 105, further comprising:

determining a second calculated motion of a second tool of a second robotic arm, where;

the determining of the second calculated motion is based on a second input value received from a second controller device that provides input from the user; and

the

second calculated motion is expressed in a second observer coordinate system that is based on the orientation of the second tool and the orientation of the observer reference structure; and

outputting a second actuation signal to move the second robotic arm in accordance with the second calculated motion.

119. The method of claim 118, further comprising:

determining a second calculated observer force value that is expressed in the second observer coordinate system and based on a second virtual force value; and

outputting a second feedback signal to the second controller device in accordance with the second calculated observer force value.

120. The method of claim 118, further comprising:

determining a second calculated observer force value that is expressed in the second observer coordinate system and based on a second measured force value from the second robotic arm; and

outputting a second feedback signal to the second controller device in accordance with the second calculated observer force value.

121. The method of claim 120, wherein the second calculated observer force value is also based on a second virtual force value.

122. The method of claim 121, wherein calculation of the second virtual force value comprises using one or more calculated virtual collisions, one or more joint limits, motion divergence, or a combination thereof.

123-129. -129. (canceled)

130. A method for controlling movement of a robotic arm of a medical robot system, the robotic arm operatively associated with a tool, the medical robot system comprising:

a medical robot under operator control having at least one robotic arm,

a camera configured to provide an image of the tool, and

a reference structure having a fixed orientation relative to the camera, the method comprising;

receiving an input value from a controller device representative of a desired motion of the tool, wherein the input value is expressed in a controller device coordinate system;

determining a calculated motion of the tool based on the input value, wherein the calculated motion is expressed in an observer coordinate system that comprises a first axis oriented in fixed relation with an axis of the tool and a second axis oriented orthogonal to the first axis and such that its projection into a plane defined by X and Y axis of an orthogonal coordinate system defined relative to the reference structure is parallel to and pointing in the same direction as the X axis;

determining a commanded motion of the robotic arm based on the calculated motion and the position of the robotic arm;

outputting an actuation signal to move the robotic arm in accordance with the commanded motion;

determining a calculated observer force value that is expressed in the observer coordinate system;

determining a controller device feedback force value based on the calculated observer force value, wherein the controller device feedback force is expressed in the controller device coordinate system; and

outputting a feedback signal to the controller device in accordance with the controller device feedback force value.

133. The method of claim 130, where:

the input value can be expressed in the controller device coordinate system as an input vector having an input magnitude and an input direction;

the calculated motion can be expressed in the observer coordinate system as a calculated motion vector having a calculated motion magnitude and a calculated motion direction; and

the calculated motion direction equals the input direction.

134. The method of claim 133, wherein the determining of the calculated observer force value comprises using a virtual force value.

135. The method of claim 133, further comprising:

receiving a measured force value from the robotic arm, wherein the measured force value is representative of a force measured at a location on the robotic arm and expressed in a sensor coordinate system; and

where;

the determining of the calculated observer force value comprises using the measured force value and the position of the robotic arm.

136. The method of claim 135, wherein the determining of the calculated observer force value further comprises using a virtual force value.

137. The method of claim 136, wherein calculation of the virtual force value comprises using one or more calculated virtual collisions.

138. The method of claim 136, wherein calculation of the virtual force value comprises using one or more joint limits.

139. The method of claim 136, wherein calculation of the virtual force value comprises using motion divergence.

140. The method of claim 136, wherein calculation of the virtual force value comprises using one or more calculated virtual collisions, one or more joint limits, motion divergence, or a combination thereof.

158. A computer readable medium comprising machine readable instructions for performing the method according to claim 130.

160. A control system for use in control of at least one medical robotic arm, the control system configured in accordance with the method according to claims 130.

131-132. -132. (canceled)

141-156. -156. (canceled)