INTUITIVE GRASP CONTROL OF A MULTI-AXIS ROBOTIC GRIPPER

• US 20140277742A1
• Filed: 03/14/2013
• Published: 09/18/2014
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: MENASSA, ROLAND J., WELLS, JAMES W., EINAV, OMER, PERLIS, NOAM
• Granted Patent: US 9,199,376 B2
• Time in Patent Office: Days
• US Class Current: 700/264
• CPC Class Codes: B25J 15/0009 comprising multi-articulated fingers, e.g. resembling a human hand
• CPC Class Codes: B25J 9/1612 characterised by the hand, wrist, grip control
• CPC Class Codes: G05B 2219/40099 Graphical user interface for robotics, visual robot user interface

Abstract

A system includes a robotic gripper and a grasp controller. The gripper, which has a sensory matrix that includes a plurality of sensors, executes selected grasp poses with respect to a component in the corresponding method to thereby grasp the component in response to a grasp command signal from the controller. The controller has a touch-screen or other interactive graphical user interface (GUI) which generates a jog signal in response to an input from a user. Sensory maps provide calibrated limits for each sensor contained in the sensory matrix for the selected grasp pose. The controller transmits the grasp command signal to the gripper in response to receipt of the jog signal from the GUI. The GUI may display a jog wheel having icons, including a hub corresponding to a neutral pose of the robotic gripper and icons corresponding to grasp poses arranged around a circumference of the jog wheel.

Claims

1. A system comprising:

a robotic gripper having a sensory matrix that includes a plurality of sensors, wherein the robotic gripper is configured to execute, in response to a grasp command signal, a selected one of a plurality of grasp poses with respect to a component; and

a grasp controller in communication with the robotic gripper that is configured to selectively generate the grasp command signal, including;

a device operable to generate a jog signal in response to a received input; and

tangible, non-transitory memory on which is recorded a sensory map in the form of a data table, wherein the sensory map provides calibrated limits for each sensor contained in the sensory matrix for the selected grasp pose;

wherein the grasp controller transmits the grasp command signal to the robotic gripper in response to receipt of the jog signal from the GUI and receives sensory feedback signals from the sensory matrix, to thereby grasp the component.

2. The system of claim 1, wherein the device is an interactive graphical user interface (GUI).

3. The system of claim 2, wherein the interactive GUI is a touch screen device configured to generate the jog signal in response to a touch gesture from the user.

4. The system of claim 3, wherein the interactive GUI is configured to display a jog wheel having icons, and wherein the icons include a hub icon corresponding to a neutral pose of the robotic gripper and grasp pose icons arranged around a circumference of the jog wheel.

5. The system of claim 1, wherein each of the plurality of grasp poses has a corresponding sensory map stored in the memory of the grasp controller.

6. The system of claim 1, wherein the robotic gripper has a palm and at least one articulated finger, and wherein the sensors are positioned on each of the articulated fingers and the palm.

7. The system of claim 1, wherein the sensors of the sensory matrix include at least one of:

a force sensor, a load sensor, a weight sensor, and a temperature sensor.

8. The system of claim 1, wherein the grasp controller is further configured to execute a teach mode in which the sensory matrix is populated via some of the sensory feedback signals derived while the user manually poses or backdrives the robotic gripper.

9. A method for controlling a robotic gripper having a sensory matrix that includes a plurality of sensors, the method comprising:

generating a jog signal via an interactive graphical user interface (GUI) of a grasp controller using an input from a user;

processing the jog signal via a processor of the grasp controller;

generating a grasp command signal via the grasp controller in response to the jog signal;

executing a selected one of a plurality of grasp poses via the robotic gripper with respect to a component in response to the grasp command signal, including grasping the component with the robotic gripper;

receiving sensory feedback signals from the sensory matrix during execution of the selected grasp pose;

comparing the received sensory feedback signals via the grasp controller to a corresponding sensory map in the form of a data table, wherein the at least one sensory map provides calibrated limits for the selected grasp pose for each sensor contained in the sensory matrix; and

executing a control action with respect to the robotic gripper when any of the received sensory feedback signals fall outside of their corresponding calibrated limits.

10. The method of claim 9, wherein the robotic gripper has a palm, at least one finger, and an opposable thumb.

11. The method of claim 10, wherein the at least one finger includes four articulated fingers, and wherein the sensory matrix includes sensors positioned on each of the fingers, the thumb, and the palm.

12. The method of claim 9, wherein receiving sensory feedback signals from the sensory matrix includes receiving at least one force or load sensor signal, a weight sensor signal, and a heat sensor signal.

13. The method of claim 9, further comprising displaying a jog wheel having icons via the GUI, including displaying an icon at the hub or center of the jog wheel corresponding to a neutral pose of the robotic gripper and displaying grasp pose icons around a circumference of the jog wheel each corresponding to at least some of the plurality of grasp poses.

14. The method of claim 9, further comprising executing a teach mode via the grasp controller, including manually posing or backdriving the robotic gripper and then populating the sensory matrix with values that are derived during the posing or backdriving.

15. The method of claim 9, wherein the grasp controller is in communication with a task controller, further comprising receiving a task command signal from the task controller.

16. The method of claim 9, further comprising:

executing a maintenance mode in which the GUI displays a status of an automatic operation of the robotic gripper, including displaying a state of motion of the robotic gripper, the grasp type, and a progression of the grasp pose.

17. The method of claim 16, wherein executing a maintenance mode includes displaying a dynamic state of the sensory map and indicating a condition of limits of the sensory map via corresponding colors.

18. A system comprising:

a robotic gripper having a sensory matrix that includes a plurality of sensors, including at least a plurality of force or load sensors, a weight sensor, and a heat sensor, wherein the robotic gripper includes a plurality of articulated fingers, a palm, and an opposable thumb, and is configured to execute a selected one of a plurality of grasp poses in response to a grasp command signal to thereby grasp the component; and

a grasp controller in communication with the robotic gripper and configured to generate the grasp command signal, the grasp controller including;

a touch-screen interactive graphical user interface (GUI) operable to display a jog wheel having a plurality of grasp pose icons arranged around its circumference and a neutral grasp pose icon positioned at its center or hub, wherein the GUI is configured to generate a jog signal in response to an input touch motion from a user;

a processor; and

tangible, non-transitory memory on which is recorded a plurality of different sensory maps in the form of data tables, wherein the sensory maps provide calibrated limits for a corresponding one of the plurality of grasp poses for each sensor contained in the sensory matrix;

wherein the controller transmits the grasp command signal to the robotic gripper in response to receipt of the jog signal from the GUI and receives sensory feedback signals from the sensory matrix to thereby cause the robotic gripper to grasp the component.

19. The system of claim 18, wherein the grasp controller is configured to execute a teach mode in which the sensory matrix is populated via some of the sensory feedback signals derived by manually jogging, posing, or backdriving the robotic gripper.

20. The system of claim 18, wherein the grasp controller is in communication with a task controller, and receives a task command signal from the task controller.