Semi-Autonomous Multi-Use Robot System and Method of Operation

• US 20170305015A1
• Filed: 05/05/2017
• Published: 10/26/2017
• Est. Priority Date: 10/27/2009
• Status: Active Grant

• Current Assignee: Battelle Memorial Institute
• Original Assignee: Battelle Memorial Institute
• Inventors: KRASNY, Darren P., SHOAF, Richard L., KEIP, Jeffrey D., NEWHOUSE, Scott A., LASTRAPES, Timothy J.
• Granted Patent: US 10,011,012 B2
• Time in Patent Office: Days
• CPC Class Codes: B25J 9/1666 Avoiding collision or forbidden zones
• CPC Class Codes: G05B 2219/40183 Tele-machining
• CPC Class Codes: G05B 2219/40418 Presurgical planning, on screen indicate regions to be operated on
• CPC Class Codes: G05B 2219/40424 Online motion planning, in real time, use vision to detect workspace changes

Abstract

A semi-autonomous robot system (10) that includes scanning and scanned data manipulation that is utilized for controlling remote operation of a robot system within an operating environment.

Claims

1. A robot system comprising:

a robot that includes an arm having multiple degrees of freedom of movement;

environmental data regarding an operating environment surrounding the robot; and

an operator station located remotely from the robot, the operator station including operator input device, a computer and associated software that is configured to employ a motion planning algorithm in combination with the environmental data to;

(1) define surfaces within the operating environment;

(2) define a path for the robot within the operating environment that avoids any collisions between the robot and the surfaces; and

(3) control movement of the robot along the path.

2. The robot system according to claim 1, wherein the computer and associated software is further configured to:

define the path for the arm of the robot within the operating environment along a series of target waypoints based on commands received by the input device; and

control movement of the robot by determining if the robot arm will collide with the surface, several time steps into the future, when moving along the path and stopping movement of the arm of the robot along the path before a collision.

3. The robot system according to claim 1, wherein the motion planning algorithm is a Rapidly-exploring Random Tree (RRT) motion planning algorithm.

4. The robot system according to claim 3, wherein the computer and associated software is further configured to:

acquire geometrical data regarding the operating environment; and

utilize the geometrical data to perform operations within the operating environment with virtual tooling.

5. The robot system according to claim 1, wherein the computer and associated software is further configured to define the path for the robot within an enclosed space for moving the arm of the robot to a selected point within the enclosed space while also avoiding collision with any of the surfaces defined within the operating environment.

6. The robot system according to claim 1, wherein the computer and associated software is configured to produce continuous trajectories for contour following by first finding a plurality of collision-free candidate solutions and then using pseudo-inverse Jacobian control methodology to compute required joint angles and rates to achieve a desired path for the arm of the robot while also maintaining a proper orientation and path speed.

7. The robot system according to claim 1, further comprising a digital camera mounted upon the arm of the robot and a display device, the digital camera and display device being configured to provide a pictorial view of the operating environment to an operator as an aid to guiding movement of the robot.

8. The robot system according to claim 1, wherein the arm of the robot is configured to carry at least one tool.

9. A robot system comprising:

a robot that includes an arm having multiple degrees of freedom of movement;

environmental data regarding an operating environment surrounding the robot; and

an operator station located remotely from the robot, the operator station including an operator input device for receiving commands and a computer and associated software that is configured to employ a motion planning algorithm in combination with the environmental data and the commands to;

(1) voxelize the environmental data;

(2) utilize the voxelized environmental data to define surfaces within the operating environment;

(3) utilize the voxelized environmental data to define a path for the robot within the operating environment that avoid collisions between the robot and the surfaces defined within the operating environment; and

(4) control movement of the robot along the path.

10. The robot system according to claim 9, wherein the motion planning algorithm is configured to employ the voxelized environmental data to define a path for the arm of the robot within the operating environment that avoid collisions between the arm of the robot and the surfaces defined within the operating environment;

and control movement of the arm of the robot along the path.

11. The robot system according to claim 9, further including multiple computing nodes connected by Ethernet, the nodes spawning multiple threads to determine potential paths for movement of the robot.

12. The robot system according to claim 9, wherein the arm of the robot is configured to carry at least one tool.

13. The robot system according to claim 9, wherein the operating environment defines an enclosed space.

14. A method for operating a robot system including a robot having an arm with multiple degrees of freedom of movement and an operator station located remotely from the robot, the arm of the robot carrying a tool and the operator station being configured to control movement of the robot, said method comprising:

(a) collecting data regarding an operating environment surrounding the robot;

(b) defining surfaces within the operating environment;

(c) selecting, with an operator input device, a desired position for the tool in Cartesian space within the operating environment;

(d) determining a path for moving the tool to the desired position selected in step (c) that avoids any collisions between the robot and the surfaces defined in step (b); and

(e) moving the tool to the position selected in step (c) via the path determined in step (d).

15. The method according to claim 14, wherein the operator station includes a display screen, with the display screen displaying a cursor controlled by the input device, and further wherein step (c) includes using the input device to position the cursor upon the display screen at the desired position for the tool.

16. The method according to claim 14, wherein determining the path for moving the tool includes determining the path for the arm of the robot within the operating environment along a series of target waypoints based on commands received by the input device and determining if the robot arm will collide with the surface defined in step (b), several time steps into the future, when moving along the path and stopping movement of the arm of the robot along the path before a collision.

17. The method according to claim 14, wherein the robot performs a desired operation once the tool has moved to the position selected in step (c).

18. The method according to claim 14, wherein the data collected in step (a) is voxelized to define the surfaces within the operating environment in step (b), and further wherein the voxelized data is utilized to determine the path step (d).

19. The method according to claim 18, wherein the voxelized data is utilized to perform real-time collision checking between the robot and the operating environment while an operator is employing Cartesian control of the tool with the input device.

20. The method according to claim 14, wherein the operator station includes a computer and associated software that is configured to use a Rapidly-exploring Random Tree (RRT) motion planning algorithm in combination with the data collected in step (a) to determine the path in step (d).

21. The method according to claim 14, wherein step (c) includes using the input device to click and drag across virtual geometry to define a trajectory, and further wherein step (d) includes determining a path whereby the tool follows the trajectory while maintaining a prescribed stand-off from the operating environment.