Learning system and method for optimizing control of autonomous earthmoving machinery
First Claim
1. A method for controlling automated movement of an earthmoving machine having a plurality of links connected at joints that are operable to move concurrently based on commands generated using at least one script, each script including at least one variable parameter defining a movement of the machine, the method comprising the steps of:
- determining at least one desired outcome from a number of desired outcomes;
measuring conditions in the machine'"'"'s environment pertaining to each desired outcome;
determining a candidate value for at least one variable parameter from a number of potential candidate values using a learning algorithm before executing the script in which the variable parameter is used; and
predicting the desired outcome of the candidate value prior to executing the script in which the variable parameter is used with the candidate value being selected based upon the determined desired outcome.
1 Assignment
0 Petitions
Accused Products
Abstract
In one embodiment of the present invention, a motion planning algorithm is used to control an autonomous machine. The motion planning algorithm consists of a template or script which captures the general trends of the motion, while parameters in the script are filled in with the kinematic details for a specific machine and set of movements. A learning algorithm computes the script parameters by using feedback of how the machine performed during the preceding cycle with the current parameter set, and adjusting the parameters to improve the machine'"'"'s performance during succeeding work cycles. The new parameters are evaluated by the learning algorithm using a predictive function approximator to test various performance criteria such as the time required to perform a task and the accuracy with which the task was performed. The performance criteria are weighted using local regression techniques so that the prediction of the outcome of alternate motions places emphasis on the performance criteria that is considered most important. As data from repeated motions accumulates, the algorithm uses the history of the results of various motions to recompute and refine the parameters to improve performance.
-
Citations
15 Claims
-
1. A method for controlling automated movement of an earthmoving machine having a plurality of links connected at joints that are operable to move concurrently based on commands generated using at least one script, each script including at least one variable parameter defining a movement of the machine, the method comprising the steps of:
-
determining at least one desired outcome from a number of desired outcomes; measuring conditions in the machine'"'"'s environment pertaining to each desired outcome; determining a candidate value for at least one variable parameter from a number of potential candidate values using a learning algorithm before executing the script in which the variable parameter is used; and predicting the desired outcome of the candidate value prior to executing the script in which the variable parameter is used with the candidate value being selected based upon the determined desired outcome. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for controlling automated movement of a machine comprising:
-
a machine having a plurality of links connected at joints that are operable to move concurrently based on commands; a processing system for executing at least one script, each script including at least one variable parameter defining a movement of the machine; and a learning algorithm operable to modify values of at least one variable parameter based on a desired outcome of the machine'"'"'s action and conditions measured in the machine'"'"'s environment pertaining to the desired outcome and predicting the desired outcome of the machine'"'"'s action prior to executing movement of the machine with the desired outcome being selected based upon a number of desired outcomes. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15)
-
Specification