Computer implemented machine learning and control system
First Claim
1. A computer implemented system, comprising:
- a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; and
a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion;
in which the computer model defines fitness as a function of input and output;
further comprising a learning unit configured to derive the computer model;
in which the learning unit is configured to derive the computer model using empirical fitness of input and output.
0 Assignments
0 Petitions
Accused Products
Abstract
In a computer implemented learning and/or process control system, a computer model is constituted by the most currently fit entity in a population of computer program entities. The computer model defines fitness as a function of inputs and outputs. A computing unit accesses the model with a set of inputs, and determines a set of outputs for which the fitness is highest. This associates a sensory-motor (input-output) state with a fitness in a manner that might be termed "feeling". The learning and/or control system preferably utilizes a compiling Genetic Programming system (CGPS) in which one or more machine code entities such as functions are created which represent solutions to a problem and are directly executable by a computer. The programs are created and altered by a program in a higher level language such as "C" which is not directly executable, but requires translation into executable machine code through compilation, interpretation, translation, etc. The entities are initially created as an integer array that can be altered by the program as data, and are executed by the program by recasting a pointer to the array as a function type. The entities are evaluated by executing them with training data as inputs, and calculating fitnesses based on a predetermined criterion. The entities are then altered based on their fitnesses using a genetic machine learning algorithm by recasting the pointer to the array as a data (e.g. integer) type. This process is iteratively repeated until an end criterion is reached.
226 Citations
68 Claims
-
1. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; and a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; in which the computer model defines fitness as a function of input and output; further comprising a learning unit configured to derive the computer model; in which the learning unit is configured to derive the computer model using empirical fitness of input and output. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; and a learning unit configured to derive the computer model;
using a compiling genetic programming system.
-
-
26. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; and a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; in which the computing unit is configured to use the output determined by the computing unit to control a real-time process. - View Dependent Claims (27)
-
-
28. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; a learning unit configured to derive the computer model; and a fitness calculation module, which is configured to calculate the empirical fitness of an output previously determined by the computing unit in response to an applied input. - View Dependent Claims (29, 30)
-
-
31. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; and a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; in which the computer model defines fitness as including a "pain" component and a "pleasure" component.
-
-
32. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; and a learning unit which includes; a memory for storing a plurality of vectors, each of which includes an input, an output, and a corresponding fitness; and a derivation unit configured to derive the computer model using the vectors as a training set. - View Dependent Claims (33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54)
-
-
55. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; and an autonomous agent, in which; the computing unit is configured to apply said output to control the autonomous agent; and said fitness includes a "pain" component and a "pleasure" component. - View Dependent Claims (56)
-
-
57. A computer implemented system, comprising:
-
a computer model which defines a relationship between inputs, outputs, and corresponding fitnesses; a computing unit for accessing the computer model to determine, in response to an applied input, an output for which a corresponding fitness meets a predetermined criterion; an autonomous agent, in which the computing unit is configured to apply said output to the autonomous agent; and the applied input represents a parameter relating to the autonomous agent; and a learning unit which includes; a memory for storing a plurality of vectors, each of which includes an input, an output, and a corresponding fitness; and a derivation unit configured to derive the computer model using the vectors as a training set. - View Dependent Claims (58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68)
-
Specification