Method of training a neural network and a neural network trained according to the method
First Claim
1. A method of training a neural network having one or more outputs, each output representing numeric or non-numeric values and when only small sets of examples are available for training, the method comprising:
- numerically encoding each non-numeric value such that the uniqueness and adjacency relationships between them are preserved;
constraining the relationship between one or more inputs and one or more outputs that the neural network learns so that it is consistent with an expected relationship between the one or more inputs and the one or more outputs;
creating a set of data comprising input data and associated outputs that represent archetypal results;
providing real exemplary input data and associated output data and the created data to the neural network;
comparing real exemplary output data and the created associated output data to the actual output of the neural network; and
adjusting the neural network to create a best fit to the real exemplary data and the created data.
2 Assignments
0 Petitions
Accused Products
Abstract
A neural network comprises trained interconnected neurons. The neural network is configured to constrain the relationship between one or more inputs and one or more outputs of the neural network so the relationships between them are consistent with expectations of the relationships; and/or the neural network is trained by creating a set of data comprising input data and associated outputs that represent archetypal results and providing real exemplary input data and associated output data and the created data to neural network. The real exemplary output data and the created associated output data is compared to the actual output of the neural network, which is adjusted to create a best fit to the real exemplary data and the created data.
45 Citations
31 Claims
-
1. A method of training a neural network having one or more outputs, each output representing numeric or non-numeric values and when only small sets of examples are available for training, the method comprising:
-
numerically encoding each non-numeric value such that the uniqueness and adjacency relationships between them are preserved;
constraining the relationship between one or more inputs and one or more outputs that the neural network learns so that it is consistent with an expected relationship between the one or more inputs and the one or more outputs;
creating a set of data comprising input data and associated outputs that represent archetypal results;
providing real exemplary input data and associated output data and the created data to the neural network;
comparing real exemplary output data and the created associated output data to the actual output of the neural network; and
adjusting the neural network to create a best fit to the real exemplary data and the created data.
-
-
2. A neural network, comprising:
-
a plurality of inputs and one or more outputs which produce an output dependant on data received by the input according to training of interconnections between the inputs, hidden neurons and the outputs, wherein interconnections are trained such that the relationship between the inputs and the outputs is constrained according to the expectations of the relationship between the inputs and the outputs, wherein one or more output neurons produce a numeric preliminary output, the preliminary output being manipulated to produce a final output, wherein during training of the neural network each possible non-numeric final output is numerically encoded into a training preliminary output such that the uniqueness and adjacency relations between each non-numeric final output value is preserved, and wherein, in use, the preliminary output is converted to an estimated nonnumeric final output based on the nearest numerically encoded equivalent final output used in training the neural network.
-
-
3. A neural network, comprising:
-
trained interconnected neurons, wherein one or more neurons produce a numeric preliminary output, the preliminary output being manipulated to produce a final output, wherein during training of the neural network each possible non-numeric final output is numerically encoded into a training preliminary output such that the uniqueness and adjacency relations between each non-numeric final output are preserved, and wherein, in use, the preliminary output is converted to an estimated nonnumeric final output. - View Dependent Claims (4, 5, 6)
-
-
7. A method of training a neural network for improved robustness when only small sets of examples are available for training, the method comprising:
-
creating a set of data comprising input data and associated outputs that represent archetypal results;
providing real exemplary input data and associated output data and the created data to the neural network;
comparing real exemplary output data and the created associated output data to the actual output of the neural network; and
adjusting the neural network to create a best fit to the real exemplary data and the created data.
-
-
8. A method of training a neural network for improved robustness when only small sets of examples are available for training, the method comprising:
constraining the relationship between one or more inputs and one or more outputs of the neural network so that the relationship is consistent with an expected relationship between the one or more inputs and the one or more outputs. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
19. A neural network, comprising:
-
a plurality of inputs and one or more outputs which produce an output dependant on data received by the input according to training of interconnections between the input, hidden neurons and the outputs, wherein interconnections are trained such that the relationship between the inputs and the outputs of the neural network is constrained, according to expectations of the relationship between the inputs and the outputs. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. A method of training a neural network when only small sets of examples are available for training, the comprising:
-
constraining the relationship between one or more inputs and one or more outputs so that the relationship between them is consistent with an expected relationship between the one or more inputs and the one or more outputs;
creating a set of data comprising input data and associated outputs that represent archetypal results;
providing real exemplary input data and associated output data and the created data to the neural network;
comparing real exemplary output data and the created associated output data to the actual output of the neural network; and
adjusting the neural network to create a best fit to the real exemplary data and the created data, where the best fit is determined in accordance with normal neural network training practice.
-
-
31. A system for training a neural network having one or more outputs, each output representing numeric or non-numeric values and when only small sets of examples are available for training, the system comprising:
-
means for numerically encoding each non-numeric value such that the uniqueness and adjacency relationships between them are preserved;
means for constraining the relationship between one or more inputs and one or more outputs that the neural network learns so that it is consistent with an expected relationship between the one or more inputs and the one or more outputs;
means for creating a set of data comprising input data and associated outputs that represent archetypal results;
means for providing real exemplary input data and associated output data and the created data to the neural network;
means for comparing real exemplary output data and the created associated output data to the actual output of the neural network; and
means for adjusting the neural network to create a ‘
best fit’
to the real exemplary data and the created data.
-
Specification