Student neural network
First Claim
1. A neural network system comprising:
- a teacher neural network, said teacher neural network capable of receiving and processing a problem set so as to produce a series of tutoring inputs, said tutoring inputs including an output solution to said problem set; and
a student neural network trained using said tutoring inputs to produce a student output that closely approximates said output solution.
1 Assignment
0 Petitions
Accused Products
Abstract
A student neural network that is capable of receiving a series of tutoring inputs from one or more teacher networks to generate a student network output that is similar to the output of the one or more teacher networks. The tutoring inputs are repeatedly processed by the student until, using a suitable method such as back propagation of errors, the outputs of the student approximate the outputs of the teachers within a predefined range. Once the desired outputs are obtained, the weights of the student network are set. Using this weight set the student is now capable of solving all of the problems of the teacher networks without the need for adjustment of its internal weights. If the user desires to use the student to solve a different series of problems, the user only needs to retrain the student by supplying a different series of tutoring inputs.
-
Citations
17 Claims
-
1. A neural network system comprising:
-
a teacher neural network, said teacher neural network capable of receiving and processing a problem set so as to produce a series of tutoring inputs, said tutoring inputs including an output solution to said problem set; and
a student neural network trained using said tutoring inputs to produce a student output that closely approximates said output solution. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of using a student neural network to produce student outputs that closely approximate an output solution produced by a teacher neural network comprising:
-
providing a teacher network with teacher weights set to produce an output solution in response to a specific problem set input;
transferring said teacher weights, said problem set input, and said output solution to said student network having student weights; and
training said student network using said teacher weights, said problem set input, and said output solution so as to arrive at a setting for said student weights that causes said student network to produce a student output that closely approximates said output solution. - View Dependent Claims (13, 14, 15, 16, 17)
-
Specification