Neural network with non-linear transformations
First Claim
1. A neural network system comprising:
- a plurality of processing nodes arranged into at least first and second layers;
input means adapted for receiving an input signal comprising data representative of an input pattern;
first communication means for communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer;
transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof;
second communication means for communicating at least a portion of the input pattern to the transformation means;
third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion;
fourth communication means for communicating the output of processing nodes of the first portion and of the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and
means for outputting the output signal from the processing nodes of the second layer.
2 Assignments
0 Petitions
Accused Products
Abstract
A neural network system includes means for accomplishing artificial intelligence functions in three formerly divergent implementations. These functions include: supervised learning, unsupervised learning, and associative memory storage and retrieval. The subject neural network is created by addition of a non-linear layer to a more standard neural network architecture. The non-linear layer functions to expand a functional input space to a signal set including orthonormal elements, when the input signal is visualized as a vector representation. An input signal is selectively passed to a non-linear transform circuit, which outputs a transform signal therefrom. Both the input signal and the transform signal are placed in communication with a first layer of a plurality of processing nodes. An improved hardware implementation of the subject system includes a highly parallel, hybrid analog/digital circuitry. Included therein is a digitally addressed, random access memory means for storage and retrieval of an analog signal.
-
Citations
15 Claims
-
1. A neural network system comprising:
-
a plurality of processing nodes arranged into at least first and second layers; input means adapted for receiving an input signal comprising data representative of an input pattern; first communication means for communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer; transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof; second communication means for communicating at least a portion of the input pattern to the transformation means; third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion; fourth communication means for communicating the output of processing nodes of the first portion and of the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and means for outputting the output signal from the processing nodes of the second layer. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of neural processing comprising the steps of:
-
receiving an input signal comprising data, representative of an input pattern, into a plurality of processing nodes arranged into at least first and second layers; communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer; communicating at least a second portion of the input signal to a transformation means; performing, in the transform means, a non-linear transform on at least the second portion of the input signal to form a transform signal; communicating the transform signal to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion; communicating the output of processing nodes of the first portion and the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and outputting an output signal from the processing nodes of the second layer. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A neural network system comprising:
-
a plurality of processing nodes arranged into first and second layers; input means adapted for receiving an input signal comprising data representative of an input pattern; first communication means for communicating at least a portion of the input signal to a first subset of the processing nodes of the first layer; transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof; second communication means for communicating at least a portion of the input pattern to the transformation means; third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second subset of the processing nodes of the first layer, the second subset being uniquely defined from processing nodes of the first subset; fourth communication means for selectively communicating the output of processing nodes of the first subset and of the second subset of the first layer to selected processing nodes of the second layer; and means for outputting the output signal from the processing nodes of the second layer. - View Dependent Claims (15)
-
Specification