Categorization automata employing neuronal group selection with reentry
First Claim
1. An apparatus for categorizing objects in an environment according to sensory input data relating to those objects and for sorting the objects in accord with such categories comprisingone or more sensory means for sensing input signals, each of said sensory means identified with a specific sense function,processing means for receiving said input signals, for categorizing objects according to said input signals and for generating output signals in response to said input signals,output effector means for receiving said output signals and for sorting said objects in response to said output signals, each of said output effector means identified with a specific motor output function,said processing means comprisinga plurality of cells, each of said cells characterized by a state of activation determined by a response function,a plurality of synapses, each of said synapses comprising a unidirectional connection between one of said cells and one of said sensory means, output effector means or another of said cells and each of said synapses having a strength capable of differential modification determined by a selective learning rule,a plurality of groups of cells, each of said groups comprising a collection of cells connected more strongly among themselves than they are connected to cells in other groups,a plurality of sensory repertoires each corresponding to one of said sense functions and each comprising collections of said groups, interconnected by mappings comprising synaptic connections,a plurality of motor repertoires each corresponding to one of said motor output functions and each comprising collections of said neuronal groups interconnected by mappings composed of synaptic connections,a plurality of value repertoires, each connected to one or more of said sensory repertoires or to other cells and capable of responding differentially to changes in the environment signaled by said input signals caused by the actions of the said output motor function, and each comprising collections of aid neuronal groups interconnected by mappings composed of synaptic connections,wherein said groups of cells comprise one or more primary repertoires of variant, overlapping response selectivities prior to selection by heterosynaptic input from said value repertoires, and comprise after selection secondary repertoires of such selectivities adapted to perform a particular categorization task and to perform particular output actions upon the categorization of certain types of objects,a plurality of processing repertoires, each connected to one or more of said sensory, motor and value repertoires by synaptic connection to form mappings,a plurality of reentrant signaling means between said neural mappings wherein during operation of said apparatus each sensory repertoire receives signals derived from at least one of said sensory means and outputs signals to at least one of said output effector means and the modification of said synaptic strengths alters the contributions of one or more neuronal groups to behavior providing integrated sensory and motor behavior,said neural mappings connected by reentrant signaling comprising classification n-tuples, wherein the apparatus is adapted to carry out categorization of the objects.
1 Assignment
0 Petitions
Accused Products
Abstract
An apparatus capable of sensing the presence of objects in its environment, categorizing these objects without a prior description of the categories to be expected, and controlling robotic effector mechanisms to respond differentially to such objects according to their categories. Such responses include sorting objects, rejecting objects of certain types, and detecting novel or deviant objects. The invention includes a device called a "classification n-tuple" (of which a "classification couple" is a special case) capable of combining signals from two or more sensory modalities to arrive at the classification of the object.
The invention operates by simulating certain features of animal nervous system, including neurons with responses determined at each moment of time by inputs received along synaptic connections from sensory means or form other neurons. In this invention, neurons are arranged in "groups", which permits them to act cooperatively while still retaining characteristic individual responses. Groups in turn are arranged in "repertoires", which provide a totality of response specificities sufficient to respond to any of a range of possible input objects. Some of these repertoires are organized as "maps", such that groups responding to inputs that are similar along some dimensional (spatial or abstract) are close together in the repertoire, enabling the repertoire to respond correctly to novel objects that are similar to objects it has encountered previously. Maps in this invention are linked by connections, called "reentrant" connections, that enable the responses of one map to be reentered into the system as inputs to another map. Reentrant connections permit signals from different sensory modalities to be correlated in an ongoing fashion, and they are the basis for the operation of classification n-tuples.
The responses of the apparatus of this invention may be improved and optimized for a particular task through the operation of "neuronal group selection", a process which enhances the responses of those neuronal groups in the apparatus which were active in some time interval preceding the production of a useful output action. This process operates by modifying the strength of selected synaptic connections. The value of various output actions is determined, for the purpose of regulating selection, by means which are internal to the apparatus of this invention. Accordingly, the invention is capable of self-organization and learning, and does not require a predetermined specification of correct responses for all possible inputs.
123 Citations
20 Claims
-
1. An apparatus for categorizing objects in an environment according to sensory input data relating to those objects and for sorting the objects in accord with such categories comprising
one or more sensory means for sensing input signals, each of said sensory means identified with a specific sense function, processing means for receiving said input signals, for categorizing objects according to said input signals and for generating output signals in response to said input signals, output effector means for receiving said output signals and for sorting said objects in response to said output signals, each of said output effector means identified with a specific motor output function, said processing means comprising a plurality of cells, each of said cells characterized by a state of activation determined by a response function, a plurality of synapses, each of said synapses comprising a unidirectional connection between one of said cells and one of said sensory means, output effector means or another of said cells and each of said synapses having a strength capable of differential modification determined by a selective learning rule, a plurality of groups of cells, each of said groups comprising a collection of cells connected more strongly among themselves than they are connected to cells in other groups, a plurality of sensory repertoires each corresponding to one of said sense functions and each comprising collections of said groups, interconnected by mappings comprising synaptic connections, a plurality of motor repertoires each corresponding to one of said motor output functions and each comprising collections of said neuronal groups interconnected by mappings composed of synaptic connections, a plurality of value repertoires, each connected to one or more of said sensory repertoires or to other cells and capable of responding differentially to changes in the environment signaled by said input signals caused by the actions of the said output motor function, and each comprising collections of aid neuronal groups interconnected by mappings composed of synaptic connections, wherein said groups of cells comprise one or more primary repertoires of variant, overlapping response selectivities prior to selection by heterosynaptic input from said value repertoires, and comprise after selection secondary repertoires of such selectivities adapted to perform a particular categorization task and to perform particular output actions upon the categorization of certain types of objects, a plurality of processing repertoires, each connected to one or more of said sensory, motor and value repertoires by synaptic connection to form mappings, a plurality of reentrant signaling means between said neural mappings wherein during operation of said apparatus each sensory repertoire receives signals derived from at least one of said sensory means and outputs signals to at least one of said output effector means and the modification of said synaptic strengths alters the contributions of one or more neuronal groups to behavior providing integrated sensory and motor behavior, said neural mappings connected by reentrant signaling comprising classification n-tuples, wherein the apparatus is adapted to carry out categorization of the objects.
-
14. An apparatus for establishing categories of shape and patterning of physical objects and sorting the physical objects in accord with such categories comprising
optical sensor means to visually sense said objects and generate input signals in response thereto, tactile sensor means to sense said objects by touch, said means being installed on a jointed arm capable of reaching out to bring said tactile means into contact with said objects, and generating tactile signals in response thereto, kinesthetic sensor means to sense the angular positions and motions of joints in the said jointed arm and generating kinesthetic signals in response thereto, processing means for receiving input data, for categorizing said input data and for generating output data in response to said input data, output means being adapted to receive said output data and to manipulate said objects in response to said output data, said processing means comprising a plurality of processing elements and memory registers configured in such a way as to constitute a plurality of synapses, each of said synapses having efficacies capable of differential modification of the strength of connections between pairs of said processing elements, said efficacies determined by an amplification function, a plurality of groups of neurons, each of said neuronal groups comprising a repertoire of neurons and including said neuron'"'"'s associated axonal and dendritic arborization patterns, a value repertoire adapted to increase a value parameter when the optical sensory means moves towards regions having predetermined optical characteristics and fixates upon them, whereby said repertoire provides heterosynaptic input to synapses thereby modulating the modification of connections from SC to OM, a VR visual repertoire of said neuronal groups containing excitatory and inhibitory layers of neurons, for the purpose of forming a neuronal mapping of visual signals produced by the said optical sensor means an SC repertoire having excitatory cells connected to ocular motor neurons OM adapted to cause motion of said optical means, an MC repertoire adapted to cause gestural motions by said arm spontaneously or from input from vision and arm kinesthesia, an IN intermediate repertoire adapted to pass signals from said MC repertoire to an SG repertoire which controls said arm, and being adapted to block outputs from MC which do not lead to desired motions of the arm upon receiving inhibitory signals from the PK repertoire, a GR repertoire adapted to correlate configurations of the arm in space with target positions, a PK repertoire connected to said GR secondary repertoire, adapted to cause inhibition of incorrect gestures of the arm by sensing inhibitory signals to the IN repertoire, an SG repertoire connected to said IN secondary repertoire, adapted to integrate control signals from the reaching and tracing subsystems, producing coordinated motions of the said arm in response to signals from either source, a plurality of reentrant signaling means between said repertoires, said VR repertoire being mapped to SC, said SC repertoire being mapped to OM, said IN intermediate secondary repertoire adapted to send signals to said SG repertoire, and to receive sensory input and primary gesture signalling from MC, said GR secondary repertoire connected to said PK secondary repertoire, via repertoire IO wherein the position of the arm and the physical object are associated with signals corresponding to primary gestures that arise from MC.
-
16. An automaton to analyze critical problems involving the acquisition and change with time of integrated sensory and motor behavior comprising
an input array on which two-dimensional patterns or visual scenes are represented, an assembly of repertoires of differential responding elements interconnected by mappings comprising synaptic connections that transform input patterns, an arrangement for coupling these networks to specified motor-output functions, means for detection of motion, comprising a connected assembly of cells, multiple inputs from the input array or directly from other sensory means, or from the outputs of groups of cells in the same or different repertoires, a single time-dependent scalar variable, which characterizes the state of each cell, and which is dependent upon the strengths of the inputs to that cell, each input multiplied by a synaptic strength, means for enabling selection in both sensory and motor control portions, wherein (a) mutual training is achieved of both sensory and motor control portions through encounter with an environment and (b) signal combinations are automatically selected during said training, an amplification function to alter the synaptic strength, of a connection according to the activity of pre- and postsynaptic groups, said rule providing for the weakening of connections between pairs of units of which one, but not both, are active, said rule providing for the strengthening of connections between pairs of units of which both, or neither, are active, said rule providing for modulation of the amount of synaptic change according to a heterosynaptic input which signals the success or failure of recent behavioral activity of the apparatus by increasing or decreasing the strength of the synapses as determined by a value repertoire.
Specification
-
- Resources
-
Current AssigneeNeurosciences Research Foundation, Inc.
-
Original AssigneeNeurosciences Research Foundation, Inc.
-
InventorsEdelman, Gerald M., Reeke, George N. Jr.
-
Primary Examiner(s)Fleming, Michael R.
-
Assistant Examiner(s)Downs, Robert W.
-
Application NumberUS07/419,524Time in Patent Office1,029 DaysField of Search364/513, 364/201, 364/807US Class Current706/20CPC Class CodesG06F 18/24 Classification techniquesG06N 3/04 Architecture, e.g. intercon...G06V 10/764 using classification, e.g. ...
