Trainable hierarchical memory system and method
First Claim
1. A computer-implemented memory network including at least one processor for producing an identifier associated with spatial patterns and temporal sequences in input data, the input data representing an object or a state of an object received from one or more sensors including at least one or more of a visual sensor, an auditory sensor, a tactile sensor, sensors distributed geographically, sensors distributed in a facility to measure one or more parameters or sensors configured to measure Internet traffic over time, comprising:
- two or more children processing modules for receiving spatially different parts of the input data, the input data representing the object or the state of the object, each child processing module generating lower level characterization data that represents spatial patterns and temporal sequences in the different parts of the input data; and
a parent processing module associated with the two or more children processing modules for receiving the lower level characterization data, the parent processing module generating and outputting higher level characterization data that represents spatial patterns and temporal sequences in the lower level characterization data, the parent processing module providing feedback information to the two or more children processing modules for associating the higher level characterization data with the lower level characterization data in a learning process, the parent processing module outputting the second level characterization data as the identifier in a querying process subsequent to the learning process.
1 Assignment
0 Petitions
Accused Products
Abstract
Memory networks and methods are provided. Machine intelligence is achieved by a plurality of linked processor units in which child modules receive input data. The input data are processed to identify patterns and/or sequences. Data regarding the observed patterns and/or sequences are passed to a parent module which may receive as inputs data from one or more child modules. the parent module examines its input data for patterns and/or sequences and then provides feedback to the child module or modules regarding the parent-level patterns that correlate with the child-level patterns. These systems and methods are extensible to large networks of interconnected processor modules.
-
Citations
37 Claims
-
1. A computer-implemented memory network including at least one processor for producing an identifier associated with spatial patterns and temporal sequences in input data, the input data representing an object or a state of an object received from one or more sensors including at least one or more of a visual sensor, an auditory sensor, a tactile sensor, sensors distributed geographically, sensors distributed in a facility to measure one or more parameters or sensors configured to measure Internet traffic over time, comprising:
-
two or more children processing modules for receiving spatially different parts of the input data, the input data representing the object or the state of the object, each child processing module generating lower level characterization data that represents spatial patterns and temporal sequences in the different parts of the input data; and a parent processing module associated with the two or more children processing modules for receiving the lower level characterization data, the parent processing module generating and outputting higher level characterization data that represents spatial patterns and temporal sequences in the lower level characterization data, the parent processing module providing feedback information to the two or more children processing modules for associating the higher level characterization data with the lower level characterization data in a learning process, the parent processing module outputting the second level characterization data as the identifier in a querying process subsequent to the learning process. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer-implemented method for training a memory network and producing an identifier associated with spatial patterns and temporal sequences in input data, the input data representing an object or a state of an object, the input data received from one or more sensors including at least one or more of a visual sensor, an auditory sensor, a tactile sensor, sensors distributed geographically, sensors distributed in a facility to measure one or more parameters or sensors configured to measure Internet traffic over time, the method comprising the steps of:
-
training the memory network comprising; receiving spatially different parts of training data at two or more children processing modules, the training data comprising spatial patterns and temporal sequences representative of the object or the state of the object; generating lower level characterization data that represents the spatial patterns and temporal sequences in the training data at the two or more children processing modules; outputting the lower level characterization data at the two or more children processing modules to a parent processing module; generating higher level characterization data that represents spatial patterns and temporal sequences in the lower level characterization data at the parent processing module; providing feedback based on the higher level characterization data to the two or more children processing modules for generating a correlation between the higher level characterization data and the lower level characterization data; and storing the correlation between the lower level characterization data and the second level characterization data; and generating and outputting from the parent processing module the identifier based on the stored correlation between the lower level characterization data and the higher level characterization data responsive to the two or more children processing modules receiving spatially different parts of the input data and providing the lower level characterization data to the parent processing module. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30)
-
-
31. A computer-implemented memory network comprising at least one processor, the memory network producing an identifier associated with spatial patterns and temporal sequences in input data received from one or more sensors including at least one or more of a visual sensor, an auditory sensor, a tactile sensor, sensors distributed geographically, sensors distributed in a facility to measure one or more parameters or sensors configured to measure Internet traffic over time, the input data representing an object or a state of an object, the memory network comprising:
-
a first lower tier processing module having a first receptive field for receiving a first spatial part of the input data, the first lower tier processing module generating first lower tier information representing spatial patterns and temporal sequences in the first spatial part of the input data; a second lower tier processing module having a second receptive field for receiving a second spatial part of the input data, the second lower tier processing module generating second lower tier information representing spatial patterns and temporal sequences in the second spatial part of the input data; and an upper tier processing module having a third spatial receptive field covering a range of the input data larger than the first spatial receptive field or the second spatial receptive field, the upper tier processing module coupled to the first lower tier processing module and the second lower tier processing module, the upper tier processing module identifying and outputting the identifier based on spatial patterns and temporal sequences in the first and second lower tier information, the upper tier processing module generating feedback information provided to the first and second lower tier processing modules for associating the first and second lower tier information with the identifier. - View Dependent Claims (32, 33, 34, 35, 36, 37)
-
Specification