Belief propagation in a hierarchical temporal memory based system
First Claim
Patent Images
1. A computer-implemented system, comprising:
- a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured to receive second input data and generate output information about the second input data, the hierarchy comprising;
a plurality of first computing modules at a first level of the hierarchy, each of the first computing modules configured to receive a part of the second input data and comprising;
a coincidence detector configured to generate coincidence information about one or more coincidences detected in the part of the second input data; and
a sequence learner configured to generate first information about temporal sequences of coincidences responsive to receiving the coincidence information, andat least one second computing module at a second level of the hierarchy, the at least one second computing module configured to generate second information about spatial patterns and temporal sequences in the second input data based on the first information.
1 Assignment
0 Petitions
Accused Products
Abstract
A hierarchy of computing modules is configured to (i) learn a cause of input data sensed over space and time, and (ii) determine a cause of novel sensed input data dependent on the learned cause. The hierarchy has a first level of computing modules and a second level of at least one computing module, wherein a computing module in the first level is configured to output to the computing module in the second level a first set of values representing probabilities of possible causes of input data received by the system.
76 Citations
16 Claims
-
1. A computer-implemented system, comprising:
a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured to receive second input data and generate output information about the second input data, the hierarchy comprising; a plurality of first computing modules at a first level of the hierarchy, each of the first computing modules configured to receive a part of the second input data and comprising; a coincidence detector configured to generate coincidence information about one or more coincidences detected in the part of the second input data; and a sequence learner configured to generate first information about temporal sequences of coincidences responsive to receiving the coincidence information, and at least one second computing module at a second level of the hierarchy, the at least one second computing module configured to generate second information about spatial patterns and temporal sequences in the second input data based on the first information. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
8. A computer-implemented method of recognizing an object, comprising:
-
receiving a first input data at a hierarchy of computing modules, the hierarchy comprising a plurality of first computing modules at a first level of the hierarchy and at least one second computing module at a second level of the hierarchy in a learning stage; learning spatial patterns and temporal sequences in the first input data by the hierarchy of computing modules in the learning stage; receiving second input data at the hierarchy of computing modules in an inference stage subsequent to the learning stage; generating coincidence information at a coincidence detector of each of the first computing modules responsive to receiving a part of the first input; generating first information about temporal sequences of coincidences at a sequence learner of each of the first computing modules responsive to receiving the coincidence information; and generating second information by the at least one second computing module responsive to receiving the first information. - View Dependent Claims (9, 10, 11, 12)
-
-
13. A computer-readable medium having instructions therein that are executable by a processor, the instructions comprising instructions to:
-
receive a first input data at a hierarchy of computing modules, the hierarchy comprising a plurality of first computing modules at a first level of the hierarchy and at least one second computing module at a second level of the hierarchy in a learning stage; learn spatial patterns and temporal sequences in the first input data by the hierarchy of computing modules in the learning stage; receive second input data at the hierarchy of computing modules in an inference stage subsequent to the learning stage; generate coincidence information at a coincidence detector of each of the first computing modules responsive to receiving a part of the first input; generate first information about temporal sequences of coincidences at a sequence learner of each of the first computing modules responsive to receiving the coincidence information; and generate second information by the at least one second computing module responsive to receiving the first information. - View Dependent Claims (14, 15, 16)
-
Specification