SEQUENCE LEARNING IN A HIERARCHICAL TEMPORAL MEMORY BASED SYSTEM
First Claim
Patent Images
1. A computer-implemented system, comprising:
- a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data associated with an object or a state of the object in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured receive second input data and generate the output information representing probabilities that spatial patterns and temporal sequences in the second input data correspond to spatial patterns and temporal sequences learned in the learning stage, wherein at least one of the computing modules comprises;
a sequence learner module in the learning stage configured to associate temporal sequences of spatial patterns in the first input data with the output information, the associated temporal sequences having different sequence lengths, the at least one computing module generating the output information responsive to receiving the second input data based on the association in the inference stage.
0 Assignments
0 Petitions
Accused Products
Abstract
A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. At least one of the computing modules has a sequence learner module configured to associate sequences of input data received by the computing module to a set of causes previously learned in the hierarchy.
-
Citations
25 Claims
-
1. A computer-implemented system, comprising:
a hierarchy of computing modules configured to receive first input data to learn spatial patterns and temporal sequences in the first input data associated with an object or a state of the object in a learning stage, the hierarchy in an inference stage subsequent to the learning stage further configured receive second input data and generate the output information representing probabilities that spatial patterns and temporal sequences in the second input data correspond to spatial patterns and temporal sequences learned in the learning stage, wherein at least one of the computing modules comprises; a sequence learner module in the learning stage configured to associate temporal sequences of spatial patterns in the first input data with the output information, the associated temporal sequences having different sequence lengths, the at least one computing module generating the output information responsive to receiving the second input data based on the association in the inference stage. - View Dependent Claims (2, 3, 4, 5, 6)
-
7. A computer-implemented method, comprising:
-
receiving spatial patterns in first input data in a learning stage; identifying temporal sequences of the spatial patterns that occur with frequency above a predetermined statistical threshold in the learning stage, the identified temporal sequences having different sequence lengths; associating the temporal sequences with the output information based on the identified temporal sequences in the learning stage; and outputting, in an inference stage subsequent to the learning stage, the output information responsive to receiving temporal sequences of spatial patterns in second input data based on the association. - View Dependent Claims (8, 9, 10)
-
-
11. A computer-implemented method providing output information for determining an object or a state of an object associated with spatial patterns and temporal sequences in input data, comprising:
-
receiving spatial patterns in first input data in a learning stage; storing a count of how many times a particular temporal sequence has been received in the first input data during the learning stage; identifying temporal sequences of the spatial patterns that occur with frequency above a predetermined statistical threshold based on the stored count in the learning stage; associating the temporal sequences with the output information in the learning stage based on the identified temporal sequences in the learning stage; and outputting, in an inference stage subsequent to the learning stage, the output information responsive to receiving temporal sequences of spatial patterns in second input data based on the association. - View Dependent Claims (12, 13, 14)
-
-
15. A computer-implemented method providing output information for determining an object or a state of an object associated with spatial patterns and temporal sequences in input data, comprising:
-
receiving spatial patterns in first input data in a learning stage; collecting data on received temporal sequences of the spatial patterns that are shorter than a predetermined sequence length; identifying temporal sequences shorter than the predetermined sequence length that occur with frequency above a predetermined statistical threshold in the learning stage, at least two of the identified temporal sequences sharing one or more spatial patterns; associating the temporal sequences with the output information in the learning stage based on the identified temporal sequences; and outputting, in an inference stage subsequent to the learning stage, the output information responsive to receiving temporal sequences of spatial patterns in second input data based on the association. - View Dependent Claims (16)
-
-
17. A computer-readable medium having instructions stored therein that are executable on a processor, the instructions configured to provide output information for determining an object or a state of an object associated with spatial patterns and temporal sequences in input data, the instructions when executed cause the processing system to:
-
receive spatial patterns in first input data in a learning stage; identify temporal sequences of the spatial patterns that occur with frequency above a predetermined statistical threshold in the learning stage, the identified temporal sequences having different sequence lengths; associate the temporal sequences with the output information in the learning stage based on the identified temporal sequences in the learning stage; and output, in an inference stage subsequent to the learning stage, the output information responsive to receiving temporal sequences of spatial patterns in second input data based on the association. - View Dependent Claims (18, 19, 20)
-
-
21. A computer-readable medium having instructions stored therein that are executable on a processor, the instructions configured to provide output information for determining an object or a state of an object associated with spatial patterns and temporal sequences in input data, the instructions when executed cause the processing system to:
-
receive spatial patterns in first input data in a learning stage; store count of how many times a particular temporal sequence has been received in the learning stage; identify temporal sequences of the spatial patterns that occur with frequency above a predetermined statistical threshold in the learning stage; associate the temporal sequences with the output information in the learning stage based on the identified temporal sequences in the learning stage; and output, in an inference stage subsequent to the learning stage, the output information responsive to receiving temporal sequences of spatial patterns in second input data based on the association. - View Dependent Claims (22, 23)
-
-
24. A computer-readable medium having instructions stored therein that are executable on a processor, the instructions configured to provide output information for determining an object or a state of an object associated with spatial patterns and temporal sequences in input data, the instructions when executed cause the processing system to:
-
receive spatial patterns in first input data in a learning stage; collect data on received temporal sequences of the spatial patterns that are shorter than a predetermined sequence length; identify the temporal sequences that occur with frequency above a predetermined statistical threshold in the learning stage; associate the temporal sequences with the output information in the learning stage based on the identified temporal sequences in the learning stage; and output, in an inference stage subsequent to the learning stage, the output information responsive to receiving temporal sequences of spatial patterns in second input data based on the association. - View Dependent Claims (25)
-
Specification