Action based learning

• US 20090150311A1
• Filed: 12/05/2008
• Published: 06/11/2009
• Est. Priority Date: 12/05/2007
• Status: Active Grant

• Current Assignee: Numenta, Inc.
• Original Assignee: Numenta, Inc.
• Inventors: George, Dileep
• Granted Patent: US 8,175,984 B2
• Time in Patent Office: Days
• US Class Current: 706/12
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
• CPC Class Codes: G06N 3/08 Learning methods

Abstract

A set of sequences of sensed input patterns associated with a set of actions is generated by performing at least a first action on data derived from a real-world system. A subset of the sequences of sensed input patterns that form a group associated with the first action is determined. A new sequence of sensed input patterns is received. A first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action based on the subset of sequences of sensed input patterns is determined and stored in a memory associated with the computer system.

Claims

1. A computer-implemented method of determining an action associated with a sequence of sensed input patterns, the method executed by one or more computer systems and comprising:

generating a set of sequences of sensed input patterns associated with a set of actions, by performing at least a first action on data derived from a real-world system;

determining that a subset of the sequences of sensed input patterns form a group associated with the first action, wherein the first action is associated with a hierarchy of actions;

receiving a new sequence of sensed input patterns;

determining a first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action based on the subset of sequences of sensed input patterns; and

storing the first value in a memory associated with the computer system.

2. The method of claim 1, further comprising:

receiving the set of sequences of sensed input patterns at a child node in a hierarchical network of nodes;

receiving the new sequence of sensed input patterns at the child node in the hierarchical network of nodes; and

transmitting the first value from the child node in the hierarchical network of nodes to a parent node in the hierarchical network of nodes.

3. The method of claim 2, wherein the hierarchical network of nodes is a Hierarchical Temporal Memory (HTM).

4. The method of claim 1, further comprising:

responsive to the first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action, labeling the new sequence of sensed inputs with the action.

5. The method of claim 4, wherein the first action is associated with a hierarchy of actions and further comprising labeling the new sequence of sense inputs with at least a second action based on the hierarchy of actions.

6. A computer system comprising:

a memory;

a processor;

a child node module stored in the memory and executable by the processor to;

receive a set of sequences of sensed input patterns associated with a set of actions, wherein the set of actions are associated with a hierarchy of actions that defines a set of subsumptive relationships between the actions;

determine that a subset of the sequences of sensed input patterns form a group associated with a first action, wherein the first action is associated with a hierarchy of actions;

receive a new sequence of sensed input patterns;

determine a first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action based on the group associated with the first action;

label the new sequence of sensed input patterns with the first action and at least a second action responsive to the first value exceeding a threshold value, wherein the at least a second action is determined according to the set of subsumptive relationships defined by the hierarchy of actions; and

store the first value in a memory associated with the child node.

7. The system of claim 6, wherein the child node is further adapted to transmit the first value to a parent node.

8. The system of claim 6, further comprising labeling the set of sequences of sensed input patterns with the set of actions.

9. The system of claim 6, wherein the set of sequences of sensed input patterns associated with the set of actions are derived from computationally performing the set of actions on real-world data.

10. The system of claim 6, wherein the set of sequences of sensed input patterns associated with the set of actions are derived from physically performing the set of actions on one or more real-world systems.

11. A computer-readable storage medium encoded with executable computer program code, the program code comprising program code for:

receiving, at a child node, a set of sequences of sensed input patterns associated with a set of actions, wherein the set of actions are associated with a hierarchy of actions that defines a set of subsumptive relationships between the actions;

determining, at the child node, that a subset of the sequences of sensed input patterns form a group associated with a first action, wherein the first action is associated with a hierarchy of actions;

receiving, at the child node, a new sequence of sensed input patterns;

determining, at the child node, a first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action based on the group associated with the first action;

responsive to the first value exceeding and at least second action; and

storing the first value in a memory associated with the child node.

12. The medium of claim 11, further comprising program code for a parent node and the child node comprise a hierarchical network of nodes.

13. The medium of claim 11, further comprising labeling the set of sequences of sensed input patterns with the set of actions.

14. The medium of claim 11, wherein the set of sequences of sensed input patterns associated with the set of actions are derived from computationally performing the set of actions on real-world data.

15. The medium of claim 11, wherein the set of sequences of sensed input patterns associated with the set of actions are derived from computationally performing the set of actions on real-world data.

16. A computer-readable storage medium encoded with executable computer program code, the program code comprising program code for:

generating a set of sequences of sensed input patterns associated with a set of actions, by performing at least a first action on data derived from a real-world system;

determining that a subset of the sequences of sensed input patterns form a group associated with the first action, wherein the first action is associated with a hierarchy of actions;

receiving a new sequence of sensed input patterns;

determining a first value which indicates the probability that the new sequence of sensed input patterns is associated with the first action and at least a first based on the subset of sequences of sensed input patterns; and

storing the first value.

17. The medium of claim 16, further comprising:

receiving the set of sequences of sensed input patterns at a child node in a hierarchical network of nodes;

receiving the new sequence of sensed input patterns at the child node in the hierarchical network of nodes; and

transmitting the first value from the child node in the hierarchical network of nodes to a parent node in the hierarchical network of nodes.

18. The medium of claim 17, wherein the hierarchical network of nodes is a Hierarchical Temporal Memory (HTM).