MESSAGE PASSING IN A HIERARCHICAL TEMPORAL MEMORY BASED SYSTEM

• US 20070192269A1
• Filed: 01/11/2007
• Published: 08/16/2007
• Est. Priority Date: 02/10/2006
• Status: Active Grant

• Current Assignee: Numenta, Inc.
• Original Assignee: Numenta, Inc.
• Inventors: Hawkins, Jeffrey, Saphir, William, Marianetti, Ronald
• Granted Patent: US 7,904,412 B2
• Time in Patent Office: Days
• US Class Current: 706/52
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/04 Architecture, e.g. interconnection topology
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/047 Probabilistic or stochastic networks
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks

Abstract

A hierarchy of computing modules is configured to learn a cause of input data sensed over space and time, and is further configured to determine a cause of novel sensed input data dependent on the learned cause. Further, the hierarchy has a first level of computing modules and a second level of at least one computing module, where at least one of the computing modules in the first level operates on a first server, and where the at least one computing module in the second level operates on a second server. The hierarchy also includes a message manager module configured to relay information between the first server and the second server.

Claims

1. A system, comprising:

a hierarchy of computing modules configured to learn a cause of input data sensed over space and time, the hierarchy further configured to determine a cause of novel sensed input data dependent on the learned cause, and the hierarchy having a first level of computing modules and a second level of at least one computing module, wherein at least one of the computing modules in the first level operates on a first server, and wherein the at least one computing module in the second level operates on a second server; and

at least one message manager module configured to relay information between the first server and the second server.

2. The system of claim 1, wherein the message manager module operates on the first server.

3. The system of claim 1, wherein the message manager module operates on the second server.

4. The system of claim 1, wherein the message manager module is further configured to input a message generated from the computing module in the first level and distribute the message to the second server.

5. The system of claim 1, wherein the message manager module is further configured to input a message generated from the computing module in the second level and distribute the message to the first server.

6. The system of claim 1, wherein the message manager module is further configured to relay the information dependent on topology information about the hierarchy.

7. The system of claim 1, wherein at least another of the computing modules in the first level operates on the second server, and wherein the message manager module is further configured to relay information between the at least one other computing module in the first level and the computing module in the second level.

8. The system of claim 1, wherein an input range of the computing module in the second module is greater than an input range of the computing module in the first level.

9. The system of claim 1, wherein the message manager module is further configured to operate according to at least one of a message passing interface (MPI) protocol and a zero-copy protocol using shared memory.

10. The system of claim 1, wherein the message manager module is further configured to operate dependent on at least one of a socket connection and a shared memory buffer.

11. A computer-implemented method, comprising:

learning a cause of a first set of input data received over space and time by a hierarchy of computing modules having a first level of a plurality of computing modules and a second level of at least one computing module, wherein at least one of the computing modules in the first level operates on a first server, and wherein the at least one computing module in the second level operates on a second server; and

enabling an operation of the hierarchy by passing information between the first server and the second server.

12. The computer-implemented method of claim 11, wherein passing the information comprises:

receiving a message generated from the computing module in the first level; and

distributing the message to the second server.

13. The computer-implemented method of claim 11, wherein passing the information comprises:

receiving a message generated from the computing module in the second level; and

distributing the message to the first server.

14. The computer-implemented method of claim 11, wherein the passing of information is dependent on topology information about the hierarchy.

15. The computer-implemented method of claim 11, wherein at least another of the computing modules in the first level operates on the second server, the method further comprising:

relaying information between the at least one other computing module in the first level and the computing module in the second level.

16. The computer-implemented method of claim 11, wherein an input range of the computing module in the second module is greater than an input range of the computing module in the first level.

17. A computer-readable medium having instructions therein that are executable by a processor, the instructions comprising instructions to:

learn a cause of a first set of input data received over space and time by a hierarchy of computing modules having a first level of a plurality of computing modules and a second level of at least one computing module, wherein at least one of the computing modules in the first level operates on a first server, and wherein the at least one computing module in the second level operates on a second server; and

enable an operation of the hierarchy by passing information between the first server and the second server.

18. The computer-readable medium of claim 17, wherein the instructions to pass the information comprise instructions to:

receive a message generated from the computing module in the first level; and

distribute the message to the second server.

19. The computer-readable medium of claim 17, wherein the instructions to pass the information comprise instructions to:

receive a message generated from the computing module in the second level; and

distribute the message to the first server.

20. The computer-readable medium of claim 17, wherein the instructions to pass the information are dependent on topology information about the hierarchy.

21. The computer-readable medium of claim 17, wherein at least another of the computing modules in the first level operates on the second server, the computer-readable medium further comprising instructions to:

relay information between the at least one other computing module in the first level and the computing module in the second level.