Hierarchical temporal memory (HTM) system deployed as web service

• US 9,621,681 B2
• Filed: 03/27/2014
• Issued: 04/11/2017
• Est. Priority Date: 02/10/2006
• Status: Active Grant

• Current Assignee: Numenta, Inc.
• Original Assignee: Numenta, Inc.
• Inventors: Edwards, Jeffrey L., Saphir, Wiliam C., Ahmad, Subutai, George, Dileep, Astier, Frank, Marianetti, Ronald
• Primary Examiner(s): Starks, Wilbert L
• Application Number:
  US14/228,121
• Publication Number:
  US 20140207842A1
• Time in Patent Office: 1,111 Days
• Field of Search: None
• CPC Class Codes: G06N 3/04 Architecture, e.g. interconnection topology
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/047 Probabilistic or stochastic networks
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: H04L 51/212 using filtering or selective blocking
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1017 based on a round robin mechanism
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A web-based hierarchical temporal memory (HTM) system in which one or more client devices communicate with a remote server via a communication network. The remote server includes at least a HTM server for implementing a hierarchical temporal memory (HTM). The client devices generate input data including patterns and sequences, and send the input data to the remote server for processing. The remote server (specifically, the HTM server) performs processing in order to determine the causes of the input data, and sends the results of this processing to the client devices. The client devices need not have processing and/or storage capability for running the HTM but may nevertheless take advantage of the HTM by submitting a request to the HTM server.

Claims

1. A server system comprising a processor and a memory device, the server system comprising:

a gateway server configured to receive via a communication network requests to perform temporal processing on input data sets from a plurality of client devices, the gateway server further configured to receive each of the input data set from each of the plurality of client devices via the communication network; and

a temporal memory server coupled to the gateway server to receive the input data sets from the gateway server, the temporal memory server configured to perform temporal processing on each of the input data sets by at least detecting temporal sequences of spatial inputs in each of the input data sets.

2. The server system of claim 1, wherein the gateway server comprises:

a Hypertext Transfer Protocol (HTTP) server configured to establish connections with the plurality of client devices in response to connection requests from the plurality of client devices; and

a scripting module configured to invoke handler scripts to extract the input data sets associated with the connection requests, the scripting module providing the extracted input data sets to the temporal memory server for the temporal processing.

3. The server system of claim 1, wherein the temporal memory server comprises a plurality of processing nodes structured in a hierarchical manner.

4. The server system of claim 3, wherein the temporal memory server comprises:

a first node for receiving the input data sets and generating a first vector representing information about temporal sequences of spatial patterns in the input data sets corresponding to learned sequences of spatial patterns; and

a second node associated with the first node to generate and output a second vector based on the first vector, the second vector representing information about causes of the input data sets.

5. The server system of claim 1, wherein the temporal memory server comprises a pre-processor module for pre-processing the input data sets before the temporal processing.

6. The server system of claim 1, wherein the temporal memory server is trained at least partially by samples of input data sets and a supervisory signal received from the plurality of client devices via the gateway server.

7. The server system of claim 1, wherein the temporal processing comprises inference and classification.

8. The server system of claim 1, wherein the temporal memory server is configured to form a model of temporal sequences of spatial patterns in all of the input data sets received from the plurality of client devices.

9. The server system of claim 1, wherein the temporal memory server is configured to generate distinct models of temporal sequences of spatial patterns in each of the input data sets received from each of the plurality of client devices.

10. The server system of claim 1, wherein the gateway server and the temporal memory server are implemented on separate computing devices.

11. A client device, comprising:

a sensor for generating input data including patterns and sequences;

a process manager comprising a processor and configured to generate a request to perform inference or classification to a remote server, the process manager coupled to the sensor to format the input data and associate the input data with the request, the processor manager further configured to receive an output from the remote server that perform temporal processing on the input data responsive to sending the request and the input data to the remote server; and

a communication module coupled to the process manager for transmitting the request and the associated input data to the remote server and receiving the output from the remote server via a communication network.

12. The client device of claim 11, further comprising a pre-processor coupled to the sensor and the processor manager for pre-processing the input data for processing at the remote server.

13. The client device of claim 11, further comprising a category mapper coupled to the process manager for storing mapping between indices in the output received from the remote server and causes to the input data learned by the remote server, the indices received from the remote server responsive to sending the input data.

14. The client device of claim 11, wherein the communication module transmits the input data and receives the output from the remote server by TCP/IP and HTTP.

15. The client device of claim 11, wherein the process manager stores identification for identifying the client device.

16. The client device of claim 11, wherein the sensor comprises a software component for processing data received at or stored in the client device.

17. A computer-implemented method of processing input data, comprising:

receiving, at a computing device located remotely from a plurality of client devices, via a communication network the input data sets from the plurality of client devices;

receiving requests to perform temporal processing on the input data sets from the plurality of client devices

performing temporal processing on each of the input data sets by at least detecting temporal sequences of spatial inputs in each of the input data sets;

generating an output representing result of the temporal processing; and

sending the output to at least one of the plurality of client devices.

18. The method of claim 17, further comprising receiving training information at the computing device for performing the temporal processing.

19. The method of claim 17, further comprising:

storing mapping information representing mapping between causes learned by the computing device using the training information and indices associated with causes, the output comprising the indices.

20. The method of claim 17, wherein the input data sets and the output is communicated using TCP/IP and HTTP protocols via the communication network.