DISTRIBUTED CACHING CLUSTER MANAGEMENT

• US 20140149537A1
• Filed: 11/26/2012
• Published: 05/29/2014
• Est. Priority Date: 11/26/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Shankaran, Nishanth, Krishnamoorthy, Shyam, Shou, Dong, Arya, Rajat, Sbisa, Clint Joseph, Thiruchi Loganathan, Rajaprabhu
• Granted Patent: US 9,847,907 B2
• Time in Patent Office: Days
• US Class Current: 709/216
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 41/0816 the condition being an adaptation, e.g. in response to network events
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

A management system may enable and monitor a cache or other cluster to make the cluster configuration-aware such that initialization and changes to the underlying structure of the cluster can be dynamically updated. For example, a distributed memory caching system may provide initial configuration to a client from a memory caching node referenced by an alias provided by a configuration endpoint. Updates of configuration may be retrieved from memory caching nodes, each storing current configuration of the cache cluster. A management system monitors changes to the cache cluster, such as provisioning of new caching nodes, and updates the configuration stored in the caching nodes for retrieval by a client.

Claims

1. A computer-implemented method for managing a distributed memory caching system, comprising:

under the control of one or more computer systems configured with executable instructions,

monitoring a set of one or more memory caching nodes forming a cache cluster, each memory caching node of the set of one or more memory caching nodes providing storage for a portion of data contained in the cache cluster and at least one memory caching node of the cache cluster comprising a configuration for accessing the data from the set of one or more memory caching nodes;

determining that a new memory caching node be added to the cache cluster;

provisioning the new memory caching node into the cache cluster; and

updating the configuration within the at least one memory caching node based at least in part on the new memory caching node.

2. The computer-implemented method of claim 1:

wherein the monitoring the set of one or more memory caching nodes further comprises detecting a failure of a failed memory caching node from the cache cluster;

wherein provisioning the new memory caching further comprises causing a replacement memory caching node to be provisioned in place of the failed memory caching node; and

wherein updating the configuration within the at least one memory caching node further comprises updating the configuration within the at least one memory caching nodes based at least in part on the replacement of the failed memory caching node with the replacement memory caching node.

3. The computer-implemented method of claim 1:

wherein the monitoring the set of one or more memory caching nodes further comprises detecting an indicator indicating a need of additional caching performance from the cache cluster;

wherein provisioning the new memory caching node into the cache cluster further comprises provisioning the new memory caching node in place of a replaced memory caching node that has less resources than the new memory caching node; and

wherein updating the configuration within the at least one memory caching node further comprises updating the configuration within the at least one memory caching nodes based at least in part on the replacement of the replaced memory caching node with the new memory caching node.

4. The computer-implemented method of claim 1, further comprising updating an alias of a configuration endpoint based at least in part on the new memory caching node.

5. The computer-implemented method of claim 1, wherein provisioning the new memory caching node into the cache cluster further comprises constructing a workflow that includes the operations of:

provisioning the new memory caching node;

adding the memory caching node to the set of one or more memory caching nodes;

determining a new configuration; and

updating the configuration within each of the set of one or more memory caching nodes.

6. A computer-implemented method for managing a service, comprising:

under the control of one or more computer systems configured with executable instructions,

monitoring a cluster comprising one or more storage nodes, each storage node of the one or more storage nodes providing storage for a portion of data contained in a distributed data store;

at least one storage node storing a configuration for accessing the data within the cluster; and

as a result of a determination that the configuration be updated, updating the configuration of the at least one storage node.

7. The computer-implemented method of claim 6, wherein updating the configuration further comprises updating the configuration based at least in part on a modification to the cluster.

8. The computer-implemented method of claim 7, further comprising modifying the cluster by removing a storage node from the cluster through the operations of:

de-provisioning the storage node; and

reallocating at least a portion of data contained in the distributed data store among at least a plurality of remaining storage nodes in the cluster.

9. The computer-implemented method of claim 7, further comprising modifying the cluster by adding a new storage node to the cluster through the operations of:

provisioning the new storage node; and

reallocating at least a portion of data contained in the distributed data store among at least a plurality of storage nodes in the cluster.

10. The computer-implemented method of claim 7, further comprising modifying the cluster by replacing a first storage node in the cluster through the operations of:

provisioning a new storage node;

de-provisioning the first storage node; and

allocating at least a portion of data from the first storage node to the new storage node.

11. The computer-implemented method of claim 7, further comprising modifying the cluster by altering a characteristic of a storage node from the cluster.

12. The computer-implemented method of claim 11, wherein altering the characteristic of the storage node further comprises modifying a storage size of the storage node.

13. A computer system for managing a caching service, comprising:

one or more computing resources having one or more processors and memory including executable instructions that, when executed by the one or more processors, cause the one or more processors to implement at least;

one or more memory caching nodes forming a cache cluster that provide storage for a distributed data cache allocated across the cache cluster and provide storage for a configuration for accessing data within the cache cluster; and

a management system that monitors and provisions memory caching nodes and updates the configuration within the cache cluster based at least in part on changes to the cache cluster caused by the management system.

14. The computer system of claim 13, further comprising a data store that provides data for the distributed data cache that is allocated across the cache cluster.

15. The computer system of claim 14, wherein the data store is a relational database and wherein the distributed data cache includes responses to queries from the relational database.

16. The computer system of claim 13, further comprising a configuration endpoint that provides an alias to a memory caching node from the cache cluster and receives alias updates from the management system.

17. The computer system of claim 16, wherein the configuration endpoint has a static address at which it can be used to resolve the alias to the memory caching node.

18. The computer system of claim 13, further comprising a program execution environment in which the cache cluster and management system are allocated computing resources on which to execute.

19. One or more computer-readable storage media having collectively stored thereon executable instructions that, when executed by one or more processors of a computer system, cause the computer system to at least:

monitor a cache cluster for indications of failure of one or more memory caching nodes, at least a plurality of memory caching nodes providing storage for a portion of data contained in a distributed data cache;

determine that an indicator of a memory caching node from the cache cluster has passed a failure threshold;

cause the memory caching node to be removed from the cache cluster; and

update a configuration stored by at least one memory caching node from the cache cluster based at least in part on the removed memory caching node.

20. The computer-readable storage media of claim 19, wherein the instructions further comprise instructions that, when executed, cause the computer system to at least:

cause a new memory caching node to be provisioned and added to the cache cluster; and

update the configuration within at least the at least one memory caching node from the cache cluster based at least in part on the provisioned new memory caching node.

21. The computer-readable storage media of claim 20, wherein updating the configuration within the at least one memory caching node from the cache cluster further comprises updating the configuration such that the new node replaces the removed memory caching node.

22. The computer-readable storage media of claim 19, wherein the configuration comprises connection information to the cache cluster.

23. The computer-readable storage media of claim 19, wherein updating the configuration within the at least one memory caching node from the cache cluster further comprises updating the memory caching nodes with the configuration to cause the memory caching nodes to propagate the configuration using peer-to-peer updating.

24. The computer-readable storage media of claim 23, wherein causing the memory caching nodes to propagate the configuration further comprises updating a configuration endpoint with a new alias to a memory caching endpoint within the set of one or more memory caching endpoints.

25. The computer-readable storage media of claim 19, wherein updating the configuration stored by the at least one memory caching node further comprises receiving an indication from a management system of one or more assignments of memory caching nodes for use with a consistent hashing method.