Allocating cache request in distributed cache system based upon cache object and marker identifying mission critical data
First Claim
1. A method for intelligently allocating cache requests among caches in a distributed cache system, the method comprising:
- allocating, at a computing device, a cache request to a first cache of the distributed cache system based on a marker identifying a mission critical data type associated with a cache object associated with the cache request, wherein the mission critical data type is identified based upon information gathered by monitoring operations concerning a number of cache objects of different types generated by user requests, and wherein the first cache comprises a local cache;
monitoring the caches in the distributed cache system;
when a slowdown in service is detected at the first cache, switching the first cache to a safe cache mode of operation;
periodically performing a test to determine whether the first cache has resumed normal operations;
when the first cache has resumed normal operations, switching the first cache to a normal cache mode of operations.
1 Assignment
0 Petitions
Accused Products
Abstract
Various embodiments of the present disclosure provide improved systems and techniques for intelligently allocating cache requests to caches based upon the nature of the cache objects associated with the cache requests, and/or the condition of the caches in the distributed cache system, to facilitate cache system utilization and performance. In some embodiments, an allocation of cache requests may be performed in response to detection of a problem at one of a group of cache servers. For example, in some embodiments, a particular cache server may be entered into a safe mode of operations when the cache'"'"'s ability to service cache requests is impaired. In other embodiments, an allocation of cache requests may be performed based on an cache object data type associated with the cache requests.
-
Citations
20 Claims
-
1. A method for intelligently allocating cache requests among caches in a distributed cache system, the method comprising:
-
allocating, at a computing device, a cache request to a first cache of the distributed cache system based on a marker identifying a mission critical data type associated with a cache object associated with the cache request, wherein the mission critical data type is identified based upon information gathered by monitoring operations concerning a number of cache objects of different types generated by user requests, and wherein the first cache comprises a local cache; monitoring the caches in the distributed cache system; when a slowdown in service is detected at the first cache, switching the first cache to a safe cache mode of operation; periodically performing a test to determine whether the first cache has resumed normal operations; when the first cache has resumed normal operations, switching the first cache to a normal cache mode of operations. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer system for intelligently allocating cache requests among caches in a distributed cache system, comprising:
-
one or more processors; and a non-transitory computer readable medium having stored thereon one or more programs, which when executed by the one or more processors, causes the one or more processor to singly or in combination; allocate a cache request to a first cache of the distributed cache system based on a marker identifying a mission critical data type associated with a cache object associated with the cache request, wherein the mission critical data type is identified based upon information gathered by monitoring operations concerning a number of cache objects of different types generated by user requests, and wherein the first cache comprises a local cache; monitor the caches in the distributed cache system; when a slowdown in service is detected at the first cache, switch the first cache to a safe cache mode of operation; periodically perform a test to determine whether the first cache has resumed normal operations; when the first cache has resumed normal operations, switch the first cache to a normal cache mode of operations. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions for:
-
allocating a cache request to a first cache of the distributed cache system based on a marker identifying a mission critical data type associated with a cache object associated with the cache request, wherein the mission critical data type is identified based upon information gathered by monitoring operations concerning a number of cache objects of different types generated by user requests, and wherein the first cache comprises a local cache; monitoring the caches in the distributed cache system; when a slowdown in service is detected at a first cache, switching the first cache to a safe cache mode of operation; periodically performing a test to determine whether the first cache has resumed normal operations; when the first cache has resumed normal operations, switching the first cache to a normal cache mode of operations.
-
Specification