Load regulation using dynamically determined time to live values
First Claim
1. A computer-implemented method of regulating server load, the method comprising:
- monitoring a load level of a server system that provides network-based access to a retrievable content resource;
regulating the load level of the server system by varying time-to-live (TTL) values sent to requester devices with the retrievable content resource, such that the TTL values are varied according to a function in which TTL values are directly proportional to the load level of the server system, whereby increases in the load level of the server system cause higher TTL values to be used; and
adaptively varying an algorithm used to calculate said TTL values based on load regulation feedback data reflective of an effectiveness of the TTL values;
said method performed programmatically by a computing system.
1 Assignment
0 Petitions
Accused Products
Abstract
Time to live (“TTL”) values are determined based on one or more factors. The TTL values may be included in responses to requests for resources, thereby affecting the frequency of subsequent requests. This dynamic determination of TTL values may provide resilience to system load, for example by using longer TTL values when the system is under greater load in order to reduce the rate at which subsequent requests are received. A dynamic TTL service may calculate a TTL value based on one or more factors, such as overall system load, resource load, hardware load, and/or software load. In various embodiments, a dynamic TTL service may act natively within a service, within a system framework, as a proxy, as a cluster, and/or as a broker.
44 Citations
21 Claims
-
1. A computer-implemented method of regulating server load, the method comprising:
-
monitoring a load level of a server system that provides network-based access to a retrievable content resource; regulating the load level of the server system by varying time-to-live (TTL) values sent to requester devices with the retrievable content resource, such that the TTL values are varied according to a function in which TTL values are directly proportional to the load level of the server system, whereby increases in the load level of the server system cause higher TTL values to be used; and adaptively varying an algorithm used to calculate said TTL values based on load regulation feedback data reflective of an effectiveness of the TTL values; said method performed programmatically by a computing system. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. Non-transitory computer storage having stored thereon executable program code that instructs a computing system to perform a load regulation process that comprises:
-
monitoring a load level of a server system that provides network-based access to a retrievable content resource, said server system comprising one or more physical servers; regulating the load level of the server system by varying time-to-live (TTL) values sent to requester devices with the retrievable content resource, such that the TTL values are varied according to a function in which TTL values are directly proportional to the load level of the server system, such that increases in the load level of the server system cause higher TTL values to be used; and adaptively varying an algorithm used to calculate said TTL values based on load regulation feedback data reflective of an effectiveness of the TTL values. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A computer-implemented process of regulating load, the process comprising:
-
monitoring a load level of a server system that provides network-based access to a retrievable content resource; detecting a cyclic pattern in said load level; receiving a request for the content resource from a requester device; and selecting a time-to-live (TTL) value to provide to the requester device with the content resource such that the TTL value is selected based at least partly on the detected cyclic pattern in the load level; said process performed programmatically by a computing system that comprises one or more computing devices. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
-
21. Non-transitory computer storage having stored thereon executable program code that instructs a computing system to perform a load regulation process that comprises:
-
monitoring a load level of a provider system that provides network-based access to a retrievable content resource; detecting a cyclic pattern in said load level; receiving a request for the content resource from a requester device; and selecting a time-to-live (TTL) value to provide to the requester device with the content resource such that the TTL value is selected based at least partly on the detected cyclic pattern in the load level.
-
Specification