Selecting executing requests to preempt
First Claim
1. A non-transitory computer readable medium including code that when executed by a computer system performs a method of selecting application requests that are executing to preempt, the method comprising:
- determining whether an application is in an overload condition;
in response to determining the application is in an overload condition, identifying each request that is being executed by the application;
determining a value for each request that is executing, wherein determining the value comprises calculating a utility measure, calculating an amount of executing time, and estimating a probability distribution of a residual lifetime for each request;
utilizing the probability distribution for estimating a utility per unit consumed by each request and utilizing the probability distribution for estimating a mean utility per additional resource consumed, wherein the mean utility per additional resource consumed includes a quantity of financial resource per additional resource consumed;
determining a mean utility per resource consumed to complete the request based on the probability distribution as the value; and
selecting executing requests to preempt based on the values for the requests.
4 Assignments
0 Petitions
Accused Products
Abstract
Systems, methods, and computer-readable and executable instructions are provided for selecting executing requests to preempt. Selecting executing requests to preempt can include determining whether an application is in an overload condition. Selecting executing requests can also include in response to determining the application is in an overload condition, identifying each request that is being executed by the application. Selecting executing requests can also include determining a value for each request that is executing. Furthermore, selecting executing requests can also include selecting executing requests to preempt based on the values for the requests.
14 Citations
11 Claims
-
1. A non-transitory computer readable medium including code that when executed by a computer system performs a method of selecting application requests that are executing to preempt, the method comprising:
-
determining whether an application is in an overload condition; in response to determining the application is in an overload condition, identifying each request that is being executed by the application; determining a value for each request that is executing, wherein determining the value comprises calculating a utility measure, calculating an amount of executing time, and estimating a probability distribution of a residual lifetime for each request; utilizing the probability distribution for estimating a utility per unit consumed by each request and utilizing the probability distribution for estimating a mean utility per additional resource consumed, wherein the mean utility per additional resource consumed includes a quantity of financial resource per additional resource consumed; determining a mean utility per resource consumed to complete the request based on the probability distribution as the value; and selecting executing requests to preempt based on the values for the requests. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer system comprising:
-
a processor executing requests for an application; an overload detector detecting when the application is in an overload condition; a request valuer determining a value for each request that is executing when the overload detector detects the overload condition, wherein determining the value comprises calculating a utility measure, calculating an amount of executing time, estimating a probability distribution of a residual lifetime for each request, utilizing the probability distribution for estimating a utility per unit consumed by each request and utilizing the probability distribution for estimating a mean utility per additional resource consumed, wherein the mean utility per additional resource consumed includes a quantity of financial resource per additional resource consumed, wherein the request valuer determines a mean utility per resource consumed to complete the request based on the probability distribution as the value; and a request preemption selector selecting one or more of the executing requests to preempt based on the values for the executing requests. - View Dependent Claims (10)
-
-
11. A non-transitory computer readable medium including code that when executed by a computer system performs a method of selecting application requests that are executing to preempt, the method comprising:
-
determining whether an application is in an overload condition based on service levels specified in a service level agreement; in response to determining the application is in an overload condition, identifying each request that is being executed by the application, wherein a request that is being executed is a request that leaves an admission queue and enters a processing state; determining a value for each request that is executing, wherein determining the value comprises calculating a utility measure, calculating an amount of executing time, and estimating a probability distribution of a residual lifetime for each request; utilizing the probability distribution for estimating a utility per unit consumed by each request and utilizing the probability distribution for estimating a mean utility per additional resource consumed, wherein the mean utility per additional resource consumed includes a quantity of financial resource per additional resource consumed; determining a mean utility per resource consumed to complete the request based on the probability distribution as the value; and selecting executing requests to suspend or terminate based on the values for the requests.
-
Specification