Method and apparatus for dynamic interval-based load balancing
First Claim
1. In a distributed or clustered network of servers wherein clients are divided into groups which periodically send mapping requests to an arbitrator for mapping and balancing service requests among multiple replicated servers which can service the request, a computerized method for mapping servers to service requests, said method comprising the steps of:
- mapping a first mapping request from a first group to a first server according to a schedule;
dynamically computing a valid interval for said mapping request to the first server as a function of one of a first group request load and a first server capacity; and
communicating the server selection and the valid interval to the first group for caching such that subsequent requests from the first group are routed to the first server during the valid interval.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for use in geographically distributed or clustered system wherein an arbiter assigns clients to servers. The arbiter also dynamically assigns a valid time interval to each mapping request based on network load and/or capacity parameters such as the client request rate and/or the server capacity. Alternative means for dynamically setting the valid interval in conjunction with a scheduling process, which can be either deterministic or probabilistic, are also devised.
240 Citations
20 Claims
-
1. In a distributed or clustered network of servers wherein clients are divided into groups which periodically send mapping requests to an arbitrator for mapping and balancing service requests among multiple replicated servers which can service the request, a computerized method for mapping servers to service requests, said method comprising the steps of:
-
mapping a first mapping request from a first group to a first server according to a schedule; dynamically computing a valid interval for said mapping request to the first server as a function of one of a first group request load and a first server capacity; and communicating the server selection and the valid interval to the first group for caching such that subsequent requests from the first group are routed to the first server during the valid interval. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. In a distributed or clustered network of servers wherein clients are divided into groups which periodically send mapping requests to an arbitrator for mapping and balancing service requests among multiple replicated servers which can service the request, said arbitrator comprising:
-
computer executable scheduling logic means for mapping a first mapping request form a first group to a first server according to a schedule; computer executable dynamic valid interval means, coupled to said scheduling logic means, for dynamically computing a valid interval for said mapping request to the first server as a function of one of a first group request load and a first server capacity; and means for communicating both a first server identifier in response to said scheduling logic means and the valid interval, to the first group such that subsequent requests from the first group are routed to the first server during the valid interval. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification