Dynamic Transaction-Persistent Server Load Balancing
First Claim
1. A method comprising:
- receiving, at a device in a network, a client request associated with a new transaction;
dynamically inferring, by the device, relative capacities of a plurality of servers;
selecting a server from the plurality of servers based on the inferred relative capacities to process requests associated with the new transaction; and
transmitting, from the device to a selected server, a request corresponding to the client request.
4 Assignments
0 Petitions
Accused Products
Abstract
The present disclosure describes a system for dynamic transaction-persistent server load balancing. The disclosed system receives a client request associated with a new transaction. In response to receiving the client request, the system dynamically infers relative capacities of a plurality of servers coupled to the device in a network. In particular, the system maintains a set of variables corresponding to the servers. Each variable indicates a number of outstanding requests transmitted from the device to a respective server. The system infers relative server capacities and transmission latencies between the device and the servers based on a comparison of current values of the variables. The system identifies and selects a server associated with high capacity or low transmission latency between the device and the server relative to one or more other servers, and transmits an outstanding request corresponding to the client request from the new transaction to the identified server.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving, at a device in a network, a client request associated with a new transaction; dynamically inferring, by the device, relative capacities of a plurality of servers; selecting a server from the plurality of servers based on the inferred relative capacities to process requests associated with the new transaction; and transmitting, from the device to a selected server, a request corresponding to the client request. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system comprising:
-
a processor; a memory; a receiving mechanism coupled to the processor and the memory, the receiving mechanism receiving a client request associated with a new transaction; an inferring mechanism coupled to the processor and the memory, the inferring mechanism inferring relative capacities of a plurality of servers; a selecting mechanism coupled to the processor and the memory, the selecting mechanism selecting a server from the plurality of servers based on the inferred relative capacities to process requests associated with the new transaction; and a transmitting mechanism coupled to the processor and the memory, the transmitting mechanism transmitting, to a selected server, a request corresponding to the client request. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer-readable storage medium storing embedded instructions to perform a method, wherein the method comprises:
-
receiving a client request associated with a new transaction; dynamically inferring relative capacities of a plurality of servers; selecting a server from the plurality of servers based on the inferred relative capacities to process requests associated with the new transaction; and transmitting, to the selected server, a request corresponding to the client request.
-
Specification