Persistent connection rebalancing

• US 10,243,854 B2
• Filed: 12/09/2015
• Issued: 03/26/2019
• Est. Priority Date: 12/09/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jones, Robert C., Kassimis, Constantinos, Mitchell, Ian J., Wakelin, Philip I.
• Primary Examiner(s): Sison, June Y
• Application Number:
  US14/963,516
• Publication Number:
  US 20170171305A1
• Time in Patent Office: 1,203 Days
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/0882 Utilisation of link capacity
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/828 Allocation of resources per group of connections, e.g. per group of users
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer

Abstract

Disclosed is a computer-implemented method of rebalancing persistent client connections to a cluster of servers. The method comprises identifying an increase in a total client connection capacity of the cluster of servers with a network connection balancing component; and for each server in a selection of servers in the cluster of servers calculating a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server; comparing the current client connection capacity utilization with the target client connection capacity utilization; and terminating a selection of its persistent client connections by a server based on its current client connection capacity utilization exceeding the target client connection capacity utilization. Also disclosed are a computer program product and a computer system for utilizing the computer-implemented method.

Claims

1. A computer program product comprising a computer readable storage medium having computer readable program instructions embodied therewith for, when executed on a computer system implementing a cluster of servers, wherein each server of within the clusters of servers comprises one or more processors, the computer readable program instructions being executable by the one or more processors to cause the one or more processors to:

rebalance persistent client connections to the cluster of servers, said rebalancing comprising;

identifying an increase in a total client connection capacity of the cluster of servers, wherein the increase in the total client connection capacity of the cluster of servers is due to one or more new servers being added to the cluster of servers;

determining a target client connection capacity utilization from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers; and

for each server in a selection of servers in the cluster of servers;

determining a current client connection capacity utilization of the server from the number of persistent connections to the server and a current capacity of the server;

comparing the current client connection capacity utilization with the target client connection capacity utilization; and

terminating a selection of its persistent client connections based on its current client connection capacity utilization exceeding the target client connection capacity utilization.

2. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to:

determine a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server and comparing the current client connection capacity utilization with the target client connection capacity utilization with a network connection balancing component;

communicate a persistent connection termination message to each server in the cluster of servers having the current client connection capacity utilization exceeding the target client connection capacity utilization; and

terminate the selection of its persistent client connections by the server based on its current client connection capacity utilization exceeding the target client connection capacity utilization in accordance with the received persistent connection termination message.

3. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to communicate the determined target client connection capacity utilization based on the increased total client connection capacity to the selection of servers in the cluster of servers with a network connection balancing component;

and

determining, with a server receiving the communicated determined target client connection capacity utilization, its current client connection capacity utilization from its number of persistent connections and its current capacity and compare its current client connection capacity utilization with the target client connection capacity utilization.

4. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to identify an increase in the total client connection capacity of the cluster of servers by receiving a capacity modification notification from the server indicating an increased current client connection capacity of that server.

5. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to determine the target client connection capacity utilization based on the number of persistent client connections to the cluster of servers and the increased total client connection capacity of the cluster of servers by dividing the number of persistent client connections to the cluster of servers by a number of servers in the cluster of servers.

6. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to determine the target client connection capacity utilization by dividing the number of persistent client connections to the cluster of servers by a sum of the individual client connection capacities of the respective servers in the cluster of servers.

7. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to terminate a selection of persistent client connections to the server based on the current client connection capacity utilization exceeding the target client connection based on at least one of:

a period of inactivity of the persistent client connections;

a lifetime of the persistent client connections;

a usage count of the persistent client connections;

a latency metric of the persistent client connections; and

a logical error metric of respective communications over the persistent client connections.

8. A computer program product according to claim 1, in which the computer readable program instructions cause the processor arrangement to terminate a selection of persistent client connections to the server based on the current client connection capacity utilization exceeding the target client connection capacity utilization when a difference between the current client connection capacity utilization and the target client connection capacity utilization exceeds a defined threshold.

12. A computer program product according to claim 1, wherein a cluster entry notification is generated by the addition of the one or more new servers.

9. A computer system comprising:

one or more processors;

one or more memory devices couple to the one or more processors;

a cluster of servers listening to a shared IP endpoint and a network balancing component for balancing client connections to a server in the cluster of servers, wherein each server of within the clusters of servers comprises one or more processors;

the network balancing component being adapted to rebalance persistent client connections to the cluster of servers, said rebalancing comprising;

identifying an increase in a total client connection capacity of the cluster of servers wherein the increase in the total client connection capacity of the cluster of servers is due to one or more new servers being added to the cluster of servers; and

determining a target client connection capacity utilization from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers;

the computer system further being adapted to, for each server in a selection of servers in the cluster of servers;

determine its current client connection capacity utilization from its number of persistent connections and its current capacity; and

compare its current client connection capacity utilization with the target client connection capacity utilization; and

each server being adapted to terminate a selection of its persistent client connections based on its current client connection capacity utilization exceeding the target client connection capacity utilization.

10. A computer system according to claim 9, the network balancing component being further adapted to:

determine the current client connection capacity utilization for a server from its number of persistent connections and its current capacity;

compare its current client connection capacity utilization with the target client connection capacity utilization; and

communicate a persistent connection termination message to each server in the cluster of servers having the current client connection capacity utilization exceeding the target client connection capacity utilization;

each server receiving the persistent connection termination message being adapted to terminate the selection of its persistent client connections in accordance with the received persistent connection termination message.

11. A computer system according to claim 9, the network balancing component being further adapted to:

communicate the determined target client connection capacity utilization based on the increased total client connection capacity to the selection of servers in the cluster of servers; and

each server being further adapted to determine its current client connection capacity utilization from its number of persistent connections and its current capacity and compare the communicated determined current client connection capacity utilization with the target client connection capacity utilization.

13. A computer system according to claim 9, wherein a cluster entry notification is generated by the addition of the one or more new servers.