Persistent connection rebalancing

• US 10,250,507 B2
• Filed: 03/11/2016
• Issued: 04/02/2019
• Est. Priority Date: 12/09/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jones, Robert C., Kassimis, Constantinos, Mitchell, Ian J., Wakelin, Philip I.
• Primary Examiner(s): Sison, June Y
• Application Number:
  US15/067,632
• Publication Number:
  US 20170171086A1
• Time in Patent Office: 1,117 Days
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/0882 Utilisation of link capacity
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/828 Allocation of resources per group of connections, e.g. per group of users
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer

Abstract

Disclosed is a computer-implemented method of rebalancing persistent client connections to a cluster of servers. The method comprises identifying an increase in a total client connection capacity of the cluster of servers with a network connection balancing component; and for each server in a selection of servers in the cluster of servers calculating a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server; comparing the current client connection capacity utilization with the target client connection capacity utilization; and terminating a selection of its persistent client connections by a server based on its current client connection capacity utilization exceeding the target client connection capacity utilization. Also disclosed are a computer program product and a computer system for utilizing the computer-implemented method.

Claims

1. A computer-implemented method of rebalancing persistent client connections to a cluster of servers, the method comprising:

identifying, by one or more processors of a computer system, an increase in a total client connection capacity of the cluster of servers with a network connection balancing component, wherein the increase in the total client connection capacity of the cluster of servers is due to one or more new servers being added to the cluster of servers;

determining, by the one or more processors of a computer system, a target client connection capacity utilization with the network connection balancing component from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers; and

for each server in a selection of servers in the cluster of servers;

determining, by the one or more processors of a computer system, a current client connection capacity utilization of the server from the number of persistent connections to the server and a current capacity of the server;

comparing, by the one or more processors of a computer system, the current client connection capacity utilization with the target client connection capacity utilization; and

terminating, by the one or more processors of a computer system, a selection of its persistent client connections by the server based on the current client connection capacity utilization exceeding the target client connection capacity utilization.

2. The computer-implemented method of rebalancing persistent client connections to a cluster of servers according to claim 1, in which:

determining a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server and comparing the current client connection capacity utilization with the target client connection capacity utilization is performed by the network connection balancing component, the method further comprising;

communicating a persistent connection termination message to each server in the cluster of servers having the current client connection capacity utilization exceeding the target client connection capacity utilization; and

terminating the selection of its persistent client connections by the server based on its current client connection capacity utilization exceeding the target client connection capacity utilization in accordance with the received persistent connection termination message.

3. The computer-implemented method of rebalancing persistent client connections to a cluster of servers according to claim 1, in which:

determining a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server and comparing the current client connection capacity utilization with the target client connection capacity utilization is performed by the server, the method further comprising;

communicating the determined target client connection capacity utilization to the selection of servers in the cluster of servers with the network connection balancing component.

4. A computer-implemented method of balancing client connections to a cluster of servers according to claim 1, in which identifying an increase in the total client connection capacity of the cluster of servers with the network connection balancing component comprises:

receiving a cluster entry notification from a server entering the cluster of servers or receiving a capacity modification notification from the server indicating an increased current client connection capacity of that server.

5. A computer-implemented method of balancing connections to a cluster of servers according to claim 1, in which the network connection balancing component comprises a persistent client connection counting component, the method further comprising:

counting the number of persistent client connections to the cluster of servers with the persistent client connection counting component.

6. A computer-implemented method of balancing connections to a cluster of servers according to claim 1, in which calculating the target client connection capacity utilization with the network connection balancing component from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers comprises:

determining the target client connection capacity utilization by dividing the number of persistent client connections to the cluster of servers by a number of servers in the cluster of servers.

7. A computer-implemented method of rebalancing connections to a cluster of servers according to claim 1, in which determining the target client connection capacity utilization with the network connection balancing component from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers comprises:

determining the target client connection capacity utilization by dividing the number of persistent client connections to the cluster of servers by a sum of the individual client connection capacities of the respective servers in the cluster of servers.

8. A computer-implemented method of rebalancing connections to a cluster of servers according to claim 1, in which terminating a selection of persistent client connections to the server based on its current client connection capacity utilization exceeding the target client connection capacity utilization comprises:

selecting persistent client connections for termination based on at least one of;

a period of inactivity of the persistent client connections;

a lifetime of the persistent client connections;

a usage count of the persistent client connections;

a latency metric of the persistent client connections; and

a logical error metric of respective communications over the persistent client connections.

9. A computer-implemented method of rebalancing connections to a cluster of servers according to claim 1, in which terminating a selection of persistent client connections to the server based on the current client connection capacity utilization exceeding the target client connection capacity utilization comprises:

terminating the selection of persistent client connections to the server when a difference between the current client connection capacity utilization and the target client connection capacity utilization exceeds a defined threshold.

10. A computer-implemented method of rebalancing connections to a cluster of servers according to claim 1, wherein a cluster entry notification is generated by the addition of the one or more new servers.