UPGRADING NETWORK TRAFFIC MANAGEMENT DEVICES WHILE MAINTAINING AVAILABILITY

• US 20100042869A1
• Filed: 08/18/2009
• Published: 02/18/2010
• Est. Priority Date: 08/18/2008
• Status: Active Grant

• Current Assignee: F5 Networks, Inc. (F5 Incorporated)
• Original Assignee: F5 Networks, Inc. (F5 Incorporated)
• Inventors: Amdahl, Saxon, Skene, Bryan D., Szabo, Paul I.
• Granted Patent: US 8,209,403 B2
• Time in Patent Office: Days
• US Class Current: 714/4
• CPC Class Codes: G06F 11/203 using migration
• CPC Class Codes: G06F 11/2033 switching over of hardware resources
• CPC Class Codes: G06F 8/656 while running
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure

Abstract

A method, system, machine-readable storage medium, and apparatus are directed towards upgrading a cluster by bifurcating the cluster into two virtual clusters, an “old” virtual cluster (old active cluster) and a “new” virtual cluster (new standby cluster), and iteratively upgrading members of the old cluster while moving them into the new cluster. While members are added to the new cluster, existing connections and new connections are seamlessly processed by the old cluster. Optionally, state mirroring occurs between the old cluster and the new cluster once the number of members of the old and new clusters are approximately equal. Once a threshold number of members have been transferred to the new cluster, control and processing may be taken over by the new cluster. Transfer of control from the old cluster to the new cluster may be performed by failing over connectivity from the old cluster to the new cluster.

Claims

1. A method operated in conjunction with one or more processors to update network devices, comprising:

selecting a first member within a plurality of members in a first cluster;

bifurcating the first cluster, wherein the bifurcation comprises;

creating a second cluster, wherein the second cluster includes the selected first member;

activating the first member within the second cluster, wherein the first member is activated with a defined configuration upgrade; and

determining if a defined failover criteria is satisfied, and if the defined failover criteria is satisfied, failing over connectivity from the first cluster to the second cluster such that the second cluster becomes an active cluster for managing connections;

removing at least one other member from the first cluster;

upgrading the at least one other member with the defined upgrade; and

joining the at least one other member as a member to the second cluster.

2. The method of claim 1, wherein updating the network devices comprises managing an upgrade to a cluster of the network devices.

3. The method of claim 1, further comprising:

mirroring state information associated with connections managed by the first cluster; and

wherein determining if the defined failover criteria is satisfied includes determining when state information for a defined number of connections is mirrored above a defined threshold.

4. The method of claim 1, wherein bifurcating further comprises:

draining at least one existing connection from the selected first member to at least one other member in the first cluster.

5. The method of claim 1, wherein bifurcating further comprises:

for each of a predefined number of members in the first cluster;

draining connections to another member of the first cluster;

upgrading a configuration of the predefined member; and

joining the predefined member as a member of the second cluster.

6. The method of claim 1, wherein bifurcating further comprises:

draining connections to another member of the first cluster by at least one of;

changing an HTTP connection header value in a request or response to indicate closing an associated connection or to indicate reducing or otherwise modifying a keep-alive time period of an associated connection, or

performing any other protocol-specific action to shutdown at least one existing network connection.

7. The method of claim 1, wherein reallocating connections further comprises inhibiting accepting at least one new connection by the selected first member.

8. A system for updating network devices, comprising:

a first cluster having a plurality of members, wherein the first cluster is an active cluster managing network connections; and

one or more control modules operating on one or more processors that are configured to perform actions, including;

selecting a first member from the first cluster to upgrade with a defined change in configuration;

creating a second cluster with the selected first member as a first member of the created second cluster;

upgrading the first member of the second cluster;

joining members from the first cluster to the second cluster until a defined criteria is satisfied by;

removing from the first cluster each member to be joined;

upgrading a configuration of the member to be joined; and

joining the upgraded member to the second cluster; and

when the defined criteria is satisfied;

failing over connectivity from the first cluster to the second cluster, when another defined criteria is satisfied such that the second cluster becomes the active cluster for managing network connections.

9. The system of claim 8, wherein the one or more control modules are configured to perform actions, further comprising:

draining at least one existing connection managed by a member to be joined in the second cluster.

10. The system of claim 9, wherein draining at least one existing connection further comprises at least one of changing an HTTP connection header value in a request or response to indicate closing an associated connection or to indicate reducing or otherwise modifying a keep-alive time period of an associated connection, or performing any other protocol-specific action to shutdown of at least one existing network connection by reducing a keep-alive time period.

11. The system of claim 9, wherein draining at least one existing connection further comprises redirecting a request for a new connection from each member to be joined to another member in the first cluster.

12. The system of claim 8, wherein the second cluster is configured as a hot standby cluster prior to failover from the first cluster.

13. The system of claim 8, wherein the defined criteria includes when approximately half of a total number of members in the first cluster are joined to the second cluster.

14. The system of claim 8, wherein the one or more control modules are configured to perform actions, further comprising:

mirroring selected information from the first cluster by the second cluster; and

wherein the other defined criteria comprises determining when a defined threshold of selected information is crossed.

15. A machine-readable storage medium having machine-executable instructions stored thereon, which when executed by at least one processor, causes the at least one processor to perform one or more actions to update network devices, comprising:

bifurcating an active first cluster of members by;

draining connections from a first member in the active first cluster;

upgrading a defined configuration of the first member; and

creating a new second cluster with the first member; and

for a defined number of other members in the active first cluster;

draining connections from each of the defined other members;

upgrading a defined configuration of the defined other members; and

joining each defined other member as a member of the second cluster; and

when a defined failover condition is satisfied, failing over connectivity from the active first cluster to the second cluster, such that the second cluster becomes the active cluster.

16. The machine-readable storage medium of claim 15, wherein draining connections further comprises at least one of changing an HTTP connection header value in a request or response to indicate closing an associated connection or to indicate reducing or otherwise modifying a keep-alive time period of an associated connection, or performing any other protocol-specific action to shutdown of at least one existing network connection by reducing a keep-alive time period.

17. The machine-readable storage medium of claim 15, wherein the one or more actions further comprises:

using the second cluster, mirroring state information and connections managed by the first active cluster; and

wherein the defined failover condition comprises detecting when a defined number of connections and state information managed by the first active cluster is detected as being mirrored by the second cluster.

18. The machine-readable storage medium of claim 15, wherein draining connections further comprises at least one of enabling intra-cluster state mirroring with at least one other member in the active first cluster, or inhibiting acceptance of a request for a new connection.

19. The machine-readable storage medium of claim 15, wherein the one or more actions further comprises:

after failover of the first cluster;

upgrading a defined configuration of each remaining member of the first cluster, and joining each upgraded remaining member to the second cluster, wherein the second cluster is the active cluster for managing network connections.

20. The machine-readable storage medium of claim 15, wherein the defined number of other members is determined to be approximately equal to half of a total number of members in the first cluster.

21. The machine-readable storage medium of claim 15, wherein creating the new second cluster further comprises designating the first member as a primary member of the new second cluster.

22. An apparatus for updating network devices, the apparatus comprising:

at least one transceiver that receives and sends network traffic to one or more clients and servers; and

at least one processor that is configured to perform one or more actions related to the network traffic, including;

bifurcating an active first cluster of member network devices by;

draining connections from a first member in the active first cluster;

upgrading a defined configuration of the first member; and

creating a new second cluster with the first member; and

for a defined number of other members in the active first cluster;

draining connections from each of the defined other members;

upgrading a defined configuration of the defined other members; and

joining each defined other member as a member of the second cluster; and

;

when a defined failover condition is satisfied, failing over connectivity from the active first cluster to the second cluster, such that the second cluster becomes the active cluster.