Virtual application delivery chassis system

• US 9,838,472 B2
• Filed: 09/21/2016
• Issued: 12/05/2017
• Est. Priority Date: 01/11/2011
• Status: Active Grant

• Current Assignee: A10 Networks Incorporated
• Original Assignee: A10 Networks Incorporated
• Inventors: Jalan, Rajkumar, Oshiba, Dennis
• Primary Examiner(s): Chang, Jungwon
• Application Number:
  US15/272,245
• Publication Number:
  US 20170013051A1
• Time in Patent Office: 440 Days
• Field of Search: 370219, 709232, 709226, 709230, 709224, 709208, 714 411, 714 472, 713300
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/2025 using centralised failover control functionality
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 41/0668 by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
• CPC Class Codes: H04L 49/70 Virtual switches
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 67/1034 Reaction to server failures by a load balancer
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests

Abstract

A method for electing a master blade in a virtual application distribution chassis (VADC), includes: sending by each blade a VADC message to each of the other blades; determining by each blade that the VADC message was not received from the master blade within a predetermined period of time; in response, sending a master claim message including a blade priority by each blade to the other blades; determining by each blade whether any of the blade priorities obtained from the received master claim messages is higher than the blade priority of the receiving blade; in response to determining that none of the blade priorities obtained is higher, setting a status of a given receiving blade to a new master blade; and sending by the given receiving blade a second VADC message to the other blades indicating the status of the new master blade of the given receiving blade.

Claims

1. A method for electing a master blade in a virtual application distribution chassis, the virtual application distribution chassis comprising a plurality of blades, one of blades of the plurality of blades operating as the master blade and each of other blades of the plurality of blades operating as a slave blade, the method comprising:

sending by each blade of the plurality of blades a virtual application distribution chassis message to each of the other blades of the plurality of blades in the virtual application distribution chassis, the virtual application distribution chassis message including one of a slave report message communicated by each slave blade of the plurality of blades to the each of the other blades and a master advertisement message communicated by the master blade of the plurality of blades to the each of the other blades;

determining by each blade whether the virtual application distribution chassis message was received by each blade from the master blade within a predetermined period of time;

in response to determining that the virtual application distribution chassis message was not received by each blade from the master blade within the predetermined period of time, sending a master claim message by each blade to each of the other blades in the virtual application distribution chassis, each master claim message comprising a blade priority for the sending blade and a blade identity of the sending blade;

comparing, by a given receiving blade, the blade priority obtained from a first master claim message with the blade priority of the given receiving blade;

determining by the given receiving blade that the blade priority obtained from the first master claim message is equal to the blade priority of the given receiving blade;

in response to determining that the blade priority obtained from the first master claim message is equal to the blade priority of the given receiving blade, determining by the given receiving blade whether the blade identity obtained from the first master claim message is numerically smaller than the blade identity of the given receiving blade;

in response to determining that the blade identity from the first master claim message is numerically smaller than the blade identity of the given receiving blade, comparing, by the given receiving blade, the blade priority obtained from a second received master claim message with the blade priority of the given receiving blade; and

in response to determining that the blade priority of the given receiving blade is either higher than, or the blade priority of the given receiving blade is equal to and the blade identity of the given receiving blade is numerically greater than, the blade priority and the blade identity obtained from the second received master claim message, setting by the given receiving blade the status of the given receiving blade to the new master blade; and

sending by the given receiving blade a second virtual application distribution chassis message to the other blades in the virtual application distribution chassis, the second virtual application distribution chassis message indicating the status of the new master blade of the given receiving blade.

2. The method of claim 1,

wherein if the slave blade is operating properly, the slave blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis,

wherein if the master blade is operating properly, the master blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis.

3. The method of claim 1, wherein the determining by each blade whether the virtual application distribution chassis message was received from the master blade within a predetermined period of time further comprises:

determining by each blade whether the virtual application distribution chassis message was received from each slave blade of the virtual application distribution chassis within the predetermined period of time;

in response to determining that the virtual application distribution chassis message was not received from a given slave blade within the predetermined period of time, marking the given slave blade as “

failed”

by each blade receiving the virtual application distribution chassis message; and

in response to determining that the virtual application distribution chassis message was received from the given slave blade within the predetermined period of time, marking the given slave blade as properly operating by each blade receiving the virtual application distribution chassis message.

4. The method of claim 1, further comprising:

in response to determining that the blade priority obtained from the second received master claim message is higher than the blade priority of the given receiving blade, maintaining a slave status of the given receiving blade.

5. The method of claim 1, wherein the sending by the given receiving blade a second virtual application distribution chassis message comprises:

determining by a given slave blade of the plurality of blades whether the second virtual application distribution chassis message was received within a second predetermined period of time; and

in response to determining by the given slave blade that the second virtual application distribution chassis message was not received within the second predetermined period of time, setting a status of the given slave blade to the new master blade and sending the second virtual application distribution message by the given slave blade to the other blades in the virtual application distribution chassis.

6. The method of claim 1, further comprising:

adding a new blade to the virtual application distribution chassis;

sending a third master claim message by the new blade to each of the other blades in the virtual application distribution chassis;

in response to receiving the third master claim message from the new blade, determining by each of the other blades whether the master blade is marked as properly operating; and

in response to determining by each of the other blades that the master blade is marked as properly operating, ignoring the third master claim message.

7. A method for selecting a blade from a plurality of blades in a virtual application distribution chassis, the virtual application distribution chassis comprising a plurality of blades, one of blades of the plurality of blades operating as a master blade and each of other blades of the plurality of blades operating as a slave blade, the method comprising:

assigning a first blade of the plurality of blades as an active blade to a virtual address, and assigning a second blade of the plurality of blades as a backup blade to the virtual address, wherein the plurality of blades are operatively coupled as the virtual application distribution chassis within a data network, the data network comprising a network switch, wherein service requests destined for the virtual address are sent to the first blade by the network switch;

determining by each blade that a virtual application distribution chassis message was not received from the active blade within the predetermined period of time, the virtual application distribution chassis message including one of a slave report message communicated by each slave blade of the plurality of blades to the each of the other blades and a master advertisement message communicated by the master blade of the plurality of blades to the each of the other blades;

in response to determining that the virtual application distribution chassis message was not received from the active blade within the predetermined period of time, changing, by the second blade, a status of the second blade to the active blade for the virtual address;

sending, by the second blade, a virtual address change message to the network switch to inform the network switch to send future service requests destined for the virtual address to the second blade;

in response to determining that the first blade was previously designated as the master blade for the virtual application distribution chassis, sending a master claim message by each blade to each of the other blades in the virtual application distribution chassis, each master claim message comprising a blade priority for the sending blade;

determining by each blade receiving the master claim messages whether any of the blade priorities obtained from the received master claim messages is higher than the blade priority of the receiving blade;

in response to determining that by a given receiving blade that none of the blade priorities obtained from the received master claim messages is higher than the blade priority of the given receiving blade, setting, by the given receiving blade, a status of the given receiving blade to a new master blade;

sending by the given receiving blade a second virtual application distribution chassis message to the other blades in the virtual application distribution chassis, the second virtual application distribution chassis message indicating the status of the new master blade of the given receiving blade.

8. The method of claim 7,

wherein if the slave blade is operating properly, the slave blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis,

wherein if the master blade is operating properly, the master blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis.

9. The method of claim 7, further comprising:

in response to determining that the blade priority obtained from the given master claim message is higher than the blade priority of the given receiving blade, maintaining a slave status of the given receiving blade.

10. A system, comprising:

a plurality of blades operatively coupled as a virtual application distribution chassis within a data network, one of blades of the plurality of blades operating as a master blade and each of other blades of the plurality of blades operating as a slave blade, wherein each blade comprises a processor and a non-transitory computer readable storage medium having a computer readable program, the computer readable program when executed by the processor causes the plurality of blades to;

send by each blade of the plurality of blades a virtual application distribution chassis message to each of the other blades of the plurality of blades in the virtual application distribution chassis, the virtual application distribution chassis message including one of a slave report message communicated by each slave blade of the plurality of blades to the each of the other blades and a master advertisement message communicated by the master blade of the plurality of blades to the each of the other blades;

determine by each blade whether the virtual application distribution chassis message was received by each blade from the master blade within a predetermined period of time;

in response to determining that the virtual application distribution chassis message was not received by each blade from the master blade within the predetermined period of time, send a master claim message by each blade to each of the other blades in the virtual application distribution chassis, each master claim message comprising a blade priority for the sending blade and a blade identity of the sending blade;

compare, by a given receiving blade, the blade priority obtained from a first master claim message with the blade priority of the given receiving blade;

determine by the given receiving blade that the blade priority obtained from the first master claim message is equal to the blade priority of the given receiving blade;

in response to determining that the blade priority obtained from the first master claim message is equal to the blade priority of the given receiving blade, determine by the given receiving blade whether the blade identity obtained from the first master claim message is numerically smaller than the blade identity of the given receiving blade;

in response to determining that the blade identity from the first master claim message is numerically smaller than the blade identity of the given receiving blade, compare, by the given receiving blade, the blade priority obtained from a second received master claim message with the blade priority of the given receiving blade; and

in response to determining that the blade priority of the given receiving blade is either higher than, or the blade priority of the given receiving blade is equal to and the blade identity of the given receiving blade is numerically greater than, the blade priority and the blade identity obtained from the second received master claim message, set by the given receiving blade the status of the given receiving blade to the new master blade; and

send by the given receiving blade a second virtual application distribution chassis message to the other blades in the virtual application distribution chassis, the second virtual application distribution chassis message indicating the status of the new master blade of the given receiving blade.

11. The system of claim 10,

wherein if the slave blade is operating properly, the slave blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis,

wherein if the master blade is operating properly, the master blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis.

12. The system of claim 10, wherein the determine by each blade whether the virtual application distribution chassis message was received from the master blade within a predetermined period of time further comprises:

determine by each blade whether the virtual application distribution chassis message was received from each slave blade of the virtual application distribution chassis within the predetermined period of time;

in response to determining that the virtual application distribution chassis message was not received from a given slave blade within the predetermined period of time, mark the given slave blade as “

failed”

by each blade receiving the virtual application distribution chassis message; and

in response to determining that the virtual application distribution chassis message was received from the given slave blade within the predetermined period of time, mark the given slave blade as properly operating by each blade receiving the virtual application distribution chassis message.

13. The system of claim 10, further comprising:

in response to determining that the blade priority obtained from the second received master claim message is higher than the blade priority of the given receiving blade, maintain a slave status of the given receiving blade.

14. The system of claim 10, wherein the send by the given receiving blade a second virtual application distribution chassis message comprises:

determine by a given slave blade of the plurality of blades whether the second virtual application distribution chassis message was received within a second predetermined period of time; and

in response to determining by the given slave blade that the second virtual application distribution chassis message was not received within the second predetermined period of time, set a status of the given slave blade to the new master blade and sending the second virtual application distribution message by the given slave blade to the other blades in the virtual application distribution chassis.

15. The system of claim 10, further comprising:

add a new blade to the virtual application distribution chassis;

send a third master claim message by the new blade to each of the other blades in the virtual application distribution chassis;

in response to receiving the third master claim message from the new blade, determine by each of the other blades whether the master blade is marked as properly operating; and

in response to determining by each of the other blades that the master blade is marked as properly operating, ignore the third master claim message.

16. A system, comprising:

a plurality of blades operatively coupled as a virtual application distribution chassis within a data network, one of blades of the plurality of blades operating as the master blade and each of other blades of the plurality of blades operating as a slave blade, wherein each blade comprises a processor and a non-transitory computer readable storage medium having a computer readable program, the computer readable program when executed by the processor causes the plurality of blades to;

assign a first blade of the plurality of blades as an active blade to a virtual address, and assign a second blade of the plurality of blades as a backup blade to the virtual address, wherein the plurality of blades are operatively coupled as the virtual application distribution chassis within a data network, the data network comprising a network switch, wherein service requests destined for the virtual address are sent to the first blade by the network switch;

determine by each blade that a virtual application distribution chassis message was not received from the active blade within the predetermined period of time, the virtual application distribution chassis message including one of a slave report message communicated by each slave blade of the plurality of blades to the each of the other blades and a master advertisement message communicated by the master blade of the plurality of blades to the each of the other blades;

in response to determining that the virtual application distribution chassis message was not received from the active blade within the predetermined period of time, change by the second blade a status of the second blade to the active blade for the virtual address;

send by the second blade a virtual address change message to the network switch to inform the network switch to send future service requests destined for the virtual address to the second blade;

in response to determining that the first blade was previously designated as the master blade for the virtual application distribution chassis, send a master claim message by each blade to each of the other blades in the virtual application distribution chassis, each master claim message comprising a blade priority for the sending blade;

determine by each blade receiving the master claim messages whether any of the blade priorities obtained from the received master claim messages is higher than the blade priority of the receiving blade;

in response to determining by a given receiving blade that none of the blade priorities obtained from the received master claim messages is higher than the blade priority of the given receiving blade, set by the given receiving blade a status of the given receiving blade to a new master blade;

send by the given receiving blade a second virtual application distribution chassis message to the other blades in the virtual application distribution chassis, the second virtual application distribution chassis message indicating the status of the new master blade of the given receiving blade.

17. The system of claim 16,

wherein if the slave blade is operating properly, the slave blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis,

wherein if the master blade is operating properly, the master blade sends the virtual application distribution chassis message to each of the other blades in the virtual application distribution chassis.

18. The system of claim 16, further comprising:

in response to determining that the blade priority obtained from the given master claim message is higher than the blade priority of the given receiving blade, maintaining a slave status of the given receiving blade.