Gateway load balancing protocol

• US 7,881,208 B1
• Filed: 06/18/2001
• Issued: 02/01/2011
• Est. Priority Date: 06/18/2001
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Wilson, Ian Herbert, Nosella, Thomas J.
• Primary Examiner(s): HO, DUC CHI
• Application Number:
  US09/883,674
• Time in Patent Office: 3,515 Days
• Field of Search: 370/400, 370/401, 370/389, 370/392, 370216-217, 370/242, 370/466, 709/105, 709/230, 709/238, 709/239
• US Class Current: 370/242
• CPC Class Codes: H04L 2101/622 Layer-2 addresses, e.g. medium access control [MAC] addresses
• CPC Class Codes: H04L 61/103 across network layers, e.g. resolution of network layer into physical layer addresses or address resolution protocol [ARP]
• CPC Class Codes: H04L 61/50 Address allocation
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1036 Load balancing of requests to servers for services different from user content provisioning, e.g. load balancing across domain name servers

Abstract

Gateway load balancing and failover methods, apparatus and systems use more than one gateway device in a gateway device group for communications directed outside of a LAN. In the load balancing arrangement, hosts that send ARP messages to a shared virtual IP address receive replies from one of the gateway devices in the gateway device group, directing the host to address outgoing communications to a virtual MAC address assigned to one of the gateway devices. Hosts are assigned virtual MAC addresses for the gateway devices according to a prescribed algorithm or methodology. In the event that one member of the gateway device group fails, the outgoing communications that would have been handled by the failed gateway device are re-assigned to another member of the gateway device group. A master gateway device controls address assignment and failover features. In the event that the master fails, additional steps are taken to appoint or elect a new master and ensure continuity in the load balancing function.

Claims

1. A method implemented on a gateway device to provide load balancing gateway services to hosts on a network segment, the method comprising:

receiving at the gateway device an address resolution protocol (ARP) message from a host addressed to an address shared by a plurality of gateway devices available for serving the hosts on the network segment;

in response to the received ARP message, and based at least in part on load balancing considerations, the gateway device selecting one of the plurality of gateway devices to act as the addressee gateway device for the host, when the gateway device is acting as a master gateway device for the plurality of gateway devices; and

the gateway device replying to the ARP message with a reply message identifying the selected addressee gateway device, when the gateway device is acting as a master gateway device for the plurality of gateway devices,

wherein, when the gateway device is acting as a master gateway device for the plurality of gateway devices, the gateway device replies to every ARP message sent to the address shared by the plurality of gateway devices, and selects a gateway device in response to each of such ARP messages.

2. The method of claim 1 wherein the gateway devices are layer 3 devices.

3. The method of claim 1 wherein the address shared by the plurality of gateway devices is a virtual IP address.

4. The method of claim 1 wherein the reply message identifies a layer 2 address for the addressee gateway device.

5. The method of claim 4 wherein the layer 2 address for the addressee gateway device is a virtual (secondary) MAC address.

6. The method of claim 1 further comprising the steps of:

determining that one of the plurality of gateway devices has failed; and

compensating for the failed gateway device by taking over acting as the addressee gateway device for any hosts for which the failed gateway device had been serving as the addressee gateway device.

7. The method of claim 1 further comprising the step of determining that the failed gateway device has failed permanently and redistributing addressee gateway device responsibility to other available gateway devices in the plurality of gateway devices for any hosts for which the failed gateway device had been serving as the addressee gateway device.

8. A method, implemented on a single gateway device, providing gateway services to hosts on a network segment, the method comprising:

receiving at the gateway device an ARP message from a host;

in response to the received ARP message, and based at least in part on load balancing considerations, the gateway device selecting a gateway device, from among a group of available gateway devices available for servicing hosts on the network segment, to act as the addressee gateway device for the host that sent the ARP message, when the gateway device is acting as a master gateway device for the plurality of gateway devices;

the gateway device replying to the ARP message with a reply message identifying the addressee gateway device, when the gateway device is acting as a master gateway device for the plurality of gateway devices,

wherein, when the gateway device is acting as a master gateway device for the plurality of gateway devices, the gateway device replies to every ARP message sent to the address shared by the plurality of gateway devices, and selects a gateway device in response to each of such ARP messages;

determining that one of the other available gateway devices has failed; and

taking over responsibility for gateway services of the failed gateway device.

9. The method of claim 8 wherein the gateway device on which the method is implemented is a layer 3 device.

10. A non-transitory computer-readable medium containing programmed instructions arranged to be implemented on a gateway device to provide load balancing gateway services to hosts on a network segment, the computer-readable medium including programmed instructions for:

receiving at the gateway device an ARP message from a host addressed to an address shared by a plurality of gateway devices available for serving the hosts on the network segment;

in response to the received ARP message, and based at least in part on load balancing considerations, the gateway device selecting one of the plurality of gateway devices to act as the addressee gateway device for the host, when the gateway device is acting as a master gateway device for the plurality of gateway devices; and

the gateway device replying to the ARP message with a reply message identifying the selected addressee gateway device, when the gateway device is acting as a master gateway device for the plurality of gateway devices,

wherein, when the gateway device is acting as a master gateway device for the plurality of gateway devices, the gateway device replies to every ARP message sent to the address shared by the plurality of gateway devices, and selects a gateway device in response to each of such ARP messages.

11. The non-transitory computer-readable medium of claim 10 wherein the gateway devices are layer 3 devices.

12. The non-transitory computer-readable medium of claim 10 wherein the address shared by the plurality of gateway devices is a virtual IP address.

13. The non-transitory computer-readable medium of claim 10 wherein the reply message identifies a layer 2 address for the addressee gateway device.

14. The non-transitory computer-readable medium of claim 13 wherein the layer 2 address for the addressee gateway device is a virtual (secondary) MAC address.

15. The non-transitory computer-readable medium of claim 10 further comprising programmed instructions for:

determining that one of the plurality of gateway devices has failed; and

compensating for the failed gateway device by taking over acting as the addressee gateway device for any hosts for which the failed gateway device had been serving as the addressee gateway device.

16. The non-transitory computer-readable medium of claim 10 further comprising programmed instructions for determining that the failed gateway device has failed permanently and redistributing addressee gateway device responsibility to other available gateway devices in the plurality of gateway devices for any hosts for which the failed gateway device had been serving as the addressee gateway device.

17. A non-transitory computer-readable medium containing programmed instructions arranged to be implemented on a gateway device to provide load balancing gateway services to hosts on a network segment, a non-transitory computer-readable medium including programmed instructions for:

receiving at the gateway device an ARP message from a host;

in response to the received ARP message, and based at least in part on load balancing considerations, the gateway device selecting a gateway device, from among the group of available gateway devices, to act as the addressee gateway device for the host that sent the ARP message, when the gateway device is acting as a master gateway device for the plurality of gateway devices;

the gateway device replying to the ARP message with a reply message identifying the addressee gateway device, when the gateway device is acting as a master gateway device for the plurality of gateway devices,

wherein, when the gateway device is acting as a master gateway device for the plurality of gateway devices, the gateway device replies to every ARP message sent to the address shared by the plurality of gateway devices, and selects a gateway device in response to each of such ARP messages;

determining that one of the available gateway devices has failed; and

taking over responsibility for gateway services of the failed gateway device.

18. The non-transitory computer-readable medium of claim 17 wherein the gateway device on which the method is implemented is a layer 3 device.

19. A master gateway device for use in a gateway load balancing service comprising the master gateway device and one or more slave gateway devices, the master gateway device comprising:

a memory configured to hold;

a shared address shared by the master gateway device and the one or more slave gateway devices;

a plurality of unique addresses comprising;

a unique address for the master gateway device; and

a unique address for each of the one or more slave gateway devices;

a network interface configured to send and receive network traffic including an ARP message from a host addressed to the shared address;

a processor configured to;

select, in response to the received ARP message, and based at least in part on load balancing considerations, one of the master and slave gateway devices to act as the addressee gateway device for the host; and

reply to the ARP message with a reply message identifying the selected addressee gateway device,

wherein the processor is further configured to reply to every ARP message sent to the address shared by the plurality of gateway devices, and select a gateway device in response to each of such ARP messages.

20. The device of claim 19 wherein the master and slave gateway devices are layer 3 devices.

21. The device of claim 19 wherein the address shared by the master and slave gateway devices is a virtual IP address.

22. The device of claim 19 wherein the reply message identifies a layer 2 address for the addressee gateway device.

23. The device of claim 22 wherein the layer 2 address for the addressee gateway device is a virtual (secondary) MAC address.

24. The device of claim 19 wherein the processor is further configured to:

detect the failure of one of the gateway devices; and

reconfigure the master gateway device to take over acting as the addressee gateway device for any hosts for which the failed gateway device had been serving as the addressee gateway device.

25. The device of claim 19 wherein the processor is further configured to:

detect whether the failed gateway device has failed permanently; and

if the failed gateway device has failed completely, to redistribute addressee gateway device responsibility to other available gateway devices in the plurality of gateway devices for any hosts for which the failed gateway device had been serving as the addressee gateway device.

26. A gateway apparatus to provide load balancing gateway services to hosts on a network segment, the apparatus comprising:

means for receiving an ARP message from a host addressed to an address shared by a plurality of gateway devices available for serving the hosts on the network segment the gateway apparatus being one of the plurality of gateway devices;

means for selecting, in response to the received ARP message, and based at least in part on load balancing considerations, one of the plurality of gateway devices to act as the addressee gateway device for the host, when the gateway apparatus is acting as a master gateway device for the plurality of gateway devices; and

means for replying to the ARP message with a reply message identifying the selected addressee gateway device, when the gateway apparatus is acting as a master gateway device for the plurality of gateway devices,

wherein the gateway apparatus is configured to reply to every ARP message sent to the address shared by the plurality of gateway devices, and select a gateway device in response to each of such ARP messages, when the gateway apparatus is acting as a master gateway device for the plurality of gateway devices.

27. The apparatus of claim 26 wherein the gateway devices are layer 3 devices.

28. The apparatus of claim 26 wherein the address shared by the plurality of gateway devices is a virtual IP address.

29. The apparatus of claim 26 wherein the reply message identifies a layer 2 address for the addressee gateway device.

30. The apparatus of claim 29 wherein the layer 2 address for the addressee gateway device is a virtual (secondary) MAC address.

31. The apparatus of claim 26 further comprising:

means for determining that one of the plurality of gateway devices has failed; and

means for compensating for the failed gateway device by taking over acting as the addressee gateway device for any hosts for which the failed gateway device had been serving as the addressee gateway device.

32. The apparatus of claim 26 further comprising means for determining that the failed gateway device has failed permanently and means for redistributing addressee gateway device responsibility to other available gateway devices in the plurality of gateway devices for any hosts for which the failed gateway device had been serving as the addressee gateway device.

33. A gateway apparatus providing gateway services to hosts on a network segment, the apparatus comprising:

means for receiving an ARP message from a host;

means for, at the gateway apparatus, selecting, in response to the received ARP message, and based at least in part on load balancing considerations, a gateway device, from among a group of available gateway devices available for servicing hosts on the network segment, to act as the addressee gateway device for the host that sent the ARP message, when the gateway apparatus is acting as a master gateway device for the plurality of gateway devices;

means for replying, to the ARP message with a reply message identifying the addressee gateway device, when the gateway apparatus is acting as a master gateway device for the plurality of gateway devices;

means for determining that one of the available gateway devices has failed; and

means for taking over responsibility for gateway services of the failed gateway device,

wherein the gateway apparatus is configured to reply to every ARP message sent to the address shared by the plurality of gateway devices, and select a gateway device in response to each of such ARP messages, when the gateway apparatus is acting as a master gateway device for the plurality of gateway devices.

34. The apparatus of claim 33 wherein the gateway apparatus is a layer 3 device.

35. A network segment comprising:

a plurality of gateway devices sharing an address, including a master gateway device, the master gateway device elected from among the plurality of gateway devices;

a host configured to send an ARP message to the shared address of the plurality of gateway devices;

wherein the master gateway device is configured to respond to the ARP message by selecting, based at least in part on load balancing considerations, one of the plurality of gateway devices to act as the addressee gateway device for the host; and

sending the host a reply message identifying the selected addressee gateway device

wherein no gateway devices other than the master gateway device selects one of the plurality of gateway devices to act as the addressee gateway device for the host, or replies to the ARP message with a reply message identifying the selected addressee gateway device.

36. The network segment of claim 35 wherein the plurality of gateway devices is configured to assume responsibility for any addressee gateway device that fails.

37. A network segment comprising:

a host having means for addressing messages to a layer 3 addressee device;

a layer 3 device group including a plurality of layer 3 devices; and

means for distributing packets from the host to the devices in the device group, the distributing means comprising;

means for electing one of the devices a master device, the electing means comprising;

means for determining a priority status of each device in the device group, wherein the master device is elected on the basis of its priority status and includes;

means for assigning a device in the device group as the addressee device for packets from the host, wherein no device other than the device elected to be the master device assigns a device in the device group as the addressee device for packets from a host;

fail-over means comprising;

slave failure means for accommodating failure of one of the devices that is not the master device in the device group, wherein the slave failure means comprises;

means for re-distributing packets destined for a failed device to a functioning device in the device group;

master failure means for accommodating failure of the master device, wherein the master failure means comprises;

means for appointing a successor master device from among the functioning devices in the device group;

means for assigning the successor master device as the addressee device for packets from the host destined for the failed master.

38. A network device comprising:

a network interface; and

a processor designed or configured to perform the following operations;

receiving an ARP message from a host addressed to an address shared by a plurality of gateway devices available for serving the hosts on the network segment, the network device being one of the plurality of gateway devices;

in response to the received ARP message, and based at least in part on load balancing considerations, selecting one of the plurality of gateway devices to act as the addressee gateway device for the host, when the network device is acting as a master gateway device for the plurality of gateway devices; and

replying to the ARP message with a reply message identifying the selected addressee gateway device, when the network device is acting as a master gateway device for the plurality of gateway devices,

wherein the network device is configured to reply to every ARP message sent to the address shared by the plurality of gateway devices, and select a gateway device in response to each of such ARP messages, when the network device is acting as a master gateway device for the plurality of gateway devices.

39. The network device of claim 38, wherein the network device is a layer 3 device.

40. The network device of claim 38 wherein the address shared by the plurality of gateway devices is a virtual IP address.

41. The network device of claim 38 wherein the reply message identifies a layer 2 address for the addressee gateway device.

42. The network device of claim 41 wherein the layer 2 address for the addressee gateway device is a virtual (secondary) MAC address.

43. The network device of claim 38, wherein the processor is further designed or configured to perform the following operations:

determining that one of the plurality of gateway devices has failed; and

compensating for the failed gateway device by taking over acting as the addressee gateway device for any hosts for which the failed gateway device had been serving as the addressee gateway device.

44. The network device of claim 38, wherein the processor is further designed or configured to perform the following operation:

determining that the failed gateway device has failed permanently and redistributing addressee gateway device responsibility to other available gateway devices in the plurality of gateway devices for any hosts for which the failed gateway device had been serving as the addressee gateway device.