Server load balancing using IP option field approach to identify route to selected server

• US 7,088,718 B1
• Filed: 03/19/2002
• Issued: 08/08/2006
• Est. Priority Date: 03/19/2002
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Srivastava, Sunil K.
• Primary Examiner(s): HO, DUC CHI
• Application Number:
  US10/101,665
• Time in Patent Office: 1,603 Days
• Field of Search: None
• US Class Current: 370/392
• CPC Class Codes: H04L 45/00 Routing or path finding of packets in data switching networks routing or path finding in wireless networks H04W40/00
• CPC Class Codes: H04L 45/22 Alternate routing
• CPC Class Codes: H04L 45/36 Backward learning
• CPC Class Codes: H04L 45/50 using label swapping, e.g. multi-protocol label switch [MPLS]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests

Abstract

A method of routing data from a client through one or more load-balancing nodes to a selected load-balanced server among a plurality of servers in a network involves: receiving, at a last load balancing node associated with a selected server among the plurality of servers, a first packet of a server reply to a request from the client; setting a first flag value in the first packet of the server reply; storing one or more identifiers of ingress interfaces on which the packet arrives, in a send path list for server load balancing, as the first packet of the server reply is routed from the last load balancing node to the client using hop-by-hop decisions; receiving one or more subsequent packets of the client request; setting a second flag value in each of the subsequent packets; and forwarding the subsequent packets to the selected server only on a route that is defined by the send path list and without hop-by-hop routing decisions. As a result, packet flows are rapidly routed from the same client to the same server without time-consuming hop-by-hop routing decisions or repeated load-balancing decisions.

Claims

1. A method of routing data from a client through one or more load-balancing nodes to a selected load-balanced server among a plurality of servers in a network, the method comprising the steps of:

receiving, at a last load balancing node associated with a selected server among the plurality of servers, a first packet of a server reply to a request from the client;

setting a first flag value in the first packet of the server reply;

storing one or more identifiers of ingress interfaces on which the packet arrives, in a send path list for server load balancing, as the first packet of the server reply is routed from the last load balancing node to the client using hop-by-hop decisions;

receiving one or more subsequent packets of the client request;

setting a second flag value in each of the subsequent packets; and

forwarding the subsequent packets to the selected server only on a route that is defined by the send path list and without hop-by-hop routing decisions.

2. A method as recited in claim 1, wherein the first flag value signals that the packet contains the send path list.

3. A method as recited in claim 1, wherein the second flag value instructs nodes to use the send path list for routing the subsequent packets for server load balancing.

4. A method as recited in claim 1, wherein the first flag value signals that the packet contains the send path list and comprises an IP-RECORD-ROUTE-OPTION-FOR-SLB flag value in a header of the first packet.

5. A method as recited in claim 1, wherein the second flag value instructs nodes to use the send path list for routing the subsequent packets and comprises an IP-STRICT-ROUTE-OPTION-FOR-SLB flag value in a header of the subsequent packets.

6. A method as recited in claim 1, further comprising the step of selecting one of the servers to respond to the client request in response to receiving a first packet of a client request at a first load-balancing node in the network associated with the client.

7. A method as recited in claim 1, further comprising storing the send path list in a mapping at the last load balancing node when the packet reaches the last node, wherein the mapping comprises an association of send path lists and client identifying information.

8. A method as recited in claim 1, further comprising storing the send path list in a mapping at the last load balancing node when the packet reaches the last node, wherein the mapping comprises an association of send path lists and packet flow identifying information.

9. A method as recited in claim 1, further comprising the steps of storing one or more identifiers of ingress interfaces on which the first packet of the client request arrives, in a return path list, as the first packet of the client request is routed from a first load balancing node to the last load balancing node using hop-by-hop decisions, based on setting an IP-RECORD-ROUTE-OPTION-FOR-SLB flag value in the first packet of the client request.

10. A method as recited in claim 9, further comprising the steps of:

receiving one or more subsequent packets of the server reply;

setting an IP-STRICT-ROUTE-OPTION-FOR-SLB flag value in each of the subsequent packets of the server reply; and

forwarding the subsequent packets of the server reply to the client on a route that is defined only by the return path list and without hop-by-hop routing decisions.

11. A method as recited in claim 9, further comprising storing the return path list in a mapping at the first node when the packet reaches the first node, wherein the mapping comprises an association of return path lists and server identifiers.

12. A method as recited in claim 11, further comprising the steps of popping a server identifier from the send path list and forwarding the packet to the server on an IP address contained in the server identifier.

13. A method as recited in claim 11, further comprising the steps of popping a server identifier from the send path list, performing network address translation on the server identifier to determine where to forward the packet, and forwarding the packet to the server on an IP address determined by the network address translation.

14. A method as recited in claim 1, wherein the first node and last node are load-balancing routers that participate in the network as multicast nodes.

15. A method of routing data from a client through one or more load-balancing nodes to a selected load-balanced server among a plurality of servers in a network, the method comprising the steps of:

receiving a first packet of a client request at a first node in the network associated with the client;

receiving a first packet of a server reply at a last node associated with a selected server among the plurality of servers;

storing one or more identifiers of ingress interfaces on which the packet arrives, in a send path list, as the first packet of the server reply is routed from the selected server to the client using hop-by-hop decisions, based on setting an IP-RECORD-ROUTE-OPTION-FOR-SLB first flag value in the first packet of the server reply, wherein the first flag value signals that the packet contains a send path list;

receiving one or more subsequent packets of the client request;

setting an IP-STRICT-ROUTE-OPTION-FOR-SLB second flag value in each of the subsequent packets, wherein the second flag value instructs nodes to use the send path list for routing the subsequent packets; and

forwarding the subsequent packets to the selected server on a route that is defined by the send path list and without hop-by-hop routing decisions.

16. A method as recited in claim 15, further comprising the step of selecting one of a plurality of servers to respond to the client request in response to receiving a first packet of a client request at the first load-balancing node in the network.

17. A method as recited in claim 15, further comprising storing the send path list in a mapping at the last node when the packet reaches the last node, wherein the mapping comprises an association of send path lists and client identifying information.

18. A method as recited in claim 15, further comprising storing the send path list in a mapping at the last load balancing node when the packet reaches the last node, wherein the mapping comprises an association of send path lists and packet flow identifying information.

19. A method as recited in claim 15, further comprising the steps of storing one or more identifiers of ingress interfaces on which the first packet of the client request arrives, in a return path list, as the first packet of the client request is routed from the first node to the last node using hop-by-hop decisions, based on setting the IP-RECORD-ROUTE-OPTION-FOR-SLB first flag value.

20. A method as recited in claim 19, further comprising the steps of:

receiving one or more subsequent packets of the server reply;

setting an IP-STRICT-ROUTE-OPTION-FOR-SLB second flag value in each of the subsequent packets of the server reply; and

forwarding the subsequent packets of the server reply to the client on a route that is defined by the return path list and without hop-by-hop routing decisions.

21. A method as recited in claim 20, further comprising storing the return path list in a mapping at the first node when the packet reaches the first node, wherein the mapping comprises an association of return path lists and server identifiers.

22. A method as recited in claim 15, further comprising the steps of popping a server identifier from the send path list and forwarding the packet to the server on an IP address contained in the server identifier.

23. A method as recited in claim 15, further comprising the steps of popping a server identifier from the send path list, performing network address translation on the server identifier to determine where to forward the packet, and forwarding the packet to the server on an IP address determined by the network address translation.

24. A method as recited in claim 15, wherein the first node and last node are load-balancing routers that participate in the network as multicast nodes.

25. A computer-readable medium carrying one or more sequences of instructions for routing data from a client through one or more load-balancing nodes to a selected load-balanced server among a plurality of servers in a network, which instructions, when executed by one or more processors, cause the one or more processors to carry out the steps of:

receiving, at a last load balancing node associated with a selected server among the plurality of servers, a first packet of a server reply to a request from a client;

storing one or more identifiers of ingress interfaces on which the packet arrives, in a send path list, as the first packet of the server reply is routed from the selected server to the client using hop-by-hop decisions;

setting a first flag value in the first packet of the server reply;

receiving one or more subsequent packets of the client request;

setting a second flag value in each of the subsequent packets; and

forwarding the subsequent packets to the selected server on a route that is defined by the send path list and without hop-by-hop routing decisions.

26. A computer-readable medium as recited in claim 25, wherein the first flag value signals that the packet contains a send path list.

27. A computer-readable medium as recited in claim 25, wherein the second flag value instructs nodes to use the send path list for routing the subsequent packets.

28. A computer-readable medium as recited in claim 25, wherein the first flag value signals that the packet contains a send path list and comprises an IP-RECORD-ROUTE-OPTION-FOR-SLB flag value in a header of the first packet.

29. A computer-readable medium as recited in claim 25, wherein the second flag value instructs nodes to use the send path list for routing the subsequent packets and comprises an IP-STRICT-ROUTE-OPTION-FOR-SLB flag value in a header of the subsequent packets.

30. A computer-readable medium as recited in claim 25, further comprising the step of selecting one of a plurality of servers to respond to the client request in response to receiving a first packet of a client request at the first load-balancing node in the network.

31. A computer-readable medium as recited in claim 25, further comprising storing the send path list in a mapping at the last node when the packet reaches the last node, wherein the mapping comprises an association of send path lists and client identifying information.

32. A computer-readable medium as recited in claim 25, further comprising the steps of storing one or more identifiers of ingress interfaces on which the first packet of the client request arrives, in a return path list, as the first packet of the client request is routed from the first node to the last node using hop-by-hop decisions, based on setting an IP-RECORD-ROUTE-OPTION-FOR-SLB flag value in the first packet of the client request.

33. A computer-readable medium as recited in claim 32, further comprising the steps of:

receiving one or more subsequent packets of the server reply;

setting an IP-STRICT-ROUTE-OPTION-FOR-SLB flag value in each of the subsequent packets of the server reply; and

forwarding the subsequent packets of the server reply to the client on a route that is defined by the return path list and without hop-by-hop routing decisions.

34. A computer-readable medium as recited in claim 32, further comprising storing the return path list in a mapping at the first node when the packet reaches the first node, wherein the mapping comprises an association of return path lists and server identifiers.

35. A computer-readable medium as recited in claim 25, further comprising the steps of popping a server identifier from the send path list and forwarding the packet to the server on an IP address contained in the server identifier.

36. A computer-readable medium as recited in claim 25, further comprising the steps of popping a server identifier from the send path list, performing network address translation on the server identifier to determine where to forward the packet, and forwarding the packet to the server on an IP address determined by the network address translation.

37. A computer-readable medium as recited in claim 25, wherein the first node and last node are load-balancing routers that participate in the network as multicast nodes.

38. An apparatus for routing data from a client through one or more load-balancing nodes to a selected load-balanced server among a plurality of servers in a network, comprising:

means for receiving, at a last load balancing node associated with a selected server among the plurality of servers, a first packet of a server reply to a request from a client;

means for storing one or more identifiers of ingress interfaces on which the packet arrives, in a send path list, as the first packet of the server reply is routed from the selected server to the client using hop-by-hop decisions;

means for setting a first flag value in the first packet of the server reply;

means for receiving one or more subsequent packets of the client request;

means for setting a second flag value in each of the subsequent packets; and

means for forwarding the subsequent packets to the selected server on a route that is defined by the send path list and without hop-by-hop routing decisions.

39. A load-balancing router, comprising:

a network interface that is coupled to a data network for receiving one or more packet flows therefrom;

a processor;

one or more stored sequences of instructions for routing data from a client through one or more load-balancing nodes to a selected load-balanced server among a plurality of servers in a network and which, when executed by the processor, cause the processor to carry out the steps of;

receiving, at a last load balancing node associated with a selected server among the plurality of servers, a first packet of a server reply to a request from a client;

storing one or more identifiers of ingress interfaces on which the packet arrives, in a send path list, as the first packet of the server reply is routed from the selected server to the client using hop-by-hop decisions;

setting a first flag value in the first packet of the server reply;

receiving one or more subsequent packets of the client request;

setting a second flag value in each of the subsequent packets; and

forwarding the subsequent packets to the selected server on a route that is defined by the send path list and without hop-by-hop routing decisions.