System and method for performing message-based load balancing

• US 9,246,819 B1
• Filed: 06/20/2011
• Issued: 01/26/2016
• Est. Priority Date: 06/20/2011
• Status: Active Grant

• Current Assignee: F5 Networks, Inc. (F5 Incorporated)
• Original Assignee: F5 Networks, Inc. (F5 Incorporated)
• Inventors: Thirasuttakorn, Nat
• Primary Examiner(s): Sheikh, Ayaz
• Assistant Examiner(s): Ghafoerkhan, Faiyazkhan
• Application Number:
  US13/164,672
• Time in Patent Office: 1,681 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04L 69/08 Protocols for interworking; Protocol conversion
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

A system and method for message based load balancing comprises receiving, at a network traffic management device, an encapsulated request from a client device to a destination server for an established session. The request is encapsulated in accordance with a first connection-oriented protocol. The encapsulated message is segmented into a plurality of encapsulated data segments in accordance with a message boundary parameter. Identifying information of a first payload data packet of a first TCP encapsulated data segment is extracted and the first payload data packet is converted into a first connection-less protocol datagram. A message-based load balancing decision is performed on the datagram to assign the datagram to a first server. The first connection-less protocol datagram is converted into a first encapsulated data packet in accordance with a second connection-oriented protocol and is sent from a first virtual server to the first server based on the message-based load balancing decision.

Claims

1. A method for message based load balancing comprising:

receiving, by a network traffic management device, an encapsulated request from a client device to a server for an established session, wherein the encapsulated request is encapsulated in accordance with a connection-oriented protocol;

segmenting, by the network traffic management device, the encapsulated request into a plurality of encapsulated data segments in accordance with a message boundary parameter;

extracting, by the network traffic management device, identifying information of a payload data packet of an encapsulated data segment of the plurality of encapsulated data segments, the identifying information comprising a session identifier for the established session;

converting, by the network traffic management device, the payload data packet into a connection-less protocol datagram;

performing, by the network traffic management device, a message-based load balancing decision on the connection-less protocol datagram to assign the connection-less protocol datagram to a server based on the message-based load balancing decision;

converting, by the network traffic management device, the connection-less protocol datagram into an encapsulated data packet, wherein the data packet is encapsulated in accordance with a second connection-oriented protocol; and

sending, by the network traffic management device, the encapsulated data packet from a virtual server to the server based on the message-based load balancing decision, wherein the session identifier is used to establish a connection between the virtual server and the server when a connection has not already been established.

2. The method of claim 1, further comprising:

extracting, by the network traffic management device, identifying information of a second payload data packet of a second encapsulated data segment associated with the encapsulated request;

converting, by the network traffic management device, the second payload data packet into a second connection-less protocol datagram at the network traffic management device;

performing, by the network traffic management device, the message-based load balancing decision on the second connection-less protocol datagram at the network traffic management device, wherein the connection-less protocol datagram is assigned to be sent to a second server based on the message-based load balancing decision;

converting, by the network traffic management device, the second connection-less protocol datagram into a second encapsulated data packet, wherein the data packet is encapsulated in accordance with the second connection-oriented protocol; and

sending, by the network traffic management device, the second encapsulated data packet from a second virtual server to a dedicated second server based on the message-based load balancing decision.

3. The method of claim 1, further comprising:

de-encapsulating, by the network traffic management device, the connection-oriented encapsulated data segment, wherein the de-encapsulated data segment comprises the payload data or a key information code.

4. The method of claim 1, wherein the converting the payload data packet into the connection-less protocol datagram further comprises:

encapsulating, by the network traffic management device, the payload data in accordance with the connection-less protocol.

5. The method of claim 1, wherein the connection-oriented protocol is a Transmission Control Protocol (TCP).

6. The method of claim 1, wherein the second connection-oriented protocol is a Transmission Control Protocol (TCP).

7. The method of claim 1, wherein the connection-less protocol is a User Datagram Protocol (UDP).

8. The method of claim 1, wherein the converting of the connection-less protocol datagram into the encapsulated data packet further comprises:

de-encapsulating, by the network traffic management device, the connection-less protocol datagram;

encapsulating, by the network traffic management device, the payload data packet into the encapsulated data packet, wherein the encapsulated data packet at least contains information identifying the virtual server as the source of transmission of the encapsulated data packet.

9. The method of claim 1, further comprising:

receiving, by the network traffic management device, an encapsulated response from the server for the established session, the response corresponding to the encapsulated data packet sent from the virtual server, wherein the response is encapsulated in accordance with the second connection-oriented protocol;

segmenting, by the network traffic management device, the encapsulated response into a plurality of encapsulated response data segments in accordance with the message boundary parameter;

extracting, by the network traffic management device, identifying information of a response payload data packet of a encapsulated response data segment of the plurality of encapsulated response data segments;

performing, by the network traffic management device, the message-based load balancing decision on the response payload data packet to identify the session and the client device where the response payload data packet is to transmitted;

converting, by the network traffic management device, the response payload data packet into the connection-less protocol datagram, wherein the connection-less protocol datagram is configured with information associated with the session between the client device and the server;

converting, by the network traffic management device, the connection-less protocol datagram into a second encapsulated response data packet, wherein the second encapsulated response data packet is encapsulated in accordance with the connection-oriented protocol; and

sending, by the network traffic management device, the second encapsulated response data to the client device based on the message-based load balancing decision.

10. A non-transitory computer readable medium having stored thereon instructions for message based load balancing, comprising machine executable code which when executed by at least one processor causes the processor to perform steps comprising:

receiving an encapsulated request from a client device to a server for an established session, wherein the encapsulated request is encapsulated in accordance with a connection-oriented protocol;

segmenting the encapsulated request into a plurality of encapsulated data segments in accordance with a message boundary parameter;

extracting identifying information of a payload data packet of an encapsulated data segment of the plurality of encapsulated data segments, the identifying information comprising a session identifier for the established session;

converting the payload data packet into a connection-less protocol datagram;

performing a message-based load balancing decision on the connection-less protocol datagram, wherein the connection-less protocol datagram is assigned to be sent to a server via a virtual server based on the message-based load balancing decision;

converting the connection-less protocol datagram into an encapsulated data packet, wherein the data packet is encapsulated in accordance with a second connection-oriented protocol; and

sending the encapsulated data packet from the virtual server to the server based on the message-based load balancing decision, wherein the session identifier is used to establish a connection between the virtual server and the server when a connection has not already been established.

11. The non-transitory computer readable medium of claim 10, further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

extracting identifying information of a second payload data packet of a second encapsulated data segment associated with the encapsulated request;

converting the second payload data packet into a second connection-less protocol datagram;

performing a message-based load balancing decision on the second connection-less protocol datagram, wherein the connection-less protocol datagram is assigned to be sent to a second server based on the message-based load balancing decision;

converting the second connection-less protocol datagram into a second encapsulated data packet, wherein the data packet is encapsulated in accordance with the second connection-oriented protocol; and

sending the second encapsulated data packet from a second virtual server to a dedicated second server based on the message-based load balancing decision.

12. The non-transitory computer readable medium of claim 10, further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

de-encapsulating the connection-oriented encapsulated data segment, wherein the de-encapsulated data segment comprises at least the payload data or a key information code.

13. The non-transitory computer readable medium of claim 10, further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

encapsulating the payload data in accordance with the connection-less protocol.

14. The non-transitory computer readable medium of claim 10, wherein the connection-oriented protocol is a Transmission Control Protocol (TCP).

15. The non-transitory computer readable medium of claim 10, wherein the second connection-oriented protocol is a Transmission Control Protocol (TCP).

16. The non-transitory computer readable medium of claim 10, wherein the connection-less protocol is a User Datagram Protocol (UDP).

17. The non-transitory computer readable medium of claim 10, wherein the converting of the connection-less protocol datagram into the encapsulated data packet further comprises:

de-encapsulating the connection-less protocol datagram; and

encapsulating the payload data packet into the encapsulated data packet, wherein the encapsulated data packet at least contains information identifying the virtual server as the source of transmission of the encapsulated data packet.

18. The non-transitory computer readable medium of claim 10, further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

receiving an encapsulated response from the server for the established session, the response corresponding to the encapsulated data packet sent from the virtual server, wherein the response is encapsulated in accordance with the second connection-oriented protocol;

segmenting the encapsulated response into a plurality of encapsulated response data segments in accordance with the message boundary parameter;

extracting identifying information of a response payload data packet of a encapsulated response data segment of the plurality of encapsulated response data segments;

performing the message-based load balancing decision on the response payload data packet to identify the session and the client device where the response payload data packet is to transmitted;

converting the response payload data packet into the connection-less protocol datagram, wherein the connection-less protocol datagram is configured with information associated with the session between the client device and the server;

converting the connection-less protocol datagram into a second encapsulated response data packet, wherein the second encapsulated response data packet is encapsulated in accordance with the connection-oriented protocol; and

sending the second encapsulated response data to the client device based on the message-based load balancing decision.

19. A network traffic management device comprising:

a network interface coupled to a client device and one or more servers via a network, the network interface capable of receiving a request from the client device requesting access to the one or more servers;

at least one processor;

a memory coupled to the at least one processor and configured to be capable of executing programmed instructions, which comprise the programmed instructions stored in the memory to;

receive an encapsulated request from a client device to a server for an established session, wherein the encapsulated request is encapsulated in accordance with a connection-oriented protocol;

segment the encapsulated request into a plurality of encapsulated data segments in accordance with a message boundary parameter;

extract identifying information of a payload data packet of an encapsulated data segment of the plurality of encapsulated data segments, the identifying information comprising a session identifier for the established session;

convert the payload data packet into a connection-less protocol datagram;

perform a message-based load balancing decision on the connection-less protocol datagram, wherein the connection-less protocol datagram is assigned to be sent to a server via a virtual server based on the message based load balancing decision;

convert the connection-less protocol datagram into an encapsulated data packet, wherein the encapsulated data packet is encapsulated in accordance with a second connection-oriented protocol; and

send the encapsulated data packet from the virtual server to the server based on the message-based load balancing decision, wherein the session identifier is used to establish a connection between the virtual server and the server when a connection has not already been established.

20. The network traffic management device of claim 19, wherein the at least one processor is further configured to be capable of executing programmed instructions, which comprise the programmed instructions stored in the memory to:

extract identifying information of a second payload data packet of a second encapsulated data segment associated with the encapsulated request;

convert the second payload data packet into a second connection-less protocol datagram;

perform a message-based load balancing decision on the second connection-less protocol datagram, wherein the connection-less protocol datagram is assigned to be sent to a second server based on the message-based load balancing decision;

convert the second connection-less protocol datagram into a second encapsulated data packet, wherein the data packet is encapsulated in accordance with the second connection-oriented protocol; and

send the second encapsulated data packet from a second virtual server to a dedicated second server based on the message-based load balancing decision.

21. The network traffic management device of claim 19, wherein the at least one processor is further configured to be capable of executing programmed instructions, which comprise the programmed instructions stored in the memory to:

de-encapsulate the connection-oriented encapsulated data segment, wherein the de-encapsulated data segment comprises at least the payload data or a key information code.

22. The network traffic management device of claim 19, wherein the at least one processor is further configured to be capable of executing programmed instructions, which comprise the programmed instructions stored in the memory to:

encapsulate the payload data in accordance with the connection-less protocol.

23. The network traffic management device of claim 19, wherein the connection-oriented protocol is a Transmission Control Protocol (TCP).

24. The network traffic management device of claim 19, wherein the second connection-oriented protocol is a Transmission Control Protocol (TCP).

25. The network traffic management device of claim 19, wherein the connection-less protocol is a User Datagram Protocol (UDP).

26. The network traffic management device of claim 19, wherein the at least one processor is further configured to be capable of executing programmed instructions, which comprise the programmed instructions for the conversion of the connection-less protocol datagram into the encapsulated data packet stored in the memory to:

de-encapsulate the connection-less protocol datagram; and

encapsulate the payload data packet into the encapsulated data packet, wherein the encapsulated data packet at least contains information identifying the virtual server as the source of transmission of the encapsulated data packet.

27. The network traffic management device of claim 19, wherein the at least one processor is further configured to be capable of executing programmed instructions, which comprise the programmed instructions stored in the memory to:

receive an encapsulated response from the server for the established session, the response corresponding to the encapsulated data packet sent from the virtual server, wherein the response is encapsulated in accordance with the second connection-oriented protocol;

segment the encapsulated response into a plurality of encapsulated response data segments in accordance with the message boundary parameter;

extract identifying information of a response payload data packet of a encapsulated response data segment of the plurality of encapsulated response data segments;

perform the message-based load balancing decision on the response payload data packet to identify the session and the client device where the response payload data packet is to transmitted;

convert the response payload data packet into the connection-less protocol datagram, wherein the connection-less protocol datagram is configured with information associated with the session between the client device and the server;

convert the connection-less protocol datagram into a second encapsulated response data packet, wherein the second encapsulated response data packet is encapsulated in accordance with the connection-oriented protocol; and

send the second encapsulated response data to the client device based on the message-based load balancing decision.