Method to allocate buffer for TCP proxy session based on dynamic network conditions

• US 8,782,221 B2
• Filed: 07/05/2012
• Issued: 07/15/2014
• Est. Priority Date: 07/05/2012
• Status: Active Grant

• Current Assignee: A10 Networks Incorporated
• Original Assignee: A10 Networks Incorporated
• Inventors: Han, Liang
• Primary Examiner(s): Nguyen, Quang N
• Application Number:
  US13/541,792
• Publication Number:
  US 20140012972A1
• Time in Patent Office: 740 Days
• Field of Search: 709/203, 709/217, 709/224, 709/225, 709/226, 709/227, 709/232, 709/235, 370/241, 726/4, 726/26
• US Class Current: 709/224
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/9005 using dynamic buffer space allocation
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

Allocation of buffers for a TCP proxy session between a client and a server by a service gateway includes: monitoring dynamic network behaviors for server and client side sessions of the TCP proxy session; and allocating capacity for a server side buffer and capacity for a client side buffer in a memory buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and a weighted average of a capacity of the memory buffer. In one approach to the allocation, the gateway determines whether an available capacity of the server or client side buffer is sufficient to store a data packet. If not sufficient, the allocated capacity of the server or client side buffer is increased based on measurements of the dynamic network behaviors and the weighted average, and the available capacity of the server or client side buffer is adjusted accordingly.

Claims

1. A method for allocating buffers for a TCP proxy session between a client and a server by a service gateway comprising a processor, comprising:

monitoring, by the processor, dynamic server side network behaviors for a server side session of the TCP proxy session and dynamic client side network behaviors for a client side session of the TCP proxy session; and

allocating, by the processor, capacity for a server side buffer and capacity for a client side buffer in a memory buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and a weighted average of a capacity of the memory buffer, the allocating comprising;

receiving a server side session data packet from the server, or

receiving a client side session data packet from the client;

determining whether an available capacity of the server side buffer is sufficient to store the server side session data packet, or

determining whether an available capacity of the client side buffer is sufficient to store the client side session data packet;

in response to determining that the available capacity of the server side buffer is not sufficient to store the server side session data packet, increasing the allocated capacity of the server side buffer, or

in response to determining that the available capacity of the client side buffer is not sufficient to store the client side session data packet, increasing the allocated capacity of the client side buffer; and

adjusting the available capacity of the server side buffer according to the increase of the allocated capacity of the server side buffer, or

adjusting the available capacity of the client side buffer according to the increase of the allocated capacity of the client side buffer.

2. The method of claim 1, wherein the allocating comprises:

calculating a maximum capacity for the server side buffer and a maximum capacity for the client side buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and the weighted average of the capacity of the memory buffer; and

allocating the capacity for the server side buffer and the capacity for the client side buffer based on the maximum capacity for the server side buffer and the maximum capacity for the client side buffer.

3. The method of claim 1, wherein:

in response to determining that the available capacity of the server side buffer is not sufficient to store the server side session data packet, determining whether the allocated capacity of the server side buffer is smaller than a maximum capacity of the server side buffer, or

in response to determining that the available capacity of the client side buffer is not sufficient to store the client side session data packet, determining whether the allocated capacity of the client side buffer is smaller than a maximum capacity of the client side buffer;

in response to determining that the allocated capacity of the server side buffer is smaller than the maximum capacity of the server side buffer, determining whether there is sufficient memory space within the maximum capacity of the server side buffer to store the server side session data packet, or

in response to determining that the allocated capacity of the client side buffer is smaller than the maximum capacity of the client side buffer, determining whether there is sufficient memory space within the maximum capacity of the client side buffer to store the client side session data packet; and

in response to determining that there is sufficient memory space within the maximum capacity of the server side buffer to store the server side session data packet, allocating the memory space to the server side buffer and adjusting the available capacity of the server side buffer according to the allocated memory space, or

in response to determining that there is sufficient memory space within the maximum capacity of the client side buffer to store the client side session data packet, allocating the memory space to the client side buffer and adjusting the available capacity of the client side buffer according to the allocated memory space.

4. The method of claim 2, wherein the monitoring and the calculating comprises:

measuring a server side data packet round trip time (RTT) and a client side data packet RTT; and

calculating the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side data packet RTT, and the weighted average of the capacity of the memory buffer.

5. The method of claim 4, wherein the weighted average of the capacity of the memory buffer is biased toward the server in calculating the maximum capacity for the server side buffer, or

wherein the weighted average of the capacity of the memory buffer is biased toward the client in calculating the maximum capacity for the client side buffer.

6. The method of claim 4, wherein the monitoring further comprises:

obtaining new measurements for the server side data packet RTT and the client side data packet RTT; and

modifying the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the new server side data packet RTT, the new client side data packet RTT, and the weighted average of the capacity of the memory buffer.

7. The method of claim 4, wherein the measuring and the calculating comprises:

measuring the server side data packet RTT, the client side data packet RTT, a server side transmission rate, and a client side transmission rate; and

calculating the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side RTT, the server side transmission rate, the client side transmission rate, and the weighted average of the capacity of the memory buffer.

8. The method of claim 7, wherein the monitoring further comprises:

obtaining new measurements for the server side transmission rate and the client side transmission rate; and

modifying the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side data packet RTT, the new server side transmission rate, the new client side transmission rate, and the weighted average of the capacity of the memory buffer.

9. A computer program product for allocating buffers for a TCP proxy session between a client and a server, the computer program product comprising:

a non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code configured to;

monitor dynamic server side network behaviors for a server side session of the TCP proxy session and dynamic client side network behaviors for a client side session of the TCP proxy session; and

allocate capacity for a server side buffer and capacity for a client side buffer in a memory buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and a weighted average of a capacity of the memory buffer, the allocating comprising;

receiving a server side session data packet from the server, or

receiving a client side session data packet from the client;

determining whether an available capacity of the server side buffer is sufficient to store the server side session data packet, or

determining whether an available capacity of the client side buffer is sufficient to store the client side session data packet;

in response to determining that the available capacity of the server side buffer is not sufficient to store the server side session data packet, increase the allocated capacity of the server side buffer, or

in response to determining that the available capacity of the client side buffer is not sufficient to store the client side session data packet, increase the allocated capacity of the client side buffer; and

adjusting the available capacity of the server side buffer according to the increase of the allocated capacity of the server side buffer, or

adjust the available capacity of the client side buffer according to the increase of the allocated capacity of the client side buffer.

10. The computer program product of claim 9, wherein the computer readable program code configured to allocate is further configured to:

calculate a maximum capacity for the server side buffer and a maximum capacity for the client side buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and the weighted average of the capacity of the memory buffer; and

allocate the capacity for the server side buffer and the capacity for the client side buffer based on the maximum capacity for the server side buffer and the maximum capacity for the client side buffer.

11. The computer program product of claim 9, wherein the computer readable program code configured to increase is further configured to:

in response to determining that the available capacity of the server side buffer is not sufficient to store the server side session data packet, determine whether the allocated capacity of the server side buffer is smaller than a maximum capacity of the server side buffer, or

in response to determining that the available capacity of the client side buffer is not sufficient to store the client side session data packet, determine whether the allocated capacity of the client side buffer is smaller than a maximum capacity of the client side buffer;

in response to determining that the allocated capacity of the server side buffer is smaller than the maximum capacity of the server side buffer, determine whether there is sufficient memory space within the maximum capacity of the server side buffer to store the server side session data packet, or

in response to determining that the allocated capacity of the client side buffer is smaller than the maximum capacity of the client side buffer, determine whether there is sufficient memory space within the maximum capacity of the client side buffer to store the client side session data packet; and

in response to determining that there is sufficient memory space within the maximum capacity of the server side buffer to store the server side session data packet, allocate the memory space to the server side buffer and adjust the available capacity of the server side buffer according to the allocated memory space, or

in response to determining that there is sufficient memory space within the maximum capacity of the client side buffer to store the client side session data packet, allocate the memory space to the client side buffer and adjust the available capacity of the client side buffer according to the allocated memory space.

12. The computer program product of claim 10, wherein the computer readable program code configured to monitor and to calculate is further configured to:

measure a server side data packet round trip time (RTT) and a client side data packet RTT; and

calculate the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side data packet RTT, and the weighted average of the capacity of the memory buffer.

13. The computer program product of claim 12, wherein the weighted average of the capacity of the memory buffer is biased toward the server in calculating the maximum capacity for the server side buffer, or

wherein the weighted average of the capacity of the memory buffer is biased toward the client in calculating the maximum capacity for the client side buffer.

14. The computer program product of claim 12, wherein the computer readable program code configured to monitor is further configured to:

obtain new measurements for the server side data packet RTT and the client side data packet RTT; and

modify the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the new server side data packet RTT, the new client side data packet RTT, and the weighted average of the capacity of the memory buffer.

15. The computer program product of claim 12, wherein the computer readable program code configured to measure and to calculate are further configured to:

measure the server side data packet RTT, the client side data packet RTT, a server side transmission rate, and a client side transmission rate; and

calculate the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side RTT, the server side transmission rate, the client side transmission rate, and the weighted average of the capacity of the memory buffer.

16. The computer program product of claim 15, wherein the computer readable program code configured to monitor is further configured to:

obtain new measurements for the server side transmission rate and the client side transmission rate; and

modify the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side data packet RTT, the new server side transmission rate, the new client side transmission rate, and the weighted average of the capacity of the memory buffer.

17. A system for allocating buffers for a TCP proxy session between a client and a server, comprising:

a processor; and

a non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code executed by the processor configured to;

monitor dynamic server side network behaviors for a server side session of the TCP proxy session and dynamic client side network behaviors for a client side session of the TCP proxy session; and

allocate capacity for a server side buffer and capacity for a client side buffer in a memory buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and a weighted average of a capacity of the memory buffer, the allocating comprising;

receive a server side session data packet from the server, or

receive a client side session data packet from the client;

determine whether an available capacity of the server side buffer is sufficient to store the server side session data packet, or

determine whether an available capacity of the client side buffer is sufficient to store the client side session data packet;

in response to determining that the available capacity of the server side buffer is not sufficient to store the server side session data packet, increase the allocated capacity of the server side buffer, or

in response to determining that the available capacity of the client side buffer is not sufficient to store the client side session data packet, increase the allocated capacity of the client side buffer; and

adjust the available capacity of the server side buffer according to the increase of the allocated capacity of the server side buffer, or

adjust the available capacity of the client side buffer according to the increase of the allocated capacity of the client side buffer.

18. The system of claim 17, wherein the computer readable program code configured to allocate is further configured to:

calculate a maximum capacity for the server side buffer and a maximum capacity for the client side buffer based on the dynamic server side network behaviors, the dynamic client side network behaviors, and the weighted average of the capacity of the memory buffer; and

allocate the capacity for the server side buffer and the capacity for the client side buffer based on the maximum capacity for the server side buffer and the maximum capacity for the client side buffer.

19. The system of claim 17, wherein the computer readable program code configured to increase is further configured to:

in response to determining that the available capacity of the server side buffer is not sufficient to store the server side session data packet, determine whether the allocated capacity of the server side buffer is smaller than a maximum capacity of the server side buffer, or

in response to determining that the available capacity of the client side buffer is not sufficient to store the client side session data packet, determine whether the allocated capacity of the client side buffer is smaller than a maximum capacity of the client side buffer;

in response to determining that the allocated capacity of the server side buffer is smaller than the maximum capacity of the server side buffer, determine whether there is sufficient memory space within the maximum capacity of the server side buffer to store the server side session data packet, or

in response to determining that the allocated capacity of the client side buffer is smaller than the maximum capacity of the client side buffer, determine whether there is sufficient memory space within the maximum capacity of the client side buffer to store the client side session data packet; and

in response to determining that there is sufficient memory space within the maximum capacity of the server side buffer to store the server side session data packet, allocate the memory space to the server side buffer and adjust the available capacity of the server side buffer according to the allocated memory space, or

in response to determining that there is sufficient memory space within the maximum capacity of the client side buffer to store the client side session data packet, allocate the memory space to the client side buffer and adjust the available capacity of the client side buffer according to the allocated memory space.

20. The system of claim 18, wherein the computer readable program code configured to monitor and to calculate is further configured to:

measure a server side data packet round trip time (RTT) and a client side data packet RTT; and

calculate the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side data packet RTT, and the weighted average of the capacity of the memory buffer.

21. The system of claim 20, wherein the weighted average of the capacity of the memory buffer is biased toward the server in calculating the maximum capacity for the server side buffer, or

wherein the weighted average of the capacity of the memory buffer is biased toward the client in calculating the maximum capacity for the client side buffer.

22. The system of claim 20, wherein the computer readable program code configured to monitor is further configured to:

obtain new measurements for the server side data packet RTT and the client side data packet RTT; and

modify the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the new server side data packet RTT, the new client side data packet RTT, and the weighted average of the capacity of the memory buffer.

23. The system of claim 20 wherein the computer readable program code configured to measure and to calculate is further configured to:

measure the server side data packet RTT, the client side data packet RTT, a server side transmission rate, and a client side transmission rate; and

calculate the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side RTT, the server side transmission rate, the client side transmission rate, and the weighted average of the capacity of the memory buffer.

24. The system of claim 23, wherein the computer readable program code configured to monitor is further configured to:

obtain new measurements for the server side transmission rate and the client side transmission rate; and

modify the maximum capacity for the server side buffer and the maximum capacity for the client side buffer using the server side data packet RTT, the client side data packet RTT, the new server side transmission rate, the new client side transmission rate, and the weighted average of the capacity of the memory buffer.