CONNECTION RATE LIMITING FOR SERVER LOAD BALANCING AND TRANSPARENT CACHE SWITCHING

• US 20100235507A1
• Filed: 05/21/2010
• Published: 09/16/2010
• Est. Priority Date: 05/03/2002
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Brocade Communications Systems, Inc. (Broadcom, Inc.)
• Inventors: Szeto, Ronald W., Jalan, Rajkumar, Cheung, David Chun Ying
• Granted Patent: US 8,572,228 B2
• Time in Patent Office: Days
• US Class Current: 709/225
• CPC Class Codes: H04L 63/0218 Distributed architectures, e.g. distributed firewalls
• CPC Class Codes: H04L 63/1458 Denial of Service
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 67/1036 Load balancing of requests to servers for services different from user content provisioning, e.g. load balancing across domain name servers
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Each service in a computer network may have a connection rate limit. The number of new connections per time period may be limited by using a series of rules. In a specific embodiment of the present invention, a counter is increased each time a server is selected to handle a connection request. For each service, connections coming in are tracked. Therefore, the source of connection-request packets need not be examined. Only the destination service is important. This saves significant time in the examination of the incoming requests. Each service may have its own set of rules to best handle the new traffic for its particular situation. For server load balancing, a reset may be sent to the source address of the new connection request. For transparent cache switching, the connection request may be forwarded to the Internet.

Claims

1. A computer implemented method comprising:

adjusting a counter each time a new server load balancing service connection request is received, the request identifying a destination server load balancing service, the request comprising a request to connect to a server load balancing service; and

directing the request to a particular one of a plurality of servers of the server load balancing service based at least in part on a predetermined scheme, if the counter adjusts at a rate exceeding a predetermined server load balancing service connection rate limit, the particular one of the plurality of servers configured to further direct the request to another one of the plurality of servers to process the request.

2. The method of claim 1, further comprising granting the request if the counter has not increased at a rate exceeding the predetermined server load balancing service connection rate limit.

3. The method of claim 1, further including resetting the counter to zero if the elapsed time since the last counter reset is greater than a predetermined time interval.

4. The method of claim 3, wherein the predetermined server load balancing service connection rate limit is a number of transactions per predetermined time interval.

5. The method of claim 1, further comprising detecting a new server load balancing service connection request by looking at a SYN bit of an incoming transmission control protocol (TCP) packet.

6. The method of claim 1 wherein the incrementing is based at least in part on the identification of the destination server load balancing service.

7. The method of claim 1, further comprising detecting a new server load balancing service connection request by looking for any user datagram protocol (UDP) packets.

8. The method of claim 1 wherein the predetermined scheme comprises directing the new server load balancing service connection request to a particular one of the plurality of servers having a least number of connections.

9. The method of claim 1 wherein the predetermined scheme comprises directing the new server load balancing service connection request to a particular one of the plurality of servers according to a round robin approach.

10. The method of claim 1 wherein the predetermined scheme comprises directing the new server load balancing service connection request to a particular one of the plurality of servers according to a weighted approach.

11. An apparatus comprising:

a memory; and

one or more processors configured to;

adjust a counter each time a new server load balancing service connection request is received, the request identifying a destination server load balancing service, the request comprising a request to connect to a server load balancing service; and

direct the request to a particular one of a plurality of servers of the server load balancing service based at least in part on a predetermined scheme, if the counter adjusts at a rate exceeding a predetermined server load balancing service connection rate limit, the particular one of the plurality of servers configured to further direct the request to another one of the plurality of servers to process the request.

12. The apparatus of claim 11 wherein the one or more processors are further configured to grant the request if the counter has not increased at a rate exceeding the predetermined server load balancing service connection rate limit.

13. The apparatus of claim 11 wherein the one or more processors are further configured to reset the counter to zero if the elapsed time since the last counter reset is greater than a predetermined time interval.

14. The apparatus of claim 13, wherein the predetermined server load balancing service connection rate limit is a number of transactions per predetermined time interval.

15. The apparatus of claim 11 wherein the one or more processors are further configured to detect a new server load balancing service connection request by looking at a SYN bit of an incoming transmission control protocol (TCP) packet.

16. The apparatus of claim 11 wherein the incrementing is based at least in part on the identification of the destination server load balancing service.

17. The apparatus of claim 11 wherein the one or more processors are further configured to detect a new server load balancing service connection request by looking for any user datagram protocol (UDP) packets.

18. The apparatus of claim 11 wherein the predetermined scheme comprises directing the new server load balancing service connection request to a particular one of the plurality of servers having a least number of connections.

19. The apparatus of claim 11 wherein the predetermined scheme comprises directing the new server load balancing service connection request to a particular one of the plurality of servers according to a round robin approach.

20. The apparatus of claim 11 wherein the predetermined scheme comprises directing the new server load balancing service connection request to a particular one of the plurality of servers according to a weighted approach.

21. An apparatus comprising:

a memory;

means for adjusting a counter each time a new server load balancing service connection request is received, the request identifying a destination server load balancing service, the request comprising a request to connect to a server load balancing service; and

means for directing the request to a particular one of a plurality of servers of the server load balancing service based at least in part on a predetermined scheme, if the counter adjusts at a rate exceeding a predetermined server load balancing service connection rate limit, the particular one of the plurality of servers configured to further direct the request to another one of the plurality of servers to process the request.

22. A program storage device readable by a machine, embodying a program of instructions executable by the machine to perform a method, the method comprising:

adjusting a counter each time a new server load balancing service connection request is received, the request identifying a destination server load balancing service, the request comprising a request to connect to a server load balancing service; and

directing the request to a particular one of a plurality of servers of the server load balancing service based at least in part on a predetermined scheme, if the counter adjusts at a rate exceeding a predetermined server load balancing service connection rate limit, the particular one of the plurality of servers configured to further direct the request to another one of the plurality of servers to process the request.