DECRYPTING LOAD BALANCING ARRAY SYSTEM

• US 20090055552A1
• Filed: 03/03/2008
• Published: 02/26/2009
• Est. Priority Date: 03/10/2000
• Status: Active Grant

• Current Assignee: Akamai Technologies, Inc.
• Original Assignee: Akamai Technologies, Inc.
• Inventors: Swildens, Eric Sven-Johan
• Granted Patent: US 7,734,814 B2
• Time in Patent Office: Days
• US Class Current: 709/241
• CPC Class Codes: H04L 63/0471 applying encryption by an intermediary, e.g. receiving clear information at the intermediary and encrypting the received information at the intermediary before forwarding
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/1034 Reaction to server failures by a load balancer
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A decrypting load balancing array system uses a Pentaflow approach to network traffic management that extends across an array of Decrypting Load Balancing Array (DLBA) servers sitting in front of back end Web servers. One of the DLBA servers acts as a scheduler for the array through which all incoming requests are routed. The scheduler routes and load balances the traffic to the other DLBA servers (including itself) in the array. Each DLBA server routes and load balances the incoming request packets to the appropriate back end Web servers. Responses to the requests from the back end Web servers are sent back to the DLBA server which forwards the response directly to the requesting client.

Claims

1. A method for routing packets through a decrypting load balancing array of servers across a network in a computer environment, the load balancing array of servers capable of decrypting and encrypting SSL requests and performing SSL session scheduling, comprising:

in response to receiving a request packet from a requesting client at a scheduler in a load balancing array of servers, the scheduler routing and load balancing the request packet to a load balancing server among the load balancing array of servers;

in response to receiving the request packet at the load balancing server, the load balancing server decrypting the response packet of an SSL session, routing and load balancing the request packet to a back end Web server among a cluster of back end Web servers, wherein the back end Web server'"'"'s response packet to the request packet is sent to the load balancing server;

in response to receiving the response packet at the load balancing server, the load balancing server encrypting the response packet of the SSL session and sending the response packet directly to the requesting client; and

prior to the sending step, having the load balancing server parse an outgoing markup language page in the response packet to identify given content served by a content delivery network and modify URLs for the given content in the markup language page so that the given content is served from the content delivery network in response to requests from requesting clients.

2. The method of claim 1, wherein the scheduler routes and load balances client requests to itself.

3. The method of claim 1, further comprising:

requesting, by the scheduler, assignment of a virtual IP address to the scheduler, wherein incoming packets over a network from requesting clients destined for the load balancing array of servers are routed through the scheduler via the virtual IP address.

4. The method of claim 1, further comprising:

detecting failure of the scheduler; and

electing a load balancing server among the load balancing array of servers as a new scheduler.

5. The method of claim 1, wherein the scheduler detects failure of any load balancing servers among the load balancing array of servers, and wherein the scheduler stops routing packets to any failed load balancing servers.

6. The method of claim 1, wherein the load balancing server schedules sessions to back end Web servers based on a cookie or session ID.

7. The method of claim 1, wherein the load balancing server uses cookie injection to map a client to a specific back end Web server.

8. The method of claim 1, wherein the load balancing server decrypts a request packet in an SSL session before routing and load balancing the request packet to a back end Web server.

9. The method of claim 7, wherein the load balancing server encrypts a response packet in an SSL session before sending the response packet directly to the requesting client.

11. The method of claim 1, wherein the scheduler routes and load balances client requests to itself.

12. The method of claim 1, further comprising:

requesting, by the scheduler, assignment of a virtual IP address to the scheduler, wherein incoming packets over a network from requesting clients destined for the load balancing array of servers are routed through the scheduler via the virtual IP address.

13. The method of claim 1, further comprising:

detecting failure of the scheduler; and

electing a load balancing server among the load balancing array of servers as a new scheduler.

14. The method of claim 1, wherein the scheduler detects failure of any load balancing servers among the load balancing array of servers, and wherein the scheduler stops routing packets to any failed load balancing servers.

15. The method of claim 1, wherein the load balancing server schedules sessions to back end Web servers based on a cookie or session ID.

16. The method of claim 1, wherein the load balancing server uses cookie injection to map a client to a specific back end Web server.

10. A method for routing packets through a decrypting load balancing array of servers across a network in a computer environment, comprising:

in response to receiving a request packet from a requesting client at a scheduler in a load balancing array of servers, the scheduler routing and load balancing the request packet to a load balancing server among the load balancing array of servers;

in response to receiving the request packet at the load balancing server, the load balancing server routing and load balancing the request packet to a back end Web server among a cluster of back end Web servers, wherein the back end Web server'"'"'s response packet to the request packet is sent to the load balancing server; and

in response to receiving the response packet at the load balancing server, the load balancing server parsing an outgoing markup language page in the response packet to identify given content served by a content delivery network, modifying URLs for the given content in the markup language page so that the given content is served from the content delivery network in response to requests from requesting clients, and sending the response packet directly to the requesting client.

17. An apparatus for routing packets through a decrypting load balancing array of servers across a network in a computer environment, the load balancing array of servers capable of decrypting and encrypting SSL requests and performing SSL session scheduling, comprising:

a scheduler in a load balancing array of servers that, in response to receiving a request packet from a requesting client, routes and load balances the request packet to a load balancing server among the load balancing array of servers;

a load balancing server among the load balancing array of servers that, in response to receiving the request packet, decrypts the response packet of an SSL session, routes and load balances the request packet to a back end Web server among a cluster of back end Web servers, wherein the back end Web server'"'"'s response packet to the request packet is sent to the load balancing server;

wherein the load balancing server, in response to receiving the response packet, encrypts the response packet of the SSL session and sends the response packet directly to the requesting client; and

wherein the load balancing server, prior to the sending of the response packet, parses an outgoing markup language page in the response packet to identify given content served by a content delivery network and modifies URLs for the given content in the markup language page so that the given content is served from the content delivery network in response to requests from requesting clients.

18. The apparatus of claim 17, wherein the scheduler routes and load balances client requests to itself.

19. The apparatus of claim 17, wherein, the scheduler requests assignment of a virtual IP address to the scheduler, wherein incoming packets over a network from requesting clients destined for the load balancing array of servers are routed through the scheduler via the virtual IP address.

20. The apparatus of claim 17, further comprising:

a module for detecting failure of the scheduler; and

a module for electing a load balancing server among the load balancing array of servers as a new scheduler.

21. The apparatus of claim 17, wherein the scheduler detects failure of any load balancing servers among the load balancing array of servers, and wherein the scheduler stops routing packets to any failed load balancing servers.

22. The apparatus of claim 17, wherein the load balancing server schedules sessions to back end Web servers based on a cookie or session ID.

23. The apparatus of claim 17, wherein the load balancing server uses cookie injection to map a client to a specific back end Web server.

24. The apparatus of claim 17, wherein the load balancing server decrypts a request packet in an SSL session before routing and load balancing the request packet to a back end Web server.

25. The apparatus of claim 23, wherein the load balancing server encrypts a response packet in an SSL session before sending the response packet directly to the requesting client.

27. The apparatus of claim 17, wherein the scheduler routes and load balances client requests to itself.

28. The apparatus of claim 17, wherein, the scheduler requests assignment of a virtual IP address to the scheduler, wherein incoming packets over a network from requesting clients destined for the load balancing array of servers are routed through the scheduler via the virtual IP address.

29. The apparatus of claim 17, further comprising:

a module for detecting failure of the scheduler; and

a module for electing a load balancing server among the load balancing array of servers as a new scheduler.

30. The apparatus of claim 17, wherein the scheduler detects failure of any load balancing servers among the load balancing array of servers, and wherein the scheduler stops routing packets to any failed load balancing servers.

31. The apparatus of claim 17, wherein the load balancing server schedules sessions to back end Web servers based on a cookie or session ID.

32. The apparatus of claim 17, wherein the load balancing server uses cookie injection to map a client to a specific back end Web server.

26. An apparatus for routing packets through a decrypting load balancing array of servers across a network in a computer environment, comprising:

a scheduler in a load balancing array of servers that, in response to receiving a request packet from a requesting client, routes and load balances the request packet to a load balancing server among the load balancing array of servers;

a load balancing server among the load balancing array of servers that, in response to receiving the request packet, routes and load balances the request packet to a back end Web server among a cluster of back end Web servers, wherein the back end Web server'"'"'s response packet to the request packet is sent to the load balancing server; and

wherein the load balancing server, in response to receiving the response packet, parses an outgoing markup language page in the response packet to identify given content served by a content delivery network, modifies URLs for the given content in the markup language page so that the given content is served from the content delivery network in response to requests from requesting clients, and sends the response packet directly to the requesting client.