Load balancing between multiple web servers

• US 20020059170A1
• Filed: 04/16/2001
• Published: 05/16/2002
• Est. Priority Date: 04/17/2000
• Status: Abandoned Application

• Current Assignee: Sons of Innovation LLC
• Original Assignee: Sons of Innovation LLC
• Inventors: Vange, Mark
• Application Number:
  US09/835,838
• Publication Number:
  US 20020059170A1
• Time in Patent Office: Days
• US Class Current: 707/1
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5088 involving task migration
• CPC Class Codes: H04L 45/14 Routing performance; Theoretical aspects
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/193 at the transport layer, e.g. TCP related
• CPC Class Codes: H04L 47/24 Traffic characterised by specific attributes, e.g. priority or QoS
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 63/0272 Virtual private networks
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/1408 by monitoring network traffic monitoring network traffic per se H04L43/00
• CPC Class Codes: H04L 63/1416 Event detection, e.g. attack signature detection
• CPC Class Codes: H04L 63/1458 Denial of Service
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 : based on network conditions
• CPC Class Codes: H04L 67/1021 : based on client or server locations
• CPC Class Codes: H04L 67/1029 : using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1031 : Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 67/1034 : Reaction to server failures by a load balancer
• CPC Class Codes: H04L 67/142 : Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/303 : Terminal profiles
• CPC Class Codes: H04L 67/561 : Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04L 67/563 : Data redirection of data network streams
• CPC Class Codes: H04L 67/564 : Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 67/565 : Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 67/568 : Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/5681 : Pre-fetching or pre-delivering data based on network characteristics
• CPC Class Codes: H04L 67/5682 : Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 67/61 : taking into account QoS or priority requirements
• CPC Class Codes: H04L 69/16 : Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/329 : in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 : Network security protocols
• CPC Class Codes: H04W 8/04 : Registration at HLR or HSS [Home Subscriber Server]
• CPC Class Codes: Y10S 707/99944 : Object-oriented database structure
• CPC Class Codes: Y10S 707/99945 : Object-oriented database structure processing

Abstract

A system for load balancing in a network environment including a plurality of network resources coupled to a network wherein at least some of the network resources provide redundant services. A client is coupled to the network and a gateway machine is coupled to the network in communication with the client. The gateway machine is configured to receive requests from the client, establish communication channel through the network with a network resource specified by the client, and access the specified network resources to service the received client requests. The gateway machine includes or is coupled to mechanisms for selecting amongst providers of redundant services a particular provider for a received request so as to balance load amongst the plurality of resources providing redundant services.

Claims

1. A system for load balancing in a network environment comprising:

a plurality of servers coupled to a network;

a set of network resources associated with each of the servers, wherein at least some of the network resources are redundant;

a client coupled to the network and generating a request specifying some of the redundant resources;

a gateway machine coupled to the network in communication with the client, the gateway machine configured to receive the request from the client, select from amongst the servers that are associated with the request-specified redundant services, establish a communication channel with the selected server, and access the specified server to service the received client request; and

means coupled to the gateway machine for selecting amongst servers of redundant resources a particular server for a received request so as to balance load amongst the servers providing redundant resources.

2. The system of claim 1 further comprising means within the gateway machine for selecting amongst a plurality of channels between the gateway machine and the servers associated with the network resources specified by the client request.

3. The system of claim 1 wherein at least some of the plurality of servers comprise world wide web servers.

4. The system of claim 3 wherein the client comprises a web browser.

5. The system of claim 1 wherein each of the plurality of servers is associated with a network address and the gateway machine comprises a web server having an network address distinct from the plurality of servers.

6. The system of claim 1 wherein the network comprises the Internet.

7. The system of claim 1 further comprising means for monitoring quality of service between the gateway and each of the servers.

8. The system of claim 7 wherein the means for monitoring quality of service is implemented within the gateway machine.

9. The system of claim 7 further comprising means for selecting from amongst the servers providing redundant services using the relative quality of service between the servers.

10. The system of claim 7 further comprising:

means for allocating an additional server with redundant services in response to the quality of service falling below a preselected level, wherein the gateway machine is configured to establish a new communication channel through the network with the additional server.

11. The system of claim 1 wherein the gateway machine further comprises:

a means for generating a response to the client request using services provided to the gateway machine by the servers.

13. The method of claim 12 selecting amongst a plurality of channels between the gateway machine and the servers of redundant services specified by the client request.

14. The method of claim 12 wherein at least some of the plurality of servers comprise world wide web servers and the client comprises a web browser.

15. The method of claim 12 wherein the network comprises the Internet.

16. The method of claim 12 further comprising monitoring quality of service between the gateway and each of the servers.

17. The method of claim 16 further comprising selecting from amongst the servers providing redundant services using the relative quality of service between the servers.

18. The method of claim 12 further comprising using the gateway machine to generate a response to the client request using services provided to the gateway machine by the servers.

12. A method for load balancing in a network environment comprising:

providing a communication network;

providing a plurality of servers coupled to the network wherein at least some of the servers provide redundant services;

generating a request for a redundant service in a network-coupled client machine;

directing the request to a network-coupled gateway machine;

causing the gateway machine to select amongst servers providing the redundant services a particular server for the received request so as to balance load amongst the plurality of servers providing the redundant services; and

after selecting a particular server, causing the gateway machine to generate a request to the selected server for the specified resources.

19. A system for improving performance of a network connected server comprising:

an intermediary server receiving requests for server access from a plurality of sources;

means for monitoring at least one variable affecting server performance; and

a queue data structure within the intermediary server, wherein the queue data structure is responsive to the means for monitoring to release requests from the queue data structure in a manner determined to improve server performance.