Scalable java servers for network server applications

• US 20020007410A1
• Filed: 05/30/2001
• Published: 01/17/2002
• Est. Priority Date: 05/30/2000
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Seagren, Charles F., Chapman, Barbara A.
• Granted Patent: US 7,139,805 B2
• Time in Patent Office: Days
• US Class Current: 709/227
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/1482 by means of middleware or OS functionality
• CPC Class Codes: G06F 11/2007 using redundant communication media
• CPC Class Codes: G06F 11/2035 without idle spare hardware
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 9/465 Distributed object oriented systems remote method invocation [RMI] G06F9/548
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1017 based on a round robin mechanism
• CPC Class Codes: H04L 67/1034 Reaction to server failures by a load balancer

Abstract

A system for providing Java-implemented Application Servers to a plurality of clients. Each of the Java-implemented Application Servers is configured to execute on a processing element of a server which has multiple independent processing elements arranged such that a failure of one processing element does not affect the operability of the other processing elements. A Distributor is provided to enable making connections with the clients and then determine which of the Application Servers actually services the clients requests. The Distributor attempts to choose the Application Server that has the fewest number of clients as the server for a new client request. A monitoring program restarts the Distributor if it fails. The system thus provides a scalable and available set of Java-implemented Application Servers without requiring any change to the Java-implemented application itself.

Claims

1. A system for providing Java-implemented Application Servers to a plurality of clients, the system comprising:

a computing system having a plurality of processing elements, each element configured such that, despite a failure of one processing element, the remaining processing elements continue to function;

a plurality of Java-implemented Application Servers, at least one Server assigned to execute on one or more processing elements; and

a distributor module that is configured to capture connection requests from a client on a port, to select one of the plurality of Application Servers to communicate with the requesting client during the connection and to assign the connection request to the selected one of the plurality of Application Servers, such that, after the assignment, the selected Application Server communicates directly with the client.

2. A system for providing Java-implemented Application Servers to a plurality of clients as recited in claim 1, further comprising:

a monitoring module that is configured to restart the distributor and any Application server that fails.

3. A system for providing Java-implemented Application Servers to a plurality of clients as recited in claim 1,

wherein the distributor module is configured to select one of the Application Servers by:

determining whether there is an Application Server supporting fewer connections than the other Application Servers,

if there is such an Application Server, sending to the Application Server a message that identifies the client making the connection request,

if there is no such Application Server, placing the client connection request on a waiting list until such an Application Server is available, and

when such an Application Server becomes available, sending to the Application Server a message that identifies the client making the connection request.

4. A system for providing Java-implemented Application Servers to a plurality of clients as recited in claim 3, wherein determining whether there is an Application Server supporting fewer connections than the other Application Servers is performed by executing a weighted round robin procedure.

5. A system for providing Java-implemented Application Servers to a plurality of clients as recited in claim 1, wherein the distributor module is further configured to:

maintain an information structure that includes a number indicating how many clients have a connection with each Application Server,

receive a message from an Application Server that a connection between the Application Server and a client is closed, and

update the number of clients with a connection to the Application Server that sent the message.

7. A method for providing Java-implemented Application Servers to a plurality of clients as recited in claim 5, further comprising the steps of:

monitoring the operation of the Application Servers and the distributor module for failures; and

if a failure occurs in the distributor module or one of the Application Servers, restarting the distributor module or Application Server.

8. A method for providing Java-implemented Application Servers to a plurality of clients as recited in claim 5, wherein the step of selection one of the Application Servers includes the steps of:

determining whether there is an Application Server supporting fewer connections than the other Application Servers;

if there is such an Application Server, sending to the Application Server a message that identifies the client making the connection request;

if there is no such Application Server, placing the client connection request on a waiting list until such an Application Server is available; and

when such an Application Server becomes available, sending to the Application Server a message that identifies the client making the connection request.

9. A method for providing Java-implemented Application Servers to a plurality of clients as recited in claim 5,

wherein the distributor module maintains an information structure that includes a number indicating how many clients have a connection with each Application Server;

and

further comprising the steps of;

receiving a message from an Application Server that a connection between the Application Server and a client is closed; and

updating the number of clients with a connection to the Application Server that sent the message.

6. A method for providing Java-implemented Application Servers to a plurality of clients, the method comprising:

providing a plurality of processing elements, each element configured such that, despite a failure of one processing element, the remaining processing elements continue to function;

causing a plurality of Java-implemented Application Servers to execute on the processing elements, at least one Server assigned to execute on one or more of the processing elements;

receiving incoming client connection requests at at least one port managed by a distributor module;

selecting one of the Application Servers to communicate with the client during the connection; and

assigning, by the distributor module, the connection request to the selected Application Server such that, after the assignment, the selected Application Server communicates with the client directly.