System and method for server load balancing and server affinity

• US 7,406,692 B2
• Filed: 02/24/2004
• Issued: 07/29/2008
• Est. Priority Date: 02/24/2003
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: BEA Systems Incorporated (Oracle Corporation)
• Inventors: Revanuru, Naresh, Halpern, Eric M., Peddada, Prasad
• Primary Examiner(s): An; Meng-Ai
• Assistant Examiner(s): To; Jennifer N
• Application Number:
  US10/785,778
• Publication Number:
  US 20040250248A1
• Time in Patent Office: 1,617 Days
• Field of Search: 718100-105, 709201-203, 709/238, 709/227, 709/245, 719/313, 719/330
• US Class Current: 718/105
• CPC Class Codes: G06F 9/5033 considering data affinity
• CPC Class Codes: G06F 9/505 considering the load

Abstract

A system and method for server load balancing that includes server affinity. The system can be incorporated into application servers to support load balancing algorithms for RMI objects that provide server affinity. Server affinity uses smart load balancing for external client connections in such a way that it uses preexisting connection and reduces overhead: the client considers its existing connections to the application server instances when choosing the server instance on which to access a service. If a service is configured for server affinity, the client-side stub attempts to choose a server instance to which it is already connected, and continues to use the same server instance for method calls. All stubs on that client will attempt to use that server instance. If the server instance becomes unavailable, the stubs fail over, if possible, to a server instance to which the client is already connected.

Claims

1. A system for server load balancing that includes server affinity, comprising:

a plurality of machines executing a plurality of server instances;

a cluster that includes the plurality of server instances providing services, and wherein each of the services provides a plurality of method calls;

a load balancing and affinity processor that assigns servers from said cluster to service client requests in the form of service requests from clients; and

a client-side stub which attempts to choose a server instance to which it is already connected, and continues to use the same server instance and the same connection for method calls of that service,

wherein the system uses a load balancing algorithm that includes server affinity to govern connections between external Java clients and server instances and

wherein the load balancing algorithm uses any of round-robin, weight-based, or random load balancing for connections between the server instances.

2. The system of claim 1 wherein all stubs on that client attempt to use that server instance.

3. The system of claim 1 wherein if the server instance becomes unavailable, the stubs fail over, if possible, to a server instance to which the client is already connected.

4. The system of claim 1 wherein the load balancing algorithm includes round robin load balancing used for both internal and external connections.

5. The system of claim 1 wherein the load balancing algorithm includes weight-based load balancing used for both internal and external connections.

6. The system of claim 1 wherein the load balancing method algorithm includes random load balancing used for both internal and external connections.

7. The system of claim 1 wherein round robin load balancing is used for connections between server instances.

8. The system of claim 1 wherein weight-based load balancing is used for connections between server instances.

9. The system of claim 1 wherein random load balancing is used for connections between server instances.

10. A method for server load balancing that includes server affinity, comprising the steps of:

providing a plurality of machines executing a plurality of server instances;

providing the plurality of server instances as a cluster providing services, and wherein each of the services provides a plurality of method calls;

assigning servers from said cluster to service client requests in the form of method calls from clients;

wherein said step of assigning includes using a client-side stub which attempts to choose a server instance to which it is already connected, and continues to use the same server instance and same connection for method calls for that service,

wherein the method uses a load balancing algorithm that includes server affinity to govern connections between external Java clients and server instances, and

wherein the load balancing algorithm uses any of round-robin, weight-based, or random load balancing for connections between the server instances.

11. The method of claim 10 wherein all stubs on that client attempt to use that server instance.

12. The method of claim 10 wherein if the server instance becomes unavailable, the stubs fail over, if possible, to a server instance to which the client is already connected.

13. The method of claim 10 wherein the load balancing algorithm includes round robin load balancing used for both internal and external connections.

14. The method of claim 10 wherein the load balancing algorithm includes weight-based load balancing used for both internal and external connections.

15. The method of claim 10 wherein the load balancing algorithm includes random load balancing used for both internal and external connections.

16. The method of claim 10 wherein round robin load balancing is used for connections between server instances.

17. The method of claim 10 wherein weight-based load balancing is used for connections between server instances.

18. The method of claim 10 wherein random load balancing is used for connections between server instances.