Cluster communication manager

• US 7,831,600 B2
• Filed: 12/28/2005
• Issued: 11/09/2010
• Est. Priority Date: 12/28/2005
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Kilian, Frank
• Primary Examiner(s): Mofiz; Apu M
• Assistant Examiner(s): DAYE, CHELCIE L
• Application Number:
  US11/322,057
• Publication Number:
  US 20070162912A1
• Time in Patent Office: 1,777 Days
• Field of Search: 707/104.1, 707/608, 707/737
• US Class Current: 707/737
• CPC Class Codes: G06F 2209/505 Clust
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues

Abstract

A cluster manager application program library includes an event handler to communicate an event from an application server instance to which the library is linked to a message server in a cluster of application server instances. The library further includes a notification handler to receive at the application server instance a notification of an event in the cluster from the message server, and a message server communication handler to exchange messages between the application server instance and other application server instances in the cluster via the message server.

Claims

1. A method of managing internal cluster communications in a cluster of application server instances, comprising:

executing a plurality of work processes in the application server instances;

establishing internal connections for internal cluster communication between a message server and each of the plurality of work processes executing in the application server instances, wherein internal cluster communication comprises internal communications relating to at least one of events occurring in the cluster and an exchange of messages between work processes executing in the application server instances, the internal connections separate from connections for external cluster communication;

providing a message service for the internal cluster communication, the internal cluster communication including inter-application server instance communication via the message server in accordance with a connection-based message passing protocol in which an internal connection established in the message server receives a notification message for each event occurring in the cluster and sends acknowledgement messages to internal connections established in the application server instances responsive to receiving messages being exchanged between work processes executing in the application server instances, the message server being shared by the application server instances through the established internal connections for internal cluster communication between the message server and each of the plurality of work processes executing in the application server instances;

operating a cluster manager to manage the internal cluster communication in accordance with the connection-based message passing protocol, the internal cluster communication sent over the established internal connections for internal cluster communications between the message server and each of the plurality of work processes executing in the application server instances, the cluster manager;

communicating an event in the cluster to the message server using an event handler, the event handler sending a notification message of the event to the message server;

relaying the notification message of the event in the cluster to one or more of the application server instances using a notification handler, the notification handler causing a function to be performed in one or more of the application server instances responsive to receiving the notification message; and

communicating messages to be exchanged between work processes executing in the application server instances to and from the message server using a message server communication handler, the message server communication handler;

acknowledging receipt of messages received from the work processes; and

relaying messages received from an originating work process to a destination work process, including replicating a multicast message received from the originating work process for broadcast to all other

work processes executing in the application server instances.

2. The method of claim 1, wherein the application server instance is a web application server instance.

3. The method of claim 1, wherein the cluster manager is implemented as an executable application program native to a platform on which the application server instance is to execute.

4. The method of claim 1, wherein the platform is specific to a hardware and operating system platform.

5. The method of claim 1, wherein the cluster manager to manage internal cluster communication includes supporting communication between the work processes executing in one of the application server instances with work processes executing in another one of the application server instances in the cluster.

6. The method of claim 1, wherein the message server is in a central services instance in the cluster.

15. The method of claim 1, wherein the event in the cluster includes one of an application server instance being started or stopped and a work process executing in the application server instance being started or stopped.

16. The method of claim 1, wherein messages to be exchanged between work processes executing in the application server instances include messages to update state information in the cluster, the state information in the cluster comprising:

adding a work process;

removing the work process;

changing a state of the work process; and

changing an availability of a work process to communicate with other work processes in the cluster.

7. A system for managing internal cluster communications in a cluster of application server instances, the system comprising:

server nodes operating in a cluster of application server instances;

a plurality of work processes executing in processors of the server nodes operating in the cluster of application server instances;

a message server providing internal cluster communication, the internal cluster communication including inter-application server instance communication in accordance with a connection-based message passing protocol for the internal cluster communication between the message server and the server nodes operating in the cluster of application server instances in which the message server receives and relays a notification message for each event occurring in the cluster and sends acknowledgement messages responsive to receiving messages being exchanged between work processes executing in processors of the server nodes operating in the application server instances, wherein each work process executing in a processor of a server node operating in the cluster of application server instances is communicatively coupled to the message server and each other via internal connections for the internal cluster communication, the internal connections having been established between the message server and each of the plurality of work processes executing in processors of the server nodes operating in the application server instances, the internal connections having been established separate from connections for external cluster communication, and wherein the internal cluster communication comprises internal communications relating to at least one of events occurring in the cluster and an exchange of messages between work processes executing in processors of the server nodes operating in the application server instances;

a cluster manager executing in processors of the server nodes operating in the cluster of application server instances, the cluster manager to manage internal cluster communications in accordance with the connection-based message passing protocol, the internal cluster communication sent over the internal connections established for internal cluster communication between the message server and each of the plurality of work processes executing in processors of the server nodes operating in the application server instances wherein, on behalf of each application server instance of the cluster of application server instances, the cluster manager operates;

an event handler to communicate an event in the cluster of application server instances from the application server instance to the message server, the event handler sending a notification message of the event to the message server;

a notification handler to relay the notification message of the event in the cluster from the message server to one or more of the application server instances , the notification handler to cause a function to be performed in one or more of the application server instances responsive to receiving the relayed notification message; and

a message server communication handler to communicate messages to be exchanged between the work processes executing in an application server instance and other application server instances in the cluster via the message server, the message server communication handler;

acknowledging receipt of messages received from the work processes; and

relaying messages received from an originating work process to a destination work process, including replicating a multicast message received from the originating work process for broadcast to all other work processes executing in the application server instances.

8. The system of claim 7, wherein the cluster manager executing in processors of the server nodes operating in the cluster of application server instances is implemented as a software library.

9. The system of claim 8, wherein the software library is dynamically linked with each of the application server instances.

10. The system of claim 9, further wherein the cluster manager executing in processors of the server nodes operating in the cluster of application server instances operates as part of a communication manager executing in processors of the server nodes in each of the application server instances, wherein the software library is dynamically linked to the communication manager in each of the application server instances.

17. The system of claim 7, wherein the event in the cluster includes one of an application server instance being started or stopped and a work process executing in the application server instance being started or stopped.

18. The system of claim 7, wherein messages to be exchanged between work processes executing in the application server instances include messages to update state information in the cluster, the state information in the cluster comprising:

adding a work process;

removing the work process;

changing a state of the work process; and

changing an availability of a work process to communicate with other work processes in the cluster.

11. An article of manufacture, comprising:

a machine readable storage medium comprising instructions, that when executed by a processor, cause the processor to;

execute a plurality of work processes in application server instances in a cluster of application server instances;

establish internal connections for internal cluster communication between a message server and each of the plurality of work processes executing in the application server instances, wherein internal cluster communication comprises internal communications relating to at least one of events occurring in the cluster and an exchange of messages between work processes executing in the application server instances, the internal connections separate from connections for external cluster communication;

provide a message service for the internal cluster communication, the internal cluster communication including inter-application server instance communication via the message server in accordance with a connection-based message passing protocol in which an internal connection established in the message server receives a notification message for each event occurring in the cluster and sends acknowledgement messages to internal connections established in the application server instances responsive to receiving messages being exchanged between work processes executing in the application server instances, the message server being shared by the application server instances through the established internal connections for internal cluster communication between the message server and each of the plurality of work processes executing in the application server instances;

manage internal cluster communication in accordance with the connection-based message passing protocol, the internal cluster communication sent over the established internal connections for internal cluster communication between the message server and each of the plurality of work processes executing in the application server instances, including causing the processor to;

communicate an event from an application server instance in the cluster of application server instances to the message server, including sending a notification message of the event to the message server;

relay the notification message of the event in the cluster from the message server to one or more of the application server instances and cause a function to be performed in the one or more of the application server instances responsive to receiving the relayed notification message; and

communicate messages being exchanged between the work processes executing in the application server instances in the cluster via the message server, including;

acknowledge receipt of messages received from the work processes; and

relay messages received from an originating work process to a destination work process, including replicating a multicast message received from the originating work process for broadcast to all other work processes executing in the application server instances.

12. The article of manufacture of claim 11, wherein the instructions comprise a library of executable application program code.

13. The article of manufacture of claim 12, wherein the instructions further comprise an instruction to dynamically link the library to an application program to cause the processor to provide a service in the application server instance.

14. The article of manufacture of claim 13, wherein the application program comprises a network communication manager.

19. The article of manufacture of claim 11, wherein the event in the cluster includes one of an application server instance being started or stopped and a work process executing in the application server instance being started or stopped.

20. The article of manufacture of claim 11, wherein messages to be exchanged between work processes executing in the application server instances include messages to update state information in the cluster, the state information in the cluster comprising:

adding a work process;

removing the work process;

changing a state of the work process; and

changing an availability of a work process to communicate with other work processes in the cluster.