Peer to peer job monitoring and control in grid computing systems

• US 8,055,753 B2
• Filed: 06/11/2003
• Issued: 11/08/2011
• Est. Priority Date: 06/11/2003
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Strait, Gary E.
• Primary Examiner(s): Dinh; Khanh Q
• Application Number:
  US10/458,956
• Publication Number:
  US 20050015437A1
• Time in Patent Office: 3,072 Days
• Field of Search: 717/10, 709/220, 709/223, 709/227, 709/228, 709/224, 709/226, 709/229, 702/186
• US Class Current: 709/224
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

A solution for improved monitoring and control of jobs in grid and batch computing systems provides a centralized server'"'"'s batch manager which is only responsible for workload balancing and job initiation and completion, all other command and status information are communicated directly between the plurality of submitter'"'"'s systems and the plurality of client systems that are processing their respective workloads. The computing system and communication process utilizes event-driven peer to peer communications between submitter'"'"'s systems and client systems and enables more detailed status and control information to be passed without overloading the centralized server, and by avoiding polling also provides more immediate feedback of results. Multiple process threads are employed on both the submitter'"'"'s and client systems, and a user interface consolidates and displays results to the submitter allow commands to be sent to processes running on client batch systems.

Claims

1. A computer system comprising:

a centralized server having overall control of a batch or grid computing system for receiving and dispatching requests from a submitter computer to an available processing computer, said processing computer being selected by said centralized server; and

means for communicating a batch job request from the submitter computer to the processing computer via the centralized server for processing by the processing computer, said batch job request identifying a monitoring process;

wherein the monitoring process is executed at the submitter computer and the processing computer, the monitoring process establishing a communication link between the submitter computer and the processing computer without participation by the centralized server, the monitoring process being configured to communicate a processing status of the batch job request via said communication link;

wherein said centralized server is only responsible for workload balancing and job initiation and completion while other command and status information is communicated directly between the submitter computer and the processing computer that are processing their respective workloads; and

wherein the submitter computer and the processing computer use event-driven peer to peer communications between each other such that detailed status and control information is passed without overloading the centralized server and without polling.

2. The computer system according to claim 1, further comprising a connection process on said submitter computer for receiving new direct connections from said processing computer whose identity is not known in advance and authenticating said processing computer via a key sent initially through the centralized server and returned via said communication link.

3. The computer system according to claim 1, wherein said batch job request includes at least one key to allow the submitter computer and the processing computer to positively identify each other and exclude communications from other computers in said computer system.

4. The computer system of claim 1, further comprising:

multiple process threads employed on the submitter computer and the processing computer to enable simultaneous bidirectional peer to peer communication between the submitter computer and the processing computer; and

a user interface for consolidating and displaying results of the batch job request to said submitter computer and for allowing commands to be sent to processes running on said processing computer.

5. A computer system, as claimed in claim 1, wherein the batch job request includes instructions as to how and where to connect to the submitter computer by the processing computer.

6. A computer system, as claimed in claim 1, further comprising a user interface at the submitter computer, said user interface simultaneously receiving and displaying a summary of input from the processing computer and enabling sending commands to said processing computer.

7. A computer system, as claimed in claim 6, wherein said user interface enables display of additional informational windows displaying additional details of communications with a job step on said processing computer.

8. A computer system, as claimed in claim 6, wherein said user interface receives from said processing computer the processing status and presents the submitter computer a summary of said processing status.

9. A computer system, as claimed in claim 1, further comprising a user interface process on said submitter computer enabling one or more of different instances of said user interface process that may exist on said submitter computer to detect e preferred communication port already in use, select another available communications port, and change a visible characteristic of said user interface.

10. A computer system as claimed in claim 1, further comprising:

a response process established on said processing computer for receiving results from said batch job request on said processing computer and forwarding the received results over e said communication link to said submitter computer for display and analysis.

11. A computer system as claimed in claim 1, further comprising:

a command process established on said processing computer for receiving commands from a user interface process on said submitter computer and forwarding the received commands from said user interface process on said submitter computer via said communication link to said processing computer.