Method and apparatus for a grid network throttle and load collector

• US 20070058547A1
• Filed: 09/13/2005
• Published: 03/15/2007
• Est. Priority Date: 09/13/2005
• Status: Active Grant

• Current Assignee: David Mims, Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Berstis, Viktors
• Granted Patent: US 7,995,474 B2
• Time in Patent Office: Days
• US Class Current: 370/232
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3442 for planning or managing the needed capacity
• CPC Class Codes: G06F 11/3457 Performance evaluation by simulation
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/12 Avoiding congestion; Recovering from congestion
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions

Abstract

A method and apparatus for a grid project throttle control for controlling the rate at which a grid job utilizes processor and network resources at the grid node. This throttling mechanism controls the rate of network and processor utilization based on a determination of the expected network and processor availability determined when a grid project is scheduled so that the grid project does not adversely affect the functioning of the nodes with regard to their regular, non-grid work.

Claims

1. A computer implemented method for controlling execution of grid jobs on a grid node, the computer implemented method comprising:

identifying a set of parameters identifying network activity for a grid job on a grid node; and

controlling a rate of data transmission for data generated by processing the grid job at the grid node based on the rate of data transmission and the set of parameters.

2. The computer implemented method of claim 1 wherein the controlling step comprises:

limiting the rate of data transmission if the rate of data transmission exceeds an expected network availability threshold set forth in the set of parameters.

3. The computer implemented method of claim 1 further comprising:

determining whether the grid node has an application that supports controlling data transmission based on the set of parameters; and

responsive to the application being present on the grid node, sending the set of parameters to the application on the grid node.

4. The computer implemented method of claim 2 further comprising:

determining whether the rate of data transmission attributable to grid work exceeds the expected network availability threshold for data transmission.

5. The computer implemented method of claim 1 further comprising receiving an expected network availability threshold packaged into a wrapper associated with the grid job or a grid job data.

6. The computer implemented method of claim 1 further comprising collecting statistics on network utilization from a network utilization monitor on the grid node.

7. The computer implemented method of claim 1 further comprising determining network utilization attributable to grid work and non-grid work.

8. A computer implemented method for controlling execution of grid jobs on a grid node, the computer implemented method comprising:

identifying a set of parameters identifying processor activity for a grid job on a grid node; and

controlling a rate of processor utilization by the grid job at the grid node based on the rate of processor utilization and the set of parameters.

9. The computer implemented method of claim 8 further comprising limiting the rate of processor utilization if the rate of processor utilization exceeds an expected processor availability threshold.

10. The computer implemented method of claim 9 further comprising:

determining whether the rate of processor utilization attributable to grid work exceeds the expected processor availability threshold for processor utilization, as set forth in the set of parameters.

11. The computer implemented method of claim 8 further comprising receiving an expected processor availability threshold packaged into a wrapper associated with the grid job or a grid job data.

12. The computer implemented method of claim 8, further comprising collecting statistics on processor utilization from a processor utilization monitor of the grid node.

13. The computer implemented method of claim 8 further comprising determining processor utilization attributable to grid work and non-grid work.

14. The computer implemented method of claim 13 further comprising determining processor utilization attributable to grid workloads and non-grid workloads, wherein processor utilization data is compared to identifiers associated with grid jobs being processed by the grid node.

15. A computer program product comprising:

a computer usable medium having computer usable program code for controlling execution of grid jobs on a grid node, comprising;

computer usable program code for identifying a set of parameters identifying network activity for a grid job on a grid node;

computer usable program code for controlling a rate of data transmission from the grid node based on the rate of data transmission and the set of parameters.

16. The computer program product of claim 15, wherein the controlling step comprises:

computer usable program code for limiting the rate of data transmission if the rate of data transmission exceeds an expected network availability threshold set forth in the set of parameters.

17. The computer program product of claim 15 further comprising:

computer usable program code for determining whether the grid node has an application that supports controlling data transmission based on the set of parameters; and

computer usable program code for sending the set of parameters to the application on the grid node responsive to the application being present on the grid node.

18. The computer program product of claim 15 further comprising computer usable program code for receiving an expected network availability threshold and an expected processor availability threshold packaged into a wrapper associated with the grid job or grid job data.

19. The computer program product of claim 15 further comprising computer usable program code for collecting statistics on network utilization from a network utilization monitor on the grid node.

20. The computer program product of claim 15 further comprising computer usable program code for determining network and processor utilization attributable to grid work and non-grid work.

21. The computer program product of claim 15 further comprising computer usable program code for limiting a rate of processor utilization if the rate of processor utilization exceeds an expected processor availability threshold.

22. The computer program product of claim 15 further comprising:

computer usable program code for determining whether a rate of processor utilization attributable to grid work exceeds an expected processor availability threshold for processor utilization.

23. The computer program product of claim 15 further comprising computer usable program code for collecting statistics on processor utilization from a processor utilization monitor of the grid node.

24. The computer program product of claim 15 further comprising computer usable program code for determining whether the rate of data transmission attributable to grid work exceeds an expected network availability threshold for data transmission.

25. The computer program product of claim 15 further comprising computer usable program code for determining processor utilization attributable to grid workloads and non-grid workloads, wherein processor utilization data is compared to identifiers associated with grid jobs being processed by the grid node.

26. An apparatus for controlling execution of grid jobs on a grid node comprising:

a computer comprising;

a bus;

a storage device connected to the bus, wherein the storage devices contains a computer usable program product;

a processor unit, wherein the processor unit executes the computer usable program product to identify a set of parameters identifying network activity for a grid job on a grid node; and

control a rate of data transmission from the grid node based on the rate of data transmission and the set of parameters.

27. The apparatus of claim 26, wherein the processor unit further executes the computer usable program code to limit the rate of data transmission if the rate of data transmission exceeds an expected network availability threshold, set forth in the set of parameters.

28. The apparatus of claim 26, wherein the processor unit executes the computer usable program code to limit a rate of processor utilization if the rate of processor utilization exceeds an expected processor availability threshold.

29. The apparatus of claim 28, wherein the processor unit executes the computer usable program code to determine whether the rate of processor utilization attributable to grid work exceeds the expected processor availability threshold.

30. The apparatus of claim 27, wherein the processor unit executes the computer usable program code to determine whether the rate of data transmission attributable to grid work exceeds the expected network availability threshold.