Automatically building a locally managed virtual node grouping to handle a grid job requiring a degree of resource parallelism within a grid environment

• US 20060149842A1
• Filed: 01/06/2005
• Published: 07/06/2006
• Est. Priority Date: 01/06/2005
• Status: Active Grant

• Current Assignee: X Corp. (f/k/a Twitter, Inc.) (X Holdings Corp.)
• Original Assignee: International Business Machines Corporation
• Inventors: Hamilton, Rick Allen II, Seaman, James W., Dawson, Christopher James, Lipton, Steven Jay
• Granted Patent: US 7,707,288 B2
• Time in Patent Office: Days
• US Class Current: 709/226
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5072 Grid computing

Abstract

A method, system, and program for automatically building a locally managed virtual node grouping to handle a grid job requiring a degree of resource parallelism for execution within a grid environment are provided. The grid environment includes multiple resource nodes which are identified by physical location as physically disparate groups each managed by a grid manager. The grid managers include a grid virtual node grouping subsystem that enables a particular grid manager receiving a grid job that requires a particular degree of resource parallelism for execution to build a virtual node grouping of resources from across the grid environment and locally manage the resources included in the virtual node grouping. In particular, the particular grid manager accesses, from the other grid managers, a current availability and workload of each of the physically disparate resource nodes. The particular grid manager selects a selection of resource nodes to build into a virtual node grouping for executing the grid job. The virtual node grouping is built by the other grid managers enabling the particular grid manager to acquire temporary management control over the selection of resource nodes for a duration of the execution of the grid job within the virtual node grouping.

Claims

1. A computer-implemented method for building virtual node groupings within a grid environment, comprising:

detecting a grid job at a particular grid manager from among a plurality of grid managers within a grid environment, wherein said grid job requires a particular degree of parallelism for execution, wherein a plurality of resource nodes within said grid environment are identified in physically disparate groups each managed by one from among said plurality of grid managers, wherein said particular grid manager locally manages a first selection of resource nodes from among said plurality of resource nodes within said grid environment within a particular physical location;

accessing, from said plurality of grid managers, a current availability and workload of said plurality of resource nodes within said grid environment;

selecting a second selection of resource nodes from among said plurality of resource nodes to build into a virtual node grouping for executing said grid job; and

building said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said second selection of resource nodes for a duration of execution of said grid job within said virtual node grouping, such that said grid job is executed within said virtual node grouping automatically built and managed by said particular grid manager within said grid environment.

2. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, further comprising:

responsive to detecting said grid job at said particular grid manager and accessing said current availability and workload of said plurality of resource nodes within said grid environment, determining whether to attempt to build said virtual node grouping.

3. The computer-implemented method according to claim 2 for building virtual node groupings within a grid environment, further comprising:

responsive to detecting said grid job at said particular grid manager, determining whether said first selection of resource nodes comprises a predesignated grouping of resource nodes available to provide said particular degree of parallelism;

responsive to detecting that said first selection of resource nodes comprises a predesignated grouping of resource nodes available to provide said particular degree of parallelism, executing said grid job within said predesignated grouping of resource nodes within said first selection of resource nodes; and

responsive to detecting that said first selection of resource nodes does not comprise a predesignated grouping of resource nodes available to provide said particular degree of parallelism, determining whether said first selection of resource nodes comprises sufficient resource nodes available for grouping to provide said particular degree of parallelism;

responsive to detecting that that said first selection of resource nodes does not comprise sufficient resource nodes available for grouping, detecting whether said second selection of resource nodes are available and are policy compliant for building said virtual node grouping; and

responsive to detecting said second selection of resource nodes are available and policy compliant for building said virtual node grouping, determining to attempt to build said virtual node grouping.

4. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, wherein selecting said second selection of resource nodes from among said plurality of resource nodes to build into a virtual node grouping for executing said grid job, further comprises:

comparing said current availability and said workload of said plurality of resource nodes to select a cost effective selection from among said plurality of resource nodes for said virtual node grouping.

5. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, wherein building said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said second selection of resource nodes for a duration of execution of said grid job within said virtual node grouping, further comprises:

enabling said particular grid manager to change a routing characteristic of each of said second selection of resource nodes to indicate management by said particular grid manager to build said virtual node grouping.

6. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, further comprising:

querying a resource availability and workload for a plurality of external resource nodes accessible outside said grid environment from at least one trusted grid vendor;

selecting said second selection of resource nodes to build into a virtual node grouping for executing said grid job comprising at least one external resource node from among said plurality of external resource nodes; and

building said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said at least one external resource node for said duration of execution of said grid job.

7. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, wherein said second selection of resource nodes comprises at least one resource node from said first selection from among said plurality of resource nodes.

8. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, wherein said second selection of resource nodes comprises at least one resource node from a first physical location and at least one resource node from a second physical location.

9. The computer-implemented method according to claim 1 for building virtual node groupings within a grid environment, wherein said plurality of resource nodes within said grid environment are managed by a particular enterprise.

10. A system for building virtual node groupings within a grid environment, comprising:

a grid environment comprising a plurality of resource nodes identified in physically disparate groups each managed by one from among said plurality of grid managers;

a particular grid manager from among said plurality of grid managers that locally manages a first selection of resource nodes from among said plurality of resource nodes within a particular physical location of said grid environment;

said particular grid manager further comprising;

means for detecting a grid job that requires a particular degree of parallelism for execution within said grid environment;

means for accessing, from said plurality of grid managers, a current availability and workload of said plurality of resource nodes within said grid environment;

means for selecting a second selection of resource nodes from among said plurality of resource nodes to build into a virtual node grouping for executing said grid job; and

means for building said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said second selection of resource nodes for a duration of execution of said grid job within said virtual node grouping.

11. The system according to claim 10 for building virtual node groupings within a grid environment, said particular grid manager further comprising:

means, responsive to detecting said grid job at said particular grid manager and accessing said current availability and workload of said plurality of resource nodes within said grid environment, for determining whether to attempt to build said virtual node grouping.

12. The system according to claim 11 for building virtual node groupings within a grid environment, said particular grid manager further comprising:

means, responsive to detecting said grid job at said particular grid manager, for determining whether said first selection of resource nodes comprises a predesignated grouping of resource nodes available to provide said particular degree of parallelism;

means, responsive to detecting that said first selection of resource nodes comprises a predesignated grouping of resource nodes available to provide said particular degree of parallelism, for executing said grid job within said predesignated grouping of resource nodes within said first selection of resource nodes; and

means, responsive to detecting that said first selection of resource nodes does not comprise a predesignated grouping of resource nodes available to provide said particular degree of parallelism, for determining whether said first selection of resource nodes comprises sufficient resource nodes available for grouping to provide said particular degree of parallelism;

means, responsive to detecting that that said first selection of resource nodes does not comprise sufficient resource nodes available for grouping, for detecting whether said second selection of resource nodes are available and are policy compliant for building said virtual node grouping; and

means, responsive to detecting said second selection of resource nodes are available and policy compliant for building said virtual node grouping, for determining to attempt to build said virtual node grouping.

13. The system according to claim 10 for building virtual node groupings within a grid environment, wherein said means for selecting said second selection of resource nodes from among said plurality of resource nodes to build into a virtual node grouping for executing said grid job, further comprises:

means for comparing said current availability and said workload of said plurality of resource nodes to select a cost effective selection from among said plurality of resource nodes for said virtual node grouping.

14. The system according to claim 10 for building virtual node groupings within a grid environment, wherein said means for building said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said second selection of resource nodes for a duration of execution of said grid job within said virtual node grouping, further comprises:

means for enabling said particular grid manager to change a routing characteristic of each of said second selection of resource nodes to indicate management by said particular grid manager to build said virtual node grouping.

15. The system according to claim 10 for building virtual node groupings within a grid environment, said particular grid manager further comprising:

means for querying a resource availability and workload for a plurality of external resource nodes accessible outside said grid environment from at least one trusted grid vendor;

means for selecting said second selection of resource nodes to build into a virtual node grouping for executing said grid job comprising at least one external resource node from among said plurality of external resource nodes; and

means for building said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said at least one external resource node for said duration of execution of said grid job.

16. The system according to claim 10 for building virtual node groupings within a grid environment, wherein said second selection of resource nodes comprises at least one resource node from said first selection from among said plurality of resource nodes.

17. The system according to claim 10 for building virtual node groupings within a grid environment, wherein said second selection of resource nodes comprises at least one resource node from a first physical location and at least one resource node from a second physical location.

18. The system according to claim 10 for building virtual node groupings within a grid environment, wherein said plurality of resource nodes within said grid environment are managed by a particular enterprise.

19. A computer program product, residing on a computer readable medium, for building virtual node groupings within a grid environment, comprising:

means for enabling detection of a grid job at a particular grid manager from among a plurality of grid managers within a grid environment, wherein said grid job requires a particular degree of parallelism for execution, wherein a plurality of resource nodes within said grid environment are identified in physically disparate groups each managed by one from among said plurality of grid managers, wherein said particular grid manager locally manages a first selection of resource nodes from among said plurality of resource nodes within said grid environment within a particular physical location;

means for controlling access, from said plurality of grid managers, a current availability and workload of said plurality of resource nodes within said grid environment;

means for controlling selection of a second selection of resource nodes from among said plurality of resource nodes to build into a virtual node grouping for executing said grid job; and

means for controlling the building of said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said second selection of resource nodes for a duration of execution of said grid job within said virtual node grouping.

20. The computer program product according to claim 19 for building virtual node groupings within a grid environment, further comprising:

means for controlling a determination whether to attempt to build said virtual node grouping.

21. The computer program product according to claim 20 for building virtual node groupings within a grid environment, further comprising:

means, responsive to enabling detection of said grid job at said particular grid manager, for controlling a determination whether said first selection of resource nodes comprises a predesignated grouping of resource nodes available to provide said particular degree of parallelism;

means, responsive to determining that said first selection of resource nodes comprises a predesignated grouping of resource nodes available to provide said particular degree of parallelism, for controlling execution of said grid job within said predesignated grouping of resource nodes within said first selection of resource nodes; and

means, responsive to determining that said first selection of resource nodes does not comprise a predesignated grouping of resource nodes available to provide said particular degree of parallelism, for controlling a determination whether said first selection of resource nodes comprises sufficient resource nodes available for grouping to provide said particular degree of parallelism;

means, responsive to detecting that that said first selection of resource nodes does not comprise sufficient resource nodes available for grouping, for controlling a determination whether said second selection of resource nodes are available and are policy compliant for building said virtual node grouping; and

means, responsive to detecting said second selection of resource nodes are available and policy compliant for building said virtual node grouping, for determining to attempt to build said virtual node grouping.

22. The computer program product according to claim 20 for building virtual node groupings within a grid environment, wherein said means for selecting said second selection of resource nodes from among said plurality of resource nodes to build into a virtual node grouping for executing said grid job, further comprises:

means for comparing said current availability and said workload of said plurality of resource nodes to select a cost effective selection from among said plurality of resource nodes for said virtual node grouping.

23. The computer program product according to claim 20 for building virtual node groupings within a grid environment, wherein said means for controlling the building of said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said second selection of resource nodes for a duration of execution of said grid job within said virtual node grouping, further comprises:

means for enabling said particular grid manager to change a routing characteristic of each of said second selection of resource nodes to indicate management by said particular grid manager to build said virtual node grouping.

24. The computer program product according to claim 20 for building virtual node groupings within a grid environment, further comprising:

means for controlling a query of a resource availability and workload for a plurality of external resource nodes accessible outside said grid environment from at least one trusted grid vendor;

means for controlling selection of said second selection of resource nodes to build into a virtual node grouping for executing said grid job comprising at least one external resource node from among said plurality of external resource nodes; and

means for controlling building of said virtual node grouping by enabling said particular grid manager to acquire temporary management control over said at least one external resource node for said duration of execution of said grid job.