On-Demand Compute Environment

• US 20100192157A1
• Filed: 04/01/2010
• Published: 07/29/2010
• Est. Priority Date: 03/16/2005
• Status: Active Grant

• Current Assignee: III Holdings 12, LLC (Intellectual Ventures LLC)
• Original Assignee: Cluster Resources, Inc. (Ala Services LLC)
• Inventors: Jackson, David B.
• Granted Patent: US 8,370,495 B2
• Time in Patent Office: Days
• US Class Current: 718/104
• CPC Class Codes: G06F 11/2038 with a single idle spare processing component
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 2209/5014 Reservation
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/80 Actions related to the user profile or the type of traffic
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network

Abstract

An on-demand compute environment comprises a plurality of nodes within an on-demand compute environment available for provisioning and a slave management module operating on a dedicated node within the on-demand compute environment, wherein upon instructions from a master management module at a local compute environment, the slave management module modifies at least one node of the plurality of nodes.

Claims

1. A slave management module operating within an on-demand compute environment having a plurality of compute nodes available for provisioning and for processing workload, the slave management module comprising:

a first module controlling a processor to receive instructions from a master management module in an external compute environment separate from the on-demand compute environment; and

a second module controlling the processor to create a new management module on one of the plurality of compute nodes based on the received instructions, wherein the new management module provisions at least one other compute node to be managed by the new management module,

wherein the on-demand compute environment receives workload for processing from the external compute environment and causes the workload to consume the provisioned at least one other compute node, and

wherein the new management module operates in addition to the slave management module and only for a duration of the workload that consumes the provisioned at least one other compute node.

2. The slave management module of claim 1, wherein the at least one other compute node is provisioned according to an analysis of at least part of the received workload.

3. The slave management module of claim 1, wherein provisioning of the at least one other compute node further comprises modifying an existing reservation associated with the at least one compute node.

4. The slave management module of claim 1, wherein the new management module communicates with the master management module in the external compute environment.

5. The slave management module of claim 1, wherein the provisioning the at least one other compute node further comprises provisioning a resource manager with the new management module to manage the provisioned at least one other compute node.

6. A method of managing an on-demand compute environment having a plurality of compute nodes available for provisioning and for processing workload via a slave management module operating in one of the plurality of compute nodes within the on-demand compute environment, the method comprising:

receiving instructions at the slave management module from a master management module associated with an external computing environment separate from the on-demand compute environment; and

creating a new management module, based on the received instructions, on a compute node in the on-demand computing environment,

wherein the on-demand compute environment receives workload for processing from the external compute environment, and

wherein the new management module operates in addition to the slave management module and only for a duration of the workload consuming resources of the provisioned at least one other compute node.

7. The method of claim 6, wherein the new management module exists for a duration of workload that consumes the resources of the provisioned at least one compute node.

8. The method of claim 6, the method further comprising removing the new management module after the received workload consumes the resources.

9. The method of claim 6, wherein the new management module communicates with the master management module.

10. A non-transitory computer-readable storage medium storing instructions which, when executed by a computing device within an on-demand compute environment having a plurality of compute nodes available for provisioning and for processing workload, cause the computing device to perform steps comprising:

receiving instructions from a master management module in an external compute environment separate from the on-demand compute environment; and

creating a new management module on one of the plurality of compute nodes based on the received instructions such that at least one other compute node is provisioned to be managed by the new management module,

wherein the on-demand compute environment receives workload for processing from the external compute environment that consumes the provisioned at least one other compute node, and

wherein the new management module operates in addition to the slave management module only while the workload consumes the provisioned at least one other compute node.

11. The non-transitory computer-readable storage medium of claim 10, wherein the at least one other compute node is provisioned according to an analysis of at least part of the received workload.

12. The non-transitory computer-readable storage medium of claim 10, wherein provisioning of the at least one other compute node further comprises modifying an existing reservation associated with the at least one compute node.

13. The non-transitory computer-readable storage medium of claim 10, wherein the new management module communicates with the master management module in the external compute environment.

14. The non-transitory computer-readable storage medium of claim 10, wherein the provisioning the at least one other compute node further comprises provisioning a resource manager with the new management module to manage the provisioned at least one other compute node.

15. A method of managing access to a separately administered on-demand compute environment using a computing device in an external compute environment having a master management module that manages compute resources in the external compute environment, the method causing the computing device to perform steps comprising:

receiving workload;

identifying a triggering event in the external compute environment;

communicating via the master management module with a slave management module in the on-demand compute environment;

transmitting instructions to the slave management module that cause the slave management module to establish a new management module which provisions compute nodes in the on-demand compute environment to be managed by the new management module; and

communicating at least part of the received workload to the on-demand compute environment, wherein the communicated at least part of the received workload consumes resources of the provisioned compute nodes.

16. The method of claim 15, wherein the new management module reserves, allocates, and dynamically provisions compute resources associated with the received workload in the on-demand compute environment.

17. The method of claim 15, the method further causing the computing device to transmit to the on-demand compute environment second instructions for unprovisioning compute nodes in the on-demand compute environment.

18. The method of claim 17, wherein after all provisioned compute nodes are unprovisioned, the new management module is removed from the on-demand compute environment.

19. The method of claim 15, the method further causing the computing device to dynamically determine when to unprovision compute nodes.

20. The method of claim 15, the method further causing the computing device to perform steps comprising:

receiving updated instructions based on an update event associated with the workload for provisioning additional compute nodes in the on-demand compute environment; and

communicating part of the received workload associated with the update event to at least one of the provisioned compute nodes and the additional provisioned compute nodes in the on-demand compute environment.

21. The method of claim 15, the method further causing the computing device to transmit configuration instructions to the new management module for configuring the provisioned compute nodes in the on-demand compute environment.

22. The method of claim 15, wherein the new management module is removed when the workload finishes consuming resources.

23. A method of managing an on-demand compute environment, the method causing a computing device to perform steps comprising:

receiving a communication from a separately administered external computer environment;

establishing via a processor a slave node in the on-demand compute environment;

receiving instructions that cause the slave node to provision compute nodes in the on-demand compute environment;

receiving transferred workload from the external compute environment;

communicating the received workload to the provisioned compute nodes in the on-demand compute environment, wherein the workload consumes resources of the provisioned compute nodes; and

de-establishing the slave node after the workload consumes the resources.

24. The method of claim 23, wherein the slave node is configured to reserve, allocate, and dynamically provision compute resources in the on-demand compute environment.

25. The method of claim 23, wherein the method causes the computing device to de-establish the slave node after all provisioned compute nodes are unprovisioned.

26. The method of claim 23, the method further causing the computing device to perform steps comprising:

receiving updated instructions based on an update event associated with the workload for provisioning additional compute nodes in the on-demand compute environment; and

receiving second workload associated with the update event to at least one of the provisioned compute nodes and the additional provisioned compute nodes in the on-demand compute environment.

27. The method of claim 23, the method further causing the computing device to receive configuration instructions for configuring the provisioned compute nodes.

28. A management node in an on-demand compute environment that manages a plurality of compute nodes in the on-demand compute environment, the management node comprising:

a first module controlling a processor in the management node to receive a communication from a master node in a separately administered external computer environment;

a second module controlling the processor to establish a slave node and provision compute nodes in the on-demand compute environment based on the communication;

a third module controlling the processor to receive transferred workload submitted into the external compute environment;

a fourth module controlling the processor to communicate the received workload to the provisioned compute nodes, wherein the workload consumes resources of the provisioned compute nodes; and

a fifth module controlling the processor to de-establish the slave node after the workload finishes consuming the resources.

29. The management node of claim 28, wherein the second module further controls the processor to configure the slave node to reserve, allocate, and dynamically provision resources of the plurality of compute nodes in the on-demand compute environment.

30. The management node of claim 28, wherein the slave node is de-established after the provisioned compute nodes are released.

31. The management node of claim 28, further comprising:

a sixth module configured to receive an update event associated with the workload;

a seventh module configured to receive update instructions based on the update event from the master node for provisioning additional compute nodes of the plurality of compute nodes; and

an eighth module configured to receive update workload associated with the update event from the external compute environment to at least one of the provisioned compute nodes and the additional provisioned compute nodes of the plurality of compute nodes.

32. The management node of claim 28, further comprising:

a sixth module configured to receive configurations and instructions from the master node to the slave node for configuring the provisioned computed nodes in the on-demand compute environment to match workload policies associated with the external compute environment.

33. A non-transitory computer-readable storage medium storing instructions which, when executed by a computing device in an on-demand compute environment, cause the computing device to perform steps comprising:

receiving a communication from a separately administered external compute environment;

establishing a slave node in the on-demand compute environment based on the communication;

receiving instructions which cause the slave node to provision compute nodes in the on-demand compute environment;

receiving workload submitted into the external compute environment and transferred to the on-demand compute environment;

communicating the received workload to the provisioned compute nodes in the on-demand compute environment, wherein the workload consumes resources of the provisioned compute nodes; and

de-establishing the slave node after the workload consumes the resources.

34. A method of managing an on-demand compute environment, the method comprising:

based on a communication from an external compute environment at a first management module in a separately administered on-demand compute environment, provisioning a second management module on a node in the on-demand compute environment;

provisioning compute nodes in the on-demand compute environment for workload to be managed by the second management module;

communicating to the provisioned compute nodes in the on-demand compute environment received workload that was previously submitted into the external compute environment, wherein the workload consumes resources of the provisioned compute nodes as managed by the second management module; and

un-provisioning the second management module after the workload consumes the resources of the provisioned compute nodes.

35. A management module in an on-demand compute environment comprising:

a processor;

a first module that controls the processor to receive a communication from an external compute environment, the on-demand compute environment separately administered from the external compute environment;

a second module that controls the processor, based on the communication, to spawn a new management module in the on-demand compute environment, in addition to the management module;

a third module that controls the processor to provision compute nodes in the on-demand compute environment for workload to be managed by the new management module;

a fourth module that controls the processor to receive workload from the external compute environment for processing;

a fifth module that controls the processor to communicate the received workload to the provisioned compute nodes, wherein the workload consumes resources of the provisioned compute nodes; and

a sixth module that controls the processor to remove the new management module from the on-demand compute environment after the workload consumes the resources of the provisioned compute nodes.

36. A master management module in an external compute environment that accesses a separately-administered on-demand compute environment, the master management module comprising:

a processor;

a first module that controls the processor to transmit a communication to a management module in the on-demand compute environment, wherein the communication causes the management module to spawn a new management module in the on-demand compute environment and provision compute nodes in the on-demand compute environment for workload to be managed by the new management module; and

a second module that controls the processor to transmit previously submitted workload to the on-demand compute environment for processing, wherein the workload consumes resources of the provisioned compute nodes, and wherein the new management module is removed from the on-demand compute environment after the workload consumes the resources of the provisioned compute nodes.