On-demand compute environment

• US 8,370,495 B2
• Filed: 04/01/2010
• Issued: 02/05/2013
• Est. Priority Date: 03/16/2005
• Status: Active Grant

• Current Assignee: III Holdings 12, LLC (Intellectual Ventures LLC)
• Original Assignee: Adaptive Computing Enterprises, Inc. (Ala Services LLC)
• Inventors: Jackson, David Brian
• Primary Examiner(s): Zele, Krista
• Assistant Examiner(s): DESAI, MARGISHI V
• Application Number:
  US12/752,622
• Publication Number:
  US 20100192157A1
• Time in Patent Office: 1,041 Days
• Field of Search: 709/225
• US Class Current: 709/226
• CPC Class Codes: G06F 11/2038 with a single idle spare processing component
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 2209/5014 Reservation
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/80 Actions related to the user profile or the type of traffic
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network

Abstract

An on-demand compute environment comprises a plurality of nodes within an on-demand compute environment available for provisioning and a slave management module operating on a dedicated node within the on-demand compute environment, wherein upon instructions from a master management module at a local compute environment, the slave management module modifies at least one node of the plurality of nodes.

Claims

1. An on-demand compute environment comprising:

a processor; and

a computer-readable storage medium having stored therein instructions which, when executed by the processor, cause the processor to perform a method comprising;

receiving instructions from a master management module in an external compute environment separate from the on-demand compute environment to yield received instructions, the external compute environment configured to receive workload for processing on external compute nodes from users via reservation of the external compute nodes, and the on-demand compute environment having on-demand compute nodes available for provisioning and processing workload via reservation of the on-demand compute nodes under a slave management module, and wherein the on-demand compute environment is not a video on-demand server;

creating a new management module on one of the on-demand compute nodes based on the received instructions, wherein the new management module provisions at least one other compute node to be managed by the new management module to yield a provisioned at last one other compute node; and

receiving workload for processing from the external compute environment and causing the workload to consume the provisioned at least one other compute node, wherein the new management module operates in addition to the slave management module only for a duration of the workload that consumes the provisioned at least one other compute node.

2. The on-demand compute environment of claim 1, wherein the at least one other compute node is provisioned according to an analysis of at least part of the workload.

3. The on-demand compute environment of claim 1, wherein provisioning of the at least one other compute node further comprises modifying an existing reservation associated with the at least one compute node.

4. The on-demand compute environment of claim 1, wherein the new management module communicates with the master management module in the external compute environment.

5. The on-demand compute environment of claim 1, wherein provisioning the at least one other compute node further comprises provisioning a resource manager with the new management module to manage the provisioned at least one other compute node.

6. A method of managing an on-demand compute environment, the method comprising:

receiving instructions at a slave management module from a master management module associated with an external computing environment separate from the on-demand compute environment to yield received instructions, the external compute environment configured to receive workload for processing on external compute nodes in the external compute environment from users via registration of the external compute nodes, the on-demand compute environment having on-demand compute nodes available for provisioning and processing workload via the slave management module via reserving the on-demand compute nodes, and wherein the on-demand compute environment is not a video on-demand server;

creating, via a processor, a new management module, based on the received instructions, on a compute node in the on-demand computing environment;

provisioning via the new management module the on-demand compute nodes in the on-demand compute environment to yield provisioned on-demand compute nodes; and

receiving workload for processing from the external compute environment, wherein the new management module operates in addition to the slave management module only for a duration of the workload consuming the provisioned on-demand compute nodes.

7. The method of claim 6, wherein the on-demand compute nodes are provisioned an analysis of at least part of the workload.

8. The method of claim 6, further comprising removing the new management module after the workload consumes the provisioned on-demand compute nodes.

9. The method of claim 6, wherein the new management module communicates with the master management module.

10. A non-transitory computer-readable storage medium having stored therein instructions which, when executed by a processor within an on-demand compute environment having on-demand compute nodes available for provisioning and for processing workload, cause the processor to perform a method comprising:

receiving instructions from a master management module in an external compute environment separate from the on-demand compute environment to yield received instructions, the external compute environment configured to receive workload for processing on external compute nodes in the external compute environment from users via registration of the external compute nodes, the on-demand compute environment having on-demand compute nodes available for provisioning and processing workload via the slave management module via reserving the on-demand compute nodes, and wherein the on-demand compute environment is not a video on-demand server;

creating a new management module on at least one of the on-demand compute nodes based on the received instructions such that at least one other compute node is provisioned to be managed by the new management module to yield a provisioned at least one other compute node; and

receiving workload for processing from the external compute environment that consumes the provisioned on-demand compute node, wherein the new management module operates in addition to the slave management module only while the workload consumes the provisioned on-demand compute node.

11. The non-transitory computer-readable storage medium of claim 10, wherein the on-demand compute node is provisioned according to an analysis of at least part of the workload.

12. The non-transitory computer-readable storage medium of claim 10, wherein provisioning of the on-demand other compute node further comprises modifying an existing reservation associated with the one on-demand compute node.

13. The non-transitory computer-readable storage medium of claim 10, wherein the new management module communicates with the master management module in the external compute environment.

14. The non-transitory computer-readable storage medium of claim 10, wherein provisioning the at least one other compute node further comprises provisioning a resource manager with the new management module to manage the provisioned on-demand compute node.

15. A method of managing access to a separately administered on-demand compute environment using a computing device in an external compute environment having a master management module that manages compute resources in the external compute environment, the method comprising:

receiving workload identifying via a processor a triggering event in the external compute environment, the external compute environment configured to receive workload for processing from users via reserving external compute nodes in the external compute environment;

communicating via the master management module with a slave management module in the on-demand compute environment, wherein the on-demand compute environment is not a video on-demand server;

transmitting instructions to the slave management module that cause the slave management module to establish a new management module which provisions on-demand compute nodes in the on-demand compute environment to be managed by the new management module to yield provisioned on-demand compute nodes; and

communicating at least part of the workload to the on-demand compute environment, wherein the at least part of the workload consumes resources of the provisioned on-demand compute nodes.

wherein the new management module operates in addition to the slave management module only for a duration of the at least part of the workload that consumes the provisioned on-demand compute nodes.

16. The method of claim 15, wherein the new management module reserves, allocates, and dynamically provisions compute resources associated with the workload in the on-demand compute environment.

17. The method of claim 15, further comprising transmitting to the on-demand compute environment second instructions for unprovisioning the provisioned on-demand compute nodes.

18. The method of claim 17, wherein after all the provisioned on-demand compute nodes are unprovisioned, the new management module is removed from the on-demand compute environment.

19. The method of claim 15, further comprising dynamically determining when to unprovision the provisioned on-demand compute nodes.

20. The method of claim 15, further comprising:

receiving updated instructions based on an update event associated with the workload for provisioning additional compute nodes in the on-demand compute environment to yield additional provisioned compute nodes; and

communicating part of the workload associated with the update event to at least one of the provisioned compute nodes and the additional provisioned compute nodes in the on-demand compute environment.

21. The method of claim 15, further comprising transmitting configuration instructions to the new management module for configuring the provisioned on-demand compute nodes in the on-demand compute environment.

22. The method of claim 15, wherein the new management module is removed when the workload finishes consuming resources.

23. A method of managing an on-demand compute environment, the method comprising:

receiving a communication from a separately administered external computer compute environment, the external compute environment configured to receive workload for processing from users via a reservation of external compute nodes in the external compute environment;

establishing via a processor a slave node in the on-demand compute environment, wherein the on-demand compute environment is not a video on-demand server;

receiving instructions that cause the slave node to provision on-demand compute nodes in the on-demand compute environment to yield provisioned on-demand compute nodes;

receiving transferred workload from the external compute environment to yield received workload;

communicating the received workload to the provisioned on-demand compute nodes in the on-demand compute environment, wherein the received workload consumes resources of the provisioned on-demand compute nodes; and

de-establishing the slave node after the received workload consumes the resources of the provisioned on-demand compute nodes.

24. The method of claim 23, wherein the slave node is configured to reserve, allocate, and dynamically provision compute resources in the on-demand compute environment.

25. The method of claim 23, further comprising de-establishing the slave node after all provisioned on-demand compute nodes are unprovisioned.

26. The method of claim 23, further comprising:

receiving updated instructions based on an update event associated with the received workload for provisioning additional compute nodes in the on-demand compute environment to yield additional provisioned compute nodes; and

receiving second workload associated with the update event to at least one of the provisioned compute nodes and the additional provisioned compute nodes in the on-demand compute environment.

27. The method of claim 23, further comprising receiving configuration instructions for configuring the provisioned on-demand compute nodes.

28. A management node in an on-demand compute environment that manages a plurality of compute nodes in the on-demand compute environment, the management node comprising:

a processor; and

a computer-readable storage medium having stored therein instructions which, when executed by the processor, cause the processor to perform a method comprising;

receiving via the management node a communication from a master node in a separately administered external compute environment, the external compute environment configured to receive workload for processing from users via a reservation of external compute nodes in the external compute environment;

establishing a slave node and provisioning compute nodes in the on-demand compute environment based on the communication to yield provisioned on-demand compute nodes, wherein the on-demand compute environment is not a video on-demand server;

receiving transferred workload submitted into the external compute environment to yield received workload;

communicating the received workload to the provisioned on-demand compute nodes, wherein the received workload consumes resources of the provisioned on-demand compute nodes; and

de-establishing the slave node after the received workload finishes consuming the resources of the provisioned on-demand compute nodes.

29. The management node of claim 28, wherein the computer-readable storage medium further stores instructions which result in the method further comprising configuring the slave node to reserve, allocate, and dynamically provision resources of the plurality of compute nodes in the on-demand compute environment.

30. The management node of claim 28, wherein the slave node is de-established after the provisioned on-demand compute nodes are released.

31. The management node of claim 28, wherein the computer-readable storage medium further stores instructions which result in the method further comprising:

receiving an update event associated with the workload;

receiving update instructions based on the update event from the master node for provisioning additional compute nodes of the plurality of compute nodes to yield additional provisioned compute nodes; and

receiving update workload associated with the update event from the external compute environment to at least one of the provisioned on-demand compute nodes and the additional provisioned on-demand compute nodes of the plurality of compute nodes.

32. The management node of claim 28, wherein the computer-readable storage medium further stores instructions which result in the method further comprising:

receiving configurations and instructions from the master node to the slave node for configuring the provisioned on-demand computed nodes to match workload policies associated with the external compute environment.

33. A non-transitory computer-readable storage medium having stored therein instructions which, when executed by a processor in an on-demand compute environment, cause the processor to perform a method comprising:

receiving a communication from a separately administered external compute environment, the external compute environment configured to receive workload for processing from users via a reservation of external compute nodes in the external compute environment;

establishing a slave node in the on-demand compute environment based on the communication, wherein the on-demand compute environment is not a video on-demand server;

receiving instructions which cause the slave node to provision compute nodes in the on-demand compute environment to yield provisioned on-demand compute nodes;

receiving workload submitted into the external compute environment and transferred to the on-demand compute environment to yield received workload;

communicating the received workload to the provisioned on-demand compute nodes, wherein the received workload consumes resources of the provisioned compute nodes; and

de-establishing the slave node after the received workload consumes the resources.

34. A method of managing an on-demand compute environment, the method comprising:

based on a communication from an external compute environment at a first management module in a separately administered on-demand compute environment, provisioning a second management module on a node in the on-demand compute environment, the external compute environment configured to receive workload for processing from users via a reservation of external compute nodes in the external compute environment, wherein the on-demand compute environment is not a video on-demand server;

provisioning compute nodes in the on-demand compute environment for workload to be managed by the second management module to yield provisioned on-demand compute nodes;

communicating to the provisioned on-demand compute nodes received workload that was previously submitted into the external compute environment, wherein the received workload consumes resources of the provisioned on-demand compute nodes as managed by the second management module; and

un-provisioning the second management module after the received workload consumes the resources of the provisioned on-demand compute nodes.

35. A management node in an on-demand compute environment comprising:

a processor; and

a computer-readable storage medium having stored therein instructions which, when executed by the processor, cause the processor to perform a method comprising;

receiving a communication from an external compute environment, the on-demand compute environment separately administered from the external compute environment, the external compute environment configured to receive workload for processing from users via a reservation of external compute nodes in the external compute environment, wherein the on-demand compute environment is not a video on-demand server;

based on the communication, spawning a new management module in the on-demand compute environment, in addition to the management module;

provisioning compute nodes in the on-demand compute environment for workload to be managed by the new management module to yield provisioned on-demand compute nodes;

receiving workload from the external compute environment for processing;

communicating the workload to the provisioned on-demand compute nodes, wherein the workload consumes resources of the provisioned on-demand compute nodes; and

removing the new management module from the on-demand compute environment after the workload consumes the resources of the provisioned on-demand compute nodes.

36. A compute environment that accesses a separately-administered on-demand compute environment, the compute environment comprising:

a processor; and

a computer-readable storage medium having stored therein instructions which, when executed by the processor, cause the processor to perform a method comprising;

transmitting a communication to a management module in the separately-administered on-demand compute environment, wherein the communication causes the management module to spawn a new management module in the separately-administered on-demand compute environment and provision compute nodes in the separately-administered on-demand compute environment for workload to be managed by the new management module to yield provisioned on-demand compute nodes, and wherein the separately-administered on-demand compute environment is not a video on-demand server; and

transmitting previously submitted workload to the separately-administered on-demand compute environment for processing, wherein the workload consumes resources of the provisioned on-demand compute nodes via a reservation process, and wherein the new management module is removed from the separately-administered on-demand compute environment after the workload consumes the resources of the provisioned on-demand compute nodes.