Simple integration of on-demand compute environment

• US 8,782,231 B2
• Filed: 03/16/2006
• Issued: 07/15/2014
• Est. Priority Date: 03/16/2005
• Status: Active Grant

• Current Assignee: III Holdings 12, LLC (Intellectual Ventures LLC)
• Original Assignee: Adaptive Computing Enterprises, Inc. (Ala Services LLC)
• Inventors: Jackson, David B.
• Primary Examiner(s): Choudhury, Azizul
• Assistant Examiner(s): DESAI, MARGISHI V
• Application Number:
  US11/276,854
• Publication Number:
  US 20060212332A1
• Time in Patent Office: 3,043 Days
• Field of Search: 709/226, 709/224, 709/203, 455/3.01, 715/273
• US Class Current: 709/226
• CPC Class Codes: G06F 11/2038 with a single idle spare processing component
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 2209/5014 Reservation
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/80 Actions related to the user profile or the type of traffic
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network

Abstract

Disclosed are a system and method of integrating an on-demand compute environment into a local compute environment. The method includes receiving a request from an administrator to integrate an on-demand compute environment into a local compute environment and, in response to the request, automatically integrating local compute environment information with on-demand compute environment information to make available resources from the on-demand compute environment to requestors of resources in the local compute environment.

Claims

1. A method comprising:

receiving a request to integrate a remote compute environment into a local compute environment, wherein a specification of compute resources associated with the request is one of fully explicit, partially explicit, fully implicit based on workload, and based on a virtual private cluster package concept where a virtual private cluster package can include aspects of provisioning a support environment and adjustments to resource request timeframes including pre-allocation, allocation duration, and post-allocation timeframe adjustments, wherein the remote compute environment comprises a plurality of networked compute nodes under common management and the local compute environment comprises a plurality of networked compute nodes under common management that is separate from the common management of the remote compute environment, wherein the remote compute environment and the local compute environment are configured to receive and process user-submitted workload, and wherein the compute resources comprise at least one of a server, memory, network bandwidth, a processor, and a virtual compute resource;

in response to the request, automatically integrating local compute environment information with remote compute environment information to make available resources from the remote compute environment to requestors of resources in the local compute environment under the local compute environment requirements; and

receiving a transfer of user-submitted workload at the remote compute environment from the local compute environment to yield transferred workload, such that policies, classes, qualities of service and resource limits associated with the local compute environment information are maintained for the transferred workload, wherein the user-submitted workload was submitted by a requestor to the local compute environment for processing.

2. The method of claim 1, wherein all data associated with the local compute environment and the remote compute environment is handled and appears locally.

3. The method of claim 1, wherein availability of the remote compute environment is transparent to requestors.

4. The method of claim 1, wherein the request is a one-click request for access to the remote compute environment.

5. The method of claim 1, wherein integrating the local compute environment information with the remote compute environment information causes the remote compute environment to consume workload based on policy requirements for jobs submitted to the local compute environment.

6. The method of claim 1, further comprising:

presenting an administrator with a plurality of options related to available modifications to resources within the remote compute environment.

7. The method of claim 6, wherein the request from the administrator is associated with a selection of one of the plurality of options.

8. The method of claim 1, further comprising:

prior to receiving the request, sending an event notice to an administrator; and

presenting, based on the event, the administrator at least one option related to resources with the remote compute environment, wherein the request that is received is based on a selection from the at least one option.

9. The method of claim 1, wherein integrating the local compute environment information comprises integrating at least one of:

resource configuration, state information, resource utilization reporting, job submission information, job management, information resource management, policy controls including priority, resource ownership, queue configuration, job accounting and tracking, and resource accounting and tracking.

10. The method of claim 1, wherein integrating the local compute environment information further comprises automatically creating at least one of a data migration interface and a job migration interface.

11. The method of claim 1, wherein the request is received from an administrator via a web interface.

12. A non-transitory computer readable storage medium storing instructions which, when executed by a processor, cause the processor to perform operations comprising:

receiving a request to integrate a remote compute environment into a local compute environment, wherein a specification of compute resources associated with the request is one of fully explicit, partially explicit, fully implicit based on workload, and based on a virtual private cluster package concept where the virtual private cluster package can include aspects of provisioning a support environment and adjustments to resource request timeframes including pre-allocation, allocation duration, and post-allocation timeframe adjustments, wherein the remote compute environment comprises a plurality of compute nodes under common management and the local compute environment comprises a plurality of networked compute nodes under common management that is separate from the common management of the remote compute environment, wherein the remote compute environment and the local compute environment are configured to receive and process user-submitted workload, and wherein the compute resources comprise at least one of a server, memory, network bandwidth, a processor, and a virtual compute resource;

in response to the request, integrating local compute environment information with remote compute environment information to make available resources from the remote compute environment to requestors of resources in the local compute environment under requirements in the local compute environment information; and

receiving a transfer of the user-submitted workload at the remote compute environment that was submitted by a requestor to the local compute environment, to yield transferred workload, wherein policies, classes, qualities of service and resource limits associated with the local compute environment information are maintained for the transferred workload.

13. The non-transitory computer readable storage medium of claim 12, wherein all data associated with the local compute environment and the remote compute environment is handled and appears locally.

14. The non-transitory computer readable storage medium of claim 12, wherein the availability of the remote compute environment is transparent to requestors.

15. The non-transitory computer readable storage medium of claim 12, wherein integrating the local compute environment information further comprises integrating at least one of:

resource configuration, state information, resource utilization reporting, job submission information, job management information, resource management, policy controls including priority, resource ownership, queue configuration, job accounting and tracking, and resource accounting and tracking.