SYSTEM AND METHOD FOR PROVIDING ADVANCED RESERVATIONS IN A COMPUTE ENVIRONMENT

• US 20100023949A1
• Filed: 10/06/2009
• Published: 01/28/2010
• Est. Priority Date: 03/13/2004
• Status: Active Grant

• Current Assignee: III Holdings 12, LLC (Intellectual Ventures LLC)
• Original Assignee: Cluster Resources, Inc. (Ala Services LLC)
• Inventors: Jackson, David B.
• Granted Patent: US 9,128,767 B2
• Time in Patent Office: Days
• US Class Current: 718/104
• CPC Class Codes: G06F 2209/5013 Request control
• CPC Class Codes: G06F 2209/5014 Reservation
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 2209/506 Constraint
• CPC Class Codes: G06F 2209/508 Monitor
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks

Abstract

A system and method are disclosed for dynamically reserving resources within a cluster environment. The method embodiment of the invention comprises receiving a request for resources in the cluster environment, monitoring events after receiving the request for resources and based on the monitored events, dynamically modifying at least one of the request for resources and the cluster environment.

Claims

1. A method of dynamically modifying resources within a compute environment comprising a plurality of compute nodes, the method comprising:

reserving resources in a compute environment under a first reservation, at a current time, for consumption at a future time;

monitoring events after reserving the resources; and

based on the monitored events, dynamically modifying the first reservation to establish a second reservation such that workload submitted within the second reservation consumers different resources than would have been consumed under the first reservation.

2. The method of claim 1, wherein the compute environment is one of a compute farm, a cluster environment and a grid environment.

3. The method of claim 1, wherein the first and second reservations are associated with at least one of consumption resources, provisioning resources, direct volume access, and batch job processing.

4. The method of claim 1, wherein the first and second reservation establishes a virtual private cluster.

5. The method of claim 1, wherein monitoring events after reserving the resources under the first reservation further comprises monitoring the compute environment via a common administrative control.

6. The method of claim 1, wherein monitoring events after reserving the resources further comprises monitoring to determine if a party has submitted workload for processing under the first reservation.

7. The method of claim 6, wherein if the party has not submitted workload for processing after a predetermined amount of time after the current time, then dynamically modifying the first reservation further comprises canceling the first reservation.

8. The method of claim 7, wherein workload comprises one of a reservation, an object that monitors policy, an object that monitors credentials, an object that monitors node states via the common administrative control and an object that monitors the compute environment via the common administrative control.

9. The method of claim 8, further comprising modifying the compute environment based on the monitored events further comprises dynamically modifying the compute environment to satisfy a request for resources associated with the first reservation.

10. The method of claim 9, wherein dynamically modifying the compute environment further comprises at least one of:

modifying at least one node, modifying at least one operating system, installing end user applications, dynamically partitioning node resources and adjusting network configuration.

11. The method of claim 1, wherein monitoring events further comprises monitoring compute resources associated with the first reservation.

12. The method of claim 1, wherein monitoring events further comprises monitoring workload submitted by a user.

13. The method of claim 12, wherein if the workload submitted within the first reservation will extend beyond the first reservation, the method further comprises canceling the workload.

14. The method of claim 13, wherein prior to canceling the workload, the method further comprises presenting to the user that submitted the workload an option of extending the first reservation to accommodate the workload.

15. The method of claim 14, wherein the option of extending the first reservation to accommodate the workload is subject to pre-established policies.

16. The method of claim 15, further comprising presenting to the user with the option of extending the first reservation and a pricing option to extend the first reservation.

17. The method of claim 1, wherein the first reservation of resources is in a window of time in which at least one user submits personal reservations.

18. The method of claim 17, wherein personal reservations are one of a non-administrator reservation and an administrator reservation.

19. The method of claim 17, wherein the first reservation for a window of time is a request for cluster resources for a periodic window of time.

20. The method of claim 19, wherein the periodic window of time is daily, weekly, monthly, quarterly or yearly.

21. The method of claim 17, further comprising:

receiving a personal reservation for the use of compute resources within the window of time; and

providing access to the reserved compute resources for the personal reservation to process workload.

22. The method of claim 21, wherein if a received consumption job associated with the personal reservation will exceed the window of time for the first reservation of compute resources, then the method comprises canceling and locking out the personal reservation from access to the compute resources.

23. The method of claim 21, wherein if a received consumption job associated with the personal reservation will exceed the window of time, then the method comprises never starting the consumption job.

24. The method of claim 22, further comprising, before canceling and locking out the personal reservation, the step of:

presenting to a user who submitted the personal reservation an option of allowing the workload running within the personal reservation to complete although a time for completing the remaining workload is beyond the window of time for the personal reservation.

25. The method of claim 22, further comprising, if the workload submitted under a personal reservation would exceed the personal reservation, extending the personal reservation to meet the needs of the workload.

26. A method of dynamically modifying a reservation of resources within a compute environment comprising a plurality of compute nodes under common administrative control, the method comprising:

receiving a request for a reservation, at a current time, for resources in the compute environment at a future time;

based on the request, reserving a set of resources in the compute environment via a reservation;

monitoring events after reserving the set of resources; and

based on the monitored events, dynamically modifying the reservation to create a modified reservation in which a different set of resources, relative to the set of resources, is reserved under the modified reservation, wherein workload submitted based on the request consumes the different set of resources.

27. The method of claim 26, wherein dynamically modifying the reservation comprises migrating a reservation to be associated with the different set of resources.

28. The method of claim 27, wherein migrating the reservation is one of a migration in space and a migration in time to the different set of resources.

29. The method of claim 26, wherein the modified reservation comprises modifying a time associated with the reservation of the set of resources.

30. The method of claim 26, wherein the different set of resources better meet needs associated with the request for resources relative to the set of resources.

31. The method of claim 28, wherein the migration is the migration in time and wherein the migration in time creates a reservation at the earliest time possible.

32. The method of claim 28, wherein the migration in time creates the modified reservation based on availability of resources in the compute environment.

33. The method of claim 28, wherein the migration is a migration in space, wherein the migration comprises migrating the reservation to the different set of resources that will provide better performance of the compute environment for the request for resources relative to the set of resources.

34. The method of claim 28, wherein the migration is a migration in space and wherein the migration in space comprises migrating the reservation to resources according to a failure or projected failure of resources.

35. The method of claim 26, wherein monitoring events after receiving the request for resources further comprises monitoring a job submitted within a reservation based on the request.

36. The method of claim 35, wherein if the job submitted within the reservation will extend beyond the reservation, the method further comprises canceling the job.

37. The method of claim 36, wherein prior to canceling the job, the method further comprises presenting to an entity that submitted the job an option of modifying the reservation to accommodate the job.

38. The method of claim 37, wherein the option of modifying the reservation to accommodate the job is subject to pre-established policies.

39. The method of claim 38, further comprising presenting an entity with an option to extend the reservation and a pricing option to extend the reservation.

40. The method of claim 26, wherein the request for resources in a compute environment comprises a request for a reservation of resources for a window of time in which at least one user can submit personal reservations.

41. The method of claim 40, wherein personal reservations are one of a non-administrator reservation and an administrator reservation.

42. The method of claim 40, wherein the reservation of compute resources for a window of time is a request for cluster resources for a periodic window of time.

43. The method of claim 42, wherein the periodic window of time may be daily, weekly, monthly, quarterly or yearly.

44. The method of claim 40, further comprising:

receiving a personal reservation for the use of compute resources within the window of time; and

providing access to the reserved compute resources for the personal reservation to process jobs.

45. The method of claim 44, wherein if a received consumption job associated with the personal reservation will exceed the window of time for the reservation of compute resources, then the method further comprises canceling and locking out the personal reservation from access to the compute resources.

46. The method of claim 44, wherein if a received consumption job associated with the personal reservation will exceed the window of time, then the method comprises never starting the consumption job.

47. The method of claim 45, further comprising, before canceling and locking out the personal reservation, the step of:

presenting to a user who requested the personal reservation an option of allowing the jobs running within the personal reservation to complete although it is beyond the window of time for their reservation of compute resources.

48. The method of claim 47, further comprising, if the job submitted under a personal reservation would exceed the personal reservation, extending the personal reservation to meet the needs of the job.

49. A tangible computer-readable medium storing instructions for controlling a computing device to dynamically manage resources within a compute environment comprising a plurality of compute nodes under common administrative control, the instructions causing the computing device to perform steps comprising:

receiving a request for a reservation, at a current time, for resources in the compute environment at a future time;

based on the request, reserving a set of resources in the compute environment via a reservation;

monitoring events after reserving the set of resources; and

based on the monitored events, dynamically modifying the reservation to create a modified reservation in which a different set of resources, relative to the set of resources, is reserved under the modified reservation, wherein workload submitted based on the request consumes the different set of resources.

50. A system for dynamically managing resources within a compute environment comprising a plurality of compute nodes under common administrative control, the system comprising:

a processor;

a hardware module configured to control the processor to receive a request for a reservation, at a current time, for resources in the compute environment at a future time;

a hardware module configured, based on the request, to control the processor to reserve a set of resources in the compute environment via a reservation;

a hardware module configured to control the processor to monitor events after reserving the set of resources; and

a hardware module configured, based on the monitored events, to control the processor to dynamically modify the reservation to create a modified reservation in which a different set of resources, relative to the set of resources, is reserved under the modified reservation, wherein workload submitted based on the request consumes the different set of resources.

51. A compute environment comprising a plurality of computing devices under common administrative control, the compute environment having resources which are dynamically managed according to a method comprising:

receiving a request for a reservation, at a current time, for resources in the compute environment at a future time;

based on the request, reserving a set of resources in the compute environment via a reservation;

monitoring events after reserving the set of resources; and

based on the monitored events, dynamically modifying the reservation to create a modified reservation in which a different set of resources, relative to the set of resources, is reserved under the modified reservation, wherein workload submitted based on the request consumes the different set of resources.