Method and system for utilizing a resource conductor to optimize resource management in a distributed computing environment

• US 20080256238A1
• Filed: 04/13/2007
• Published: 10/16/2008
• Est. Priority Date: 04/13/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: Platform Computing Corporation
• Inventors: Parmar, Onkar S., Hu, Yonggang
• Granted Patent: US 8,386,607 B2
• Time in Patent Office: Days
• US Class Current: 709/226
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways

Abstract

Disclosed herein are embodiments of a method and system for optimizing resource management in a distributed computing environment through the use of a resource conductor. An application managed by an application manager requires resources managed by a resource manager. A resource conductor in communication with both the application manager and the resource manager receives from the application manager a processing specification for the application and workload associated with the application. The processing specification provides the resource conductor with information needed to determine the type and quantity of resources appropriate for processing the workload associated with the application. The resource conductor adjusts the quantity of resources allocated to the application by communicating with the resource manager.

Claims

1. A method for managing shared computing resources in a distributed computing environment, wherein at least one application manager manages at least one application comprising a plurality of workload units, and wherein at least one resource manager manages a plurality of resources capable of processing at least some of the plurality of workload units, the method comprising:

receiving by a resource conductor a processing specification for a first application, wherein the first application is associated with a first application manager, wherein the processing specification affects a quantity N, and wherein the quantity N represents a quantity of the plurality of resources allocated to the first application;

receiving by the resource conductor at least one of the plurality of workload units associated with the first application from the first application manager;

determining by the resource conductor a quantity R, wherein the quantity R represents a quantity of the plurality of resources for processing the received workload units in accordance with the processing specification; and

adjusting by the resource conductor the quantity N based on the quantity R.

2. A method according to claim 1, wherein the quantity R is an integer value.

3. A method according to claim 1, wherein the quantity R is a range of integer values.

4. A method according to claim 1, wherein the adjusting comprises sending an outbound message to a first resource manager.

5. A method according to claim 4, wherein the first resource manager comprises a local resource manager.

6. A method according to claim 4, wherein the first resource manager comprises a remote resource manager.

7. A method according to claim 4, wherein the outbound message comprises a Resource Request message.

8. A method according to claim 4, wherein the adjusting further comprises receiving an inbound message in response to the outbound message.

9. A method according to claim 8, wherein the outbound message comprises a Resource Request message and the inbound message comprises a Resource Allocation message.

10. A method according to claim 9, wherein the adjusting further comprises communicating the received Resource Allocation message to the first application manager.

11. A method according to claim 4, wherein the outbound message comprises a Resource Release message.

12. A method according to claim 11, wherein the adjusting further comprises receiving the Resource Release message from the first application manager prior to the sending of the Resource Release to the first resource manager.

13. A method according to claim 1, further comprising:

receiving by the resource conductor a Resource Reclaim message from a first resource manager; and

adjusting by the resource conductor the quantity N based on the received Resource Reclaim message.

14. A method according to claim 13, wherein the adjusting based on the received Resource Reclaim message comprises communicating the received Resource Reclaim message to the first application manager, receiving a Resource Release message from the first application manager, and communicating the received Resource Release message to the first resource manager.

15. A method according to claim 1, wherein the processing specification comprises a Service Level Agreement.

16. A method according to claim 15, wherein the Service Level Agreement is configured to minimize resource allocation.

17. A method according to claim 15, wherein the Service Level Agreement is configured to maximize throughput.

18. A method according to claim 15, wherein the Service Level Agreement is configured to minimize response time.

19. A method according to claim 15, wherein the Service Level Agreement is configured to minimize cost.

20. A method according to claim 15, wherein the Service Level Agreement is configured to model historical resource allocation patterns.

21. A method according to claim 15, wherein the processing specification further comprises a resource type identifier.

22. A method according to claim 1, wherein the receiving of the at least one of the plurality of workload units further comprises receiving each of the at least one of the plurality of workload units individually, and wherein the determining of the quantity R and the adjusting of the quantity N are repeated as each of the at least one of the plurality of workload units is received.

23. A method for managing shared computing resources in a distributed computing environment, wherein at least one application manager manages at least one application comprising a plurality of workload units, and wherein at least one resource manager manages a plurality of resources capable of processing at least some of the plurality of workload units, the method comprising:

receiving by a resource conductor a processing specification for a first application, wherein the first application is associated with a first application manager, wherein the processing specification affects a quantity N, and wherein the quantity N represents a quantity of the plurality of resources allocated to the first application;

receiving by the resource conductor a first workload unit associated with the first application from the first application manager;

determining by the resource conductor a quantity R1, wherein the quantity R1 represents a quantity of the plurality of resources for processing the first workload unit in accordance with the processing specification;

adjusting by the resource conductor the quantity N based on the quantity R1, wherein the adjusting comprises sending an outbound message to a first resource manager;

receiving by the resource conductor a second workload unit associated with the first application;

determining by the resource conductor a quantity R2, wherein the quantity R2 represents a quantity of the plurality of resources for processing the second workload unit in accordance with the processing specification; and

adjusting by the resource conductor the quantity N based on the quantity R2, wherein the adjusting comprises sending an outbound message to a second resource manager.

24. A method according to claim 23, wherein the first resource manager and the second resource manager are the same resource manager.

25. A method according to claim 23, wherein the adjusting by the resource conductor the quantity N based on the quantity R1 further comprises sending an outbound message to a third resource manager.

26. A method according to claim 25, wherein the first resource manager and the third resource manager are the same resource manager.

27. A system for managing shared computing resources in a distributed computing environment, the system comprising:

at least one resource manager, wherein each of the at least one resource managers manages a plurality of resources;

at least one application manager, wherein each of the at least one application managers manages at least one application comprising a plurality of workload units; and

a resource conductor in communication with the at least one application manager and the at least one resource manager, wherein the resource conductor is configured to

receive a processing specification for a first application, wherein the first application is associated with a first application manager, wherein the processing specification affects a quantity N, and wherein the quantity N represents a quantity of the plurality of resources allocated to the first application,

receive at least one of the plurality of workload units associated with the first application;

determine a quantity R, wherein the quantity R represents a quantity of the plurality of resources for processing the received workload units in accordance with the processing specification, and

adjust the quantity N based on the quantity R.

28. A system according to claim 27, wherein the quantity R is an integer value.

29. A system according to claim 27, wherein the quantity R is a range of integer values.

30. A system according to claim 27, wherein the adjusting comprises sending an outbound message to a first resource manager.

31. A system according to claim 30, wherein the first resource manager comprises a local resource manager.

32. A system according to claim 30, wherein the first resource manager comprises a remote resource manager.

33. A system according to claim 30, wherein the outbound message comprises a Resource Request message.

34. A system according to claim 30, wherein the adjusting further comprises receiving an inbound message in response to the outbound message.

35. A system according to claim 34, wherein the outbound message comprises a Resource Request message and the inbound message comprises a Resource Allocation message.

36. A system according to claim 35, wherein the adjusting further comprises communicating the received Resource Allocation message to the first application manager.

37. A system according to claim 30, wherein the outbound message comprises a Resource Release message.

38. A system according to claim 37, wherein the adjusting further comprises receiving the Resource Release message from the first application manager prior to the sending of the Resource Release to the first resource manager.

39. A system according to claim 27, wherein the resource conductor is further configured to

receive a Resource Reclaim message from a first resource manager, and

adjust the quantity N based on the received Resource Reclaim message.

40. A system according to claim 39, wherein the adjusting based on the received Resource Reclaim message comprises communicating the received Resource Reclaim message to the first application manager, receiving a Resource Release message from the first application manager, and communicating the received Resource Release message to the first resource manager.

41. A system according to claim 27, wherein the processing specification comprises a Service Level Agreement.

42. A system according to claim 41, wherein the Service Level Agreement is configured to minimize resource allocation.

43. A system according to claim 41, wherein the Service Level Agreement is configured to maximize throughput.

44. A system according to claim 41, wherein the Service Level Agreement is configured to minimize response time.

45. A system according to claim 41, wherein the Service Level Agreement is configured to minimize cost.

46. A system according to claim 41, wherein the Service Level Agreement is configured to model historical resource allocation patterns.

47. A system according to claim 41, wherein the processing specification further comprises a resource type identifier.

48. A system according to claim 27, wherein the receiving of the at least one of the plurality of workload units further comprises receiving each of the at least one of the plurality of workload units individually, and wherein the determining of the quantity R and the adjusting of the quantity N are repeated as each of the at least one of the plurality of workload units is received.

49. A system for managing shared computing resources in a distributed computing environment, the system comprising:

at least one resource manager, wherein each of the at least one resource managers manages a plurality of resources;

at least one application manager, wherein each of the at least one application managers manages at least one application comprising a plurality of workload units; and

a resource conductor in communication with the at least one application manager and the at least one resource manager, wherein the resource conductor is configured to

receive a processing specification for a first application, wherein the first application is associated with a first application manager, wherein the processing specification affects a quantity N, and wherein the quantity N represents a quantity of the plurality of resources allocated to the first application,

receive a first workload unit associated with the first application,

determine a quantity R1, wherein the quantity R1 represents a quantity of the plurality of resources for processing the first workload unit in accordance with the processing specification,

adjust the quantity N based on the quantity R1, wherein the adjusting comprises sending an outbound message to a first resource manager,

receive a second workload unit associated with the first application,

determine a quantity R2, wherein the quantity R2 represents a quantity of the plurality of resources for processing the second workload unit in accordance with the processing specification, and

adjust the quantity N based on the quantity R2, wherein the adjusting comprises sending an outbound message to a second resource manager.

50. A system according to claim 49, wherein the first resource manager and the second resource manager are the same resource manager.

51. A system according to claim 49, wherein the adjusting the quantity N based on the quantity R1 further comprises sending an outbound message to a third resource manager.

52. A system according to claim 51, wherein the first resource manager and the third resource manager are the same resource manager.