Method and system for utilizing a resource conductor to optimize resource management in a distributed computing environment

• US 8,386,607 B2
• Filed: 04/13/2007
• Issued: 02/26/2013
• Est. Priority Date: 04/13/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hu, Yonggang, Parmar, Onkar S.
• Primary Examiner(s): SERRAO, RANODHI N
• Application Number:
  US11/735,115
• Publication Number:
  US 20080256238A1
• Time in Patent Office: 2,146 Days
• Field of Search: 709/223, 709/226, 718/104, 718/105
• US Class Current: 709/226
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways

Abstract

Disclosed herein are embodiments of a method and system for optimizing resource management in a distributed computing environment through the use of a resource conductor. An application managed by an application manager requires resources managed by a resource manager. A resource conductor in communication with both the application manager and the resource manager receives from the application manager a processing specification for the application and workload associated with the application. The processing specification provides the resource conductor with information needed to determine the type and quantity of resources appropriate for processing the workload associated with the application. The resource conductor adjusts the quantity of resources allocated to the application by communicating with the resource manager.

Claims

1. A method for managing shared computing resources in a distributed computing environment, wherein at least one application manager manages at least one application comprising a plurality of workload units, and wherein at least one resource manager, logically distinct from the at least one application manager, manages a plurality of resources capable of processing at least some of the plurality of workload units, the method comprising:

receiving, by a resource conductor, hosted by a computing system, logically distinct from both the at least one application manager and the at least one resource manager, a processing specification for a first application, wherein the first application is associated with a first application manager, wherein the processing specification affects a first quantity N, and wherein the first quantity N represents a quantity of the plurality of resources allocated to the first application;

receiving by the resource conductor information related to at least one of the plurality of workload units associated with the first application from the first application manager;

determining by the resource conductor a first quantity R, wherein the first quantity R represents a quantity of the plurality of resources appropriate for processing the workload units associated with the first application in accordance with the processing specification for the first application; and

based on the determined first quantity R, adjusting by the resource conductor the first quantity N of resources allocated to the first application, wherein the adjusting the first quantity N is accomplished at least in part by communicating with the at least one resource manager.

2. A method according to claim 1, wherein the first quantity R is an integer value.

3. A method according to claim 1, wherein the first quantity R is a range of integer values.

4. A method according to claim 1, wherein the adjusting the first quantity N comprises sending an outbound message to a first resource manager.

5. A method according to claim 4, wherein the outbound message comprises a Resource Request message.

6. A method according to claim 4, wherein the adjusting the first quantity N further comprises receiving an inbound message from the first resource manager in response to the outbound message.

7. A method according to claim 6, wherein the outbound message comprises a Resource Request message and the inbound message comprises a Resource Allocation message.

8. A method according to claim 7, wherein the adjusting the first quantity N further comprises communicating the received Resource Allocation message to the first application manager.

9. A method according to claim 4, wherein the outbound message comprises a Resource Release message.

10. A method according to claim 9, wherein the adjusting the first quantity N further comprises receiving the Resource Release message from the first application manager prior to the sending of the Resource Release to the first resource manager.

11. A method according to claim 4, wherein the adjusting the first quantity N further comprises sending an outbound message to a second resource manager.

12. A method according to claim 1, wherein the at least one resource manager comprises a local resource manager.

13. A method according to claim 1, wherein the at least one resource manager comprises a remote resource manager.

14. A method according to claim 1, further comprising:

receiving by the resource conductor a Resource Reclaim message from a first resource manager,

wherein the adjusting the first quantity N is further based on the received Resource Reclaim message.

15. A method according to claim 14, wherein the adjusting the first quantity N comprises communicating the received Resource Reclaim message to the first application manager, receiving a Resource Release message from the first application manager, and communicating the received Resource Release message to the first resource manager.

16. A method according to claim 1, wherein the processing specification comprises a Service Level Agreement.

17. A method according to claim 16, wherein the Service Level Agreement is configured to minimize resource allocation.

18. A method according to claim 16, wherein the Service Level Agreement is configured to maximize throughput.

19. A method according to claim 16, wherein the Service Level Agreement is configured to minimize response time.

20. A method according to claim 16, wherein the Service Level Agreement is configured to minimize cost.

21. A method according to claim 16, wherein the Service Level Agreement is configured to model historical resource allocation patterns.

22. A method according to claim 16, wherein the processing specification further comprises a resource type identifier.

23. A method according to claim 1, wherein the receiving of the information related to at least one of the plurality of workload units further comprises receiving information related to each of the at least one of the plurality of workload units individually, and wherein the determining of the first quantity R and the adjusting of the first quantity N are repeated as information related to each of the at least one of the plurality of workload units is received.

24. A method according to claim 1, wherein the information related to at least one of the plurality of workload units associated with the first application comprises the actual at least one of the plurality of workload units associated with the first application.

25. A method according to claim 1, further comprising:

receiving by the resource conductor a processing specification for a second application, wherein the second application is associated with a second application manager, wherein the processing specification affects a second quantity N, and wherein the second quantity N represents a quantity of the plurality of resources allocated to the second application;

receiving by the resource conductor information related to at least one of the plurality of workload units associated with the second application from the second application manager;

determining by the resource conductor a second quantity R, wherein the second quantity R represents a quantity of the plurality of resources appropriate for processing the workload units associated with the second application in accordance with the processing specification for the second application; and

based on the determined second quantity R, adjusting by the resource conductor the second quantity N of resources allocated to the second application, wherein the adjusting the second quantity N is accomplished at least in part by communicating with the at least one resource manager.

26. A method according to claim 25, wherein the adjusting the first quantity N comprises sending an outbound message to a first resource manager.

27. A method according to claim 26, wherein the adjusting the second quantity N comprises sending an outbound message to the first resource manager.

28. A method according to claim 26, wherein the adjusting the second quantity N comprises sending an outbound message to a second resource manager.