Automated reconfiguration of shared network resources

• US 9,755,990 B2
• Filed: 10/10/2016
• Issued: 09/05/2017
• Est. Priority Date: 05/10/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Vicaire, Pascal A.
• Primary Examiner(s): Mejia, Anthony
• Application Number:
  US15/289,468
• Publication Number:
  US 20170026309A1
• Time in Patent Office: 330 Days
• Field of Search: 709200, 709226
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2209/5011 Pool
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

A resource manager can adjust the amount of capacity in each of a plurality of resource pools using a combination of proactive and reactive approaches. Targets such as an amount of total capacity and an amount of free capacity can be forecast and periodically compared against actual capacity and usage of the pools. A pool balancing algorithm can be used to shift capacity among pools as needed, in order to provide the targeted amount of capacity for each pool before the capacity is needed. When actual usage varies sufficiently from the forecasted usage on which the targets are based, the resource manager can react by reconfiguring resources as needed.

Claims

1. A computer-implemented method of managing resource capacity in a multi-tenant environment, comprising:

determining a total capacity target and a free capacity target for one resource pool of a plurality of resource pools, the one resource pool including a set of resources having a similar configuration, the total capacity target and the free capacity target each being calculated based at least in part upon a forecast usage by customers of the plurality of resource pools;

comparing capacity data for the resource pool against the total capacity target and the free capacity target for the resource pool;

when the capacity data for the resource pool does not satisfy at least one of the total capacity target or the free capacity target;

determining at least one resource that can be moved from a source pool to a target pool of the plurality of resource pools to enable at least a portion of the plurality of resource pools to satisfy at least one of the total capacity target or the free capacity target; and

causing the determined at least one resource to be reconfigured to provide capacity in the target pool;

receiving a request for an amount and type of capacity in the multi-tenant environment;

granting access to the amount and type of capacity in a respective pool when the amount and the type of capacity is available; and

when granting the access causes the type of capacity of a respective pool to fall below the total capacity target or the free capacity target, reconfiguring the determined at least one resource to provide additional capacity of the type of capacity.

2. The computer-implemented method of claim 1, further comprising:

denying the request when there is less than the amount of capacity of the type of capacity available for the request.

3. The computer-implemented method of claim 1, further comprising:

determining that capacity is available, according to the type of capacity, when there are one or more empty slots on a host machine on which a customer instance can be instantiated.

4. The computer-implemented method of claim 1, further comprising:

reconfiguring the determined at least one resource when all slots on a respective host machine are empty and not reserved for an upcoming period of time.

5. The computer-implemented method of claim 1, wherein the request for an amount and type of capacity is received to an application programming interface (API) of a web services component in the multi-tenant environment.

6. The computer-implemented method of claim 1, wherein the plurality of resource pools is distributed across a plurality of resource zones.

7. The computer-implemented method of claim 6, wherein the resource pool includes the set of resources with the similar configuration that is in a designated one of the resource zones.

8. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to:

determine a total capacity target and a free capacity target for one resource pool of a plurality of resource pools in a multi-tenant environment, the one resource pool including a set of resources having a similar configuration, the total capacity target and the free capacity target each being calculated based at least in part upon a forecast usage by customers of the plurality of resource pools;

compare capacity data for the one resource pool of the plurality of pools against the total capacity target and the free capacity target for the one resource pool;

when the capacity data for the one resource pool does not satisfy at least one of the total capacity target or the free capacity target, determine at least one resource that can be moved from a source pool to a target pool of the plurality of resource pools to enable at least a portion of the plurality of resource pools to satisfy at least one of the total capacity target or the free capacity target, and cause the determined at least one resource to be reconfigured to provide capacity in the target pool;

receive a request for an amount and type of capacity in the multi-tenant environment;

grant access to the amount and type of capacity in a respective pool when the amount and the type of capacity is available; and

when granting the access causes the type of capacity of the respective pool to fall below the total capacity target or the free capacity target, reconfigure the determined at least one resource to provide additional capacity of the type of capacity.

9. The non-transitory computer-readable storage medium of claim 8, wherein the instructions that, when executed by the at least one processor of the computing system, further cause the computing system to:

determine that capacity is available, according to the type of capacity, when there are one or more empty slots on a host machine on which a customer instance can be instantiated.

10. The non-transitory computer-readable storage medium of claim 8, wherein the instructions that, when executed by the at least one processor of the computing system, further cause the computing system to:

reconfigure a resource when all slots on a respective host machine are empty and not reserved for an upcoming period of time.

11. The non-transitory computer-readable storage medium of claim 8 wherein the instructions that, when executed by the at least one processor of the computing system, further cause the computing system to:

deny the request when there is less than the amount of capacity of the type of capacity available for the request.

12. The non-transitory computer-readable storage medium of claim 8, wherein the instructions that, when executed by the at least one processor of the computing system, further cause the computing system to receive the request for an amount and type of capacity via an application programming interface (API) of a web services component in the multi-tenant environment.

13. The non-transitory computer-readable storage medium of claim 8, wherein the plurality of resource pools is distributed across a plurality of resource zones.

14. The non-transitory computer-readable storage medium of claim 13, wherein the resource pool includes the set of resources with the similar configuration that is in a designated one of the resource zones.

15. A system comprising:

at least one device processor; and

memory including instructions that, when executed by the at least one processor, cause the system to;

determine a total capacity target and a free capacity target for one resource pool of a plurality of resource pools in a multi-tenant environment, the one resource pool including a set of resources having a similar configuration, the total capacity target and the free capacity target each being calculated based at least in part upon a forecast usage by customers of the plurality of resource pools;

compare capacity data for the one resource pool of the plurality of pools against the total capacity target and the free capacity target for the one resource pool;

when the capacity data for the one resource pool does not satisfy at least one of the total capacity target or the free capacity target, determine at least one resource that can be moved from a source pool to a target pool of the plurality of resource pools to enable at least a portion of the plurality of resource pools to satisfy at least one of the total capacity target or the free capacity target, and cause the determined at least one resource to be reconfigured to provide capacity in the target pool;

receive a request for an amount and type of capacity in the multi-tenant environment;

grant access to the amount and type of capacity in a respective pool when the amount and the type of capacity is available; and

when granting the access causes the type of capacity of the respective pool to fall below the total capacity target or the free capacity target, reconfigure the determined at least one resource to provide additional capacity of the type of capacity.

16. The system of claim 15, wherein the instructions when executed further cause the system to:

determine that capacity is available, according to the type of capacity, when there are one or more empty slots on a host machine on which a customer instance can be instantiated.

17. The system of claim 15, wherein the instructions when executed further cause the system to:

reconfigure a resource when all slots on a respective host machine are empty and not reserved for an upcoming period of time.

18. The system of claim 15, wherein the instructions when executed further cause the system to:

deny the request when there is less than the amount of capacity of the type of capacity available for the request.

19. The system of claim 15, wherein the instructions when executed further cause the system to:

receive the request for an amount and type of capacity via an application programming interface (API) of a web services component in the multi-tenant environment.

20. The system of claim 15, wherein the plurality of resource pools is distributed across a plurality of resource zones.

21. The system of claim 20, wherein the resource pool includes the set of resources with the similar configuration that is in a designated one of the resource zones.