Automatic determination of resource sizing

• US 10,353,746 B2
• Filed: 12/30/2016
• Issued: 07/16/2019
• Est. Priority Date: 12/05/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Reque, Sean Philip, Manwaring, Derek Steven, Thomas, Dylan Chandler, Wagner, Timothy Allen, Zhao, Xin
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Smith, Cheneca
• Application Number:
  US15/396,155
• Publication Number:
  US 20170206116A1
• Time in Patent Office: 928 Days
• Field of Search: None
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 9/445 Program loading or initiating bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/808 User-type aware
• CPC Class Codes: H04L 47/83 based on usage prediction

Abstract

A system for providing automatic resource resizing is provided. The system may be configured to maintain a plurality of virtual machine instances. The system may be further configured to receive a request to execute a program code and allocate computing resources for executing the program code on one of the virtual machine instances. The amount of resources allocated for executing the program code may be specified by the request and adjusted as needed.

Claims

1. A computer-implemented method, comprising:

determining, based on a request to execute a program code of a user, a user-specified amount of a first computing resource to be used to execute the program code;

obtaining a virtual machine instance to be used to execute the program code, the virtual machine instance associated with a first maximum amount of the first computing resource and a second maximum amount of a second computing resource, the second computing resource being different from the first computing resource;

determining a first ratio of the user-specified amount of the first computing resource to the first maximum amount of the first computing resource;

computing a corresponding amount of the second computing resource based on (i) the first ratio of the user-specified amount of the first computing resource to the first maximum amount of the first computing resource and (ii) the second maximum amount of the second computing resource associated with the virtual machine instance; and

executing the program code in a container created in the virtual machine instance, the container having at least the user-specified amount of the first computing resource and the computed corresponding amount of the second computing resource.

2. The computer-implemented method of claim 1, further comprising:

determining an actual amount of the first computing resource used by the program code during execution of the program code;

determining, based on the actual amount, that the user-specified amount is to be overridden; and

executing the program code in another container having an alternate amount of the first computing resource in response to a subsequent request to execute the program code, wherein the alternate amount is different from the user-specified amount.

3. The computer-implemented method of claim 1, further comprising:

determining an actual amount of the second computing resource used by the program code during execution of the program code;

determining, based on the actual amount, that the computed corresponding amount is to be adjusted; and

executing the program code in another container having an alternate amount of the second computing resource in response to a subsequent request to execute the program code, wherein the alternate amount is different from the computed corresponding amount.

4. The computer-implemented method of claim 1, further comprising determining, based on the user-specified amount, another resource amount of a third computing resource other than the first and second computing resources.

5. The computer-implemented method of claim 1, further comprising over-subscribing the virtual machine instance such that a sum of the user-specified amount of the first computing resource allocated to each container created in the virtual machine instance exceeds the first maximum amount.

6. The computer-implemented method of claim 1, wherein the request does not specify an amount of the second computing resource to be allocated to execute the program code.

7. The computer-implemented method of claim 6, further comprising receiving a subsequent request to execute another program code of another user, the subsequent request specifying a first amount of the first computing resource and a second amount of the second computing resource to be allocated to execute said another program code.

8. A system, comprising:

one or more processors; and

one or more memories, the one or more memories having stored thereon instructions, which, when executed by the one or more processors, cause the one or more processors to;

determine, based on a request to execute a program code of a user, a user-specified amount of a first computing resource to be used to execute the program code;

obtain a virtual machine instance to be used to execute the program code, the virtual machine instance associated with a first maximum amount of the first computing resource and a second maximum amount of a second computing resource, the second computing resource being different from the first computing resource;

determine a first ratio of the user-specified amount of the first computing resource to the first maximum amount of the first computing resource;

compute a corresponding amount of the second computing resource based on (i) the first ratio of the user-specified amount of the first computing resource to the first maximum amount of the first computing resource and (ii) the second maximum amount of the second computing resource associated with the virtual machine instance; and

cause the program code to be executed in a container created in the virtual machine instance, the container having at least the user-specified amount of the first computing resource and the computed corresponding amount of the second computing resource.

9. The system of claim 8 further comprising instructions to:

determine an actual amount of the first computing resource used by the program code during execution of the program code;

determine, based on the actual amount, that the user-specified amount is to be overridden; and

cause the program code to be executed in another container having an alternate amount of the first computing resource in response to a subsequent request to execute the program code, wherein the alternate amount is different from the user-specified amount.

10. The system of claim 8 further comprising instructions to:

determine an actual amount of the second computing resource used by the program code during execution of the program code;

determine, based on the actual amount, that the computed corresponding amount is to be adjusted; and

cause the program code to be executed in another container having an alternate amount of the second computing resource in response to a subsequent request to execute the program code, wherein the alternate amount is different from the computed corresponding amount.

11. The system of claim 8 further comprising instructions to determine, based on the user-specified amount, another resource amount of a third computing resource other than the first and second computing resources.

12. The system of claim 8 further comprising instructions to over-subscribe the virtual machine instance such that a sum of the user-specified amount of the first computing resource allocated to each container created in the virtual machine instance exceeds the first maximum amount.

13. The system of claim 8, wherein the request does not specify an amount of the second computing resource to be allocated to execute the program code.

14. The system of claim 13 further comprising instructions to receive a subsequent request to execute another program code of another user, the subsequent request specifying a first amount of the first computing resource and a second amount of the second computing resource to be allocated to execute said another program code.

15. Non-transitory physical computer storage storing computer executable instructions that, when executed by one or more processors, configure the one or more processors to:

determine, based on a request to execute a program code of a user, a user-specified amount of a first computing resource to be used to execute the program code;

obtain a virtual machine instance to be used to execute the program code, the virtual machine instance associated with a first maximum amount of the first computing resource and a second maximum amount of a second computing resource, the second computing resource being different from the first computing resource;

determine a first ratio of the user-specified amount of the first computing resource to the first maximum amount of the first computing resource;

compute a corresponding amount of the second computing resource based on (i) the first ratio of the user-specified amount of the first computing resource to the first maximum amount of the first computing resource and (ii) the second maximum amount of the second computing resource associated with the virtual machine instance; and

cause the program code to be executed in a container created in the virtual machine instance, the container having at least the user-specified amount of the first computing resource and the computed corresponding amount of the second computing resource.

16. The non-transitory physical computer storage of claim 15, wherein the instructions further configure the one or more processors to:

determine an actual amount of the first computing resource used by the program code during execution of the program code;

determine, based on the actual amount, that the user-specified amount is to be overridden; and

cause the program code to be executed in another container having an alternate amount of the first computing resource in response to a subsequent request to execute the program code, wherein the alternate amount is different from the user-specified amount.

17. The non-transitory physical computer storage of claim 15, wherein the instructions further configure the one or more processors to:

determine an actual amount of the second computing resource used by the program code during execution of the program code;

determine, based on the actual amount, that the computed corresponding amount is to be adjusted; and

cause the program code to be executed in another container having an alternate amount of the second computing resource in response to a subsequent request to execute the program code, wherein the alternate amount is different from the computed corresponding amount.

18. The non-transitory physical computer storage of claim 15, wherein the instructions further configure the one or more processors to over-subscribe the virtual machine instance such that a sum of the user-specified amount of the first computing resource allocated to each container created in the virtual machine instance exceeds the first maximum amount.

19. The non-transitory physical computer storage of claim 15, wherein the request does not specify an amount of the second computing resource to be allocated to execute the program code.

20. The non-transitory physical computer storage of claim 19, wherein the instructions further configure the one or more processors to receive a subsequent request to execute another program code of another user, the subsequent request specifying a first amount of the first computing resource and a second amount of the second computing resource to be allocated to execute said another program code.