Automated profiling of resource usage

• US 10,015,241 B2
• Filed: 04/25/2016
• Issued: 07/03/2018
• Est. Priority Date: 09/20/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Marr, Michael David, Klein, Matthew D.
• Primary Examiner(s): SCOTT, RANDY A
• Application Number:
  US15/138,071
• Publication Number:
  US 20160241637A1
• Time in Patent Office: 799 Days
• Field of Search: 718 1, 718104, 718105, 709223, 709224, 709225, 709226
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: H04L 41/0806 for initial configuration or provisioning, e.g. plug-and-play
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30

Abstract

Operating profiles for consumers of computing resources may be automatically determined based on an analysis of actual resource usage measurements and other operating metrics. Measurements may be taken while a consumer, such as a virtual machine instance, uses computing resources, such as those provided by a host. A profile may be dynamically determined based on those measurements. Profiles may be generalized such that groups of consumers with similar usage profiles are associated with a single profile. Assignment decisions may be made based on the profiles, and computing resources may be reallocated or oversubscribed if the profiles indicate that the consumers are unlikely to fully utilize the resources reserved for them. Oversubscribed resources may be monitored, and consumers may be transferred to different resource providers if contention for resources is too high.

Claims

1. A system for profiling computing resource usage, the system comprising:

one or more processors;

a computer-readable memory including executable instructions that, when executed by the one or more processors, configure the system to;

receive a request to instantiate a virtual machine, wherein execution of the virtual machine instance is associated with use of an expected operating constraint; and

in response to the request;

determine for a plurality of host computing devices a measure of one or more operating characteristics related to the operation of virtual machine instances;

determine that a host computing device of the plurality of host computing devices is hosting an existing virtual machine instance that is using less than all of a quantity of a computing resource reserved for the existing virtual machine instance;

select the host computing device based on the existing virtual machine instance using less than all of the reserved quantity of the computing resource and based on whether the one or more characteristics satisfy the expected operating constraint during the lifecycle of the instance of the virtual machine; and

cause at least in part, a new instance of the virtual machine to be instantiated on the host computing device.

2. The system of claim 1, wherein the operating characteristic are associated with operating metrics that vary over the lifecycle of the instance of the virtual machine.

3. The system of claim 2, wherein at least one of the operating metrics relates to central processing unit (CPU) utilization, memory utilization, network utilization, hard disk utilization, or electrical power utilization.

4. The system of claim 1, wherein the operating constraint relates to an expected usage amount of a computing resource provided by the host computing device.

5. The system of claim 4, wherein the expected usage amount is further based at least in part on data received from a customer associated with the virtual machine.

6. The system of claim 1, wherein the operating constraint relates to an expected usage amount of a computing resource determined by at least one historical measure of the usage of the amount of computing resource.

7. The system of claim 1, wherein the executable instructions, when executed, further configure the system to:

receive an additional operating metric regarding operation of the new instance on the host computing device, the additional operating metric related to the one or more operating characteristics; and

in response to determining, based on the additional operating metric, that the one or more operating characteristics no longer satisfy the operating constraint, transfer the new instance to a second computing device associated with one or more additional operating characteristics that satisfy the operating constraint.

8. The system of claim 1, wherein the executable instructions, when executed, further configure the system to select a host computing device based partly on a number of virtual machine instances previously hosted on the host computing device and associated with a common customer.

9. A computer-implemented method for profiling computing resource usage, the method comprising:

receiving a request to instantiate a virtual machine, wherein execution of the virtual machine instance is associated with use of an expected operating constraint; and

in response to the request;

determining for a plurality of host computing devices a measure of one or more operating characteristics related to the operation of virtual machine instances;

determining that a host computing device of the plurality of host computing devices is hosting an existing virtual machine instance that is using less than all of a quantity of a computing resource reserved for the existing virtual machine instance;

selecting the host computing device based on the existing virtual machine instance using less than all of the reserved quantity of the computing resource and based on whether the one or more characteristics satisfy the expected operating constraint during the lifecycle of the instance of the virtual machine; and

causing at least in part, a new instance of the virtual machine to be instantiated on the host computing device.

10. The computer-implemented method of claim 9, wherein the operating characteristics are associated with operating metrics that vary over the lifecycle of the instance of the virtual machine.

11. The computer-implemented method of claim 10, wherein at least one of the operating metrics relates to central processing unit (CPU) utilization, memory utilization, network utilization, hard disk utilization, or electrical power utilization.

12. The computer-implemented method of claim 9, wherein the operating constraint relates to an expected usage amount of a computing resource provided by the host computing device.

13. The computer-implemented method of claim 12, wherein the expected usage amount is further based at least in part on data received from a customer associated with the virtual machine.

14. The computer-implemented method of claim 9, wherein the operating constraint relates to an expected usage amount of a computing resource determined by at least one historical measure of the usage of the amount of the computing resource.

15. The computer-implemented method of claim 9, further comprising:

receiving an additional operating metric regarding operation of the new instance on the host computing device, the additional operating metric related to the one or more operating characteristics; and

in response to determining, based on the additional operating metric, that the one or more operating characteristics no longer satisfy the operating constraint, transferring the new instance to a second computing device associated with one or more additional operating characteristics that satisfy the operating constraint.

16. The computer-implemented method of claim 9, further comprising selecting a host computing device based partly on a number of virtual machine instances previously hosted on the host computing device and associated with a common customer.

17. A non-transitory computer-readable storage medium including computer-executable instructions comprising:

computer-executable instructions that, when executed by one or more processors of a computer system, configure the system to;

receive a request to instantiate a virtual machine, wherein execution of the virtual machine instance is associated with use of an expected operating constraint; and

in response to the request;

determine for a plurality of host computing devices a measure of one or more operating characteristics related to the operation of virtual machine instances;

determine that a host computing device of the plurality of host computing devices is hosting an existing virtual machine instance that is using less than all of a quantity of a computing resource reserved for the existing virtual machine instance;

select the host computing device based on the existing virtual machine instance using less than all of the reserved quantity of the computing resource and based on whether the one or more characteristics satisfy the expected operating constraint during the lifecycle of the instance of the virtual machine; and

cause at least in part, a new instance of the virtual machine to be instantiated on the host computing device.

18. The non-transitory computer-readable storage medium of claim 17, wherein the operating characteristics are associated with operating metrics that vary over the lifecycle of the instance of the virtual machine.

19. The non-transitory computer-readable storage medium of claim 18, wherein at least one of the operating metrics relates to central processing unit (CPU) utilization, memory utilization, network utilization, hard disk utilization, or electrical power utilization.

20. The non-transitory computer-readable storage medium of claim 17, wherein the operating constraint relates to an expected usage amount of a computing resource provided by the host computing device.

21. The non-transitory computer-readable storage medium of claim 20, wherein the expected usage amount is further based at least in part on data received from a customer associated with the virtual machine.

22. The non-transitory computer-readable storage medium of claim 17, wherein the operating constraint relates to an expected usage amount of a computing resource determined by at least one historical measure of the usage of the amount of the computing resource.

23. The non-transitory computer readable medium of claim 17, wherein the module, when executed, is further configured to:

receive an additional operating metric regarding operation of the new instance on the host computing device, the additional operating metric related to the one or more operating characteristics; and

in response to determining, based on the additional operating metric, that the one or more operating characteristics no longer satisfy the operating constraint, transfer the new instance to a second computing device associated with one or more additional operating characteristics that satisfy the operating constraint.

24. The non-transitory computer-readable medium of claim 17, wherein the module, when executed, is further configured to select a host computing device based partly on a number of virtual machine instances previously hosted on the computing device and associated with a common customer.