DYNAMICALLY MODIFYING PROGRAM EXECUTION CAPACITY

• US 20150193276A1
• Filed: 03/20/2015
• Published: 07/09/2015
• Est. Priority Date: 09/29/2009
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Maclinovsky, Alex, Meike, Blake, Buragohain, Chiranjeeb, Kommareddy, Christopher Reddy, Pare, Geoffrey Scott, Heitmann, John W., Lohia, Sumit, Chen, Liang, Musgrave, Zachary S.
• Granted Patent: US 10,642,653 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: Y04S 10/50 Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications

Abstract

Techniques are described for managing program execution capacity, such as for a group of computing nodes that are provided for executing one or more programs for a user. In some situations, dynamic program execution capacity modifications for a computing node group that is in use may be performed periodically or otherwise in a recurrent manner, such as to aggregate multiple modifications that are requested or otherwise determined to be made during a period of time, and with the aggregation of multiple determined modifications being able to be performed in various manners. Modifications may be requested or otherwise determined in various manners, including based on dynamic instructions specified by the user, and on satisfaction of triggers that are previously defined by the user. In some situations, the techniques are used in conjunction with a fee-based program execution service that executes multiple programs on behalf of multiple users of the service.

Claims

1-33. -33. (canceled)

34. A computer-implemented method comprising:

receiving, by a configured computing system having a plurality of computing resources available to users, instructions for modifying an amount of allocated computing resources based on specified conditions that are associated with CPU (central processing unit) utilization of the allocated computing resources;

determining, by the configured computing system, to modify the amount of allocated computing resources based at least in part on at least one of the specified conditions being satisfied; and

initiating, by the configured computing system, the modifying of the amount of allocated computing resources.

35. The computer-implemented method of claim 34 wherein the configured computing system is part of a program execution service, and wherein the computing resources are allocated to a customer of the program execution service who pays one or more fees for use of the allocated computing resources.

36. The computer-implemented method of claim 35 wherein the received instructions further include a request to provide an initial amount of computing resources, and wherein the method further comprises allocating, by the configured computing system, the initial amount of computing resources.

37. The computer-implemented method of claim 36 wherein the initial amount of allocated computing resources includes a group of computing nodes, wherein the specified conditions include an average CPU utilization of the computing nodes of the group exceeding a defined threshold, and wherein the modifying of the amount of allocated computing resources includes adding one or more computing nodes to the group.

38. The computer-implemented method of claim 36 wherein the initial amount of allocated computing resources includes a group of computing nodes, wherein the specified conditions include an average CPU utilization of the computing nodes of the group being below a defined threshold, and wherein the modifying of the amount of allocated computing resources includes removing one or more computing nodes from the group.

39. The computer-implemented method of claim 35 wherein the determining to modify the amount of allocated computing resources is performed while an initial amount of allocated computing resources is in use.

40. The computer-implemented method of claim 39 wherein the initiating of the modifying of the amount of allocated computing resources is performed in response to the determining and while the initial amount of allocated computing resources is in use.

41. The computer-implemented method of claim 39 further comprising executing one or more software programs on one or more computing nodes provided by the program execution service.

42. The computer-implemented method of claim 34 wherein the specified conditions include one or more capacity modification triggers that include one or more criteria for use in determining if the one or more capacity modification triggers are satisfied.

43. The computer-implemented method of claim 42 wherein the determining to modify the amount of allocated computing resources is based on one of the specified capacity modification triggers being satisfied and includes identifying an amount of the modifying based at least in part on information associated with the one specified capacity modification trigger.

44. The computer-implemented method of claim 34 further comprising monitoring, by the configured computing system, use of initial allocated computing resources, and wherein the determining to modify the amount of allocated computing resources is based in part on the monitoring.

45. The computer-implemented method of claim 34 further comprising receiving, by the configured computing system, a capacity modification instruction that indicates an amount to modify the allocated computing resources, and wherein the determining to modify the amount of allocated computing resources is based at least in part on the capacity modification instruction.

46. The computer-implemented method of claim 34 wherein the configured computing system is part of a program execution service that provides one or more Application Programming Interfaces (APIs) for use in programmatic interactions with the program execution service over one or more networks, and wherein the received instructions are received from a client system via the one or more APIs.

47. The computer-implemented method of claim 34 wherein the configured computing system is part of a program execution service that provides virtualized computing resources, and wherein the amount of allocated computing resources includes one or more virtual machines.

48. The computer-implemented method of claim 34 wherein an initial amount of allocated computing resources includes a group of computing nodes, wherein the specified conditions include a threshold associated with an ability of the computing nodes to respond in a load-balanced manner, and wherein the modifying of the amount of allocated computing resources includes adding one or more additional computing nodes to the group based at least in part on the threshold.

49. The computer-implemented method of claim 34 wherein an initial amount of allocated computing resources includes a group of computing nodes, wherein the specified conditions correspond to a defined metric that is specified by a user and that the computing nodes of the group track, and wherein the modifying of the amount of allocated computing resources includes adding one or more additional computing nodes to the group based at least in part on the tracking of the defined metric.

50. The computer-implemented method of claim 34 wherein the configured computing system is part of a program execution service that provides a plurality of computing nodes in multiple geographical locations, wherein an initial amount of allocated computing resources includes a group of computing nodes, and wherein the modifying of the amount of allocated computing resources includes selecting, by the configured computing system and based at least in part on the received instructions, one or more of the multiple geographical locations in which to perform the modifying of the amount of computing resources and includes adding, to the group, one or more computing nodes in the selected one or more geographical locations.

51. The computer-implemented method of claim 34 wherein an initial amount of allocated computing resources includes a group of computing nodes, and wherein the modifying of the amount of allocated computing resources includes determining a level of CPU utilization for the computing nodes of the group and selecting, by the configured computing system and based at least in part on the received instructions, a first or second amount of modifying to perform based on the determined level of CPU utilization, the first amount being selected if the determined level of CPU utilization exceeds a first threshold and the second amount being selected if the determined level of CPU utilization exceeds a second threshold.

52. A non-transitory computer-readable medium having stored contents that configure a computing system of a program execution service to:

receive, by the configured computing system, instructions for modifying an amount of allocated computing resources of a group of computing nodes based on specified conditions, the specified conditions associated with an aggregate ability of the computing nodes of the group to respond in a load-balanced manner to requests;

determine, by the configured computing system, to modify the amount of allocated computing resources based at least in part on at least one of the specified conditions being satisfied; and

initiate, by the configured computing system, the modifying of the amount of allocated computing resources.

53. The non-transitory computer-readable medium of claim 52 wherein the received instructions further include a request to provide an initial amount of computing resources from the group of computing nodes, and wherein the stored contents include software instructions that, when executed, further configure the computing system to allocate the initial amount of computing resources, and to use the computing nodes of the group to respond in the load-balanced manner to the requests.

54. The non-transitory computer-readable medium of claim 53 wherein the specified conditions include the aggregate ability passing a defined threshold, and wherein the modifying of the amount of allocated computing resources includes adding one or more additional computing nodes to the group that are provided by the program execution service, to cause the aggregate ability to increase.

55. The non-transitory computer-readable medium of claim 54 wherein the determining to modify the amount of allocated computing resources is performed while one or more software programs are being executed by the computing nodes of the group, and wherein the initiating of the modifying of the amount of allocated computing resources is performed in response to the determining.

56. A system comprising:

one or more processors; and

one or more modules that, when executed by at least one of the processors, cause the at least one processor to;

provide an initial amount of computing resources using a group of computing nodes provided by a program execution service, wherein the computing nodes of the group provide a type of functionality;

receive instructions for modifying an amount of computing resources of the group of computing nodes based on specified conditions associated with a defined metric monitored by the computing nodes of the group;

determine to modify the amount of computing resources of the group of computing nodes based at least in part on at least one of the specified conditions being satisfied; and

initiate the modifying of the amount of computing resources of the group of computing nodes.

57. The system of claim 56 wherein the one or more modules are part of the program execution service and include software instructions that, when executed, further configure the at least one processor to determine that the specified conditions are satisfied based on a determined value for the defined metric passing a defined threshold, and wherein the modifying of the amount of computing resources of the group of computing nodes includes adding one or more additional computing nodes to the group that are provided by the program execution service.

58. The system of claim 57 wherein the defined metric is specified by a user, wherein monitoring of the defined metric and the determining to modify the amount of computing resources of the group of computing nodes are performed while one or more software programs are being executed by the computing nodes of the group to provide the type of functionality, and wherein the initiating of the modifying of the amount of computing resources of the group of computing nodes is performed while the one or more software programs continue to be executed by the computing nodes of the group.