Dynamic modification of interruptibility settings for network-accessible resources

• US 10,223,647 B1
• Filed: 03/27/2012
• Issued: 03/05/2019
• Est. Priority Date: 03/27/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Ward, Jr., David John
• Primary Examiner(s): Crawley, Talia F
• Application Number:
  US13/431,379
• Time in Patent Office: 2,534 Days
• Field of Search: 705 34, 705 80, 709203
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 2009/45591 Monitoring or debugging support
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs
• CPC Class Codes: G06F 9/44505 Configuring for program initiating, e.g. using registry, configuration files
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/48 Program initiating; Program switching, e.g. by interrupt
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06Q 10/00 Administration; Management

Abstract

Methods and apparatus for dynamic modification of interruptibility settings of network-accessible resources are disclosed. A system includes a resource manager and a plurality of resource instances, each of which has an interruptibility setting. In response to an instance acquisition request, the resource manager allocates an instance with a first interruptibility setting, allowing the resource manager to revoke the client'"'"'s access to the instance without a notification. In response to an approval of an interruptibility upgrade request, the resource manager modifies the interruptibility setting to a second setting that allows the client to retain access to the instance for at least a specified time. Respective billing amounts for the client'"'"'s use of the instance are determined for each of the interruptibility settings used.

Claims

1. A system, comprising:

one or more computing devices comprising one or more hardware processors and configured to implement a plurality of resource instances of a provider network, wherein each resource instance of the plurality of resource instances has a modifiable interruptibility property, wherein the modifiable interruptibility property defines conditions under which access to a resource instance with an ongoing reservation may be revoked; and

one or more computing devices comprising one or more hardware processors and configured to implement a resource manager;

wherein the one or more computing devices are configured to execute program instructions on the one or more hardware processors that cause the resource manager to;

receive an instance acquisition request from a client;

allocate, to the client, a resource instance of the plurality of resource instances being implemented on the one or more computing devices, wherein the interruptibility property of the resource instance is set to a first interruptibility level allowing the resource manager to revoke the client'"'"'s access to the resource instance without an access revocation notification;

receive an interruptibility upgrade request from the client to upgrade the resource instance allocated to the client; and

in response to an approval of the interruptibility upgrade request, modify the interruptibility property of the resource instance being implemented on the one or more computing devices to a second interruptibility level, wherein the second interruptibility level allows the client to retain access to the resource instance for at least a specified time interval

wherein the resource instance allocated to the client set to the first interruptibility level and the resource instance allocated to the client set to the second interruptibility level is the same resource instance being implemented on the one or more computing devices.

2. The system as recited in claim 1, wherein the one or more computing devices are further configured to execute program instructions that cause the resource manager to:

assign one or more resource instances of the plurality of resource instances implemented on the one or more computing devices to a pool of available resource instances, based at least in part on a determination that the one or more resource instances are not in use;

select the resource instance from the pool of available resource instances for allocation to the client; and

determine an interruptible instance usage amount rate based at least in part on a current size of the pool of available resource instances.

3. The system as recited in claim 2, wherein the one or more computing devices are further configured to execute program instructions that cause the resource manager to:

in response to receiving the interruptibility upgrade request from the client, determine whether to approve the interruptibility upgrade request based at least in part on (a) a current size of the pool of available resource instances and (b) an estimate of a number of resource instances needed to fulfill resource instance reservations.

4. The system as recited in claim 1, wherein the one or more computing devices are further configured to execute program instructions that cause the resource manager to:

in response to receiving the interruptibility upgrade request from the client, determine whether to approve the interruptibility upgrade request based at least in part on an estimate of a rate of expected instance acquisition requests for on-demand resource instances.

5. The system as recited in claim 1, wherein the one or more computing devices are further configured to execute program instructions that cause the resource manager to:

provide an access revocation notice to the client; and

refrain from interrupting the resource instance subsequent to the access revocation notice being provided to the client for the specified time interval.

6. The system as recited in claim 1, wherein the one or more computing devices are further configured to execute program instructions that cause the resource manager to:

in response to a second instance acquisition request from a second client, wherein the second instance acquisition request includes an indication of a preference for the second interruptibility level, allocate a second resource instance of the plurality of resource instances implemented on the one or more computing devices to the second client, wherein the interruptibility property of the second resource instance is set to the second interruptibility level.

7. A method, comprising:

receiving an instance acquisition request from a client;

allocating, to the client, by a resource manager implemented on one or more computing devices comprising one or more hardware processors, a resource instance of a plurality of resource instances implemented on one or more other computing devices, wherein an interruptibility property of the resource instance is set to a first interruptibility level allowing a revocation of the client'"'"'s access to the first resource instance without an access revocation notification, wherein the interruptibility property defines conditions under which access to a resource instance with an ongoing reservation may be revoked;

receiving an interruptibility upgrade request from the client to upgrade the resource instance allocated to the client; and

in response to an approval of the interruptibility upgrade request, modifying, by the resource manager implemented on the one or more computing devices, the interruptibility property to a second interruptibility level, wherein the second interruptibility level allows the client to retain access to the resource instance for at least a specified time period

wherein the resource instance allocated to the client set to the first interruptibility level and the resource instance allocated to the client set to the second interruptibility level is the same resource instance.

8. The method as recited in claim 7, further comprising:

assigning, by the resource manager implemented on the one or more computing devices, one or more resource instances of the plurality of resource instances implemented on the one or more other computing devices to a pool of available resource instances, based at least in part on a determination that the one or more resource instances are not in use;

selecting, by the resource manager implemented on the one or more computing devices, the resource instance from the pool of available resource instances for allocation to the client; and

determining, by the resource manager implemented on the one or more computing devices, an interruptible instance usage amount rate based at least in part on a current size of the pool of available resource instances.

9. The method as recited in claim 8, further comprising:

in response to receiving the interruptibility upgrade request from the client, determining, by the resource manager implemented on the one or more computing devices, whether to approve the interruptibility upgrade request based at least in part on (a) a current size of the pool of available resource instances and (b) an estimate of a number of resource instances needed to fulfill resource instance reservations.

10. The method as recited in claim 7, further comprising:

in response to receiving the interruptibility upgrade request from the client, determining, by the resource manager implemented on the one or more computing devices, whether to approve the interruptibility request based at least in part on an estimate of a rate of expected instance acquisition requests for on-demand resource instances.

11. The method as recited in claim 7, further comprising:

sending an access revocation notice to the client; and

refraining from interrupting the resource instance for the specified time period subsequent to the access revocation notice being sent to the client.

12. The method as recited in claim 7, further comprising:

in response to a second instance acquisition request from a second client, wherein the second instance acquisition request includes an indication of a preference for the second interruptibility level, allocating, by the resource manager implemented on the one or more computing devices, a second resource instance of the plurality of resource instances implemented on the one or more other computing devices to the second client, wherein the interruptibility property of the second resource instance is set to the second interruptibility level.

13. The method as recited in claim 7, further comprising:

in response to an interruptibility downgrade request received from the client after the approval of the interruptibility upgrade request, modifying, by the resource manager implemented on the one or more computing devices, the interruptibility property of the resource instance to the first interruptibility level.

14. The method as recited in claim 13, further comprising:

in response to a fulfillment request from a second client for a resource instance reservation,

revoking, by the resource manager implemented on the one or more computing devices, access to the resource instance by the client to whom the first resource instance is allocated; and

allocating, by the resource manager implemented on the one or more computing devices, the resource instance to the second client.

15. The method as recited in claim 7, further comprising:

monitoring, by the resource manager implemented on the one or more computing devices, a first rate at which instance acquisition requests are received over a first time period, and a second rate at which interruptibility upgrade requests are received over a second time period;

determining, by the resource manager implemented on the one or more computing devices, a first estimate of expected future instance acquisition request rates and a second estimate of expected future interruptibility upgrade requests based at least in part on the first rate and the second rate; and

determining, by the resource manager implemented on the one or more computing devices, an interruptible instance usage amount rate and a non-interruptible instance usage amount rate based at least in part on the first estimate and the second estimate.

16. The method as recited in claim 7, further comprising:

in response to receiving a request to resell a resource instance reservation, setting by the resource manager implemented on the one or more computing devices, the interruptibility property of a selected resource instance of the plurality of resource instances to the first interruptibility level.

17. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more hardware processors causes the one or more hardware processors to:

in response to an approval of an interruptibility upgrade request, modify an interruptibility property of a resource instance allocated to a client from a first interruptibility level to a second interruptibility level, wherein the interruptibility property defines conditions under which access to a resource instance with an ongoing reservation may be revoked, wherein the first interruptibility level allows a revocation of the client'"'"'s access to the resource instance without an access revocation notification; and

in accordance with the second interruptibility level, allow the client to retain access to the resource instance for at least a specified time period,

wherein the same resource instance is allocated to the client at the first interruptibility level and the second interruptibility level.

18. The storage medium as recited in claim 17, wherein the instructions when executed on the one or more processors:

determine a first usage amount for use of the resource by the client based at least in part on an interruptible instance usage amount rate; and

determine a second usage amount for use of the resource by the client based at least in part on a non-interruptible instance usage amount rate.

19. The storage medium as recited in claim 18, wherein the instructions when executed on the one or more processors:

determine the first usage amount based at least in part on a duration for which the interruptibility property of the resource is set to the first interruptibility level; and

determine the second usage amount based at least in part on a duration for which the interruptibility property of the resource is set to the second interruptibility level.

20. The storage medium as recited in claim 18, wherein the instructions when executed on the one or more processors:

assign one or more resource instances of the plurality of resource instances to a pool of available resource instances, based at least in part on a determination that the one or more resource instances are not in use;

select the resource instance from the pool of available resource instances for allocation to the client; and

determine the interruptible instance usage amount rate based at least in part on a current size of the pool of available resource instances.

21. The storage medium as recited in claim 17, wherein the instructions when executed on the one or more processors:

in response to receiving the interruptibility upgrade request from the client, determine whether to approve the interruptibility upgrade request based at least in part on (a) a current size of the pool of available resource instances and (b) an estimate of a number of resource instances needed to fulfill resource instance reservations.

22. The storage medium as recited in claim 17, wherein the instructions when executed on the one or more processors:

in response to receiving the interruptibility upgrade request from the client, determine whether to approve the interruptibility request based at least in part on an estimate of a rate of expected instance acquisition requests for on-demand resource instances.

23. The storage medium as recited in claim 18, wherein the instructions when executed on the one or more processors:

send an access revocation notice to the client; and

refrain from interrupting the resource instance for at least the specified time interval subsequent to the access revocation notice being sent to the client.

24. The storage medium as recited in claim 17, wherein the instructions when executed on the one or more processors:

in response to a second instance acquisition request from a second client, wherein the second instance acquisition request includes an indication of a preference for the second interruptibility level, allocating a second resource instance of the plurality of resource instances to the second client, wherein the interruptibility property of the second resource instance is set to the second interruptibility level.

25. The storage medium as recited in claim 17, wherein the specified time period includes a time period after an access revocation notification is transmitted to the client.