Instance selection ordering policies for network-accessible resources

• US 9,246,986 B1
• Filed: 05/21/2012
• Issued: 01/26/2016
• Est. Priority Date: 05/21/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Ward, David John Jr., Grit, Laura Ellen, Nunnerley, David
• Primary Examiner(s): Hussain, Tauqir
• Application Number:
  US13/476,828
• Time in Patent Office: 1,345 Days
• Field of Search: 709/226
• US Class Current: 1/1
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: H04L 12/1485 Tariff-related aspects
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0897 by horizontal or vertical scaling of resources, or by migrating entities, e.g. virtual resources or entities
• CPC Class Codes: H04L 41/5029 Service quality level-based billing, e.g. dependent on measured service level customer is charged more or less
• CPC Class Codes: H04L 47/00 Traffic control in data switching networks arrangements for detecting or preventing errors in the information received H04L1/00
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04M 15/765 Linked or grouped accounts, e.g. of users or devices
• CPC Class Codes: H04M 15/7652 shared by users
• CPC Class Codes: H04M 15/80 Rating or billing plans; Tariff determination aspects
• CPC Class Codes: H04M 15/8083 involving reduced rates or discounts, e.g. time-of-day reductions or volume discounts
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

Methods and apparatus for supporting instance ordering selection policies (ISOPs) for network-accessible resources are disclosed. A system includes a plurality of resource instances of a provider network, and a resource manager. The resource manager assigns an ISOP to be used to respond to instance acquisition requests of a specified type from a particular client. In response to a request of the specified type from the client, the resource manager determines, based at least in part on the ISOP, an order in which a plurality of resource groups (such as a set of instances reservations of the client, or an instance marketplace accessible to multiple clients) is to be examined to obtain an instance for the client. Starting with a first resource group, the resource manager examines each resource group until an instance matching instance selection criteria specified in the request is found.

Claims

1. A system, comprising:

a plurality of computing devices configured to implement a plurality of resource instances of a provider network; and

one or more computing devices configured to implement a resource manager;

wherein the resource manager is configured to;

assign, based at least in part on one or more instance selection ordering priorities specified by a user or as a default setting, an instance selection ordering policy to be used to respond to instance acquisition requests of a specified type from a particular client; and

in response to an instance acquisition request of the specified type from the particular client, comprising one or more instance selection criteria;

determine, based at least in part on the instance selection ordering policy, an order in which a plurality of resource groups is to be examined to obtain an instance for the particular client, wherein the plurality of resource groups includes (a) a set of instance reservations assigned to an account associated with the particular client, and (b) a particular marketplace of one or more marketplaces of resource instances of the provider network accessible to multiple clients including the particular client;

starting with a first resource group in the order determined at least in part on the policy, examine each resource group of the plurality of resource groups until an instance matching the one or more instance selection criteria is found; and

activate in the provider network the found instance for use by the particular client, wherein the found instance is found in accordance with the assigned instance selection ordering policy.

2. The system as recited in claim 1, wherein the type of the instance acquisition request is determined based at least in part on an indication in the instance acquisition request of a pricing policy intended to be used to pay for a requested instance, wherein the pricing policy comprises one of:

a dynamic spot-pricing policy, an on-demand pricing policy, and a reserved instance pricing policy.

3. The system as recited in claim 1, wherein the type of the instance acquisition request is determined based at least in part on an application programming interface used for the instance acquisition request.

4. The system as recited in claim 1, wherein the one or more marketplaces comprise at least one of:

a spot instance marketplace, an on-demand instance marketplace, or a reserved instance marketplace.

5. The system as recited in claim 1, wherein the resource manager is further operable to:

in response to finding an instance that matches the one or more selection criteria, wherein the found instance is in the set of instance reservations assigned to an account associated with the particular client, wherein the found instance is allocated to a different client at the time that it is found, revoke access by the different client to the found instance.

6. The system as recited in claim 1, wherein the instance selection ordering policy comprises an indication of at least one of (a) a request prioritization protocol to be used to schedule pending instance acquisition requests or (b) a retention prioritization protocol to be used to select which particular instance allocation, among a plurality of interruptible instance allocations found in response to the instance acquisition request, is to be interrupted.

7. A method, comprising:

determining, based at least in part on a request comprising one or more instance selection ordering priorities or based on one or more default settings, an instance selection ordering policy to be used to respond to instance acquisition requests;

receiving an instance acquisition request of a particular type from a particular client, wherein the request comprises one or more instance selection criteria; and

in response to the instance acquisition request,

determining, based at least in part on the instance selection ordering policy and the particular type of instance acquisition request, an order in which a plurality of resource groups is to be examined to obtain an instance for the particular client;

starting with a first resource group in the order determined at least in part on the policy, examining each resource group of the plurality of resource groups until an instance matching the one or more selection criteria is found; and

activating the found instance for use by the particular client, wherein the found instance is found in accordance with the instance selection ordering policy.

8. The method as recited in claim 7, wherein the type of the instance acquisition request is determined based at least in part on an indication in the instance acquisition request of a pricing policy intended to be used to pay for a requested instance, wherein the pricing policy comprises one of:

a dynamic spot-pricing policy, an on-demand pricing policy, and a reserved instance pricing policy.

9. The method as recited in claim 7, further comprising:

implementing a plurality of application programming interface calls allowing clients to submit instance acquisition requests; and

determining the type of the instance acquisition request received from the particular client based at least in part on the particular application programming interface call of the plurality of application programming interface calls used for the instance acquisition request.

10. The method as recited in claim 7, wherein the plurality of resource groups comprises at least one of:

a set of instance reservations of the particular client currently not in use by the particular client, a spot instance marketplace, an on-demand instance marketplace, or a reserved instance marketplace.

11. The method as recited in claim 7, wherein the resource manager is further operable to:

in response to finding an instance that matches the one or more selection criteria in a resource group comprising a set of instance reservations assigned to an account associated with the particular client, wherein the found instance is allocated to a different client at the time that it is found, revoking access by the different client to the found instance.

12. The method as recited in claim 7, wherein the instance selection ordering policy comprises an indication of a request prioritization protocol to be used to schedule pending instance acquisition requests.

13. The method as recited in claim 7, wherein the instance selection ordering policy comprises an indication of a retention prioritization protocol to be used to select which particular instance allocation, among a plurality of interruptible instance allocations found in response to the instance acquisition request, is to be interrupted.

14. The method as recited in claim 7, further comprising:

implementing one or more programmatic interfaces to allow a client to specify an instance selection ordering policy to be used for instance acquisition requests from the client; and

receiving an indication of the instance selection ordering policy from the particular client in accordance with an interface of the one or more programmatic interfaces.

15. The method as recited in claim 7, further comprising:

linking a first account of the particular client to a second account of a second client to allow a resource group comprising instance reservations assigned to the second client to be used to implement the instance selection ordering policy.

16. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:

receive an instance acquisition request from a particular client; and

in response to the instance acquisition request,

determine, based at least in part on a request type of the instance acquisition request, whether a particular instance selection ordering policy is to be used to obtain an instance for the particular client;

in response to determining that the particular instance selection policy is to be used, examine a set of resource groups in a sequence specified in the particular instance selection policy to obtain an instance for the particular client; and

activate the obtained instance for use by the particular client.

17. The storage medium as recited in claim 16, wherein the request type of the instance acquisition request is determined based at least in part on an indication in the instance acquisition request of a pricing policy intended to be used to pay for a requested instance, wherein the pricing policy comprises one of:

a dynamic spot-pricing policy, an on-demand pricing policy, and a reserved instance pricing policy.

18. The storage medium as recited in claim 16, wherein the instructions when executed on the one or more processors:

implement a plurality of application programming interface calls allowing clients to submit instance acquisition requests; and

determine the request type of the instance acquisition request received from the particular client based at least in part on the particular application programming interface call of the plurality of application programming interface calls used for the instance acquisition request.

19. The storage medium as recited in claim 16, wherein the set of resource groups comprises at least one of:

a set of instance reservations of the particular client currently not in use by the particular client, a spot instance marketplace, an on-demand instance marketplace, or a reserved instance marketplace.

20. The storage medium as recited in claim 16, wherein the instructions when executed on the one or more processors:

in response to finding an instance that matches one or more selection criteria specified in the instance acquisition request within a resource group comprising a set of instance reservations assigned to an account associated with the particular client, wherein the found instance is allocated to a different client at the time that it is found, revoking access by the different client to the found instance.

21. The storage medium as recited in claim 16, wherein the particular instance selection ordering policy comprises an indication of a request prioritization protocol to be used to schedule pending instance acquisition requests.

22. The storage medium as recited in claim 21, wherein the request prioritization protocol comprises using a bid value included in an instance acquisition request to assign a scheduling priority to the instance acquisition request.

23. The storage medium as recited in claim 21, wherein the request prioritization protocol comprises assigning a scheduling priority to an instance acquisition request based on a position within a job queue of a computation job associated with the instance acquisition request.

24. The storage medium as recited in claim 16, wherein the particular instance selection ordering policy comprises an indication of a retention prioritization protocol to be used to select which particular instance allocation, among a plurality of interruptible instance allocations found in response to the instance acquisition request, is to be interrupted.

25. The storage medium as recited in claim 16, wherein the instance acquisition request comprises one or more instance selection criteria to be used in obtaining the instance for the particular client, including one or more of:

(a) an instance performance capability requirement (b) an instance location requirement (c) a maximum price the particular client is willing to pay for the instance or (d) a software stack requirement.