Producer system selection

• US 9,843,631 B2
• Filed: 06/26/2013
• Issued: 12/12/2017
• Est. Priority Date: 06/26/2013
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Parakh, Vishal, Gilman, Timothy Allen, Kanawati, Antoun Joubran, Karnik, Mukul Vijay, Vincent, Pradeep
• Primary Examiner(s): Cheema, Umar
• Assistant Examiner(s): Fan, John
• Application Number:
  US13/927,933
• Publication Number:
  US 20150006728A1
• Time in Patent Office: 1,630 Days
• Field of Search: None
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1025 Dynamic adaptation of the criteria on which the server selection is based

Abstract

Processes and systems are disclosed for selecting a producer system from a number of producer systems to lease to a consumer system. A leasing agent, in response to a request from the consumer system for access to a service at a producer system, can identify a producer system to lease to the lease requestor based, at least in part, on a selection weight associated with each producer system that the leasing agent is assigned. The selection weights can be modified based on status information associated with each of the producer systems. This status information may be obtain from the producer systems and/or from a consumer system that has previously accessed the producer system. The consumer system may provide the status information to the leasing agent as part of the consumer system'"'"'s lease request.

Claims

1. A method for selecting a producer system from a plurality of producer systems to provide access to a service, the method comprising:

by a first leasing agent system comprising one or more servers configured to allocate resource requests from a plurality of consumer systems across the plurality of producer systems, wherein individual producer systems of the plurality of producer systems comprise one or more servers configured to provide computing resources;

receiving status information sent from a first consumer system of the plurality of consumer systems to the first leasing agent system, the status information indicative of at least one of a response time associated with a first producer system of the plurality of producer systems, a number of consumer systems serviced by the first producer system, available resources associated with the first producer system, an error rate associated with the first producer system, or a resource utilization associated with the first producer system, wherein individual producer systems of the plurality of producer systems are associated with a selection weight, and wherein at least some of the status information reflects a determination of a status of at least one producer system by at least one consumer system;

modifying, by the first leasing agent system, producer status information associated with the plurality of producer systems based, at least in part, on the at least one of the response time associated with the first producer system of the plurality of producer systems, the number of consumer systems serviced by the first producer system, the available resources associated with the first producer system, the error rate associated with the first producer system, or the resource utilization associated with the first producer system indicated by the status information received from the first consumer system, the modified producer status information comprising a set of metrics relating to a performance of the plurality of producer systems with respect to interacting with the plurality of consumer systems;

determining whether the modified producer status information indicates a change in a load metric associated with the first producer system;

in response to determining that the modified producer status information indicates a change in the load metric associated with the first producer system, modifying a first selection weight associated with the first producer system based, at least in part, on the change indicated by the modified producer status information;

receiving a request from a second consumer system different from the first consumer system to obtain network access to one of the plurality of producer systems; and

in response to receiving the request to obtain network access to one of the plurality of producer systems;

selecting a producer system from the plurality of producer systems based, at least in part, on the corresponding modified selection weights associated with the plurality of producer systems to service the second consumer system;

providing an identity of the selected producer system to the second consumer system that provided the request to obtain network access to one of the plurality of producer systems; and

providing producer status information associated with the selected producer system to the second consumer system, wherein at least some of the producer status information is obtained from the first consumer system.

2. The method of claim 1, wherein the plurality of producer systems comprises a subset of producer systems.

3. The method of claim 1, wherein modifying the selection weights associated with the plurality of producer systems alters a probability that said selecting the producer system selects a specific producer system.

4. The method of claim 1, wherein the at least one producer system is assigned to a leasing agent system other than the first leasing agent system.

5. The method of claim 1, wherein the first consumer system is different from the second consumer system.

6. The method of claim 1, further comprising receiving status information associated with the plurality of producer systems from the plurality of producer systems.

7. The method of claim 1, further comprising receiving status information associated with the plurality of producer systems from a second leasing agent system.

8. The method of claim 1, further comprising:

determining for the first producer system from the plurality of producer systems whether a corresponding modified selection weight satisfies a removal threshold; and

in response to the modified selection weight satisfying the removal threshold, removing an identity of the first producer system from a list of available producer systems, the list of available producer systems comprising identities of available producer systems corresponding to producer systems from the plurality of producer systems that are available for selection.

9. The method of claim 8, wherein said selecting the producer system from the plurality of producer systems comprises selecting the producer system from the list of available producer systems.

10. The method of claim 8, further comprising:

tracking a count of producer systems removed from the list of available producer systems; and

in response to the count satisfying a reduction threshold, repartitioning the available producer systems among a plurality of leasing agent systems, the plurality of leasing agent systems including the first leasing agent system.

11. The method of claim 8, wherein the removal threshold is based on an average value of the load metric for the plurality of producer systems.

12. The method of claim 1, wherein the producer status information provided to the second consumer system comprises an independent set of producer status information available to the first leasing agent system, and wherein the independent set of producer status information enables the second consumer system to select from a plurality of leased producer systems a less utilized producer system compared to the other leased producer systems.

13. The method of claim 1, wherein selecting the producer system from the plurality of producer systems further comprises selecting one of a first set of producer systems with a lower load than a second set of producer systems.

14. The method of claim 13, wherein the selected producer system is not associated with a lowest load thereby reducing a frequency of occurrence of load oscillations.

15. A system for selecting a producer system from a plurality of producer systems to provide access to a service, the system comprising:

a first leasing agent of a plurality of leasing agents, the first leasing agent comprising one or more processors configured to allocate resource requests from a plurality of consumer systems across the plurality of producer systems, wherein individual producer systems of the plurality of producer systems comprise one or more processors configured to provide computing resources, the first leasing agent configured to;

receive status information sent from a first consumer system of the plurality of consumer systems to the first leasing agent, the status information indicative of at least one of a response time associated with a first producer system, a number of consumer systems serviced by the first producer system, available resources associated with the first producer system, an error rate associated with the first producer system, or a resource utilization associated with the first producer system, wherein individual producer systems from the plurality of producer systems are associated with a selection weight;

modify producer status information associated with the plurality of producer systems based, at least in part, on the at least one of the response time associated with the first producer system of the plurality of producer systems, the number of consumer systems serviced by the first producer system, the available resources associated with the first producer system, the error rate associated with the first producer system, or the resource utilization associated with the first producer system indicated by the status information received from the first consumer system, the modified producer status information comprising a set of metrics relating to a performance of the plurality of producer systems with respect to interacting with the plurality of consumer systems;

determine whether modified producer status information indicates a change in a load metric associated with the first producer system;

in response to determining that the modified producer status information indicates a change in the load metric associated with the first producer system, modify the selection weight associated with the first producer system based, at least in part, on the change indicated by the modified producer status information;

receive a request to access one of the plurality of producer systems from a second consumer system; and

select a producer system from the plurality of producer systems including the first producer system, based, at least in part, on the corresponding selection weight associated with individual producer systems of the plurality of producer systems to service the second consumer system.

16. The system of claim 15, wherein the first consumer system is different from the second consumer system.

17. The system of claim 15, wherein the first leasing agent is further configured to:

determine whether the first producer system is assigned to the first leasing agent; and

in response to determining that the first producer is not assigned to the first leasing agent, the first leasing agent is further configured to;

identify a second leasing agent assigned to the first producer; and

provide the received status information to the second leasing agent.

18. The system of claim 15, wherein the first leasing agent is further configured to:

determine whether the modified selection weight satisfies a removal threshold; and

disassociate the first producer system from the plurality of producer systems in response to the modified selection weight satisfying the removal threshold.

19. The system of claim 18, wherein the first leasing agent further comprises a partitioning system configured to repartition the plurality of producer systems among the plurality of leasing agents in response to a number of producer systems disassociated from the plurality of producer systems satisfying a reduction threshold.

20. The system of claim 15, wherein the leasing system is further configured to provide an identity of the producer system to the second consumer system that provided the request to access one of the plurality of producer systems.

21. The system of claim 15, wherein the selected producer system comprises the first producer system.

22. Non-transitory physical computer storage comprising computer-executable instructions that, when implemented in one or more processors, direct a computing system to select a producer system from a plurality of producer systems to provide computing resources by at least:

in response to receiving status information associated with a first producer system of the plurality of producer systems and sent from a first consumer system to a first leasing agent, determining whether the first producer system is a member of a first subset of producer systems, the first subset of producer systems associated with the first leasing agent, the status information comprising at least one of a response time associated with the first producer system, a number of consumer systems serviced by the first producer system, available resources associated with the first producer system, an error rate associated with the first producer system, or a resource utilization associated with the first producer system, wherein individual producer systems from the plurality of producer systems are associated with a selection weight, the plurality of producer systems partitioned into a number of subsets of producer systems;

modifying, by the first leasing agent, producer status information associated with the plurality of producer systems based, at least in part, on the at least one of the response time associated with the first producer system of the plurality of producer systems, the number of consumer systems serviced by the first producer system, the available resources associated with the first producer system, the error rate associated with the first producer system, or the resource utilization associated with the first producer system indicated by the status information received from the first consumer system, the modified producer status information comprising a set of metrics relating to a performance of the plurality of producer systems with respect to interacting with the plurality of consumer systems;

in response to determining that the first producer system is a member of the first subset of producer systems and determining that the modified producer status information indicates a change in the load metric associated with the first producer system, modifying the selection weight associated with the first producer system; and

in response to receiving a request to access a producer system from a second consumer system, selecting a second producer system from the first subset of producer systems based, at least in part, on the selection weights associated with the producer systems from the subset of producer systems to service the second consumer system.

23. The non-transitory physical computer storage of claim 22, wherein the second producer system and the first producer system are the same.

24. The non-transitory physical computer storage of claim 22, wherein, in response to determining that the first producer system is not a member of the first subset of producer systems, the method further comprises:

identifying a second subset of producer systems that includes the first producer system;

identifying a second leasing agent associated with the second subset of producer systems; and

providing the status information to the second leasing agent.