BACKGROUND PROCESSES IN UPDATE LOAD BALANCERS OF AN AUTO SCALING GROUP

• US 20160323197A1
• Filed: 04/30/2015
• Published: 11/03/2016
• Est. Priority Date: 04/30/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Guzman, Marcel Robert, Jones, Shawn, Jordan, Norman, Khalid, Ahmed Usman
• Granted Patent: US 10,412,020 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/46 Multiprogramming arrangements
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 47/726 Reserving resources in multiple paths to be used simultaneously by balancing the load H04L47/125

Abstract

A computing resource service provider may provide computing instances organized into logical groups, such as auto-scale groups. Computing instances assigned to an auto-scale group may be associated with one or more load balancers configured to direct traffic to the computing instances. Furthermore, customers of the computing resource service provider may add or remove load balancer from the auto-scale groups. A background process may be used to add and remove computer instances of the auto-scale group form the load balancers customers are attempting to have added or removed.

Claims

1. A computer-implemented method, comprising:

under the control of one or more computer systems configured with executable instructions,

detecting one or more load balancers of a set of load balancers in a transient state, where the transient state indicates that one or more load balancers associated with an auto-scale group requires an update, and where the auto-scale group comprises at least one computer instance;

receiving, from an auto-scale service, a request to initiate an asynchronous workflow configured to update computer instances of the auto-scale group, managed by the auto-scale service, by at least associating the computer instances with at least one load balancer of a set of load balancers assigned to the auto-scale group;

determining one or more computer instances of a set of computer instances of the auto-scale group to be updated based at least in part on the determined one or more load balancers in the transient state;

determining a set of batch operations configured to update an association between the determined one or more computer instances and the determined one or more load balancers in the transient state;

causing the set of batch operations to be executed; and

updating a load balancer database as a result of the set of batch operations being executed.

2. The computer-implemented method of claim 1, wherein determining the set of batch operations configured to update the association between the determined one or more computer instances and the determined one or more load balancers in the transient state further comprises a set of application program interface calls configured to cause the determined one or more computer instances to be assigned the determined one or more load balancers such that the determined one or more load balancers distribute network traffic to the determined one or more computer instances.

3. The computer-implemented method of claim 1, wherein determining the set of batch operations configured to update the association between the determined one or more computer instances and the determined one or more load balancers in the transient state further comprises a set of application program interface calls configured to cause the determined one or more computer instances to be removed from the determined one or more load balancers such that the determined one or more load balancers no longer distribute network traffic to the determined one or more computer instances.

4. The computer-implemented method of claim 1, wherein the computer-implemented method further comprises receiving a second request to initiate an update to computer instances of an auto-scale group and restarting the asynchronous workflow.

5. A system, comprising:

one or more processors; and

memory that includes instructions that, when executed by the one or more processors, cause the system to;

receive a request to initiate a workflow;

fulfil the request by at least by at least;

determining at least one load balancer of a set of load balancers in a transient state;

determining at least one computer instance of a group of computer instances to be assigned to the at least one load balancer in the transient state;

determining operations configured to assign the determined at least one computer instance to the determined at least one load balancer in the transient state; and

cause the determined operations to be executed.

6. The system of claim 5, wherein the instructions that cause the system to determine the at least one load balancer of the set of load balancers in the transient state further include instructions that, when executed by the one or more processors cause the system to:

query a data store for load balancer state information; and

determine the at least one load balancer is in the transient state is based at least in part on a result of the query.

7. The system of claim 6, wherein the memory further includes instructions that, when executed by the one or more processors cause the system to update load balancer state information in the data store based at least in part on a result of the determined operations.

8. The system of claim 5, wherein the memory further includes instructions that, when executed by the one or more processors cause the system to:

receive a second request to initiate a second workflow;

fulfill the second request by at least;

determining a second at least one load balancer of the set of load balancers, where the second at least one load balancer is in a removing state; and

determining a second at least one instance of the group of computer instances to be removed from the at least one load balancer; and

cause additional operations to be executed, where the additional operations are configured to remove the determined second at least one computer instance from the determined second at least one load balancer in the transient state.

9. The system of claim 8, wherein the memory further includes instructions that, when executed by the one or more processors cause the system to determine that the request and the second request would occur concurrently and restart a background process configured to execute the second workflow.

10. The system of claim 5, wherein the instructions that cause the system to cause the determined operations to be executed further include instructions that, when executed by the one or more processors, cause the system to provide the determined operations to a load balancing service.

11. The system of claim 10, wherein causing the determined operations to be executed further comprises application program interface calls to assign the at least one computer instance to the at least one of load balancer.

12. The system of claim 5, wherein the request to initiate the workflow is generated based at least in part on an application program request from a customer to add a particular load balancer to the group of computer instances.

13. A non-transitory computer-readable storage medium having stored thereon executable instructions that, when executed by one or more processors of a computer system, cause the computer system to at least:

determine a set of load balancers to update based at least in part on each load balancer of the set of load balancers being in a transient state by at least querying a data store for information corresponding to load balancers associated with a group of computer instances;

determine a set of computer instances associated with the group of computer instances, where an association between the determined set of computer instances and the determined set of load balancers is to be updated;

determine operations configured to update an association between the determined set of computer instances and the determined set of load balancers;

cause operations to be executed; and

update the data store as a result of the set of operates being executed.

14. The non-transitory computer-readable storage medium of claim 13, wherein the transient state indicates that at least one computer instance of the group of computer instances requires an update to the one or more load balancers in the transient state.

15. The non-transitory computer-readable storage medium of claim 13, wherein the transient state includes at least one of the following states:

adding state, added state, and removing state.

16. The non-transitory computer-readable storage medium of claim 13, wherein the instructions that cause the computer system to generate the operations configured to update the association between the determined set of computer instances and the determined set of load balancers further include instructions that cause the computer system to generate the operations such that, when executed, the operations cause the determined set of computer instances to be deassigned from the determined set of load balancer.

17. The non-transitory computer-readable storage medium of claim 13, wherein the instructions that cause the computer system to generate the operations configured to update the association between the determined set of computer instances and the determined set of load balancers further include instructions that cause the computer system to generate the operations such that, when executed, the operations cause the determined set of computer instances to be assigned from the determined set of load balancer.

18. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to:

receive a request to terminate a background process based at least in part a request to update load balancers associated with the group of computer instances, where the background process is configured to generate the operations; and

reinitiate the background process in order to process the request.

19. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to determine a number of computer instances of the group of computer instances to be updated to include in a particular operation of the operations based at least in part on a computing capacity of a load balancing service.

20. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further comprise instructions that, when executed by the one or more processors, cause the computer system to determine an order of operations based at least in part on information obtained from a load balancing service.