Managing update deployment

• US 9,229,902 B1
• Filed: 02/14/2013
• Issued: 01/05/2016
• Est. Priority Date: 02/14/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Leis, Benjamin Alan, Li, Gang, Thomas, Nathan Bartholomew
• Primary Examiner(s): Donaghue, Larry
• Application Number:
  US13/767,714
• Time in Patent Office: 1,055 Days
• Field of Search: 709/221
• US Class Current: 1/1
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: H04L 41/0654 using network fault recovery ring fault isolation or reconfiguration in loop networks without recovery actions by a network management system H04L12/437
• CPC Class Codes: H04L 41/082 the condition being updates or upgrades of network functionality
• CPC Class Codes: H04L 41/0866 Checking the configuration
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Systems and methods for managing deployment of an update to computing devices, and for diagnosing issues with such deployment, are provided. An update deployment manager determines one or more initial computing devices to receive and execute an update. The update deployment manager further monitors a set of performance metrics with respect to the initial computing devices or a collection of computing devices. If a deployment issue is detected based on the monitored metrics, the update deployment manager may attempt to diagnosis the deployment issue. For example, the update deployment manager may determine that a specific characteristic of computing devices is associated with the deployment issue. Thereafter, the update deployment manager may modify future deployment based on the diagnosis (e.g., to exclude computing devices likely to experience the deployment issue).

Claims

1. A computer-implemented method for managing update deployment, the method comprising:

obtaining a software update to be deployed on a plurality of computing devices according to a deployment schedule, and a set of criteria for determination of deployment issues in response to deployment of the software update;

causing the deployment of the software update to a first set of computing devices of the plurality of computing devices;

determining, based on the set of criteria, a likelihood of a deployment issue on at least one computing device of the first set of computing devices, wherein a deployment issue corresponds to at least one of (i) a failure to implement the software update by the at least one computing device and (ii) a decline in a performance metric associated with the at least one computing device;

in response to an attempted determination of a correlation between the determined deployment issue and a set of characteristics of the at least one computing device, deploying the software update to a second set of computing devices of the plurality of computing devices;

detecting a correlation between the determined deployment issue and the set of characteristics of the at least one computing device based at least in part on characteristic information of the first and second sets of computing devices; and

modifying the deployment schedule to exclude one or more computing devices of the plurality of computing devices that conform to the set of characteristics.

2. The computer-implemented method of claim 1, wherein the software update comprises at least one of an application, an operating system, a driver, a module, a script, and a configuration.

3. The computer-implemented method of claim 1, wherein the set of characteristics of the at least one computing device comprises at least one of a configuration of the at least one computing device, statistical information corresponding to the at least one computing device, a location of the at least one computing device, environmental information regarding the at least one computing device, or a classification of the at least one computing device.

4. The computer-implemented method of claim 1, wherein detecting a correlation between the determined deployment issue and the set of characteristics of the at least one computing device is based at least in part on characteristics of each of the first set of computing devices.

5. The computer-implemented method of claim 1, wherein detecting a correlation between the determined deployment issue and the set of characteristics of the at least one computing device is based at least in part on characteristics of the second set of computing devices.

6. The computer-implemented method of claim 1, wherein the second set of computing devices is determined based at least in part on the set of characteristics.

7. A system for managing update deployment, the system comprising:

one or more processors configured to;

obtain a software update to be deployed on a plurality of computing devices according to a deployment schedule, and a set of criteria for detection of deployment issues in response to deployment of the software update, wherein deployment of the software update on individual computing devices is associated with a target result;

cause deployment of the software update to a set of computing devices of the plurality of computing devices;

determine, based on the set of criteria, a deployment issue on at least one computing device of the set of computing devices, wherein a deployment issue corresponds to failing to achieve the target result on the at least one computing device;

detect a correlation between the determined deployment issue and a set of characteristics of the at least one computing device based at least in part on characteristic information of the set of computing devices; and

modify the deployment schedule to exclude one or more computing devices of the plurality of computing devices that conform to the set of characteristics.

8. The system of claim 7, wherein the one or more processors are configured to determine a deployment issue based at least in part on a determination that the performance metric has fallen below a predetermined threshold.

9. The system of claim 7, wherein the one or more processors are configured to detect a correlation between the determined deployment issue and one or more characteristics of the at least one computing device based at least in part on characteristics of each of the set of computing devices.

10. The system of claim 7, wherein the correlation is detected according to a heuristic algorithm.

11. The system of claim 7, wherein the correlation is detected at a statistical confidence level exceeding a predetermined threshold.

12. The system of claim 7, wherein the one or more processors are further configured to:

attempt to detect a correlation between the determined deployment issue and the set of characteristics of the at least one computing device;

determine that additional information is required to detect the correlation; and

deploy the software update to a second set of computing devices of the plurality of computing devices,

wherein the one or more processors are further configured to detect a correlation between the determined deployment issue and set of characteristics of the at least one computing device based at least in part on characteristics of the second set of computing devices.

13. The system of claim 7, wherein the one or more processors are further configured to transmit a notification that a deployment issue has been detected.

14. The system of claim 13, wherein the notification indicates that a correlation between the determined deployment issue and the one or more characteristics has been determined.

15. A non-transitory computer readable medium comprising computer-executable modules for managing update deployment, the modules comprising:

a deployment module that, when executed by a processor, causes the processor to;

cause deployment of a software update to a first set of computing devices within a plurality of computing devices intended to receive the software update;

determine a deployment issue on at least one computing device of the set of computing devices;

detect a correlation between the determined deployment issue and a set of characteristics of the at least one computing device based at least in part on characteristic information of the set of computing devices; and

modify future deployment of the software update to exclude one or more computing devices of the plurality of computing devices that conform to the set of characteristics.

16. The non-transitory computer readable medium of claim 15, wherein the performance metric comprises at least one of response time, response failures, dropped packets, ping failures, error rate, network bandwidth, central processing unit use, random access memory use, or power consumption.

17. The non-transitory computer readable medium of claim 15, wherein the set of performance metrics are determined based at least in part on a service level agreement associated with a service provided by a computing device.

18. The non-transitory computer readable medium of claim 15, wherein the deployment module, when executed by a processor, causes the processor to detect the correlation between the determined deployment issue and the set of characteristics based at least in part on characteristics of the set of computing devices.

19. The non-transitory computer readable medium of claim 15, wherein the correlation is detected at a statistical confidence level exceeding a predetermined threshold.

20. The non-transitory computer readable medium of claim 15, wherein the deployment module, when executed by a processor, further causes the processor to:

attempt to detect a correlation between the determined deployment issue and the set of characteristics of the at least one computing device;

determine that additional information is required to detect the correlation; and

deploy the software update to a second set of computing devices of the plurality of computing devices.

21. The non-transitory computer readable medium of claim 19, wherein the second set of computing devices comprises a virtual computing device, and wherein the deployment module, when executed by a processor, further causes the processor to instantiate the virtual computing device.

22. A computer-implemented method for managing update deployment, the method comprising:

obtaining a software update to be deployed on a plurality of computing devices;

deploying the software update to a set of computing devices of the plurality of computing devices;

determining a deployment issue on at least one computing device of the set of computing devices;

detecting a correlation between the determined deployment issue and a set of characteristics of the at least one computing device based at least in part on characteristic information of the set of computing devices; and

modifying further deployment of the software update to exclude one or more computing devices of the plurality of computing devices that conform to the set of characteristics.

23. The method claim 22, wherein detecting a correlation between the determined deployment issue and the set of characteristics is based at least in part on characteristics of the set of computing devices.

24. The method claim 22 further comprising:

attempting to detect a correlation between the determined deployment issue and the set of characteristics of the at least one computing device;

determining that additional information is required to detect the correlation; and

deploying the software update to a second set of computing devices of the plurality of computing devices.

25. The method claim 23, wherein detecting a correlation between the determined deployment issue and the set of characteristics is based at least in part on characteristics of the second set of computing devices.