Autonomous upgrade of deployed resources in a distributed computing environment

• US 10,318,279 B2
• Filed: 05/30/2017
• Issued: 06/11/2019
• Est. Priority Date: 05/30/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Mohammed, Yunus, Patwa, Pritesh, Door, Gregory Marvin, Reddy, Ravikiran Janardhan, Zimmerman, Sean David, Tian, Xiaoxiong, Burela, Phani Soma Shekar, Russinovich, Mark Eugene
• Primary Examiner(s): Keller, Michael A
• Assistant Examiner(s): Moreau, Austin J
• Application Number:
  US15/608,871
• Publication Number:
  US 20180349130A1
• Time in Patent Office: 742 Days
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3055 Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction by redundancy in operation G06F11/14; error detection or correction by redundancy in hardware G06F11/16
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 8/63 Image based installation; Cloning; Build to order
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 8/656 while running
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: H04L 41/082 the condition being updates or upgrades of network functionality
• CPC Class Codes: H04L 41/0886 Fully automatic configuration
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 43/0805 by checking availability
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 63/00 Network architectures or network communication protocols for network security cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00; network architectures or network communication protocols for wireless network security H04W12/00; security arrangements for protecting computers or computer systems against unauthorised activity G06F21/00
• CPC Class Codes: H04L 67/34 : involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/61 : taking into account QoS or priority requirements
• CPC Class Codes: H04L 67/62 : Establishing a time schedule for servicing the requests

Abstract

Various methods and systems for autonomously upgrading deployed resources in a distributed computing environment are provided. An autonomous upgrade system identifies updates such as operating system image updates and virtual machine extension updates for deployment in the distributed computing environment. The autonomous upgrade system identifies eligible tenants, identifies deployed resources that may be impacted by the identified update, batches the resources and upgrades the batched resources. The autonomous upgrade system performs a diagnostic test on upgraded resources to determine whether an upgrade was successful. In some embodiments, the diagnostic test is performed by executing a diagnostic script that can be provided by a tenant. The autonomous upgrade system can stop or pause the upgrade if various success metrics are not satisfied. In some embodiments, the autonomous upgrade system tests and certifies newly published updates for deployment to the distributed computing environment.

Claims

1. A system for implementing autonomous upgrade of distributed computing machines, the system comprising:

a certification component configured to;

access a published update to a first computer file, wherein the first computer file supports operating one or more applications;

deploy the published update to a first computing machine in a test environment, wherein the first computing machine is configured to use the first computer file to support operating one or more first applications when running in the test environment;

monitor a health of the one or more first applications on the first computing machine to determine whether the published update was successfully deployed to the first computing machine; and

certify the published update when the published update was successfully deployed to the first computing machine;

an upgrade manager component configured to;

identify a certified update to a second computer file for deployment in a distributed computing environment, wherein the second computer file supports operating one or more applications;

identify in the distributed computing environment a tenant infrastructure having one or more second computing machines configured to use the second computer file to support operating one or more second applications when running in the distributed computing environment;

access a tenant upgrade profile for the tenant infrastructure, wherein the tenant upgrade profile instructs on an upgrade process and one or more availability requirements for the tenant infrastructure;

batch the one or more second computing machines into one or more batches in accordance with the tenant upgrade profile,

deploy the certified update to at least one of the batched computing machines;

perform a diagnostic test, in accordance with the tenant upgrade profile, on the one or more second applications on at least one batched computing machine to determine whether the certified update was successfully deployed to the at least one batched computing machine; and

an interface component configured to;

communicate a notification indicating a status of deploying the certified update to the at least one batched computing machine.

2. The system of claim 1, wherein the upgrade process is configured to instruct on at least one of how to upgrade the tenant infrastructure using the one or more availability requirements or how to determine a successful deployment.

3. The system of claim 1, wherein the upgrade process includes an executable diagnostic script configured to implement one or more diagnostic rules to diagnose a health of one or more upgraded resources in the tenant infrastructure during the diagnostic test.

4. The system of claim 1, wherein the upgrade manager component is additionally configured to halt a tenant upgrade workflow based on at least one of one or more tenant upgrade metrics or one or more regional characteristics of the batched computing machines.

5. The system of claim 1, wherein the upgrade manager component is additionally configured to deploy the certified update by providing a threshold time, within which a tenant can trigger deploying the certified update, and after expiration of the threshold time, the certified update is configured to deploy automatically.

6. The system of claim 1, wherein the tenant upgrade profile comprises a tenant context comprising at least an indication of what resources have been deployed in the tenant infrastructure and the one or more availability requirements, and wherein the upgrade manager component is configured to deploy the certified update based on the tenant context.

7. The system of claim 1, wherein the first and second computer files are operating system images.

8. A computer-implemented method for providing autonomous upgrade of distributed computing machines, the method comprising:

identifying an update to a computer file for deployment in a distributed computing environment, wherein the computer file supports operating one or more applications;

identifying in the distributed computing environment a tenant infrastructure having one or more computing machines configured to use the computer file to support operating one or more applications when running in the distributed computing environment;

accessing a tenant upgrade profile for the tenant infrastructure, wherein the tenant upgrade profile instructs on an upgrade process and one or more availability requirements for the tenant infrastructure;

batching the one or more computing machines into one or more batches in accordance with the tenant upgrade profile,

deploying the certified update to at least one of the batched computing machines;

performing a diagnostic test, in accordance with the tenant upgrade profile, on the one or more applications on at least one batched computing machine to determine whether the certified update was successfully deployed to the at least one batched computing machine; and

communicating a notification indicating a status of deploying the certified update to the at least one batched computing machine.

9. The method of claim 8, wherein the upgrade process instructs on at least one of how to upgrade the tenant infrastructure using the one or more availability requirements or how to determine a successful deployment.

10. The method of claim 8, wherein the upgrade process includes an executable diagnostic script configured to implement one or more diagnostic rules to diagnose a health of one or more upgraded resources in the tenant infrastructure during the diagnostic test.

11. The method of claim 8, additionally comprising halting a tenant upgrade workflow based on one or more tenant upgrade metrics.

12. The method of claim 8, wherein the tenant upgrade profile comprises a tenant context comprising at least an indication of what resources have been deployed in the tenant infrastructure and the one or more availability requirements, and wherein the deploying the certified update is based on the tenant context.

13. The method of claim 8, additionally comprising halting a roll out based on telemetry for the roll out, the telemetry indicating a percentage of failed deployments across all participating tenants.

14. The method of claim 8, wherein the computer file is an operating system image.

15. One or more computer storage media having computer-executable instructions embodied thereon that, when executed, by one or more processors, causes the one or more processors to perform a method for providing autonomous upgrade of distributed computing machines, the method comprising:

accessing a published update to a computer file, wherein the computer file supports operating one or more applications;

deploying the published update to a first computing machine in a test environment, wherein the first computing machine is configured to use the computer file to support operating one or more first applications when running in the test environment;

monitoring a health of the one or more first applications on the first computing machine to determine whether the published update was successfully deployed to the first computing machine;

certifying the published update when the published update was successfully deployed to the first computing machine;

identifying in a distributed computing environment a tenant infrastructure having one or more second computing machines configured to use the computer file to support operating one or more second applications when running in the distributed computing environment;

accessing a tenant upgrade profile for the tenant infrastructure, wherein the tenant upgrade profile is configured to instruct on an upgrade process and one or more availability requirements for the tenant infrastructure;

batching the one or more second computing machines into one or more batches in accordance with the tenant upgrade profile,

deploying the certified update to at least one of the batched computing machines;

performing a diagnostic test, in accordance with the tenant upgrade profile, on the one or more second applications on at least one batched computing machine to determine whether the certified update was successfully deployed to the at least one batched computing machine; and

communicating a notification indicating a status of deploying the certified update to the at least one batched computing machine.

16. The media of claim 15, wherein the upgrade process is configured to instruct on at least one of how to upgrade the tenant infrastructure using the one or more availability requirements or how to determine a successful deployment.

17. The media of claim 15, wherein the upgrade process includes an executable diagnostic script configured to implement one or more diagnostic rules to diagnose a health of one or more upgraded resources in the tenant infrastructure during the diagnostic test.

18. The media of claim 15, wherein the tenant upgrade profile comprises a tenant context comprising at least an indication of what resources have been deployed in the tenant infrastructure and the one or more availability requirements, and wherein the deploying the certified update is based on the tenant context.

19. The media of claim 15, the method additionally comprising halting a tenant upgrade workflow based on one or more regional characteristics of the batched computing machines.

20. The media of claim 15 the method additionally comprising halting a roll out based on telemetry for the roll out, the telemetry indicating a percentage of failed deployments across all participating tenants.