Availability risk assessment, system modeling

• US 9,137,110 B1
• Filed: 08/16/2012
• Issued: 09/15/2015
• Est. Priority Date: 08/16/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Adogla, Eden G., Agarwal, Manish
• Primary Examiner(s): DOAN, DUYEN MY
• Application Number:
  US13/587,879
• Time in Patent Office: 1,125 Days
• Field of Search: 709223-226
• US Class Current: 1/1
• CPC Class Codes: H04L 41/082 the condition being updates or upgrades of network functionality
• CPC Class Codes: H04L 41/0883 Semiautomatic configuration, e.g. proposals from system
• CPC Class Codes: H04L 41/145 involving simulating, designing, planning or modelling of a network

Abstract

Embodiments of the present disclosure are directed to, among other things, determining whether some or all portions of an application stack implemented on a distributed system are vulnerable to availability issues. In some examples, a web service may utilize or otherwise control a client instance to control, access, or otherwise manage resources of a distributed system. Based at least in part on comparing one or more customer graphs with one or more model, curated, or best practice graphs of a distributed system, availability risks and/or deployment recommendations may be provided. Additionally, in some examples, one or more remediation and/or migration operations may be performed automatically or provided as recommendations.

Claims

1. A computer-implemented method for distributed resource management, comprising:

under control of one or more computer systems configured with executable instructions,

receiving a plurality of sets of operational information describing at least one feature of a distributed computing system, each set of operational information from a different distributed computing system;

forming, based at least in part on the received plurality of sets of information, a plurality of sets of model graphs, each set of model graphs associated with each respective different distributed computing system;

generating, based at least in part on information that describes a configuration of computing devices, a customer test graph;

performing a comparison of the customer test graph with at least a subset of each of the sets of model graphs to select an ideal curated graph from at least one of the sets of model graphs that is most similar to the customer graph; and

providing to a user associated with the configuration of computing devices, one or more recommendations based at least in part on the selected ideal curated graph.

2. The computer-implemented method of claim 1, wherein the each of a subset of the plurality of sets of operational information is based at least in part on an application stack.

3. The computer-implemented method of claim 1, further comprising forming, based at least in part on at least a subset of the model graphs of a particular set of model graphs, at least one arbitrary graph for the particular set of model graphs.

4. The computer-implemented method of claim 3, further comprising analyzing at least one of the at least one arbitrary graphs or a model graph of the particular set of model graphs by instantiating a virtual representation of the model graph or the at least one arbitrary graphs within a controlled environment.

5. The computer-implemented method of claim 4, wherein instantiating the virtual representation of the model graph or the at least one arbitrary graphs within the controlled environment includes injecting virtual disruptions into the controlled environment.

6. The computer-implemented method of claim 5, wherein the recommendations provided are further based at least in part on an outcome of at least one of the instantiation or the injection of virtual disruptions.

7. A computer-implemented method for resource availability management, comprising:

under control of one or more computer systems configured with executable instructions,

storing a plurality of sets of best practice graphs, each of the sets of best practice graphs from a respective different distributed computing system;

receiving, from a user of the distributed computing system, information describing a configuration of resources of the distributed system;

comparing a user graph with at least a portion of best practice graphs in at least one subset of the plurality of sets of best practice graphs, the user graph representing the received information describing the configuration of resources;

identifying, based at least in part on the comparison, an ideal best practice graph of the plurality of sets of best practice graphs that most closely matches the user graph; and

providing to the user, based at least in part on the identified ideal best practice graph, information associated with operation of the configuration of resources.

8. The computer-implemented method of claim 7, further comprising receiving each of the sets of best practice graphs from each respective different distributed computing system.

9. The computer-implemented method of claim 7, further comprising generating the user graph based at least in part on at least one of a role or a significance of a resource instance from the configuration of resources.

10. The computer-implemented method of claim 7, wherein the received information is based at least in part on an application stack associated with the configuration of resources.

11. The computer-implemented method of claim 7, further comprising:

storing arbitrary graphs that represent testing scenarios; and

comparing the user graph with at least a portion of the stored arbitrary graphs.

12. The computer-implemented method of claim 7, wherein the plurality of sets of best practice graphs include at least predefined operating scenarios for at least one of the respective different distributed computing systems, and forming at least one best practice graph based at least in part on an availability risk profile associated with a result of a test of the predefined operating scenario.

13. A system for resource availability management, comprising:

at least one memory that stores computer-executable instructions; and

at least one processor configured to access the at least one memory, wherein the at least one processor is configured to execute the computer-executable instructions to;

store one or more curated models for each distributed system of a subset of a plurality of distributed systems;

receive information obtained from operation of at least one computing resource;

generate, based at least in part on the received information, a relative usage model for the at least one computing resource;

compare the relative usage model with one or more curated models to identify at least one ideal curated model of the one or more curated models; and

provide to a user associated with the at least one computing resource, based at least in part on each of a subset of the identified at least one ideal curated models, operating information associated with the at least one computing resource.

14. The system of claim 13, wherein at least one of a role or a significance of the at least one computing resource is inferred based at least in part on the received information.

15. The system of claim 13, wherein the at least one computing resource of the distributed system comprises a resource instance of at least one environment of the plurality of distributed systems.

16. The system of claim 15, wherein the comparison of the relative usage model with the one or more curated models to identify at least one ideal curated model comprises (i) identifying the ideal curated model for an intermediate model that is isomorphic with the relative usage model or is isomorphic with a derivative model of the relative usage model, or (ii) manually identifying the ideal curated model for an intermediate model and automatically assigning subsequent ideal curated models based at least in part on the manually identified ideal curated model.

17. The system of claim 13, wherein the at least one computing resource is associated with at least one distributed systems of the subset of the plurality of distributed systems.

18. The system of claim 13, wherein the provided operating information associated with the at least one computing resource includes at least one of an availability risk for the at least one computing resource, a recommendation to remediate an availability risk of the at least one computing resource, an instruction to remediate an availability risk of the at least one computing resource, or a recommendation to operate the at least one computing resource in a second distributed system of the plurality of distributed systems.

19. One or more non-transitory computer-readable media collectively storing computer-executable instructions for resource availability management that, when executed by one or more processors, configures the one or more processors to perform operations comprising:

generating, based at least in part on information associated with a plurality of service provider environments, a virtual environment associated with at least one of the plurality of service provider environments;

receiving operational information obtained from operating at least one distributed resource;

evaluating, based at least in part on the generated virtual environment, the received operational information; and

providing to a user associated with the at least one distributed resource, based at least in part on the evaluation, operating information associated with the at least one distributed resource.

20. The one or more non-transitory computer-readable media of claim 19, wherein the received operational information comprises at least one of role or relative significance for the at least one distributed resource.

21. The one or more non-transitory computer-readable media of claim 19, wherein the at least one distributed resource comprises a virtual machine instance.

22. The one or more non-transitory computer-readable media of claim 19, wherein the at least one distributed resource is from at least one of the plurality of service provider environments or a distributed environment different from a system of the plurality of service provider environments.

23. The one or more non-transitory computer-readable media of claim 19, wherein evaluating the received operational information comprises simulating the distributed resource in the generated virtual environment associated with at least one of the plurality of service provider environments.

24. The one or more non-transitory computer-readable media of claim 19, wherein the provided operating information associated with the at least one distributed resource comprises a recommendation for operating the distributed resource in at least one of the plurality of service provider environments.

25. The one or more non-transitory computer-readable media of claim 19, wherein the instructions further configure the one or more processors to perform operations comprising:

receiving a user-defined performance metric; and

indicating, based at least in part on the evaluation, when the performance metric is met at a cost below a particular level.