Modeling distributed systems

• US 9,525,599 B1
• Filed: 06/24/2014
• Issued: 12/20/2016
• Est. Priority Date: 06/24/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Wang, Ruiyi, Retford, Brian Paul, Johnston, Emily Jane, Lovejoy, Joshua
• Primary Examiner(s): Chacko, Joe
• Application Number:
  US14/313,073
• Time in Patent Office: 910 Days
• US Class Current: 1/1
• CPC Class Codes: C23C 18/1608 from pretreatment step, i.e. selective pre-treatment
• CPC Class Codes: C23C 18/1612 through irradiation means
• CPC Class Codes: C23C 18/1641 Organic substrates, e.g. resin, plastic
• CPC Class Codes: C23C 18/204 Radiation, e.g. UV, laser
• CPC Class Codes: C23C 18/38 Coating with copper
• CPC Class Codes: G06F 30/18 Network design, e.g. design based on topological or interconnect aspects of utility systems, piping, heating ventilation air conditioning [HVAC] or cabling circuit design at the physical level G06F30/39; network planning tools for wireless communication networks H04W16/18
• CPC Class Codes: G06F 30/20 Design optimisation, verification or simulation optimisation, verification or simulation of circuit designs G06F30/30
• CPC Class Codes: G06F 30/331 with hardware acceleration, e.g. by using field programmable gate array [FPGA] or emulation
• CPC Class Codes: H04L 41/0604 using filtering, e.g. reduction of information by using priority, element types, position or time
• CPC Class Codes: H04L 41/065 involving logical or physical relationship, e.g. grouping and hierarchies
• CPC Class Codes: H04L 41/145 involving simulating, designing, planning or modelling of a network
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H05K 3/185 by making a catalytic pattern by photo-imaging
• CPC Class Codes: H05K 3/32 electrically connecting electric components or wires to printed circuits
• CPC Class Codes: H05K 3/422 characterised by electroless plating method; pretreatment therefor

Abstract

A modeling system including a data processing device in communication with a non-transitory memory storing a model modeling interactions of resources of a distributed system. The data processing device executes instructions that cause the data processing device to implement a system monitor that monitors interactions of the resources of the distributed system and builds the model. The system monitor detects a state change of a first resource of the distributed system and identifies an entity causing the state change of the first resource. The system monitor determines whether a second resource of the distributed system changes state within a threshold period of time after the first resource changed state. The system monitor updates the model to indicate a relationship between the first resource, the second resource and the identified entity, in response to the first resource and the second resource changing state within the threshold time period.

Claims

1. A modeling system comprising:

a non-transitory memory storing a model modeling interactions of resources of a distributed system; and

a data processing device in communication with the non-transitory memory and executing instructions that cause the data processing device to implement a system monitor, the system monitor monitoring interactions of the resources of the distributed system and building the model by;

detecting a state change of a first resource of the distributed system;

identifying an entity causing the state change of the first resource;

determining whether a second resource of the distributed system changes state within a threshold period of time after the first resource changed state, wherein at least one of the first resource or the second resource comprises a hardware resource of the distributed system in communication with the data processing device; and

updating the model to indicate a relationship between the first resource, the second resource, and the identified entity in response to the identified entity triggering the first resource and the second resource to change state within the threshold time period,

wherein the system monitor periodically validates the relationship between the first resource, the second resource, and the identified entity by;

retrieving the relationship from the model stored in the non-transitory memory;

varying a property of the identified entity to trigger a state change of the first resource;

determining whether the second resource changes state within the threshold time period after the state change of the first resource; and

validating the relationship between the first resource, the second resource, and the identified entity when the second resource changes state within the threshold time period.

2. The modeling system of claim 1, wherein the entity comprises a software resource associated with the first and second resources.

3. The modeling system of claim 1, wherein the entity comprises a hardware resource.

4. The modeling system of claim 1, wherein the entity comprises an event affecting a measurable characteristic of the first resource.

5. The modeling system of claim 1, wherein the system monitor:

receives data from the first resource or the second resource indicating the relationship between the first resource and the second resource; and

updates the model to indicate the relationship between the first resource and the second resource.

6. The modeling system of claim 1, wherein the system monitor receives data indicating the entity causing the change in state of the first resource.

7. The modeling system of claim 1, wherein the system monitor:

receives a request from a requestor in communication with the data processing device to determine an impact of a first software service on a second software service;

determines a first set of resources of the distributed system associated with the first software service;

determines a second set of resources of the distributed system associated with the second software service;

retrieves relationships between the first set of resources and the second set of resources from the model; and

sends the retrieved relationships to the requestor.

8. The modeling system of claim 1, wherein the system monitor purges the relationship from the model in response to the second resource not changing state within the threshold period of time.

9. The modeling system of claim 1, wherein the entity causing the state change of the first resource comprises at least one of a power surge, a power drop, a change in temperature, a change in processing demand, or a change in memory demand.

10. A distributed system comprising:

a plurality of hardware resources;

a plurality of software resources residing in one or more of the hardware resources;

a non-transitory memory residing in one or more of the hardware resources, the memory storing a model modeling relationships among the hardware resources and the software resources;

a model interface implemented on one or more of the hardware resources, the model interface, when executed on the one or more hardware resources, causing the one or more hardware resources to;

in response to a request for a representation of at least a portion of the model, retrieve relationships affecting the organization from the model, the request originating from a requestor of an organization, the organization having a plurality of software applications, the request associated with one of the software applications;

categorize each resource in the retrieved relationships as one of;

an organization resource, when the resource affects all of the software applications of the organization;

an infrastructure resource, when the resource affects some of the software applications of the organization;

an application resource, when the resource affects only the software application of the organization associated with the request; and

a metadata resource, when the resource is available to the software application for storing metadata related to other resources; and

generates a representation of the retrieved and categorized relationships; and

a system monitor implemented on one or more of the hardware resources, the system monitor, when executed on the one or more hardware resources, causing the one or more hardware resources to build the model by;

detecting a state change of a first resource of the distributed system;

identifying an entity causing the state change of the first resource;

determining whether a second resource of the distributed system changes state within a threshold period of time after the first resource changed state, wherein at least one of the first resource or the second resource comprises a hardware resource of the distributed system; and

updating the model to indicate a relationship between the first resource, the second resource, and the identified entity in response to the identified entity triggering the first resource and the second resource to change state within the threshold time period,

wherein the system monitor periodically validates the relationship between the first resource, the second resource, and the identified entity by;

retrieving the relationship from the model stored in the non-transitory memory;

varying a property of the identified entity to trigger a state change of the first resource;

determining whether the second resource changes state within the threshold time period after the state change of the first resource; and

validating the relationship between the first resource, the second resource, and the identified entity when the second resource changes state within the threshold time period.

11. The distributed system of claim 10, wherein the model interface:

displays a graphical representation of the retrieved and categorized relationships as a directed graph; and

displays indicia indicating the organization resources, the infrastructure resources, the application resources, and the metadata resources.

12. The distributed system of claim 10, wherein the entity comprises a hardware resource.

13. The distributed system of claim 10, wherein the system monitor:

receives data from the first resource or the second resource indicating the relationship between the first resource and the second resource; and

updates the model to indicate the relationship between the first resource and the second resource.

14. The distributed system of claim 10, wherein the system monitor receives data indicating the entity causing the change in state of the first resource.

15. The distributed system of claim 10, wherein the system monitor:

receives a request from a requestor in communication with the data processing device to determine an impact of a first software service on a second software service;

determines a first set of resources of the distributed system associated with the first software service;

determines a second set of resources of the distributed system associated with the second software service;

retrieves relationships between the first set of resources and the second set of resources from the model; and

sends the retrieved relationships to the requestor.

16. The distributed system of claim 10, wherein the system monitor purges the relationship in response to the second resource not changing state within the threshold period of time.

17. The distributed system of claim 10, wherein the first resource comprises a software application and the entity causing the state change of the first resource comprises at least one of a runtime error, a change in processing demand, a change in memory demand, a change in a number of virtual machines, a change in a number of application threads, or a change in a number of users using the software application.

18. A method comprising:

detecting, using a data processing device, a state change of a first resource of a distributed system;

identifying, using the data processing device, an entity causing the state change of the first resource;

determining, using the data processing device, whether a second resource of the distributed system changes state within a threshold period of time after the first resource changed state, wherein at least one of the first resource or the second resource comprises a hardware resource of the distributed system in communication with the data processing device;

updating a model stored in non-transitory memory in communication with the data processing device to indicate a relationship between the first resource, the second resource, and the identified entity in response to the identified entity triggering the first resource and the second resource to change state within the threshold time period; and

periodically validating, using the data processing device, the relationship between the first resource, the second resource, and the identified entity by;

retrieving the relationship from the model stored in the non-transitory memory;

varying a property of the identified entity to trigger a state change of the first resource;

determining whether the second resource changes state within the threshold time period after the state change of the first resource; and

validating the relationship between the first resource, the second resource, and the identified entity when the second resource changes state within the threshold time period.

19. The method of claim 18, wherein identifying the entity comprises identifying a software resource associated with the first resource and the second resource.

20. The method of claim 18, wherein identifying the entity comprises identifying a hardware resource connected to the first resource and the second resource.

21. The method of claim 18, wherein identifying the entity comprises identifying an event causing the change in state of the first resource.

22. The method of claim 18, wherein identifying the entity comprises receiving, via a receiver in communication with the data processing device, data indicating the entity causing the change in state of the first resource.

23. The method of claim 18, further comprising:

receiving data from the first resource or the second resource indicating the relationship between the first resource and the second resource; and

updating the model to indicate the relationship between the first resource and the second resource.

24. The method of claim 18, further comprising:

receiving a request to determine an impact of a first software service on a second software service;

determining a first set of resources of the distributed system associated with the first software service;

determining a second set of resources of the distributed system associated with the second software service;

retrieving relationships between the first set of resources and the second set of resources from the model; and

sending the retrieved relationships in response to the request.

25. The method of claim 24, further comprising:

receiving a request to return a representation of at least a portion of the model, the request originating from a requestor of an organization, the organization having a plurality of software applications, the request associated with one of the software applications;

retrieving relationships affecting the organization from the model;

categorizing each resource in the retrieved relationships as one of;

an organization resource, when the resource affects all of the software applications of the organization;

an infrastructure resource, when the resource affects some of the software applications of the organization;

an application resource, when the resource affects only the software application associated with the request; and

a metadata resource, when the resource is available to the software application to store metadata related to other resources; and

generates a representation of the retrieved and categorized relationships.

26. The method of claim 25, further comprising:

displaying a graphical representation of the retrieved and categorized relationships as a directed graph on a display in communication with the data processing device; and

displaying indicia indicating the organization resources, the infrastructure resources, the application resources and the metadata resources.