Parallel distributed network management

• US 8,903,973 B1
• Filed: 05/13/2011
• Issued: 12/02/2014
• Est. Priority Date: 11/10/2008
• Status: Active Grant

• Current Assignee: Tanium Inc.
• Original Assignee: Tanium Inc.
• Inventors: Hindawi, David, Hindawi, Orion, Lippincott, Lisa, Lincroft, Peter
• Primary Examiner(s): Strange, Aaron
• Application Number:
  US13/107,625
• Time in Patent Office: 1,299 Days
• Field of Search: 709/217, 709/243, 709/223
• US Class Current: 709/223
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 41/04 Network management architectures or arrangements
• CPC Class Codes: H04L 41/0853 by actively collecting configuration information or by backing up configuration information
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/26 using dedicated tools for LAN [Local Area Network] management
• CPC Class Codes: H04L 43/06 Generation of reports
• CPC Class Codes: H04L 43/065 related to network devices
• CPC Class Codes: H04L 43/10 Active monitoring, e.g. heartbeat, ping or trace-route
• CPC Class Codes: H04L 45/16 Multipoint routing
• CPC Class Codes: H04L 45/44 Distributed routing

Abstract

A method of parallel processing by networked devices, in which distributed data in a network is accessed in parallel to provide results. Commands and queries by a user station define a set of such distributed data. The networked devices access the distributed data in portions, individually process each portion, conduct peer-to-peer communication to aggregate results from processing each portion, and individually determine whether and when to report results. Making effective use of network assets (such as processing and storage at each node), making effective use of concurrency of network assets, limiting bandwidth use between network assets and user stations, and limiting use of assets (such as processing and storage) at user stations.

Claims

1. A method, including:

in a computer network having a plurality of nodes, wherein each said node comprises a respective computing device and has a respective defined location in a linearly ordered sequence of said plurality of nodes, wherein the linearly ordered sequence includes a plurality of local segments, each local segment including a 1st said node followed by a sequence of 2nd said nodes in the local segment, wherein at least a portion of the linearly ordered sequence is separated into two or more local segments by one or more firewalls, and wherein the 1st said node and each 2nd said node in the local segment includes a respective communication link to a respective next node in the linearly ordered sequence;

at the 1st said node of a respective local segment, injecting a query regarding a set of management information associated with the local segment, the query designating, by specifying a first shared node property, a first subset of nodes in the local segment to respond to the query,

wherein the query is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node;

wherein each node of the first subset of nodes having the first shared node property responds to the query by aggregating its respective local information to any answers already accumulated in the query; and

wherein at least one of the sequence of 2nd nodes sends a report message containing aggregated management information collected from the first subset of nodes in response to the query.

2. The method of claim 1, further comprising:

at the 1st said node of a respective local segment, injecting a command specifying a set of operations to be executed by a second subset of nodes in the local segment, the command designating the second subset of nodes by specifying a second shared node property for the second subset of nodes,

wherein the command is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node; and

wherein each node of the second subset of nodes having the second shared node property executes the set of operations in response to the command.

3. The method of claim 1, wherein the plurality of nodes self-organize into the linearly ordered sequence in accordance with a sequential order of their respective hardware addresses.

4. The method of claim 1, wherein the query is selected from a set of frequently-asked network queries and automatically injected into the network at multiple times.

5. The method of claim 1, wherein the query is selected from a set of audit or compliance rules and automatically injected into the network at multiple times.

6. The method of claim 1, wherein the plurality of nodes further self-organize into one or more express orbits, each express orbit including a respective subset of the plurality of nodes and organized in substantially the same order as the linearly ordered sequence.

7. A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by one or more processors, cause the processors to perform operations comprising:

in a computer network having a plurality of nodes, wherein each said node comprises a respective computing device and has a respective defined location in a linearly ordered sequence of said plurality of nodes, wherein the linearly ordered sequence includes a plurality of local segments, each local segment including a 1st said node followed by a sequence of 2nd said nodes in the local segment, wherein at least a portion of the linearly ordered sequence is separated into two or more local segments by one or more firewalls, and wherein the 1st said node and each 2nd said node in the local segment includes a respective communication link to a respective next node in the linearly ordered sequence;

at the 1st said node of a respective local segment, injecting a query regarding a set of management information associated with the local segment, the query designating, by specifying a first shared node property, a first subset of nodes in the local segment to respond to the query,

wherein the query is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node;

wherein each node of the first subset of nodes having the first shared node property responds to the query by aggregating its respective local information to any answers already accumulated in the query; and

wherein at least one of the sequence of 2nd said nodes sends a report message containing aggregated management information collected from the first subset of nodes in response to the query.

8. The computer-readable medium of claim 7, wherein the operations further comprise:

at the 1st said node of a respective local segment, injecting a command specifying a set of operations to be executed by a second subset of nodes in the local segment, the command designating the second subset of nodes by specifying a second shared node property for the second subset of nodes,

wherein the command is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node; and

wherein each node of the second subset of nodes having the second shared node property executes the set of operations in response to the command.

9. The computer-readable medium of claim 7, wherein the query is selected from a set of frequently-asked network queries and automatically injected into the network at multiple times.

10. The computer-readable medium of claim 7, wherein the plurality of nodes further self-organize into one or more express orbits, each express orbit including a respective subset of the plurality of nodes and organized in substantially the same order as the linearly ordered sequence.

11. A system, comprising:

one or more processors; and

memory having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to perform operations comprising;

in a computer network having a plurality of nodes, wherein each said node comprises a respective computing device and has a respective defined location in a linearly ordered sequence of said plurality of nodes, wherein the linearly ordered sequence includes a plurality of local segments, each local segment including a 1st said node followed by a sequence of 2nd said nodes in the local segment, wherein at least a portion of the linearly ordered sequence is separated into two or more local segments by one or more firewalls, and wherein the 1st said node and each 2nd said node in the local segment includes a respective communication link to a respective next node in the linearly ordered sequence;

at the 1st said node of a respective local segment, injecting a query regarding a set of management information associated with the local segment, the query designating, by specifying a first shared node property, a first subset of nodes in the local segment to respond to the query,

wherein the query is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node;

wherein each node of the first subset of nodes having the first shared node property responds to the query by aggregating its respective local information to any answers already accumulated in the query; and

wherein at least one of the sequence of 2nd said nodes sends a report message containing aggregated management information collected from the first subset of nodes in response to the query.

12. The system of claim 11, wherein the operations further comprise:

at the 1st said node of a respective local segment, injecting a command specifying a set of operations to be executed by a second subset of nodes in the local segment, the command designating the second subset of nodes by specifying a second shared node property for the second subset of nodes,

wherein the command is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node; and

wherein each node of the second subset of nodes having the second shared node property executes the set of operations in response to the command.

13. The system of claim 11, wherein the plurality of nodes self-organize into the linearly ordered sequence in accordance with a sequential order of their respective hardware addresses.

14. The system of claim 11, wherein the query is selected from a set of frequently-asked network queries and automatically injected into the network at multiple times.

15. The system of claim 11, wherein the query is selected from a set of audit or compliance rules and automatically injected into the network at multiple times.

16. The system of claim 11, wherein the plurality of nodes further self-organize into one or more express orbits, each express orbit including a respective subset of the plurality of nodes and organized in substantially the same order as the linearly ordered sequence.

17. A method, including:

in a computer network having a plurality of nodes, wherein each said node comprises a respective computing device and has a respective defined location in a linearly ordered sequence of said plurality of nodes, wherein the linearly ordered sequence includes a plurality of local segments, each local segment including a 1st said node followed by a sequence of 2nd said nodes in the local segment, wherein the plurality of nodes further self-organize into one or more express orbits, each express orbit including a respective subset of the plurality of nodes and organized in substantially the same order as the linearly ordered sequence, and wherein the 1st said node and each 2nd said node in the local segment includes a respective communication link to a respective next node in the linearly ordered sequence;

at the 1st said node of a respective local segment, injecting a query regarding a set of management information associated with the local segment, the query designating, by specifying a first shared node property, a first subset of nodes in the local segment to respond to the query,

wherein the query is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node;

wherein each node of the first subset of nodes having the first shared node property responds to the query by aggregating its respective local information to any answers already accumulated in the query; and

wherein at least one of the sequence of 2nd nodes sends a report message containing aggregated management information collected from the first subset of nodes in response to the query.

18. The method of claim 17, further comprising:

at the 1st said node of a respective local segment, injecting a command specifying a set of operations to be executed by a second subset of nodes in the local segment, the command designating the second subset of nodes by specifying a second shared node property for the second subset of nodes,

wherein the command is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node; and

wherein each node of the second subset of nodes having the second shared node property executes the set of operations in response to the command.

19. The method of claim 17, wherein the plurality of nodes self-organize into the linearly ordered sequence in accordance with a sequential order of their respective hardware addresses.

20. The method of claim 17, wherein the query is selected from a set of frequently-asked network queries and automatically injected into the network at multiple times.

21. The method of claim 17, wherein the query is selected from a set of audit or compliance rules and automatically injected into the network at multiple times.

22. A non-transitory computer-readable medium having instructions stored thereon, the instructions, when executed by one or more processors, cause the processors to perform operations comprising:

in a computer network having a plurality of nodes, wherein each said node comprises a respective computing device and has a respective defined location in a linearly ordered sequence of said plurality of nodes, wherein the linearly ordered sequence includes a plurality of local segments, each local segment including a 1st said node followed by a sequence of 2nd said nodes in the local segment, wherein the plurality of nodes further self-organize into one or more express orbits, each express orbit including a respective subset of the plurality of nodes and organized in substantially the same order as the linearly ordered sequence, and wherein the 1st said node and each 2nd said node in the local segment includes a respective communication link to a respective next node in the linearly ordered sequence;

at the 1st said node of a respective local segment, injecting a query regarding a set of management information associated with the local segment, the query designating, by specifying a first shared node property, a first subset of nodes in the local segment to respond to the query,

wherein the query is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node;

wherein each node of the first subset of nodes having the first shared node property responds to the query by aggregating its respective local information to any answers already accumulated in the query; and

wherein at least one of the sequence of 2nd said nodes sends a report message containing aggregated management information collected from the first subset of nodes in response to the query.

23. The computer-readable medium of claim 22, wherein the operations further comprise:

at the 1st said node of a respective local segment, injecting a command specifying a set of operations to be executed by a second subset of nodes in the local segment, the command designating the second subset of nodes by specifying a second shared node property for the second subset of nodes,

wherein the command is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node; and

wherein each node of the second subset of nodes having the second shared node property executes the set of operations in response to the command.

24. The computer-readable medium of claim 22, wherein the query is selected from a set of frequently-asked network queries and automatically injected into the network at multiple times.

25. A system, comprising:

one or more processors; and

memory having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to perform operations comprising;

in a computer network having a plurality of nodes, wherein each said node comprises a respective computing device and has a respective defined location in a linearly ordered sequence of said plurality of nodes, wherein the linearly ordered sequence includes a plurality of local segments, each local segment including a 1st said node followed by a sequence of 2nd said nodes in the local segment, wherein the plurality of nodes further self-organize into one or more express orbits, each express orbit including a respective subset of the plurality of nodes and organized in substantially the same order as the linearly ordered sequence, and wherein the 1st said node and each 2nd said node in the local segment includes a respective communication link to a respective next node in the linearly ordered sequence;

at the 1st said node of a respective local segment, injecting a query regarding a set of management information associated with the local segment, the query designating, by specifying a first shared node property, a first subset of nodes in the local segment to respond to the query,

wherein the query is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node;

wherein each node of the first subset of nodes having the first shared node property responds to the query by aggregating its respective local information to any answers already accumulated in the query; and

wherein at least one of the sequence of 2nd said nodes sends a report message containing aggregated management information collected from the first subset of nodes in response to the query.

26. The system of claim 25, wherein the operations further comprise:

at the 1st said node of a respective local segment, injecting a command specifying a set of operations to be executed by a second subset of nodes in the local segment, the command designating the second subset of nodes by specifying a second shared node property for the second subset of nodes,

wherein the command is forwarded along the local segment through the respective communication links of the 1st said node and the sequence of 2nd said nodes following the 1st said node; and

wherein each node of the second subset of nodes having the second shared node property executes the set of operations in response to the command.

27. The system of claim 25, wherein the plurality of nodes self-organize into the linearly ordered sequence in accordance with a sequential order of their respective hardware addresses.

28. The system of claim 25, wherein the query is selected from a set of frequently-asked network queries and automatically injected into the network at multiple times.

29. The system of claim 25, wherein the query is selected from a set of audit or compliance rules and automatically injected into the network at multiple times.