Distributed fault isolation in connected networks

• US 9,705,768 B2
• Filed: 09/14/2015
• Issued: 07/11/2017
• Est. Priority Date: 09/14/2015
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Kakani, Balram Reddy
• Primary Examiner(s): ANWAR, MOHAMMAD S
• Application Number:
  US14/852,980
• Publication Number:
  US 20170078174A1
• Time in Patent Office: 666 Days
• CPC Class Codes: H04L 41/0631 using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
• CPC Class Codes: H04L 41/065 involving logical or physical relationship, e.g. grouping and hierarchies
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/0817 by checking functioning

Abstract

A method is described for determining, via a local fault poller, a list of local unreachable devices of a plurality of devices within a local domain, wherein the local unreachable devices are coupled for communication with the local fault poller. The method comprises determining selected neighboring domains of a plurality of neighboring domains, wherein the selected neighboring domains comprise neighboring devices which are coupled for communication with the local unreachable devices, each neighboring domain having a respective neighboring global fault poller. The method comprises requesting an operational test of the local unreachable devices from the respective neighboring global fault pollers of the selected neighboring domains, and receiving responses, via the respective neighboring global fault pollers, indicating whether the local unreachable devices are operational. The method further comprises determining, based on the responses, a root cause device from the list of local unreachable devices.

Claims

1. A method, comprising:

determining, via a local fault poller, a list of local unreachable devices of a plurality of devices within a local domain, wherein the local unreachable devices are coupled for communication with the local fault poller;

determining selected neighboring domains of a plurality of neighboring domains, wherein the selected neighboring domains are outside the local domain and comprise neighboring devices which are coupled for communication with the local unreachable devices, each neighboring domain having a respective neighboring global fault poller;

requesting an operational test of the local unreachable devices within the local domain by the respective neighboring global fault pollers of the selected neighboring domains outside the local domain;

receiving responses, via the respective neighboring global fault pollers of the selected neighboring domains outside the local domain, indicating whether the local unreachable devices within the local domain are operational;

determining, based on the responses, a root cause device from the list of local unreachable devices.

2. The method of claim 1, wherein the local fault poller manages the plurality of devices within the local domain.

3. The method of claim 1, wherein determining, via a local fault poller, the root cause device, further comprises:

determining a local fault domain, wherein the local fault domain indicates how performance of each of the plurality of devices affects performance of the plurality of devices.

4. The method of claim 3, wherein determining the local fault domain further comprises:

determining a topology of the plurality of devices within the local domain.

5. The method of claim 4, wherein determining the local fault domain further comprises:

mapping performance relationships for each of the plurality of devices within the local domain; and

predicting a probable performance impact for the local domain based on the local fault domain.

6. The method of claim 1, further comprising:

mapping a communication relationship for each local unreachable device, wherein the communication relationship defines respective neighboring devices within the selected neighboring domains which are coupled for communication with the local unreachable devices.

7. The method of claim 1, wherein determining, based on the responses, the root cause device from the list of local unreachable devices, further comprises:

determining a probable impact on local domain services.

8. The method of claim 1, further comprising:

determining a local domain solution to limit downtime of the root cause device; and

implementing the local domain solution.

9. The method of claim 1, wherein the root cause device prevents the local fault poller from communicating with the local unreachable devices.

10. The method of claim 1, wherein notifying the network administrator of the probable fault based on pre-fault performance characteristics of the at least one of the plurality of network elements further comprises:

determining a timeframe in which the probable fault is likely to occur.

11. A system comprising:

a memory; and

a processor in communication with the memory, the processor configured to;

determine, via a local fault poller, a list of local unreachable devices of a plurality of devices within a local domain, wherein the local unreachable devices are coupled for communication with the local fault poller;

determine selected neighboring domains of a plurality of neighboring domains, wherein the selected neighboring domains are outside the local domain and comprise neighboring devices which are coupled for communication with the local unreachable devices, each neighboring domain having a respective neighboring global fault poller;

request an operational test of the local unreachable devices within the local domain by the respective neighboring global fault pollers of the selected neighboring domains outside the local domain;

receive responses, via the respective neighboring global fault pollers of the selected neighboring domains outside the local domain, indicating whether the local unreachable devices within the local domain are operational; and

determine, based on the responses, a root cause device from the list of local unreachable devices.

12. The system of claim 11, wherein the local fault poller manages the plurality of devices within the local domain.

13. The system of claim 12, wherein when determining, via a local fault poller, the root cause device, the processor is further configured to:

determine a local fault domain, wherein the local fault domain indicates how performance of each of the plurality of devices affects performance of the plurality of devices.

14. The system of claim 13, wherein when determining the local fault domain, the processor is further configured to:

determine a topology of the plurality of devices within the local domain.

15. The system of claim 14, wherein when determining the local fault domain, the processor is further configured to:

map performance relationships for each of the plurality of devices within the local domain; and

predict a probable performance impact for the local domain based on the local fault domain.

16. The system of claim 12, wherein the processor is further configured to:

map a communication relationship for each local unreachable device, wherein the communication relationship defines neighboring devices within the selected neighboring domains which are coupled for communication with the local unreachable devices.

17. The system of claim 11, wherein when determining, based on the responses, the root cause device from the list of local unreachable devices, the processor is further configured to:

determine a probable impact on local domain services.

18. The system of claim 11, wherein the processor is further configured to:

determine a local domain solution to limit downtime of the root cause device; and

implement the local domain solution.

19. The system of claim 11, wherein when notifying the network administrator of the probable fault based on pre-fault performance characteristics of the at least one of the plurality of network elements, the processor is further configured to:

determine a timeframe in which the probable fault is likely to occur.

20. A computer program product comprising:

a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code comprising;

computer-readable program code configured to determine, via a local fault poller, a list of local unreachable devices of a plurality of devices within a local domain, wherein the local unreachable devices are coupled for communication with the local fault poller;

computer-readable program code configured to determine selected neighboring domains of a plurality of neighboring domains, wherein the selected neighboring domains are outside the local domain and comprise neighboring devices which are coupled for communication with the local unreachable devices, each neighboring domain having a respective neighboring global fault poller;

computer-readable program code configured to request an operational test of the local unreachable devices within the local domain by the respective neighboring global fault pollers of the selected neighboring domains outside the local domain;

computer-readable program code configured to receive responses, via the respective neighboring global fault pollers of the selected neighboring domains outside the local domain, indicating whether the local unreachable devices within the local domain are operational;

computer-readable program code configured to determine, based on the responses, a root cause device from the list of local unreachable devices.