Fault isolation in large networks

• US 7,165,192 B1
• Filed: 12/19/2003
• Issued: 01/16/2007
• Est. Priority Date: 12/19/2003
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Cadieux, Christian, Gibson, Gavin G.
• Primary Examiner(s): Iqbal; Nadeem
• Application Number:
  US10/741,399
• Time in Patent Office: 1,124 Days
• Field of Search: 714/43, 714/47, 714/57, 714/25, 714/48, 714/49, 714/31, 709/220, 709/221, 709/249
• US Class Current: 714/43
• CPC Class Codes: H04L 41/0631 using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
• CPC Class Codes: H04L 41/0677 Localisation of faults
• CPC Class Codes: H04L 43/12 Network monitoring probes

Abstract

In some embodiments, a computer accessible medium comprises a plurality of instructions which, when executed, probe nodes in a network to determine if one or more nodes are experiencing any events indicative of a fault. The nodes are probed in a sequence. The instructions, when executed, in response to receiving a first alert transmitted by a first node in the network asynchronous to the probes performed according to the sequence, probe one or more neighbor nodes of the first node. In some other embodiments, the instructions, when executed, in response to receiving a first alert transmitted by a first node in the network asynchronous to the probes performed according to the sequence, interrupt probing according to the sequence to probe at least the first node.

Claims

1. A computer accessible medium comprising a plurality of instructions which, when executed:

probe nodes in a network to determine if one or more nodes are experiencing any events indicative of one or more faults, wherein nodes are probed in a sequence; and

in response to receiving a first alert transmitted by a first node in the network, wherein the first node is configured to transmit the first alert in response to the first node detecting an event and independent of the probes performed according to the sequence and asynchronous to the probes performed according to the sequence, probe one or more neighbor nodes of the first node.

2. The computer accessible medium as recited in claim 1 wherein the plurality of instructions, when executed, further probe the first node in response to receiving the first alert.

3. The computer accessible medium as recited in claim 1 wherein the plurality of instructions, when executed, further revert to probing according to the sequence subsequent to probing the one or more neighbor nodes.

4. A computer accessible medium comprising a plurality of instructions which, when executed:

probe nodes in a network to determine if one or more nodes are experiencing one or more events indicative of one or more faults, wherein nodes are probed in a sequence; and

in response to receiving a first alert transmitted by a first node in the network asynchronous to the probes performed according to the sequence, interrupt probing according to the sequence to probe at least the first node.

5. The computer accessible medium as recited in claim 4 wherein the instructions, when executed, further probe one or more neighbor nodes to the first node in response to the first alert and independent of the sequence.

6. The computer accessible medium as recited in claim 4 wherein the instructions, when executed, revert to probing according to the sequence subsequent to probing the first node.

7. A computer system comprising a probe agent and an inspector, wherein the probe agent is configured to probe nodes in a network in a sequence to determine if the nodes are experiencing an event or events indicative of one or more faults, and wherein the inspector is configured, in response to receiving a first alert transmitted by a first node in the network asynchronous to the probing by the probe agent, to identify one or more neighbor nodes of the first node and to cause the probe agent to probe the one or more neighbor nodes independent of the sequence.

8. The computer system as recited in claim 7 wherein the inspector is further configured to cause the probe agent to probe the first node independent of the sequence.

9. The computer system as recited in claim 7 wherein the sequence is specified in a probe list, and wherein the inspector is configured to update the probe list with the one or more neighbor nodes to cause the probe agent to probe the one or more neighbor nodes.

10. The computer system as recited in claim 7 wherein the first node and the neighbor nodes share at least one resource.

11. The computer system as recited in claim 10 wherein the resource comprises at least one of a network connection, a power supply, a rack that holds the first node and the neighbor nodes, and a room in which the first node and the neighbor nodes are physically located.

12. A method comprising:

probing nodes in a network to determine if one or more nodes are experiencing one or more events indicative of one or more faults, wherein nodes are probed in a predetermined sequence;

receiving a first alert transmitted by a first node in the network asynchronous to the probing and independent of the probing, wherein the first node is configured to transmit the first alert in response to the first node detecting an event and independent of the probes performed according to the sequence; and

in response to receiving the first alert, probing one or more neighbor nodes of the first node.

13. The method as recited in claim 12 further comprising probing the first node in response to receiving the first alert.

14. The method as recited in claim 12 further comprising reverting to probing according to the predetermined sequence subsequent to probing the one or more neighbor nodes.

15. An apparatus comprising:

a plurality of nodes; and

a computer system coupled to the plurality of nodes, wherein the computer system is configured to probe the plurality of nodes in a sequence to determine if one or more nodes are experiencing one or more faults or one or more events indicative of one or more faults;

and wherein at least a first node is configured to transmit a first alert to the computer system asynchronous to the probing, and wherein the computer system, in response to the first alert, is configured to probe one or more neighbor nodes of the first node independent of the sequence.

16. The apparatus as recited in claim 15 wherein the computer system is further configured to probe the first node responsive to the first alert.

17. The apparatus as recited in claim 15 wherein the plurality of nodes comprise at least one of:

storage devices in a storage area network, and computer systems coupled to a network.

18. The apparatus as recited in claim 15 wherein the first node and the neighbor nodes share at least one resource.

19. The apparatus as recited in claim 18 wherein the resource comprises at least one of a network connection, a power supply, a rack that holds the first node and the neighbor nodes, and a room in which the first node and the neighbor nodes are physically located.