Knowledge based field replaceable unit management

• US 5,293,556 A
• Filed: 07/29/1991
• Issued: 03/08/1994
• Est. Priority Date: 07/29/1991
• Status: Expired due to Term

• Current Assignee: Storage Technologies Corporation (Oracle Corporation)
• Original Assignee: Storage Technologies Corporation (Oracle Corporation)
• Inventors: Hill, Fletcher L., Holm, Douglas A., Jurestovsky, Nancy R., Pinkham, Gregory A.
• Primary Examiner(s): Harvey, Jack B.
• Assistant Examiner(s): Stamber, Eric W.
• Application Number:
  US07/737,159
• Time in Patent Office: 953 Days
• Field of Search: 379/2, 379/10, 379/11, 379/29, 340/652, 340/653, 371/8.1, 371/15.1, 371/16.5, 371/18, 371/21.6, 371/29.1, 371/20.1, 364/551.01, 364/570, 364/419, 364/550
• US Class Current: 702/184
• CPC Class Codes: G01R 31/319 Tester hardware, i.e. output processing circuits
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/20 using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
• CPC Class Codes: G06F 11/2257 using expert systems
• CPC Class Codes: H04M 3/08 Indicating faults in circuits or apparatus
• CPC Class Codes: H04M 3/247 Knowledge-based maintenance systems

Abstract

This failure management system architecture guides, detects, validates and logs field replaceable unit (FRU) changes. This system includes a guided capability by which service personnel use the guided process to select candidates for FRU swaps or FRU replacement. FRU change and swap detection is described as a function of FRU memory scanning coupled with embedded database query activity. For swap activity virtual Composite Failure Events are created to manage post-swap failures. Validation logic determines whether the changed FRU is positioned correctly, is at the correct hardware, software and feature level, executes diagnostics correctly and performs flawlessly during monitored and extended functional operation.

Claims

1. Apparatus for controllably managing the replacement of field replaceable units in a customer system, which customer system includes a plurality of operational elements, each interconnected to at least one other operational element via an interconnection path, said operational elements being mounted on a plurality of field replaceable units, comprising:

means for storing data identifying all said operational elements and said interconnection paths;

means for detecting the presence of a failure in said customer system;

means for generating a failure report which contains data relevant to said detected failure, including an identification of the failure mode and all operational elements that were cooperatively operative during said detected failure;

means for storing said failure report;

means for mapping said stored failure reports to a stored composite failure event containing a list of field replaceable units containing said set of operational elements; and

means, responsive to a craftsperson inquiry, for listing said stored composite failure event and said list of field replaceable units associated with said stored composite failure event.

2. The apparatus of claim 1 wherein said mapping means includes:

means for maintaining a failure analysis history containing data identifying each of said operational elements and associated composite failure data representative of known operational element failures;

means for comparing said stored failure report with said failure analysis history; and

means for identifying a set of most likely failed operational elements based on said comparison.

3. The apparatus of claim 1 wherein said mapping means includes:

means for ordering said list of field replaceable units in order of probability of failure.

4. The apparatus of claim 1 wherein said system further comprises:

means, responsive to a craftsperson selecting one of said list of field replaceable units for replacement, for isolating said selected field replaceable unit by disabling all said interconnection paths connected to all said operational elements located on said selected field replaceable unit; and

means, responsive to said craftsperson replacing said selected field replaceable unit with a replacement field replaceable unit, for testing said replacement field replaceable unit to verify the compatibility of said replacement field replaceable unit with said selected field replaceable unit.

5. The apparatus of claim 4 wherein said testing means includes:

means for verifying the positional correspondence of said replacement field replaceable unit to said selected field replaceable unit.

6. The apparatus of claim 4 wherein said system further comprises:

means, responsive to said craftsperson replacing said selected field replaceable unit with a replacement field replaceable unit, for suspending the generation of additional failure reports relating to said replacement field replaceable unit while said testing means verifies the compatibility of said replacement field replaceable unit with said selected field replaceable unit.

7. The apparatus of claim 4 wherein said system further comprises:

means for recording the identity of said replacement field replaceable unit and its physical location in said customer system.

8. The apparatus of claim 1 wherein said system further comprises:

means, responsive to a craftsperson selecting one of said list of field replaceable units for replacement, for computing customer system service impact data to identify the extent to which the operation of said customer system is impacted by disabling said selected field replaceable unit; and

means, responsive to said computed service impact data exceeding a predetermined threshold, for alerting said craftsperson that disablement of said selected field replaceable unit has a significant negative impact on service in said customer system.

9. The apparatus of claim 8 wherein said listing means contains composite failure events indicative of a plurality of concurrently occurring failures, said alerting means includes:

means for indicating to said craftsperson an alternative one of said concurrently occurring failures, listing said stored composite failure event and said list of field replaceable units associated with said stored composite failure event.

10. The apparatus of claim 1 wherein said system further comprises:

means for auditing said plurality of field replaceable units using said stored data to verify the integrity of said customer system.

11. The apparatus of claim 10 wherein said system further comprises:

means for activating said auditing means in response to said customer system exiting an inoperative state.

12. The apparatus of claim 10 wherein said system further comprises:

means for activating said auditing means in response to one of said field replaceable units being replaced by a new field replaceable unit by said craftsperson.

13. The apparatus of claim 1 wherein said system further comprises:

means, responsive to said craftsperson replacing one of said field replaceable units identified in said list with a new field replaceable unit, for noting all said failure reports associated with said replaced field replaceable unit as interim closed.

14. The apparatus of claim 13 wherein said system further comprises:

means for noting a composite failure event as permanently closed when said new field replaceable unit does not fail for greater than a predetermined period of time.

15. Apparatus for controllably managing the replacement of field replaceable units in a customer system, which customer system includes a plurality of operational elements, each interconnected to at least one other operational element via an interconnection path, said operational elements being mounted on a plurality of field replaceable units, comprising:

means for storing data identifying all said operational elements and said interconnection paths;

means for detecting the presence of a failure in said customer system;

means for generating a failure report which contains data relevant to said detected failure, including an identification of the failure mode and all operational elements that were cooperatively operative during said detected failure;

means for storing said failure report;

means for mapping said stored failure reports to a stored composite failure event containing a list of field replaceable units containing said set of operational elements; and

means, responsive to a craftsperson inquiry, for listing said stored composite failure event and said list in field replaceable units associated with said stored composite failure event;

means, responsive to said craftsperson selecting one of said field replaceable units identified in said list, wherein said identified field replaceable unit is one of a plurality of identical field replaceable units, for instructing said craftsperson to exchange said selected field replaceable unit with one of said plurality of identical field replaceable units;

means, responsive to said craftsperson performing said exchange, for generating a virtual composite failure event duplicative of said composite failure event associated with said selected field replaceable unit; and

means for mapping said virtual composite failure event to said exchanged selected field replaceable unit and said composite failure event with said exchanged one of said plurality of identical field replaceable units.

16. The apparatus of claim 15 wherein said system further comprises:

means, responsive to said exchanged selected field replaceable unit failing, for identifying said exchanged selected field replaceable unit as inoperable; and

means, responsive to said exchanged selected field replaceable unit being replaced, for noting said virtual composite failure event as closed.

17. The apparatus of claim 15 wherein said system further comprises:

means, responsive to said exchanged selected field replaceable unit not failing, for identifying said exchanged selected field replaceable unit as not inoperable; and

means for instructing said craftsperson to restore said exchanged selected field replaceable unit and said exchanged one of said plurality of identical field replaceable units to their respective original locations in said customer system.

18. A method for controllably managing the replacement of field replaceable units in a customer system, which customer system includes a plurality of operational elements, each interconnected to at least one other operational element via an interconnection path, said operational elements being mounted on a plurality of field replaceable units, comprising the steps of:

storing data identifying all said operational elements and said interconnection paths;

detecting the presence of a failure in said customer system;

generating a failure report which contains data relevant to said detected failure, including an identification of the failure mode and all operational elements that were cooperatively operative during said detected failure;

storing said failure report;

mapping said stored failure reports to a composite failure event which contains a list of field replaceable units containing said set of operational elements; and

listing, in response to a craftsperson inquiry, said stored composite failure event and said list of field replaceable units associated with said stored composite failure event.

19. The method of claim 18 wherein said step of mapping includes:

maintaining a failure analysis history containing data identifying each of said operational elements and associated composite failure data representative of known operational element failures;

comparing said stored failure report with said failure analysis history; and

identifying a set of most likely failed operational elements based on said comparison.

20. The method of claim 18 wherein said step of mapping includes:

ordering said list of field replaceable units in order of probability of failure.

21. The method of claim 18 further comprising the steps of:

isolating, in response to a craftsperson selecting one of said list of field replaceable units for replacement, said selected field replaceable unit by disabling all said interconnection paths connected to all said operational elements located on said selected field replaceable unit; and

testing, in response to said craftsperson replacing said selected field replaceable unit with a replacement field replaceable unit, said replacement field replaceable unit to verify the compatibility of said replacement field replaceable unit with said selected field replaceable unit.

22. The method of claim 21 wherein said step of testing includes:

verifying the positional correspondence of said replacement field replaceable unit to said selected field replaceable unit.

23. The method of claim 21 further comprising the step of:

suspending, in response to said craftsperson replacing said selected field replaceable unit with a replacement field replaceable unit, the generation of additional failure reports relating to said replacement field replaceable unit while said testing means verifies the compatibility of said replacement field replaceable unit with said selected field replaceable unit.

24. The method of claim 21 further comprising the step of:

recording the identity of said replacement field replaceable unit and its physical location in said customer system.

25. The method of claim 18 further comprising the steps of:

computing, in response to a craftsperson selecting one of said list of field replaceable units for replacement, customer system service impact data to identify the extent to which the operation of said customer system is impacted by disabling said selected field replaceable unit; and

alerting, in response to said computed service impact data exceeding a predetermined threshold, said craftsperson that disablement of said selected field replaceable unit has a significant negative impact on service in said customer system.

26. The method of claim 25 wherein said listing contains failure reports indicative of a plurality of concurrently occurring failures, said step of alerting includes:

indicating to said craftsperson an alternative one of said concurrently occurring failures, listing said stored composite failure event and said list of field replaceable units associated with said stored composite failure event.

27. The method of claim 18 further comprising the step of:

auditing said plurality of field replaceable units using said stored data to verify the integrity of said customer system.

28. The method of claim 27 further comprising the step of:

activating said auditing step in response to said customer system exiting an inoperative state.

29. The method of claim 27 further comprising the step of:

activating said auditing step in response to one of said field replaceable units being replaced by a new replaceable unit by said craftsperson.

30. The method of claim 18 further comprising the step of:

noting, in response to said craftsperson replacing one of said field replaceable units identified in said list with a new field replaceable unit, all said composite failure events associated with said replaced field replaceable unit as interim closed.

31. The method of claim 30 further comprising the step of:

noting a composite failure event as permanently closed when said new field replaceable unit does not fail for greater than a predetermined period of time.

32. A method for controllably managing the replacement of field replaceable units in a customer system, which customer system includes a plurality of operational elements, each interconnected to at least one other operational element via an interconnection path, said operational elements being mounted on a plurality of field replaceable units, comprising the steps of:

storing data identifying all said operational elements and said interconnection paths;

detecting the presence of a failure in said customer system;

generating a failure report which contains data relevant to said detected failure, including an identification of the failure mode and all operational elements that were cooperatively operative during said detected failure;

storing said failure report;

mapping said stored failure reports to a composite failure event which contains a list of field replaceable units containing said set of operational elements; and

listing, in response to a craftsperson inquiry, said stored composite failure event and said list of field replaceable units associated with said stored composite failure event

instructing, in response to said craftsperson selecting one of said field replaceable units identified in said list, wherein said identified field replaceable unit is one of a plurality of identical field replaceable units, said craftsperson to exchange said selected field replaceable unit with one of said plurality of identical field replaceable units;

generating, in response to said craftsperson performing said exchange, a virtual composite failure event duplicative of said composite failure event associated with said selected field replaceable unit; and

mapping said virtual composite failure event to said exchanged selected field replaceable unit and said composite failure event with said exchanged one of said plurality of identical field replaceable units.

33. The method of claim 32 further comprising the steps of:

identifying, in response to said exchanged selected field replaceable unit failing, said exchanged selected field replaceable unit as inoperable; and

noting, in response to said exchanged selected field replaceable unit being replaced, said virtual composite failure event as closed.

34. The method of claim 32 further comprising the steps of:

identifying, in response to said exchanged selected field replaceable unit not failing, said exchanged selected field replaceable unit as not inoperable; and

instructing said craftsperson to restore said exchanged selected field replaceable unit and said exchanged one of said plurality of identical field replaceable units to their respective original locations in said customer system.