Diagnosability system

• US 7,937,623 B2
• Filed: 10/15/2008
• Issued: 05/03/2011
• Est. Priority Date: 10/19/2007
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Yu, Hailing, Shaft, Uri, Sarig, Yair, Mysorenagarajarao, Ajith Kumar, Ramacher, Mark, Feng, Mike, Beresniewicz, John, Fallen, Marcus, Kuchibhotla, Balasubrahmanya, Valiani, Amir, Ngai, Gary, Dias, Karl, Tan, Leng, Venkataramani, Venkateshwaran, Klein, Jonathan, Dageville, Benoit
• Primary Examiner(s): Iqbal; Nadeem
• Application Number:
  US12/252,056
• Publication Number:
  US 20090106278A1
• Time in Patent Office: 930 Days
• Field of Search: 714 18- 21, 714/26, 714/27, 714 37- 39, 714 45- 48
• US Class Current: 714/37
• CPC Class Codes: G06F 11/0748 in a remote unit communicating with a single-box computer node experiencing an error/fault remote testing G06F11/2294
• CPC Class Codes: G06F 11/0778 Dumping, i.e. gathering error/state information after a fault for later diagnosis
• CPC Class Codes: G06F 11/0781 Error filtering or prioritizing based on a policy defined by the user or on a policy defined by a hardware/software module, e.g. according to a severity level
• CPC Class Codes: H04L 41/0681 Configuration of triggering conditions
• CPC Class Codes: H04L 41/16 using machine learning or artificial intelligence

Abstract

A diagnosability system for automatically collecting, storing, communicating, and analyzing diagnostic data for one or more monitored systems. The diagnosability system comprises several components configured for the collection, storage, communication, and analysis of diagnostic data for a condition detected in monitored system. The diagnosability system enables targeted dumping of diagnostic data so that only diagnostic data that is relevant for diagnosing the condition detected in the monitored system is collected and stored. This in turn enables first failure analysis thereby reducing the time needed to resolve the condition detected in the monitored system.

Claims

1. A method for processing diagnostic data in a monitored system, comprising:

detecting, by a computer system, a condition in the monitored system;

determining, by the computer system, context data for the detected condition;

determining, by the computer system, a diagnostic action to be performed in response to the detected condition, the diagnostic action determined based upon the context data and a set of one or more rules configured for the monitored system;

gathering, by the computer system, diagnostic data relevant to the condition by executing the diagnostic action;

storing, by the computer system, the diagnostic data in a diagnostic data repository;

determining, by the computer system, a portion of the diagnostic data to be sent to a diagnosis site, the portion of the diagnostic data pertaining to incidents that are correlated with the detected condition;

preparing, by the computer system a package comprising the portion of the diagnostic data determined; and

communicating, by the computer system, the package to the diagnosis site.

2. The method of claim 1 wherein determining the context data comprises:

determining information related to the detected condition in the monitored system;

determining information related to functions or processes that are being executed in the monitored system;

determining information related to a tagged function or process; and

determining information related to an impact that the detected condition has on the monitored system.

3. The method of claim 1 wherein:

each rule in the set of one or more rules specifies a condition and one or more actions to be performed when the condition specified in the rule is satisfied; and

wherein determining the diagnostic action to be performed comprises determining that the condition associated with a first rule from the set of rules is satisfied by the context data determined, wherein at least one action specified by the first rule is the diagnostic action determined to be performed in the monitored system.

4. The method of claim 1 further comprising

outputting information recommending execution of the diagnostic action;

and

executing the diagnostic action only upon receiving an input from a user to execute the diagnostic-related action, wherein the diagnostic action is executed using the context data determined for the detected condition.

5. The method of claim 1 wherein determining the context data comprises:

gathering information related to the monitored system during runtime of the monitored system;

storing the gathered information during runtime of the monitored system;

retrieving a portion of the stored information in response to the condition detected in the monitored system; and

wherein the retrieved information is used for determining the diagnostic actions to be performed in response to the detected condition.

6. The method of claim 1 further comprising:

determining a first rule for the condition detected in the monitored system, the first rule specifying when diagnostic data gathering is to be suppressed or allowed upon occurrence of the detected condition;

determining, based upon the first rule, if gathering of diagnostic data for the condition detected in the monitored system is to be suppressed; and

wherein gathering of diagnostic data for the detected condition is suppressed upon determining that gathering of diagnostic data for the detected condition is to be suppressed.

7. The method of claim 6 further comprising:

determining a second rule for the diagnostic action determined to be performed in response to the condition detected in the monitored system, the second rule specifying when execution of the diagnostic action is to be suppressed or allowed;

determining, based upon the second rule, if execution of the diagnostic action is to be suppressed; and

wherein gathering of diagnostic data for the condition detected in the monitored system is suppressed upon determining that the execution of the diagnostic action is to be suppressed.

8. The method of claim 1 further comprising:

receiving indication of the condition from a first process or thread in the monitored system;

initiating a second process or thread to perform the determined diagnostic action; and

executing the determined diagnostic action in the second process or thread, wherein the first process or thread can continue processing without being delayed or interrupted by the execution of the diagnostic action in the second process.

9. The method of claim 1 further comprising:

executing a health check to determine information related to the monitored system, the health check invoked based upon a predefined schedule or in response to the condition detected in the monitored system; and

outputting the information related to the monitored system determined from executing the health check.

10. The method of claim 1 further comprising:

storing diagnostic data related to a first monitored system in a first directory in the diagnostic data repository;

storing diagnostic data related to a second monitored system in a second directory in the diagnostic data repository; and

storing the first directory and the second directory under a common directory in the diagnostic data repository.

11. The method of claim 1 wherein storing the diagnostic data comprises:

storing metadata information, the metadata information including one or more correlation keys;

storing information related to one or more health checks for the monitored system;

storing information related to packaged diagnostics that is to be communicated to the diagnosis site; and

storing information related to one or more incidents for the monitored system.

12. The method of claim 1 wherein determining a portion of the diagnostic data to be sent to the diagnosis site further comprising:

receiving a request to create a package to be communicated to the diagnosis site;

identifying a first set of one or more incidents based upon the request, each incident corresponding to an error detected in the monitored system;

identifying a second set of incidents correlated to the first set of incidents;

determining diagnostic data for the first set of incidents and the second set of incidents; and

preparing a package comprising the diagnostic data determined for the first set of incidents and the second set of incidents.

13. The method of claim 1 further comprising modifying the portion of the diagnostic data included in the package prior to communication of the package to the diagnosis site.

14. The method of claim 1 further comprising generating an incident and an associated problem key in response to the condition detected in the monitored system.

15. A computer-readable storage medium storing a plurality of instructions for controlling a processor to process diagnostic data in a monitored system, the plurality of instructions comprising:

instructions that cause the processor to detect a condition in the monitored system;

instructions that cause the processor to determine context data for the detected condition; and

instructions that cause the processor to determine a diagnostic action to be performed responsive to the detected condition based upon the context data determined and based upon a set of one or more rules configured for the monitored system;

instructions that cause the processor to gather diagnostic data relevant to the condition by executing the diagnostic action;

instructions that cause the processor to store the diagnostic data in a diagnostic data repository;

instructions that cause the processor to determine a portion of the diagnostic data to be sent to a diagnosis site, the portion of the diagnostic data pertaining to incidents that are correlated with the detected condition;

instructions that cause the processor to prepare a package comprising the portion of the diagnostic data determined; and

instructions that cause the processor to communicate the package to the diagnosis site.

16. The computer readable storage medium of claim 15 wherein the instructions that cause the processor to determine the context data for the detected condition comprise:

instructions that cause the processor to determine information related to the detected condition in the monitored system;

instructions that cause the processor to determine information related to functions or processes that are being executed in the monitored system;

instructions that cause the processor to determine information related to a tagged function or process; and

instructions that cause the processor to determine information related to an impact that the detected condition has on the monitored system.

17. The computer readable storage medium of claim 15 wherein:

each rule in the set of one or more rules specifies a condition and one or more actions to be performed when the condition specified in the rule is satisfied; and

wherein the instructions that cause the processor to determine the diagnostic action to be performed comprises instructions that cause the processor to determine that the condition associated with a first rule from the set of rules is satisfied by the context data determined, wherein at least one action specified by the first rule is the diagnostic action determined to be performed in the monitored system.

18. The computer readable storage medium of claim 15 wherein the plurality of instructions further comprise:

instructions to cause the processor to output information recommending execution of the diagnostic action; and

instructions to cause the processor to execute the diagnostic action only upon receiving an input from a user to execute the diagnostic-related action, wherein the diagnostic action is executed using the context data determined for the detected condition.

19. The computer readable storage medium of claim 15 wherein the plurality of instructions further comprise:

instructions to cause the processor to receive indication of the condition from a first process or thread in the monitored system;

instructions to cause the processor to initiate a second process or thread to perform the determined diagnostic action; and

instructions to cause the processor to execute the determined diagnostic action in the second process or thread, wherein the first process or thread can continue processing without being delayed or interrupted by the execution of the diagnostic action in the second process.

20. A system for processing diagnostic data in a monitored system, the system comprising:

a memory; and

a processor coupled to the memory;

wherein the processor is configured to;

detect a condition in the monitored system;

determine context data for the detected condition; and

determine a diagnostic action to be performed responsive to the detected condition based upon the context data determined and based upon a set of one or more rules configured for the monitored system;

gather diagnostic data relevant to the condition by executing the diagnostic action;

store the diagnostic data in a diagnostic data repository;

determine a portion of the diagnostic data to be sent to a diagnosis site, the portion of the diagnostic data pertaining to incidents that are correlated with the detected condition;

prepare a package comprising the portion of the diagnostic data determined; and

communicate the package to the diagnosis site.