Varying logging depth based on user defined policies

• US 9,535,780 B2
• Filed: 11/18/2013
• Issued: 01/03/2017
• Est. Priority Date: 11/18/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Rajamanickam, Logeswaran T., Ramakrishnan, Arun, Shetty, Rohit
• Primary Examiner(s): DUNCAN, MARC M
• Application Number:
  US14/082,804
• Publication Number:
  US 20150143182A1
• Time in Patent Office: 1,142 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/0706 the processing taking place on a specific hardware platform or in a specific software environment
• CPC Class Codes: G06F 11/0781 Error filtering or prioritizing based on a policy defined by the user or on a policy defined by a hardware/software module, e.g. according to a severity level
• CPC Class Codes: G06F 11/0787 Storage of error reports, e.g. persistent data storage, storage using memory protection
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 11/3072 where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
• CPC Class Codes: G06F 11/3075 the data filtering being achieved in order to maintain consistency among the monitored data, e.g. ensuring that the monitored data belong to the same timeframe, to the same system or component

Abstract

Techniques for writing logging files, where the logging files include multiple pieces of logging information. The pieces of logging information are based on operation of a computer system. The writing of the logging information includes the following steps (not necessarily in the following order): (i) choosing a set of logging rules; which logging rules determine the selection of which pieces of operational information relating to the computer system will be written to a non-volatile log file; (ii) operating the computer system; (iii) during operation of the computer system, collecting a first set of pieces of operational information; (iv) saving the first set of pieces of operational information to a volatile buffer memory; and (v) writing only a first sub-set of the first set of pieces of operational information to a first log file.

Claims

1. A method for writing at least a portion of a logging file associated with a thread generated by execution of an application, the logging file including a plurality of pieces of logging information from the application'"'"'s thread, the method comprising:

choosing a set of logging rules, which logging rules determine the selection of which pieces of information from an application'"'"'s thread will be written to a non-volatile log file;

operating the application on a computer system to generate the application'"'"'s thread;

during operation of the application and generation of the application'"'"'s thread, collecting a first set of pieces of operational information relating to the operation of the application from the application'"'"'s thread;

saving the first set of pieces of operational information to a volatile buffer memory, with the volatile buffer memory being dedicated to collecting logging information from the application'"'"'s thread;

evaluating the first set of pieces of operational information for a pre-determined condition, wherein the pre-determined condition is based on one or more policies, and wherein the one or more policies comprise a rule, a log level, a record before time, a record after time, a logging thread rule, and a first failure data capture (FFDC) rule;

in response to a pre-determined condition occurring, selectively writing, to a non-volatile storage medium, only a first sub-set of the first set of pieces of operational information from the portion of the volatile buffer memory to the logging file, with the selection of the first sub-set from the first set being based upon the one or more policies; and

in response to determining that the volatile buffer memory is full, overwriting the first set of operational information with a second set of operational information to the volatile buffer memory.

2. The method of claim 1 wherein the chosen set of logging rules mandate inclusion in the logging file of all pieces of operational information stored in the portion of the volatile buffer memory that occurred in the application'"'"'s thread within a predetermined time range before and after the application'"'"'s thread experiences a failure condition.

3. The method of claim 2 wherein the chosen set of logging rules further mandate inclusion in the logging file of less than all pieces of operational information stored in the portion of the volatile buffer memory that occurred in the application'"'"'s thread outside of the predetermined time range.

4. The method of claim 1 wherein:

the choice of a set of logging rules is based, at least in part, upon the first set of operational information stored in the volatile buffer memory.

5. The method of claim 1 wherein the volatile buffer memory acts as a circular buffer memory so that, on an on-going basis during runtime of the application, more recent pieces of operational information collected from an application'"'"'s thread will overwrite older pieces of operational information collected from the application'"'"'s thread and previously saved in the volatile buffer memory.

6. The method of claim 1, wherein the pre-determined condition is selected from the group consisting of:

an error and a failure.

7. A computer program product for writing at least a portion of a logging file associated with a thread generated by execution of an application, the logging file including a plurality of pieces of logging information from the application'"'"'s thread, the computer program product comprising software stored on a non-transitory software storage device, the software comprising:

first program instructions programmed to choose a set of logging rules, which logging rules determine the selection of which pieces of information from an application'"'"'s thread will be written to a non-volatile log file;

second program instructions programmed to operate the application on a computer system to generate the application'"'"'s thread;

third program instructions programmed to, during operation of the application and generation of the application'"'"'s thread by the second program instructions, collect a first set of pieces of operational information relating to the operation of the application from the application'"'"'s thread;

fourth program instructions programmed to save the first set of pieces of operational information to a volatile buffer memory, with the volatile buffer memory being dedicated to collecting logging information from the application'"'"'s thread;

fifth program instructions programmed to evaluate the first set of pieces of operational information for a pre-determined condition, wherein the pre-determined condition is based on one or more policies, and wherein the one or more policies comprise a rule, a log level, a record before time, a record after time, a logging thread rule, and a first failure data capture (FFDC) rule

in response to a predetermined condition occurring, sixth program instructions programmed to selectively write, to a non-volatile storage medium, only a first sub-set of the first set of pieces of operational information from the portion of the volatile buffer memory the logging file, with the selection of the first sub-set from the first set being based upon the one or more policies; and

in response to determining that the volatile buffer memory is full, seventh program instructions programmed to overwrite the first set of operational information with a second set of operational information to the volatile buffer memory.

8. The product of claim 7 wherein the chosen set of logging rules mandate inclusion in the logging file of all pieces of operational information stored in the portion of the volatile buffer memory that occurred in the application'"'"'s thread within a predetermined time range before and after the application'"'"'s thread experiences a failure condition.

9. The product of claim 8 wherein the chosen set of logging rules further mandate inclusion in the logging file of less than all pieces of operational information stored in the portion of the volatile buffer memory that occurred in the application'"'"'s thread outside of the predetermined time range.

10. The product of claim 7 wherein:

the choice of a set of logging rules, by the first program instructions, is based, at least in part, upon the first set of operational information stored in the volatile buffer memory by the fourth program instructions.

11. The product of claim 7 wherein the volatile buffer memory acts as a circular buffer memory so that, on an on-going basis during runtime of the application, more recent pieces of operational information collected from an application'"'"'s thread will overwrite older pieces of operational information collected from the application'"'"'s thread and previously saved in the volatile buffer memory.

12. The computer program product of claim 7, wherein the pre-determined condition is selected from the group consisting of:

an error and a failure.

13. A computer system for writing at least a portion of a logging file associated with a thread generated by execution of an application, the logging file including a plurality of pieces of logging information from the application'"'"'s thread, the computer system comprising:

a processor(s) set; and

a non-transitory software storage device;

wherein;

the processor set is structured, located, connected and/or programmed to run software stored on the non-transitory software storage device; and

the software comprises;

first program instructions programmed to choose a set of logging rules, which logging rules determine the selection of which pieces of information from an application'"'"'s thread will be written to a non-volatile log file,

second program instructions programmed to operate the application on the computer system to generate the application'"'"'s thread,

third program instructions programmed to, during operation of the application and generation of the application'"'"'s thread by the second program instructions, collect a first set of pieces of operational information relating to the operation of the application from the application'"'"'s thread,

fourth program instructions programmed to save the first set of pieces of operational information to a volatile buffer memory, with the volatile buffer memory being dedicated to collecting logging information from the application'"'"'s thread;

fifth program instructions programmed to evaluate the first set of pieces of operational information for a pre-determined condition, wherein the pre-determined condition is based on one or more policies, and wherein the one or more policies comprise a rule, a log level, a record before time, a record after time, a logging thread rule, and a first failure data capture (FFDC) rule

in response to a predetermined condition occurring, sixth program instructions programmed to selectively write, to a non-volatile storage medium, only a first sub-set of the first set of pieces of operational information from the portion of the volatile buffer memory the logging file, with the selection of the first sub-set from the first set being based upon the one or more policies; and

in response to determining that the volatile buffer memory is full, seventh program instructions programmed to overwrite the first set of operational information with a second set of operational information to the volatile buffer memory.

14. The system of claim 13 wherein the chosen set of logging rules mandate inclusion in the logging file of all pieces of operational information stored in the portion of the volatile buffer memory that occurred in the application'"'"'s thread within a predetermined time range before and after the application'"'"'s thread experiences a failure condition.

15. The system of claim 14 wherein the chosen set of logging rules further mandate inclusion in the logging file of less than all pieces of operational information stored in the portion of the volatile buffer memory that occurred in the application'"'"'s thread outside of the predetermined time range.

16. The system of claim 13 wherein:

the choice of a set of logging rules, by the first program instructions, is based, at least in part, upon the first set of operational information stored in the volatile buffer memory by the fourth program instructions.

17. The system of claim 13 wherein the volatile buffer memory acts as a circular buffer memory so that, on an on-going basis during runtime of the application, more recent pieces of operational information collected from an application'"'"'s thread will overwrite older pieces of operational information collected from the application'"'"'s thread and previously saved in the volatile buffer memory.

18. The computer system of claim 13, wherein the pre-determined condition is selected from the group consisting of:

an error and a failure.