METHOD AND SYSTEM FOR DATA-TRIGGERED DYNAMIC LOG LEVEL CONTROL

• US 20140279918A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Han, Yiping
• Granted Patent: US 9,342,438 B2
• Time in Patent Office: Days
• US Class Current: 707/648
• CPC Class Codes: G06F 11/366 using diagnostics G06F11/0703 takes precedence

Abstract

Embodiments of the present teachings disclose method, system, and programs for data driven dynamic logging. Data is received by a logging system where the data is flagged for dynamic logging when one or more dynamic flagging level criteria are satisfied. Data is evaluated by a logging module wrapper, which determines whether to log the data using the default logging level or dynamic logging level, according to whether the data is flagged. A logging module logs information in a logging database according to the default logging level or dynamic logging level. Based on the logged information and detected abnormalities the dynamic flagging level and dynamic logging level are automatically or manually adjusted.

Claims

1. A method implemented on a machine having one or more processor, storage, and communication platform for creating a log, comprising:

obtaining a first indicator indicative of a dynamic level at which a data traffic is to be logged; and

logging the data traffic in accordance with the first indicator,

wherein

the first indicator is dynamically adjusted based on the health of the data traffic.

7. The method of claim 1, further comprising associating a second indicator with the data traffic indicative of whether the data traffic is to be logged at a default level or at a level determined based on the first indicator.

8. The method of claim 7, wherein the second indicator is determined based on one or more criteria which include at least one of a random sampling rate, an even trigger, a user related the data traffic, content related to the data traffic, and an application related to the data traffic.

9. The method of claim 7, wherein the second indicator is dynamically adjusted based on the health of the data traffic.

10. The method of claim 1, wherein the first indicator is adjustable across a plurality of logging levels, each of which represents an extent to which information associated with the data traffic is to be collected.

2-3. -3. (canceled)

4. A method implemented on a machine having one or more processor, storage, and communication platform for adjusting a log level, comprising:

obtaining a first indicator indicative of a dynamic level at which a data traffic is to be logged;

accessing log data collected from the data traffic that has been logged in accordance with the first indicator;

estimating the health of the data traffic based on the accessed log data; and

adjusting the first indicator to generated an adjusted first indicator in accordance with the health of the data traffic, wherein the adjusted first indicator is with respect to the data traffic.

11. The method of claim 4, further comprising associating a second indicator with the data traffic indicative of whether the data traffic is to be logged at a default level or at a level determined based on the first indicator.

12. The method of claim 11, wherein the second indicator is determined based on one or more criteria which include at least one of a random sampling rate, an even trigger, a user related the data traffic, content related to the data traffic, and an application related to the data traffic.

13. The method of claim 11, further comprising adjusting the second indicator to generate an adjusted second indicator in accordance with the health of the data traffic, wherein the adjusted second indicator is with respect to the data traffic.

14. The method of claim 4, wherein the first indicator is adjustable across a plurality of logging levels, each of which represents an extent to which information associated with the data traffic is to be collected.

5-6. -6. (canceled)

15. A system having at least one processor, a storage, and a communication platform for creating a log, the system comprising:

a logging module implemented on the at least one processor and configured to

obtain a first indicator indicative of a dynamic level at which a data traffic is to be logged, and

log the data traffic in accordance with the first indicator, wherein

the first indicator is dynamically adjusted based on the health of the data traffic.

16. The system of claim 15, further comprising a decision module configured to associate a second indicator with the data traffic indicative of whether the data traffic is to be logged at a default level or at a level determined based on the first indicator.

17. The system of claim 16, wherein the second indicator is determined based on one or more criteria which include at least one of a random sampling rate, an even trigger, a user related the data traffic, content related to the data traffic, and an application related to the data traffic.

18. The system of claim 16, wherein the second indicator is dynamically adjusted based on the health of the data traffic.

19. A system having at least one processor, a storage, and a communication platform for adjusting a log level, the system comprising:

a logging module implemented on the at least one processor and configured to obtain a first indicator indicative of a dynamic level at which a data traffic is to be logged; and

a log analysis module implemented on the at least one processor and configured to

access log data collected from the data traffic that has been logged in accordance with the first indicator,

estimate the health of the data traffic based on the log data, and

adjust the first indicator to generated an adjusted first indicator in accordance with the health of the data traffic, wherein the adjusted first indicator is with respect to the data traffic.

20. The system of claim 19, further comprising a decision module configured to associate a second indicator with the data traffic indicative of whether the data traffic is to be logged at a default level or at a level determined based on the first indicator.

21. The system of claim 20, wherein the second indicator is determined based on one or more criteria which include at least one of a random sampling rate, an even trigger, a user related the data traffic, content related to the data traffic, and an application related to the data traffic.

22. The system of claim 20, wherein the log analysis module is further configured to adjust the second indicator to generate an adjusted second indicator in accordance with the health of the data traffic, wherein the adjusted second indicator is with respect to the data traffic.

23. A non-transitory machine-readable medium having information recorded thereon for creating a log, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining a first indicator indicative of a dynamic level at which a data traffic is to be logged; and

logging the data traffic in accordance with the first indicator, wherein

the first indicator is dynamically adjusted based on the health of the data traffic.

24. A non-transitory machine-readable medium having information recorded thereon for adjusting a log level, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining a first indicator indicative of a dynamic level at which a data traffic is to be logged;

accessing log data collected from the data traffic that has been logged in accordance with the first indicator;

estimating the health of the data traffic based on the accessed log data; and

adjusting the first indicator to generated an adjusted first indicator in accordance with the health of the data traffic, wherein the adjusted first indicator is with respect to the data traffic.