Method for estimating format of log message and computer and computer program therefor

• US 9,858,168 B2
• Filed: 11/11/2016
• Issued: 01/02/2018
• Est. Priority Date: 08/28/2014
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Mizutani, Masayoshi
• Primary Examiner(s): Arjomandi, Noosha
• Application Number:
  US15/349,033
• Publication Number:
  US 20170060724A1
• Time in Patent Office: 417 Days
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06N 5/048 Fuzzy inferencing

Abstract

A technique for estimating a format of a log message (LM) according to the present invention includes creating a first directed graph structure by dividing a first LM by predetermined characters to define divided portions as nodes and arranging the nodes in order from the beginning of the first LM; creating a second directed graph structure by performing on a second LM the same processing as that performed on the first LM; comparing nodes in the first directed graph structure with nodes in the second directed graph structure to detect nodes other than nodes including a corresponding character string; adding to the first directed graph structure the node detected in the second directed graph structure among the detected nodes as a first branch node; and estimating the format, based on the first directed graph structure including the first branch node added thereto.

Claims

1. A computer for estimating a format of a log message, the computer comprising:

one or more hardware processors;

directed graph structure creation means for creating a first directed graph structure by dividing a first log message by predetermined characters to define divided portions as nodes and arranging the nodes in order from the beginning of the first log message, and creating a second directed graph structure by dividing the second log message by the predetermined characters to define divided portions as nodes and arranging the nodes in order from the beginning of the second log message;

node detection means for comparing nodes in the first directed graph structure with nodes in the second directed graph structure to detect a node in the first directed graph structure and a node in the second directed graph structure that are nodes other than nodes including a corresponding character string;

directed graph structure change means for adding to the first directed graph structure the node detected in the second directed graph structure among the detected nodes as a first branch node; and

format estimation means for estimating the format, based on the first directed graph structure including the first branch node added thereto, wherein the format includes a first portion associated with a node including a corresponding character string, a second portion associated with a node whose appearance tendency of character string is similar between the node detected in the first directed graph structure and the node detected in the second directed graph structure, and a third portion associated with a node other than nodes having a similar appearance tendency of character string.

2. The computer of claim 1, wherein the creating the second directed graph structure, the detecting, and the adding are repeated.

3. The computer of claim 1, wherein the estimating is performed based on the directed graph structure created in the adding after repeating a predetermined number of times.

4. The computer of claim 1, further comprising:

a means for integrating the nodes having similar appearance tendencies of character strings into one node in the first directed graph structure including the first branch node added thereto,

wherein the estimating is performed based on the first directed graph structure in which the nodes having similar appearance tendencies of character strings are integrated into one node.

5. The computer of claim 4, wherein a determination of the appearance tendencies of character strings are similar to each other is performed on the basis of:

a first condition that a percentage of character strings having similar character types is equal to or more than a predetermined value,

a second condition that a character length is equal to or more than a predetermined value,

a third condition that an editing distance between characters is short, or

a fourth condition that at least two of the first to third conditions are satisfied.

6. The computer of claim 4, wherein the creating the second directed graph structure, the detecting, the adding, and the integrating are repeated.

7. The computer of claim 6, wherein the estimating is performed based on the directed graph structure created in the integrating performed after repeating a predetermined number of times.

8. The computer of claim 4, wherein the first directed graph structure including the first branch node added thereto has a closed path including two nodes including a corresponding character string, at least one node detected in the first directed graph structure, and at least one node detected in the second directed graph structure, and the at least one node detected in the first directed graph structure and the at least one node detected in the second directed graph structure exist between the two nodes including the corresponding character string.

9. The computer of claim 8, wherein in case that the closed path includes a plurality of closed paths, the detecting further includes a determining step of recursively determining, from a smaller closed path of the plurality of closed paths, that the appearance tendencies of character strings are similar to each other.

10. The computer of claim 4, further comprising:

a means for outputting the first directed graph structure in which the nodes having similar appearance tendencies of character strings are integrated into one node as an automaton.

11. The computer of claim 10, further comprising:

a means for creating a third directed graph structure by dividing a third log message by the predetermined characters to define divided portions as nodes and arranging the nodes in order from the beginning of the third log message;

a means for determining whether a node in the third directed graph structure corresponds to a node in the automaton;

a means for comparing, in accordance with a node in the third directed graph structure being different from a node in the automaton, nodes in the first directed graph structure including the first branch node added thereto with nodes in the third directed graph structure to detect a node in the first directed graph structure including the first branch node added thereto and a node in the third directed graph structure that are nodes other than nodes including a corresponding character string; and

a means for adding to the first directed graph structure including the first branch node added thereto the node detected in the third directed graph structure among the detected nodes as a second branch node, wherein the estimating is performed based on the first directed graph structure including the second branch node added thereto.

12. The computer of claim 11, wherein the determining whether the node in the third directed graph structure corresponds to the node in the automaton includes:

determining, in accordance with at least one node in the third directed graph structure satisfying a predetermined condition with respect to the integrated node in the automaton, that the node in the third directed graph structure corresponds to the node in the automaton.

13. The computer of claim 1, wherein the detecting includes:

searching for, in case that a node in the first directed graph structure and a node in the second directed graph structure that include a different character string are found, a subgraph and a path including the largest number of partially corresponding nodes in the found nodes.

14. The computer of claim 13, wherein the searching is performed using a memorizing recursion technique.

15. The computer of claim 1, wherein the estimating includes:

estimating the format, by scanning at least a path passing from an origin node to a terminal node of the first directed graph structure including the first branch node added thereto.

16. The computer of claim 15, wherein in case that the path includes a plurality of paths, the format includes the first portion, the second portion, and the third portion, which are associated with nodes in the plurality of paths.

17. The computer of claim 1, wherein the predetermined characters are signs or blank characters.

18. The computer of claim 1, wherein the second portion is a sign representing an arbitrary character string.