Ultra-fast pattern generation algorithm for the heterogeneous logs
First Claim
1. A computer-implemented method executed on a processor for generating patterns from a set of heterogeneous log messages, the method comprising:
- collecting the set of heterogenous log messages from arbitrary or unknown systems or applications or sensors or instruments;
splitting the log messages into tokens based on a set of delimiters;
identifying datatypes of the tokens;
identifying a log structure of the log messages by generating pattern-signatures of all the tokens and the datatypes based on predefined pattern settings;
generating a pattern for each of the log structures; and
enabling users to edit the pattern for each of the log structures based on user requirements.
2 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method for generating patterns from a set of heterogeneous log messages is presented. The method includes collecting the set of heterogenous log messages from arbitrary or unknown systems or applications or sensors or instruments, splitting the log messages into tokens based on a set of delimiters, identifying datatypes of the tokens, identifying a log structure of the log messages by generating pattern-signatures of all the tokens and the datatypes based on predefined pattern settings, generating a pattern for each of the log structures and enabling users to edit the pattern for each of the log structures based on user requirements.
5 Citations
20 Claims
-
1. A computer-implemented method executed on a processor for generating patterns from a set of heterogeneous log messages, the method comprising:
-
collecting the set of heterogenous log messages from arbitrary or unknown systems or applications or sensors or instruments; splitting the log messages into tokens based on a set of delimiters; identifying datatypes of the tokens; identifying a log structure of the log messages by generating pattern-signatures of all the tokens and the datatypes based on predefined pattern settings; generating a pattern for each of the log structures; and enabling users to edit the pattern for each of the log structures based on user requirements. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for generating patterns from a set of heterogeneous log messages, the system comprising:
-
a memory; and a processor in communication with the memory, wherein the processor runs program code to; collect the set of heterogenous log messages from arbitrary or unknown systems or applications or sensors or instruments; split the log messages into tokens based on a set of delimiters; identify datatypes of the tokens; identify a log structure of the log messages by generating pattern-signatures of all the tokens and the datatypes based on predefined pattern settings; generate a pattern for each of the log structures; and enable users to edit the pattern for each of the log structures based on user requirements. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A non-transitory computer-readable storage medium comprising a computer-readable program for generating patterns from a set of heterogeneous log messages, wherein the computer-readable program when executed on a computer causes the computer to perform the steps of:
-
collecting the set of heterogenous log messages from arbitrary or unknown systems or applications or sensors or instruments; splitting the log messages into tokens based on a set of delimiters; identifying datatypes of the tokens; identifying a log structure of the log messages by generating pattern-signatures of all the tokens and the datatypes based on predefined pattern settings; generating a pattern for each of the log structures; and enabling users to edit the pattern for each of the log structures based on user requirements. - View Dependent Claims (20)
-
Specification