Systems and Methods for Concurrent Summarization of Indexed Data
First Claim
Patent Images
1. A method comprising:
- receiving raw machine-generated data;
segmenting the raw machine-generated data into a set of time-stamped event records;
indexing and storing the set of time-stamped event records in two or more partitions of event records;
receiving a first summary request;
executing, in response to receiving the first summary request, a first process comprising writing, to a first summary directory, first summary data for a first partition of the two or more partitions;
receiving a second summary request;
executing, in response to receiving the second summary request, a second process comprising;
determining that the first summary directory is locked to inhibit processes other than the first process from writing summary data to the first summary directory; and
in response to determining that the first summary directory is locked;
identifying a second partition of the two or more partitions;
locking a second summary directory to inhibit processes other than the second process from writing summary data to the second summary directory;
determining second summary data for the second partition;
writing the second summary data to the second summary directory; and
unlocking the second summary directory.
1 Assignment
0 Petitions
Accused Products
Abstract
Provided are systems and methods for concurrent summarization of indexed data. In some embodiments, two or more summary processes can be executed concurrently (e.g., in parallel) by an indexer to generate summaries for respective subsets of indexed data (e.g., partitions or buckets of indexed data) managed by the indexer.
-
Citations
30 Claims
-
1. A method comprising:
-
receiving raw machine-generated data; segmenting the raw machine-generated data into a set of time-stamped event records; indexing and storing the set of time-stamped event records in two or more partitions of event records; receiving a first summary request; executing, in response to receiving the first summary request, a first process comprising writing, to a first summary directory, first summary data for a first partition of the two or more partitions; receiving a second summary request; executing, in response to receiving the second summary request, a second process comprising; determining that the first summary directory is locked to inhibit processes other than the first process from writing summary data to the first summary directory; and in response to determining that the first summary directory is locked; identifying a second partition of the two or more partitions; locking a second summary directory to inhibit processes other than the second process from writing summary data to the second summary directory; determining second summary data for the second partition; writing the second summary data to the second summary directory; and unlocking the second summary directory. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. A system comprising:
-
one or more processors; and one or more memories comprising program instructions stored thereon that are executable by the one or more processors to cause; receiving, at a computing device, raw machine-generated data; segmenting the raw machine-generated data into a set of time-stamped event records; indexing and storing the set of time-stamped event records in two or more partitions of event records; receiving a first summary request; executing, in response to receiving a first summary request, a first process comprising writing, to a first summary directory, first summary data for a first partition of the two or more partitions; receiving a second summary request; executing, in response to receiving the second summary request, a second process comprising; determining that the first summary directory is locked to inhibit processes other than the first process from writing summary data to the first summary directory; and in response to determining that the first summary directory is locked; identifying a second partition of the two or more partitions; locking a second summary directory to inhibit processes other than the second process from writing summary data to the second summary directory; determining second summary data for the second partition; writing the second summary data to the second summary directory; and unlocking the second summary directory.
-
-
30. One or more non-transitory computer-readable medium comprising program instructions stored thereon that are executable by one or more processors to cause:
-
receiving, at a computing device, raw machine-generated data; segmenting the raw machine-generated data into a set of time-stamped event records; indexing and storing the set of time-stamped event records in two or more partitions of event records; receiving a first summary request; executing, in response to receiving a first summary request, a first process comprising writing, to a first summary directory, first summary data for a first partition of the two or more partitions; receiving a second summary request; executing, in response to receiving the second summary request, a second process comprising; determining that the first summary directory is locked to inhibit processes other than the first process from writing summary data to the first summary directory; and in response to determining that the first summary directory is locked; identifying a second partition of the two or more partitions; locking a second summary directory to inhibit processes other than the second process from writing summary data to the second summary directory; determining second summary data for the second partition; writing the second summary data to the second summary directory; and unlocking the second summary directory.
-
Specification