Computing usage metrics for a content sharing platform
First Claim
1. A method comprising:
- receiving, by a processing device, usage logs of a content sharing platform, the usage logs pertaining to events associated with content items of the content sharing platform, wherein the usage logs comprise data pertaining to the events, the data stored using an unstructured format;
for each usage log, processing the usage log in a single parsing and processing pipeline executed by the processing device, where the single parsing and processing pipeline is to;
identify an event associated with the usage log;
parse the unstructured format of the data of the usage log to identify parsed data comprising a set of characteristics for the identified event, wherein parsing the unstructured format of the data comprises delineating the data to associate with different fields corresponding to the set of characteristics for the identified event;
derive classification data about the identified event from the parsed data, the classification data not comprised in the data of the usage log and comprising at least a source of the event and a type of device associated with the event; and
store the parsed data and the classification data as an event entry for the event, wherein the event entry is stored using a structured format; and
storing metadata corresponding to the event separately from the event entry, the metadata to be combined with the event entry to create a log entry, wherein the log entry is provided as a response to a request for information about the event received from a downstream pipeline.
2 Assignments
0 Petitions
Accused Products
Abstract
A method for computing usage metrics for a content sharing platform is disclosed. The method includes receiving usage logs of a content sharing platform, the usage logs pertaining to a plurality of events associated with content items of the content sharing platform. The method further includes, for each usage log, identifying an event associated with the usage log, parsing the usage log to identify a set of characteristics for the identified event, obtaining additional information about the identified event based on the set of characteristics, and storing the set of characteristics and the additional information as an event entry for the event. The method also includes storing metadata corresponding to the event separately from the event entry, the metadata to be provided with the event entry to a user upon a user request for information about the event.
15 Citations
20 Claims
-
1. A method comprising:
-
receiving, by a processing device, usage logs of a content sharing platform, the usage logs pertaining to events associated with content items of the content sharing platform, wherein the usage logs comprise data pertaining to the events, the data stored using an unstructured format; for each usage log, processing the usage log in a single parsing and processing pipeline executed by the processing device, where the single parsing and processing pipeline is to; identify an event associated with the usage log; parse the unstructured format of the data of the usage log to identify parsed data comprising a set of characteristics for the identified event, wherein parsing the unstructured format of the data comprises delineating the data to associate with different fields corresponding to the set of characteristics for the identified event; derive classification data about the identified event from the parsed data, the classification data not comprised in the data of the usage log and comprising at least a source of the event and a type of device associated with the event; and store the parsed data and the classification data as an event entry for the event, wherein the event entry is stored using a structured format; and storing metadata corresponding to the event separately from the event entry, the metadata to be combined with the event entry to create a log entry, wherein the log entry is provided as a response to a request for information about the event received from a downstream pipeline. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:
-
receiving, by the processing device, usage logs of a content sharing platform, the usage logs pertaining to events associated with content items of the content sharing platform, wherein the usage logs comprise data pertaining to the events, the data stored using an unstructured format; for each usage log, processing the usage log in a single parsing and processing pipeline executed by the processing device, where the single parsing and processing pipeline is to; identify an event associated with the usage log; parse the unstructured format of the data of the usage log to identify parsed data comprising a set of characteristics for the identified event, wherein parsing the unstructured format of the data comprises delineating the data to associate with different fields corresponding to the set of characteristics for the identified event; derive classification data about the identified event from the parsed data, the classification data not comprised in the data of the usage log and comprising at least a source of the event and a type of device associated with the event; and store the parsed data and the classification data as an event entry for the event, wherein the event entry is stored using a structured format; and storing metadata corresponding to the event separately from the event entry, the metadata to be combined with the event entry to create a log entry, wherein the log entry is provided as a response to a request for information about the event received from a downstream pipeline. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A system comprising:
-
a processing device; a memory coupled to the processing device, the memory to store a plurality of media items; and a log processing component executable by the processing device from the memory, the log processing component to; receive usage logs of a content sharing platform, the usage logs pertaining to events associated with content items of the content sharing platform, wherein the usage logs comprise data pertaining to the events, the data stored using an unstructured format; for each usage log, process the usage log in a single parsing and processing pipeline executed by the processing device, where the single parsing and processing pipeline is to; identify an event associated with the usage log; parse the unstructured format of the data of the usage log to identify parsed data comprising a set of characteristics for the identified event, wherein parsing the unstructured format of the data comprises delineating the data to associate with different fields corresponding to the set of characteristics for the identified event; derive classification data about the identified event from the parsed data, the classification data not comprised in the data of the usage log and comprising at least a source of the event and a type of device associated with the event; and store the parsed data and the classification data as an event entry for the event, wherein the event entry is stored using a structured format; and a metadata processing component executable by the processing device from the memory, the metadata processing component to metadata corresponding to the event separately from the event entry, the metadata to be combined with the event entry to create a log entry, wherein the log entry is provided as a response to a request for information about the event received from a downstream pipeline. - View Dependent Claims (17, 18, 19, 20)
-
Specification