×

Collecting and aggregating datasets for analysis

  • US 9,082,127 B2
  • Filed: 09/08/2010
  • Issued: 07/14/2015
  • Est. Priority Date: 03/31/2010
  • Status: Active Grant
First Claim
Patent Images

1. A method of facilitating collection and aggregation of machine or user generated dataset for analysis, the method comprising:

  • collecting, by a compute node, the dataset from a data source on a machine,wherein the dataset is received or generated on the machine;

    transmitting the dataset from the data source toward a receiving location by steps including;

    recording the dataset as an event using a data model;

    extracting a timestamp from the dataset;

    specifying, based on the timestamp, a priority of the event in a priority field included in the data model;

    specifying, based on the priority, the event in the data model with an attribute in a metadata table included in the data model, wherein the attribute includes a map that directs how the event is to be streamed to a subsequent machine, wherein the metadata table included in the data model is extensible to add additional attributes to the event by the subsequent machine which is configured to further process the dataset as the event is streamed from the data source to the receiving location;

    aggregating the dataset collected from the data source at the receiving location,wherein the receiving location is dynamically updated by the compute node responsive to receiving the configuration information from a master node; and

    performing analytics on the dataset responsive to collecting or aggregating the dataset on the machine;

    wherein the dataset aggregated at the receiving location is written to a storage location, andwherein the dataset is stored redundantly on a distributed file system at the storage location.

View all claims
  • 5 Assignments
Timeline View
Assignment View
    ×
    ×