×

Systems and methods for scheduling data flow execution based on an arbitrary graph describing the desired data flow

  • US 20040186915A1
  • Filed: 03/18/2003
  • Published: 09/23/2004
  • Est. Priority Date: 03/18/2003
  • Status: Active Grant
First Claim
Patent Images

1. A data transformation service comprising:

  • a data retrieval system to receive data from a source;

    a data transformation pipeline comprising;

    a plurality of component objects;

    a graphical user interface by which a user can represent a data transformation as a series of interconnected nodes in a graph, each node corresponding to a component object from among the plurality of components objects;

    an interpreter that traverses the graph and translates the graph into a data flow execution plan and at least one work list, said list comprising at least one work item;

    a pipeline engine to build the data flow execution based on the data flow execution plan, said data flow execution comprising a set of components instantiated from the plurality of component objects; and

    a scheduler that executes at least one work item in at least one work list;

    a destination data storage system to store data.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×