×

Model-based design for transforming data

  • US 10,083,215 B2
  • Filed: 04/06/2015
  • Issued: 09/25/2018
  • Est. Priority Date: 04/06/2015
  • Status: Active Grant
First Claim
Patent Images

1. A method for providing a model-based design for transforming data, the method comprising:

  • developing, by one or more processors, a modeling framework, wherein the modeling framework includes a plurality of rules for performing transformations of data;

    configuring, by one or more processors, a data unit, wherein the data unit is assigned to a job that includes one or more rules of the plurality of rules, and wherein the job transforms the data unit from a data format of a source system into a data format of a destination system;

    monitoring, by one or more processors, usage statistics for at least one rule of the job, wherein a plurality of data units are split into a first stream and a second stream for parallel processing, wherein different operations are performed on each stream in parallel, and wherein results of each stream are combined;

    determining, by one or more processors, a pattern in at least one data unit of the first stream and at least a second data unit of the second stream;

    determining, by one or more processors, an aggregate rule based on a first atomic rule of the plurality of rules and a second atomic rule of the plurality of rules, wherein the first atomic rule and the second atomic rule are identified, in part, by the pattern;

    identifying, by one or more processors, a first rule of the job based on failing to meet a predetermined threshold of usage of data units assigned to the job that include the first rule;

    removing, by one or more processors, the first rule from memory, based on the first rule of the job failing to meet the predetermined threshold; and

    configuring, by one or more processors, a subsequent data unit, wherein;

    the subsequent data unit is assigned to a subsequent job that includes the aggregate rule; and

    the subsequent job transforms the subsequent data unit from the data format of the source system into the data format of the destination system.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×