×

Auto-generation of code for performing a transform in an extract, transform, and load process

  • US 8,504,513 B2
  • Filed: 11/25/2009
  • Issued: 08/06/2013
  • Est. Priority Date: 11/25/2009
  • Status: Active Grant
First Claim
Patent Images

1. A computer-implemented method for performing a transform in an extract, transform, and load process, the computer-implemented method comprising performing computer-implemented operations for:

  • storing, by a computing device, a data model mapping that maps data types within a data source type system implemented by one or more data sources to elements within a data warehouse, the elements including dimension data types, relationship fact data types and outrigger data types;

    generating, by the computing device, program code that performs a transform of data retrieved from the one or more data sources based on the data model mapping, the transform including a dimension data type transform, a relationship fact data type transform and an outrigger data type transform,where the program code initializes a plurality of watermarks, the watermarks indicating a date and a time at which a previous dimension transform ended; and

    determining where a current dimension transform is to begin based on the plurality of watermarks,wheredimension data types include information regarding specific descriptive aspects of an organization,relationship fact data types include information regarding multiple associations of data between a plurality of dimension data types and tracks changes of the associations, andoutrigger data types include information regarding commonly associated data between at least two dimension data types,wherein the dimension data type transform further comprisesupdating, by the computing device, a destination dimension table attribute for a change in an existing element,inserting, by the computing device, new data into the destination dimension table for a new data object, andupdating, by the computing device, the destination dimension table by marking an element as deleted for a data object that has been deleted from a data source,wherein the relationship fact data type transform further comprisesdetermining, by the computing device, a relationship in a destination relationship table between data objects that need to be deleted,setting, by the computing device, a deleted time of a relationship to be deleted in the destination relationship table between objects to a time of creation of a new relationship between objects, andupdating, by the computing device, the destination relationship table by marking the relationship to be deleted based on the time of creation of the new relationship, andwherein the outrigger data type transform further includes inserting, by the computing device, new enumerations in a destination outrigger table, andupdating, by the computing device, existing enumerations in the destination outrigger table.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×