×

Multi-input SQL-MR

  • US 10,452,632 B1
  • Filed: 06/27/2014
  • Issued: 10/22/2019
  • Est. Priority Date: 06/29/2013
  • Status: Active Grant
First Claim
Patent Images

1. A system comprising:

  • an array of storage devices configured to store data;

    an array of processing nodes in communication with the array of storage devices, the array of processing nodes configured to;

    receive a request to perform at least one task associated with the data, wherein the request includes a function call to a function configured to operate on a first data table and a second data table included in the data;

    partition rows of the first data table into a plurality of row partitions among respective subsets of the processing nodes based on a partition key common to both the first data table and the second data table, wherein at least one row partition of the first data table comprises a plurality of rows;

    for each partition key, generate a relation, wherein each relation is a data structure configured to include a plurality of columns in a single row, wherein each column of the relation is configured to maintain multiple column values from at least one row of a different data table;

    for each relation, insert a plurality of row values from at least one row of the first data table from one of the row partitions into a single column of a row of the relation according to the partition key;

    distribute row values from at least one row of the second data table into another single column of at least one relation according to the partition key, wherein at least one row value from at least one column of the second data table is distributed into a column of a row of a relation and, wherein the column of the row of the relation is in a row of the relation having at least one row value from the first data table in a different column of the relation; and

    execute the function on each relation to generate at least one output data object.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×