×

Parallel processing of data

  • US 9,626,202 B2
  • Filed: 02/13/2015
  • Issued: 04/18/2017
  • Est. Priority Date: 05/04/2010
  • Status: Active Grant
First Claim
Patent Images

1. A computer-implemented method executed by one or more processors, the method comprising:

  • executing a deferred operation included in a dataflow graph for a data parallel pipeline to produce materialized data objects corresponding to the deferred operation, including;

    determining an estimated size of data associated with the deferred operation;

    determining that the estimated size exceeds a data size threshold;

    in response to determining that the estimated size exceeds the data size threshold, executing the deferred operation as a remote parallel operation with the one or more processors,wherein determining the dataflow graph for the data parallel pipeline includes analyzing sequential programming language instructions associated with the data parallel pipeline, andwherein the materialized data objects are configured to be accessed during execution of a program corresponding to the sequential programming language instructions associated with the data parallel pipeline.

View all claims
  • 3 Assignments
Timeline View
Assignment View
    ×
    ×