×

Adaptive resource scheduling for data stream processing

  • US 10,554,577 B2
  • Filed: 03/14/2017
  • Issued: 02/04/2020
  • Est. Priority Date: 03/14/2017
  • Status: Active Grant
First Claim
Patent Images

1. A method of stream processing in a data processing system cluster, the method comprising:

  • a processor executing a driver to request, from a cluster manager, (1) execution of a first task within a job including a plurality of tasks and (2) a first quantity of resources of the cluster to support execution of the task; and

    at completion of execution of the first task by the cluster, the processor executing the driver to retain for a second task among the plurality of tasks at least a portion of the resources allocated to the first task by the cluster manager, wherein the retaining includes;

    determining a second quantity of the resources to retain for the second task based on a relative priority of the job to other jobs in the cluster and efficiency of the cluster manager in allocating resources to the first task.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×