Method and system for coordinating stream processing at a video streaming platform

• US 9,826,011 B2
• Filed: 07/31/2014
• Issued: 11/21/2017
• Est. Priority Date: 07/31/2014
• Status: Active Grant

• Current Assignee: iStreamPlanet Co. LLC (Warner Bros. Discovery, Inc.)
• Original Assignee: iStreamPlanet
• Inventors: Ito, Motonari
• Primary Examiner(s): CONAWAY, JAMES E
• Application Number:
  US14/448,981
• Publication Number:
  US 20160036886A1
• Time in Patent Office: 1,209 Days
• Field of Search: 709219
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/23439 for generating different versions

Abstract

A method implemented in an electronic device serving as a worker processing video and audio streams of a streaming platform system is disclosed. The method includes the electronic device requesting a task group from an orchestrator of the streaming platform system, where the orchestrator manages video and audio stream processing of the streaming platform system. The method also includes the electronic device receiving the task group allocated for the worker from the orchestrator, where the task group is allocated based at least partially on characteristics of the worker. The method also includes the electronic device initiating one or more task running processes to execute the allocated task group, and where each task running process performs at least one of processing one or more inputs corresponding to an incoming edge to the node, and producing one or more outputs corresponding to one or more outgoing edges from the node.

Claims

1. A method implemented in an electronic device serving as a worker processing video and audio streams of a streaming platform system, the method comprising:

requesting a task group from an orchestrator of the streaming platform system, wherein the orchestrator manages video and audio stream processing of the streaming platform system;

receiving the task group allocated for the worker from the orchestrator, wherein the task group is allocated based at least partially on characteristics of the worker, wherein the task group corresponds to a subset of a task graph of the orchestrator, wherein the task graph is a directed acyclic graph of tasks, wherein each node of the task graph represents a processing task, and wherein each edge of the task graph represents a data flow across two processing tasks and corresponding input and output of each processing task; and

initiating one or more task running processes to execute the allocated task group, wherein each task running process executes a processing task corresponding to a node of the task group, and wherein each task running process performs at least one of processing one or more inputs corresponding to an incoming edge to the node, and producing one or more outputs corresponding to one or more outgoing edges from the node, where the one or more outputs are stored as a set of resources within a segment store of the worker and the set of resources is made accessible to other workers via a resource registry service.

2. The method of claim 1, the method further comprising:

indicating a status of the one or more task running processes, wherein the status is utilized to determine aborting or restarting a task running process.

3. The method of claim 1, wherein executing a processing task corresponding to a node of the task group comprises:

for each incoming edge to the node,

reading an input parameter set corresponding to the incoming edge to the node, wherein the input parameter set maps to a resource required to execute the processing task;

determining whether the resource is within the segment store of the worker or not, wherein the segment store stores resources of the worker; and

upon determining that the resource is within the worker, utilizing data of the resource to execute the processing task.

4. The method of claim 3, wherein executing the processing task corresponding to the node of the task group further comprises:

upon determining that the resource is not within the worker,

obtaining resource resolution of the resource from the resource registry service, wherein the resource resolution provides a source location of the resource;

replicating data of the resolved resource into the segment store of the worker through a replication connection to the source location; and

utilizing replicated data in the segment store in executing the processing task.

5. The method of claim 4, wherein the resource registry service is provided by the orchestrator.

6. The method of claim 1, wherein executing a processing task corresponding to a node of the task group comprises:

for each outgoing edge from the node,

requesting to create a resource, wherein the resource maps to an output parameter set corresponding to the outgoing edge from the node;

registering the resource in the resource registry service;

creating the resource in the segment store of the worker; and

writing data to the resource in executing the processing task.

7. The method of claim 6, wherein executing a processing task corresponding to a node of the task group further comprises:

replicating data of the resource to each processing task having a replication connection to the resource.

8. An electronic device to serve as a worker processing video and audio streams of a streaming platform system, the electronic device comprising:

a non-transitory machine-readable storage medium to store the worker; and

a processor coupled to the non-transitory machine-readable storage medium, the processor to execute the worker, the worker configured to request a task group from an orchestrator of the streaming platform system, wherein the orchestrator manages video and audio stream processing of the streaming platform system;

receive the task group allocated for the worker from the orchestrator, wherein the task group is allocated based at least partially on characteristics of the worker, wherein the task group corresponds to a subset of a task graph of the orchestrator, wherein the task graph is a directed acyclic graph of tasks, wherein each node of the task graph represents a processing task, and wherein each edge of the task graph represents a data flow across two processing tasks and corresponding input and output of each processing task; and

initiate one or more task running processes to execute the allocated task group, wherein each task running process executes a processing task corresponding to a node of the task group, and

wherein each task running process performs at least one of processing one or more inputs corresponding to an incoming edge to the node, and producing one or more outputs corresponding to one or more outgoing edges from the node, where the one or more outputs are stored as a set of resources within a segment store of the worker and the set of resources is made accessible to other workers via a resource registry service.

9. The electronic device of claim 8, wherein the worker is further configured to indicate a status of the one or more task running processes, wherein the status is utilized to determine aborting or restarting a task running process.

10. The electronic device of claim 8, wherein for executing a processing task corresponding to a node of the task group, the worker is further configured to,

for each incoming edge to the node,

read an input parameter set corresponding to the incoming edge to the node, wherein the input parameter set maps to a resource required to execute the processing task;

determine whether the resource is within the segment store of the worker or not, wherein the segment store stores resources of the worker; and

upon determining that the resource is within the worker, utilize data of the resource to execute the processing task.

11. The electronic device of claim 10, wherein for executing a processing task corresponding to a node of the task group, the worker is further configured to:

upon determining that the resource is not within the worker,

obtain resource resolution of the resource from the resource registry service, wherein the resource resolution provides a source location of the resource;

replicate data of the resolved resource into the segment store of the worker through a replication connection to the source location; and

utilize replicated data in the segment store in executing the processing task.

12. The electronic device of claim 11, wherein the resource registry service is provided by the orchestrator.

13. The electronic device of claim 8, wherein for executing a processing task corresponding to a node of the task group, the worker is further configured to:

for each outgoing edge from the node,

request to create a resource, wherein the resource maps to an output parameter set corresponding to the outgoing edge from the node;

register the resource in the resource registry service;

create the resource in the segment store of the worker; and

write data to the resource in executing the processing task.

14. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations in an electronic device serving a worker processing video and audio streams of a streaming platform system, the operations comprising:

requesting a task group from an orchestrator of the streaming platform system, wherein the orchestrator manages video and audio stream processing of the streaming platform system;

receiving the task group allocated for the worker from the orchestrator, wherein the task group is allocated based at least partially on characteristics of the worker, wherein the task group corresponds to a subset of a task graph of the orchestrator, wherein the task graph is a directed acyclic graph of tasks, wherein each node of the task graph represents a processing task, and wherein each edge of the task graph represents a data flow across two processing tasks and corresponding input and output of each processing task; and

initiating one or more task running processes to execute the allocated task group, wherein each task running process executes a processing task corresponding to a node of the task group, and wherein each task running process performs at least one of processing one or more inputs corresponding to an incoming edge to the node, and producing one or more outputs corresponding to one or more outgoing edges from the node, where the one or more outputs are stored as a set of resources within a segment store of the worker and the set of resources is made accessible to other workers via a resource registry service.

15. The non-transitory machine-readable medium of claim 14, the operations further comprising:

indicating a status of the one or more task running processes, wherein the status is utilized to determine aborting or restarting a task running process.

16. The non-transitory machine-readable medium of claim 14, wherein executing a processing task corresponding to a node of the task group comprises:

for each incoming edge to the node,

reading an input parameter set corresponding to the incoming edge to the node, wherein the input parameter set maps to a resource required to execute the processing task;

determining whether the resource is within the segment store of the worker or not, wherein the segment store stores resources of the worker; and

upon determining that the resource is within the worker, utilizing data of the resource to execute the processing task.

17. The non-transitory machine-readable medium of claim 16, wherein executing the processing task corresponding to the node of the task group further comprises:

upon determining that the resource is not within the worker,

obtaining resource resolution of the resource from the resource registry service, wherein the resource resolution provides a source location of the resource;

replicating data of the resolved resource into the segment store of the worker through a replication connection to the source location; and

utilizing replicated data in the segment store in executing the processing task.

18. The non-transitory machine-readable medium of claim 17, wherein the resource registry service is provided by the orchestrator.

19. The non-transitory machine-readable medium of claim 14, wherein executing a processing task corresponding to a node of the task group comprises:

for each outgoing edge from the node,

requesting to create a resource, wherein the resource maps to an output parameter set corresponding to the outgoing edge from the node;

registering the resource in the resource registry service;

creating the resource in the segment store of the worker; and

writing data to the resource in executing the processing task.

20. The non-transitory machine-readable medium of claim 19, wherein executing a processing task corresponding to a node of the task group further comprises:

replicating data of the resource to each processing task having a replication connection to the resource.