Method and apparatus for ripple rate sensitive and bottleneck aware resource adaptation for real-time streaming workflows
First Claim
1. A method for adapting resources of the cluster of nodes for a real-time streaming workflow, comprising:
- receiving, by a processor, a notification that a node of the cluster of nodes associated with an instance of a process of the real-time streaming workflow is predicted to be a bottleneck;
identifying, by the processor, a number of hops to send a resource statement when the bottleneck is predicted that minimizes a ripple effect associated with transmitting the resource statement;
transmitting, by the processor, the resource statement to one or more nodes of the cluster of nodes within the number of hops;
receiving, by the processor, a response from at least one of the one or more nodes within the cluster of nodes, wherein the response from the at least one of the one or more nodes within the cluster of nodes is based on an evaluation performed by the at least one of the one or more nodes within the cluster of nodes, wherein the evaluation is a comparison of an inbound network bandwidth, an outbound network bandwidth and a processing capability of the at least one of the one or more nodes within the cluster of nodes to an inbound network bandwidth, an outbound network bandwidth and a processing capability of the node; and
adapting, by the processor, a resource usage to the at least one of the one or more nodes within the cluster of nodes that the response was received from, wherein the adapting comprises a migration of the instance or a duplication of the instance.
7 Assignments
0 Petitions
Accused Products
Abstract
A method, non-transitory computer readable medium, and apparatus for adapting resources of the cluster of nodes for a real-time streaming workflow are disclosed. For example, the method receives a notification that a node of the cluster of nodes associated with an instance of a process of the real-time streaming workflow is predicted to be a bottleneck, identifies a number of hops to send a resource statement when the bottleneck is predicted that minimizes a ripple effect associated with transmitting the resource statement, transmits the resource statement to at least one or more nodes of the cluster of nodes within the number of hops, receives a response from one of the at least one or more nodes within the cluster of nodes and adapts a resource usage to the at least one of the one or more nodes within the cluster of nodes that the response was received from.
-
Citations
15 Claims
-
1. A method for adapting resources of the cluster of nodes for a real-time streaming workflow, comprising:
-
receiving, by a processor, a notification that a node of the cluster of nodes associated with an instance of a process of the real-time streaming workflow is predicted to be a bottleneck; identifying, by the processor, a number of hops to send a resource statement when the bottleneck is predicted that minimizes a ripple effect associated with transmitting the resource statement; transmitting, by the processor, the resource statement to one or more nodes of the cluster of nodes within the number of hops; receiving, by the processor, a response from at least one of the one or more nodes within the cluster of nodes, wherein the response from the at least one of the one or more nodes within the cluster of nodes is based on an evaluation performed by the at least one of the one or more nodes within the cluster of nodes, wherein the evaluation is a comparison of an inbound network bandwidth, an outbound network bandwidth and a processing capability of the at least one of the one or more nodes within the cluster of nodes to an inbound network bandwidth, an outbound network bandwidth and a processing capability of the node; and adapting, by the processor, a resource usage to the at least one of the one or more nodes within the cluster of nodes that the response was received from, wherein the adapting comprises a migration of the instance or a duplication of the instance. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable medium storing a plurality of instructions which, when executed by a processor of an endpoint device, cause the processor to perform operations for adapting resources of the cluster of nodes for a real-time streaming workflow, the operations comprising:
-
receiving a notification that a node of the cluster of nodes associated with an instance of a process of the real-time streaming workflow is predicted to be a bottleneck; predicting a bottleneck at the node based monitoring of the resource usage; identifying a number of hops to send a resource statement when the bottleneck is predicted that minimizes a ripple effect associated with transmitting the resource statement; transmitting the resource statement to one or more nodes of the cluster of nodes within the number of hops; receiving a response from at least one of the one or more nodes within the cluster of nodes, wherein the response from the at least one of the one or more nodes within the cluster of nodes is based on an evaluation performed by the at least one of the one or more nodes within the cluster of nodes, wherein the evaluation is a comparison of an inbound network bandwidth, an outbound network bandwidth and a processing capability of the at least one of the one or more nodes within the cluster of nodes to an inbound network bandwidth, an outbound network bandwidth and a processing capability of the node; and adapting a resource usage to the one of the at least one or more nodes within the cluster of nodes that the response was received from, wherein the adapting comprises a migration of the instance or a duplication of the instance. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
Specification