Query Deployment Plan For A Distributed Shared Stream Processing System
First Claim
1. A method of providing a deployment plan for a query in a distributed shared stream processing system, the method comprising:
- storing a set of pre-computed feasible deployment plans for a query that is currently deployed in the stream processing system, wherein a query includes a plurality of operators hosted on nodes in the stream processing system providing a data stream responsive to a client request for information;
determining whether a QoS metric constraint for the query is violated; and
selecting a deployment plan from the set of feasible deployment plans to be used for providing the query in response to determining the QoS metric constraint is violated.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of providing a deployment plan for a query in a distributed shared stream processing system includes storing a set of feasible deployment plans for a query that is currently deployed in the stream processing system. A query includes a plurality of operators hosted on nodes in the stream processing system providing a data stream responsive to a client request for information. The method also includes determining whether a QoS metric constraint for the query is violated, and selecting a deployment plan from the set of feasible deployment plans to be used for providing the query in response to determining the QoS metric constraint is violated.
62 Citations
20 Claims
-
1. A method of providing a deployment plan for a query in a distributed shared stream processing system, the method comprising:
-
storing a set of pre-computed feasible deployment plans for a query that is currently deployed in the stream processing system, wherein a query includes a plurality of operators hosted on nodes in the stream processing system providing a data stream responsive to a client request for information; determining whether a QoS metric constraint for the query is violated; and selecting a deployment plan from the set of feasible deployment plans to be used for providing the query in response to determining the QoS metric constraint is violated. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of resolving conflicts to deploy a deployment plan for a query in a distributed stream processing system, the method comprising:
-
determining a new deployment plan for an existing query should be applied; for each operator in the new deployment plan, locking the operator unless the operator is already locked; if the operator is already locked, determining whether a conflict exists; if a conflict exists, identifying an alternative deployment plan; if a conflict does not exist, replicating the operator and deploying the new deployment plan. - View Dependent Claims (13, 14, 15)
-
-
16. A computer readable storage medium storing software including instructions that when executed perform a method comprising:
-
creating partial deployment plans for a query currently deployed in an overlay network providing end-to-end overlay paths for data streams in a distributed stream processing system; storing statistics on bandwidth consumed by an upstream operator of a local operator for the query; storing statistics on query latency up to the local operator; for each partial deployment plan, evaluating differences between the bandwidth consumed and latency for the partial deployment plan versus the currently deployed query; and for each partial deployment plan, storing the partial deployment plan and metadata for subsequent evaluation of the partial deployment plan if the evaluated differences indicate that the partial deployment plan is better than the deployed query and the partial deployment plan satisfies a QoS metric constraint. - View Dependent Claims (17, 18, 19, 20)
-
Specification