DYNAMIC STABILIZATION FOR A STREAM PROCESSING SYSTEM
First Claim
1. A method on a current processing element for dynamically stabilizing a stream processing system, the method comprising:
- receiving at least one computing resource allocation target;
determining that a plurality of downstream processing elements are communicatively coupled to at least one upstream processing element, wherein each of the downstream processing elements in the plurality of downstream processing elements consumes data packets produced by the upstream processing element received on an output stream associated with the upstream processing element, wherein each of the downstream processing elements and the upstream processing element are each associated with at least one input buffer, wherein each downstream processing element processes data packets as they arrive in the input buffer associated therewith;
determining that an input data flow rate of the upstream processing element varies, and in response, dynamically performing at least one of;
controlling data flow between the upstream processing element and the processing element; and
allocating the computing resource to the processing element in response to the input data flow rate of the upstream processing element wherein dynamically allocating the computing resource is based on an input buffer occupancy of the upstream processing element.
0 Assignments
0 Petitions
Accused Products
Abstract
Disclosed are a method, upstream processing node, and computer readable medium for dynamically stabilizing a stream processing system. The method includes receiving at least one computing resource allocation target. The method further includes determining that an input data flow rate of at least one upstream processing element varies. The computing resource is dynamically allocated to the upstream processing element in response to the input rate of the upstream processing element varying. Data flow is dynamically controlled between the upstream processing element and at least one downstream processing element.
-
Citations
10 Claims
-
1. A method on a current processing element for dynamically stabilizing a stream processing system, the method comprising:
-
receiving at least one computing resource allocation target; determining that a plurality of downstream processing elements are communicatively coupled to at least one upstream processing element, wherein each of the downstream processing elements in the plurality of downstream processing elements consumes data packets produced by the upstream processing element received on an output stream associated with the upstream processing element, wherein each of the downstream processing elements and the upstream processing element are each associated with at least one input buffer, wherein each downstream processing element processes data packets as they arrive in the input buffer associated therewith; determining that an input data flow rate of the upstream processing element varies, and in response, dynamically performing at least one of; controlling data flow between the upstream processing element and the processing element; and allocating the computing resource to the processing element in response to the input data flow rate of the upstream processing element wherein dynamically allocating the computing resource is based on an input buffer occupancy of the upstream processing element. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method on a current processing node for dynamically stabilizing a stream processing system, the method comprising:
-
receiving at least one computing resource allocation target; associating a plurality of downstream processing elements and an upstream processing element with at least one input buffer, wherein each of the downstream processing elements consumes data packets produced by the upstream processing element received on an output stream associated with the upstream processing element; and determining that an input data flow rate of the upstream processing element varies, and in response, controlling data flow between the upstream processing element and the processing element.
-
-
9. A method on a current processing node for dynamically stabilizing a stream processing system, the method comprising:
-
receiving at least one computing resource allocation target; associating a plurality of downstream processing elements and an upstream processing element with at least one input buffer, wherein each of the downstream processing elements consumes data packets produced by the upstream processing element received on an output stream associated with the upstream processing element; and determining that an input data flow rate of the upstream processing element varies and in response allocating the computing resource to the processing element in response to the input data flow rate of the upstream processing element wherein dynamically allocating the computing resource is based on an input buffer occupancy of the upstream processing element.
-
-
10. An upstream processing node in a distributed stream processing system, the upstream processing node comprising:
-
at least one upstream processing element; a processing element monitor communicatively coupled to the upstream processing element adapted to; determine that a plurality of downstream processing element are communicatively coupled to the upstream processing element, wherein each of the downstream processing elements in the plurality of downstream processing elements consumes data packets produced by the upstream processing element received on an output stream associated with the upstream processing element, wherein each of the downstream processing elements and the upstream processing element are each associated with at least one input buffer, wherein each downstream processing element processes data packets as they arrive in the input buffer associated therewith; and determine that an input data flow rate of the upstream processing element varies; controlling data flow between the upstream processing element and the processing element; and allocating the computing resource to the processing element in response to the input data flow rate of the upstream processing element wherein dynamically allocating the computing resource is based on an input buffer occupancy of the upstream processing element.
-
Specification