Managing attributes in stream processing
First Claim
1. A system for referencing attributes from a stream of tuples, comprising:
- a plurality of processing elements capable of receiving the stream of tuples;
the stream of tuples having at least a first tuple and a second tuple;
a stream manager communicatively coupled with the processing elements for tracking the tuples and having a capability of selecting attributes in tuples, wherein one or more selected attributes are chosen from a group of candidate attributes;
a first stream operator communicatively coupled with the stream manager and capable of receiving the stream of tuples, wherein the first stream operator selects the selected attribute of the first tuple and assigns a first identifier to the selected attribute;
a second stream operator communicatively coupled with the stream manager and capable of receiving the stream of tuples, and capable of replacing the selected attribute in the second tuple with a second identifier provided by the first stream operator;
an identifier table communicatively coupled with the stream manager and the first and second stream operator, wherein the identifier table includes identifiers for selected tuples.
5 Assignments
0 Petitions
Accused Products
Abstract
A method and system for managing attributes in a streaming application is disclosed. The system may have a stream manager communicatively coupled with processing elements for tracking a stream of tuples. The system may also have a first stream operator communicatively coupled with the stream manager and capable of receiving the stream of tuples, wherein the first stream operator selects the selected attribute of the first tuple and assigns a first identifier to the selected attribute. The system may also have a second stream operator communicatively coupled with the stream manager and capable of receiving the stream of tuples, and capable of replacing the selected attribute in the second tuple with a second identifier provided by the first stream operator. The system may also have an identifier table communicatively coupled with the stream manager and the first and second stream operator, wherein the identifier table includes identifiers for selected tuples.
26 Citations
19 Claims
-
1. A system for referencing attributes from a stream of tuples, comprising:
-
a plurality of processing elements capable of receiving the stream of tuples; the stream of tuples having at least a first tuple and a second tuple; a stream manager communicatively coupled with the processing elements for tracking the tuples and having a capability of selecting attributes in tuples, wherein one or more selected attributes are chosen from a group of candidate attributes; a first stream operator communicatively coupled with the stream manager and capable of receiving the stream of tuples, wherein the first stream operator selects the selected attribute of the first tuple and assigns a first identifier to the selected attribute; a second stream operator communicatively coupled with the stream manager and capable of receiving the stream of tuples, and capable of replacing the selected attribute in the second tuple with a second identifier provided by the first stream operator; an identifier table communicatively coupled with the stream manager and the first and second stream operator, wherein the identifier table includes identifiers for selected tuples. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for referencing attributes in a streaming application, comprising:
-
receiving a stream of tuples to be processed by a plurality of processing elements operating on one or more computer processors, each tuple containing one or more attributes, each processing element having one or more stream operators, each processing element assigned to one or more compute nodes; examining one or more candidate attributes; selecting a selected attribute from one or more candidate attributes; adding an identifier to the tuple; using the identifier to retrieve the selected attribute, wherein the using the identifier includes; reading the unique identifier on the second tuple by a second stream operator, wherein the second stream operator requires the selected attribute, matching the unique identifier to the selected attribute of the first tuple on the identifier table, locating the selected attribute, and transmitting the selected attribute from the first tuple to the second stream operator; monitoring one or more stream operators for one or more removal factors; and dereferencing the selected attribute if the removal factor is present. - View Dependent Claims (11, 12, 13)
-
-
14. A method of referencing attributes in a streaming application, comprising:
-
receiving a stream of tuples to be processed by a plurality of processing elements operating on one or more computer processors, each processing element having at least a first stream operator, each stream operator being communicatively coupled to a stream manager; examining one or more candidate attributes; selecting one or more selected attributes from the candidate attributes; identifying the selected attribute of a first tuple, substituting the selected attribute of a second tuple with a unique identifier, wherein the the unique identifier is matched to the selected attribute in an identifier table; reading the unique identifier with a second stream operator, wherein the second stream operator requires the selected attribute; transmitting the selected attribute from the first tuple to the second stream operator; monitoring one or more stream operators for one or more removal factors; and modifying the identifier table if the removal factor is present. - View Dependent Claims (15, 16, 17, 18, 19)
-
Specification