Managing multiple windows on an operator graph

• US 9,305,077 B2
• Filed: 10/18/2013
• Issued: 04/05/2016
• Est. Priority Date: 09/25/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Branson, Michael J., Cobb, Bradford L., Santosuosso, John M.
• Primary Examiner(s): Hwa, Shyue Jiunn
• Application Number:
  US14/057,163
• Publication Number:
  US 20150088889A1
• Time in Patent Office: 900 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/26 Visual data mining; Browsing structured data
• CPC Class Codes: G06F 16/285 Clustering or classification

Abstract

Embodiments of the disclosure provide a method, system, and computer program product for managing a windowing operation. The method for grouping processing of a stream of tuples with each tuple containing one or more attributes can include receiving the stream of tuples to be processed by a plurality of processing elements operating on one or more computer processors. The method can also include processing, with a first processing method, a group of tuples from the stream of tuples into a grouping window. The method can also include processing, with a second processing method, a subgroup of tuples from the group of tuples into a subgrouping window. The second processing method can include identifying a sub-membership condition.

Claims

1. A computer program product for processing a stream of tuples, each tuple containing one or more attributes, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code comprising computer readable program code configured to:

process the attributes of the stream of tuples using stream operators operating on one or more computer processors and corresponding one or more processing elements;

process, with a first processing method, a group of tuples from the stream of tuples into a grouping window, wherein the first processing method is configured to;

identify a membership condition,

determine whether the membership condition is met by a tuple from the stream of tuples,

evict the tuple from the grouping window in response to the membership condition being unmet, and

include the tuple in the grouping window in response to the membership condition being met; and

process, with a second processing method, a subgroup of tuples from the group of tuples into a subgrouping window, wherein the second processing method is configured to;

identify a sub-membership condition,

determine whether the sub-membership condition is met by a tuple from the group of tuples, wherein the membership condition and the sub-membership condition are not the same condition type, and

include the tuple in the subgrouping window in response to the sub-membership condition being met.

2. The computer program product of claim 1, wherein the computer readable program code is further configured to:

remove the subgroup of tuples from the group of tuples; and

process the group of tuples without the subgroup of tuples.

3. The computer program product of claim 1, wherein identify the membership condition includes:

select a time-based windowing operation; and

identify a time for the membership condition.

4. The computer program product of claim 1, wherein identify the membership condition includes:

select a tuple count-based windowing operation; and

identify a tuple count for the membership condition.

5. The computer program product system of claim 1, wherein identify the membership condition includes:

select a sentinel value-based windowing operation; and

identify a sentinel value for the membership condition.

6. The computer program product of claim 1, wherein the process a subgroup of tuples includes:

evict the tuple from the grouping window in response to the membership condition being unmet.

7. A system for processing a stream of tuples, each tuple having one or more attributes, comprising:

one or more processing elements operating on one or more computer processors configured to processes the attributes from the stream of tuples, each processing element configured to;

process the attributes of the stream of tuples using stream operators operating on one or more computer processors and corresponding one or more processing elements;

process, with a first processing method, a group of tuples from the stream of tuples into a grouping window, wherein the first processing method is configured to cause the system to;

identify a membership condition,

determine whether the membership condition is met by a tuple from the stream of tuples,

evict the tuple from the grouping window in response to the membership condition being unmet, and

include the tuple in the grouping window in response to the membership condition being met, and

process, with a second processing method, a subgroup of tuples from the group of tuples into a subgrouping window, wherein the second processing method is configured to cause the system to;

identify a sub-membership condition,

determine whether the sub-membership condition is met by a tuple from the group of tuples, wherein the membership condition and the sub-membership condition are not the same condition type, and

include the tuple in the subgrouping window in response to the sub-membership condition being met.

8. The system of claim 7, wherein each processing element is further configured to:

remove the subgroup of tuples from the group of tuples; and

process the group of tuples without the subgroup of tuples.

9. The system of claim 7, wherein identify the membership condition includes:

select a time-based windowing operation; and

identify a time for the membership condition.

10. The system of claim 7, wherein identify the membership condition includes:

select a tuple count-based windowing operation; and

identify a tuple count for the membership condition.

11. The system of claim 7, wherein identify the membership condition includes:

select a sentinel value-based windowing operation; and

identify a sentinel value for the membership condition.

12. The system of claim 11, wherein the sentinel value is a combination of two or more different attributes.

13. The system of claim 11, wherein identify the sentinel value includes identify a tuple with the sentinel value.

14. The system of claim 7, wherein the process the subgroup of tuples includes:

evict the tuple from the grouping window in response to the membership condition being unmet.

15. The system of claim 7, wherein the one or more processing elements are configured to:

process, with a third processing method, a second subgroup of tuples from the group of tuples into a second subgrouping window, wherein the third processing method includes;

identify a second sub-membership condition,

determine whether the second sub-membership condition is met by a tuple from the group of tuples and from the subgroup of tuples, and

include the tuple in the second subgrouping window in response to the second sub-membership condition being met.

16. The system of claim 7, wherein the one or more processing elements are configured to determine whether the sub-membership condition is met by a tuple from the group of tuples by determining whether there is a sub-grouping window exclusion specified for the tuple.

17. The system of claim 7, wherein the one or more processing elements are configured to evict in response to a timing error, wherein the timing error occurs when there is a time delay between a first time stamp when a first tuple from the stream of tuples is transmitted, and a second time stamp when the first tuple is received.

18. The system of claim 17, wherein the timing error has a tolerance level that is adjustable, wherein the tolerance level is a buffer to hold a certain number of tuples in order to rearrange the receipt of tuples.