Unified window support for event stream data management

• US 8,180,801 B2
• Filed: 07/16/2009
• Issued: 05/15/2012
• Est. Priority Date: 07/16/2009
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Zhang, Jin, Shan, Ming-Chien, Yan, Ying
• Primary Examiner(s): Leroux, Etienne
• Assistant Examiner(s): Nguyen, Cindy
• Application Number:
  US12/504,641
• Publication Number:
  US 20110016160A1
• Time in Patent Office: 1,034 Days
• Field of Search: 707/805, 707/792, 707/794, 707/798
• US Class Current: 707/792
• CPC Class Codes: G06F 16/24 Querying

Abstract

Data stream query mediation may utilize a query handler configured to receive a query from a stream application to be applied against a stream of data including multiple tuples representing events. A stream window manager may be configured to express the query in a specification which defines a window including a subset of the tuples, the specification defining content of the window as a range of the tuples having a range attribute over which the content is specified, defining when to update the window using a synchronization attribute specifying a movement of the window over time with respect to the content, and defining an evaluation of the content of the window using an evaluation attribute specifying when to perform the evaluation. A query translator may be configured to translate the query including mapping the range attribute, the synchronization attribute, and the evaluation attribute to a stream processing language of a data stream management system (DSMS), to thereby obtain a translated query. A DSMS mediator may be configured to provide the translated query to the DSMS for processing therewith.

Claims

1. A computer system including instructions recorded on a non-transitory computer-readable medium, the system comprising:

a query handler configured to receive a query from a stream application to be applied against a stream of data including multiple tuples representing events;

a stream window manager configured to express the query in a specification which defines a window including a subset of the tuples, the specification defining content of the window as a range of the tuples having a range attribute over which the content is specified, defining when to update the window using a synchronization attribute specifying a movement of the window over time with respect to the content, and defining an evaluation of the content of the window using an evaluation attribute specifying when to perform the evaluation;

a query translator configured to translate the query into any one of a plurality of stream processing languages of a data stream management system (DSMS), and configured to translate the query into a stream processing language of the plurality of stream processing languages including mapping the range attribute, the synchronization attribute, and the evaluation attribute to the stream processing language of the data stream management system (DSMS), to thereby obtain a translated query; and

a DSMS mediator configured to provide the translated query to the DSMS for processing therewith.

2. The system of claim 1 comprising:

a result manager configured to receive query results from the DSMS specified according to the stream processing language and translate the received query results according to the specification to thereby provide the translated results to the stream application.

3. The system of claim 1 wherein the range attribute includes a specification of a number of the tuples.

4. The system of claim 1 wherein the range attribute includes a specification of time.

5. The system of claim 1 wherein the range attribute includes a specification of one or more fields of the stream of data.

6. The system of claim 1 wherein the range attribute includes a specification of a detected pattern associated with the tuples.

7. The system of claim 1 wherein the synchronization attribute includes a specification of a number of the tuples.

8. The system of claim 1 wherein the synchronization attribute includes a specification of a time to update the window.

9. The system of claim 1 wherein the synchronization attribute includes a specification of a detected pattern associated with the tuples.

10. The system of claim 1 wherein the evaluation attribute includes a specification of one or more of the tuples.

11. The system of claim 1 wherein the evaluation attribute includes a specification of time to evaluate the window.

12. The system of claim 1 wherein the evaluation attribute includes a specification of a detected pattern associated with the tuples to trigger evaluation of the window.

13. The system of claim 1 wherein the query translator comprises a compiler configured to parse the query, and is further configured to select a mapping table associated with the stream processing language associated with the DSMS and to execute therewith a mapping of the parsed query to provide a syntax translation, semantic translation, and behavior translation of the query to obtain the translated query.

14. The system of claim 1 wherein the stream of data includes one or more streams of data expressed as either relational or XML data streams, or combinations thereof, and wherein the query translator is configured to translate any of relational or XML data streams, or combinations thereof, into the stream processing language.

15. A computer-implemented method comprising:

receiving a query from a stream application to be applied against a stream of data including multiple tuples representing events;

expressing the query in a specification which defines a window including a subset of the tuples, the specification defining content of the window as a range of the tuples having a range attribute over which the content is specified, defining when to update the window using a synchronization attribute specifying a movement of the window over time with respect to the content, and defining an evaluation of the content of the window using an evaluation attribute specifying when to perform the evaluation;

translating the query into any one of a plurality of stream processing languages of a data stream management system (DSMS), including translating the query into a stream processing language of the plurality of stream processing languages including mapping the range attribute, the synchronization attribute, and the evaluation attribute to the stream processing language of the data stream management system (DSMS), to thereby obtain a translated query; and

providing the translated query to the data stream management system for processing therewith.

16. The method of claim 15 comprising:

receiving query results from the DSMS specified according to the stream processing language; and

translating the received query results according to the specification to thereby provide the results to the stream application.

17. The method of claim 15 wherein the translating the query comprises:

parsing the query;

selecting a mapping table associated with the stream processing language associated with the DSMS; and

executing therewith a mapping of the parsed query to provide a syntax translation, semantic translation, and behavior translation of the query to obtain the translated query.

18. A computer program product, the computer program product being tangibly embodied on a computer-readable medium and comprising instructions that, when executed, are configured to cause a data processing apparatus to:

receive a query from a stream application to be applied against a stream of data including multiple tuples representing events;

express the query in a specification which defines a window including a subset of the tuples, the specification defining content of the window as a range of the tuples having a range attribute over which the content is specified, defining when to update the window using a synchronization attribute specifying a movement of the window over time with respect to the content, and defining an evaluation of the content of the window using an evaluation attribute specifying when to perform the evaluation;

translate the query into any one of a plurality of stream processing languages of a data stream management system (DSMS), including translating the query into a stream processing language of the plurality of stream processing languages including mapping the range attribute, the synchronization attribute, and the evaluation attribute to the stream processing language of the data stream management system (DSMS), to thereby obtain a translated query; and

provide the translated query to the data stream management system for processing therewith.

19. The computer program product of claim 18 wherein the instructions further cause the data processing apparatus to

receive query results from the DSMS specified according to the stream processing language;

and

translate the received query results according to the specification to thereby provide the results to the stream application.

20. The computer program product of claim 18 wherein the instructions further cause the data processing apparatus to translate the query including:

parsing the query;

selecting a mapping table associated with the stream processing language associated with the DSMS; and

executing therewith a mapping of the parsed query to provide a syntax translation, semantic translation, and behavior translation of the query to obtain the translated query.