Generic query templates for complex event processing and data stream systems

• US 9,836,509 B2
• Filed: 05/30/2014
• Issued: 12/05/2017
• Est. Priority Date: 09/20/2012
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Wolf, Bernhard, Makhani, Rahim
• Primary Examiner(s): Burke, Jeffrey A
• Assistant Examiner(s): VU, THONG H
• Application Number:
  US14/292,818
• Publication Number:
  US 20140351287A1
• Time in Patent Office: 1,285 Days
• Field of Search: 707779, 707536, 707797, 707769, 707600, 707754, 715536, 715234
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries

Abstract

Systems and methods provide for queries with an arbitrary number of input streams to be created from a generic query template, during runtime, based on, for example, configuration parameters provided by the system or a user. The generic query templates include a generic query template string, query template segments, and an orchestration mechanism for automatic query template generation. The systems and methods of the present invention provide for the substitution of concrete input streams, counters (e.g., stream indices) and query template segments (which can include further placeholders) into the generic query templates. Further, the input placeholders of the generic query template provide for any part of the query template to be substituted with arbitrary logic. Also, the orchestration process is query language independent and can be applied (and extended) for any query language.

Claims

1. A computer-implemented method for generating queries with a number of input streams from a generic query template, the method comprising:

sending, with a processor, a selected generic query template and an at least one entered query input stream to a query manager, wherein the generic query template includes at least one predefined query string having placeholders at designated alterable fields of the generic query template, each placeholder of the generic query template having a mandatory designation or an optional designation;

registering, with the query manager, the selected generic query template and the at least one entered query input stream;

generating, with the query manager, at least one query output stream based on the registered generic query template and the at least one registered query input stream;

loading, with the query manger, the registered generic query template with the at least one query output stream and the at least one registered query input stream;

parsing, with the query manager, the loaded generic query template, comprising;

retrieving, with the query manager, a query template orchestration configuration for the loaded generic query template from the database; and

upon determining, with the query manager, that instructions are available in the query template orchestration configuration,

executing, with the query manager, the instructions in the query template orchestration configuration, wherein each step of the instructions is executed for each of the at least one query input stream; and

forming a deployable query for instantiation within a data stream management system from substituting, with the query manager, the placeholders with the at least one query output stream and the at least one registered query input stream.

2. The method of claim 1, wherein the placeholders include at least one of an input stream placeholder, an output stream placeholder, a parameter placeholder and an input placeholder, wherein the input stream placeholder is substituted with the at least one registered query input stream, the output stream placeholder is substituted with the at least one query output stream, the parameter placeholder is substituted with a mathematical comparative operator expression, and the input placeholder is substituted with a query template segment or the input stream placeholder.

3. The method of claim 2, wherein the query template segment is a predefined complex query code which is inserted into the generic query template, wherein the query template segment includes at least one of the input stream placeholder, the output stream placeholder, the parameter placeholder and the input placeholder.

4. The method of claim 3, wherein the instructions in the query template orchestration configuration are executed by a query template orchestrator, wherein the query template orchestration configuration includes instructions to perform actions on the placeholders in the generic query template, wherein the actions are (1) described by an orchestration type and (2) performed by an orchestration operator.

5. The method of claim 4, wherein the orchestration operator performs at least one of (1) retrieving the query template segment specified in the step of the instruction (2) replacing the input placeholder in the generic query template with an index of an instant query input stream and (3) creating another input stream placeholder in the generic query template for the instant query input stream.

6. The method of claim 4, wherein the orchestration operator performs at least one of (1) replacing the placeholder with the query template segment (2) replacing the placeholder with a query template segment only if additional input streams are to be processed and (3) appending an intermediate string to the generic query template.

7. The method of claim 1, wherein substituting the placeholders occurs only for placeholders having the mandatory designation.

8. A non-transitory computer readable medium having program instructions for generating queries with a number of input streams from a generic query template, wherein execution of the program instructions by one or more processor of a computer system causes one or more processor to carry out the steps of:

sending a selected generic query template and an at least one entered query input stream to a query manager, wherein the generic query template includes at least one predefined query string having placeholders at designated alterable fields of the generic query template, each placeholder of the generic query template having a mandatory designation or an optional designation;

registering, with the query manager, the selected generic query template and the at least one entered query input stream;

generating, with the query manager, at least one query output stream based on the registered generic query template and the at least one registered query input stream;

loading, with the query manager, the registered generic query template with the at least one query output stream and the at least one registered query input stream;

parsing, with the query manager, the loaded generic query template, comprising;

retrieving, with the query manager, a query template orchestration configuration for the loaded generic query template from the database; and

upon determining, with the query manager, that instructions are available in the query template orchestration configuration,

executing, with the query manager, the instructions in the query template orchestration configuration, wherein each step of the instructions is executed for each of the at least one query input stream; and

forming a deployable query for instantiation within a data stream management system from substituting, with the query manager, the placeholders with the at least one query output stream and the at least one registered query input stream.

9. The non-transitory computer readable medium of claim 8, wherein the placeholders include at least one of an input stream placeholder, an output stream placeholder, a parameter placeholder and an input placeholder, where in the input stream placeholder is substituted with the at least one registered query input stream, the output stream placeholder is substituted with the at least one query output stream, the parameter placeholder is substituted with a mathematical comparative operator expression, and the input placeholder is substituted with a query template segment or the input stream placeholder.

10. The non-transitory computer readable medium of claim 9, wherein the query template segment is a predefined complex query code which is inserted into the generic query template, wherein the query template segment includes at least one of the input stream placeholder, the output stream placeholder, the parameter placeholder and the input placeholder.

11. The non-transitory computer readable medium of claim 10, wherein the instructions in the query template orchestration configuration are executed by a query template orchestrator, wherein the query template orchestration configuration includes instructions to perform actions on the placeholders in the generic query template, wherein the actions are (1) described by an orchestration type and (2) performed by an orchestration operator.

12. The non-transitory computer readable medium of claim 11, wherein the orchestration operator performs at least one of (1) retrieving the query template segment specified in the step of the instruction (2) replacing the input placeholder in the generic query template with an index of an instant query input stream and (3) creating another input stream placeholder in the generic query template for the instant query input stream.

13. The non-transitory computer readable medium of claim 11, wherein the orchestration operator performs at least one of (1) replacing the placeholder with the query template segment (2) replacing the placeholder with a query template segment only if additional input streams are to be processed and (3) appending an intermediate string to the generic query template.

14. A system directed to generating queries with an arbitrary number of input streams from a generic query template, comprising:

a database;

a data stream management system;

a query manager;

a processor, wherein the processor performs the steps of;

sending a selected generic query template and at least one entered query input stream to the query manger, wherein the generic query template includes at least one predefined query string having placeholders at designated alterable field of the generic query, each placeholder of the generic query template having a mandatory designation or an optional designation;

registering, with the query manager, the selected generic query template and the at least one entered query input stream;

generating, with the query manager, at least one query output stream based on the registered generic query template and the at least one registered query input stream;

loading, with the query manager, the registered generic query template with the at least one query output stream and the at least one registered query input stream;

parsing, with the query manager, the loaded generic query template, comprising;

retrieving, with the query manager, a query template orchestration configuration of the loaded generic query template from the database; and

upon determining, with the query manager, that instructions are available in the query template orchestration configuration,

executing, with the query manager, the instructions in the query template orchestration configuration, wherein each step of the instructions is executed for each of the at least one query input stream;

forming a deployable query for instantiation within the data stream management system from substituting, within the query manager, the placeholders with the at least one query output stream and the at least one registered query input stream; and

deploying the deployable query within the data stream management system for application against stream data.

15. The system of claim 14, wherein the placeholders include at least one of an input stream placeholder, an output stream placeholder, a parameter placeholder and an input placeholder, wherein the input stream placeholder is substituted with the at least one registered query input stream, the output stream placeholder is substituted with the at least one query output stream, the parameter placeholder is substituted with a mathematical comparative operator expression, and the input placeholder is substituted with a query template segment or the input stream placeholder.

16. The system of claim 15, wherein the query template segment is a predefined complex query code which is configured to be inserted into the generic query template, wherein the query template segment includes at least one of the input stream placeholder, the output stream placeholder, the parameter placeholder and the input placeholder.

17. The system of claim 16, where in the instructions in the query template orchestration configuration are executed by a query template orchestrator, wherein the query template orchestration configuration includes instructions to perform actions on the placeholders in the generic query template, wherein the actions are (1) described by an orchestration type and (2) performed by an orchestration operator.

18. The system of claim 17, wherein the orchestration operator performs one of (1) retrieving the query template segment specified in the step of the instruction (2) replacing the input placeholder in the generic query template with an index of an instant query input stream and (3) creating another input stream placeholder in the generic query template for the instant query input stream.

19. The system of claim 17, wherein the orchestration operator performs one of (1) replacing the placeholder with the query template segment (2) replacing the placeholder with a query template segment only if additional input streams are to be processed and (3) appending an intermediate string to the generic query template.

20. The system of claim 14, wherein substituting the placeholders occurs only for placeholders having the mandatory designation.