Generation of archiver queries for continuous queries over archived relations

• US 9,953,059 B2
• Filed: 09/25/2013
• Issued: 04/24/2018
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Deshmukh, Unmesh Anil, Srinivasan, Anand, Shukla, Vikram
• Primary Examiner(s): Thomas, Ashish K
• Assistant Examiner(s): FERRER, JEDIDIAH P
• Application Number:
  US14/036,659
• Publication Number:
  US 20140095445A1
• Time in Patent Office: 1,672 Days
• CPC Class Codes: G06F 16/2308 Concurrency control transaction processing G06F9/466
• CPC Class Codes: G06F 16/24542 Plan optimisation
• CPC Class Codes: G06F 16/24544 Join order optimisation
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A method may include receiving a continuous query identified by an archived relation associated with an application. The method may also include generating a physical query plan. Additionally, the method may include constructing a structured query language (SQL) equivalent expression corresponding to an attribute utilized by the operator and/or constructing an output SQL expression for the identified operator based at least in part on the SQL equivalent expression. Additionally, the method may include constructing the archiver query for the identified operator based at least in part on the output SQL expression. Further, the method may include executing the archiver query to obtain a result set of data records related to the application and/or generating a snapshot output of one or more data values related to the application based at least in part on the result set of data records.

Claims

1. A computer-implemented method, comprising:

receiving, by a computer system configured to execute computer-executable instructions, a continuous query to be executed on an event stream, the continuous query being identified based at least in part on an archived relation associated with an application, the archived relation indicating availability of historical data related to the event stream, the historical data stored in a database;

generating a physical query plan for the continuous query;

determining that an operator identified in the physical query plan is capable of being used to construct a corresponding archiver query based at least in part on a function being performed by the operator and a type of the operator;

when it is determined that the operator is capable of being used to construct a corresponding archiver query, determining that the operator is capable of maintaining state information related to the application such that the operator can be used on the event stream after being pre-populated with a state of the operator, the state of the operator providing historical context associated with querying the historical data in the database;

based at least in part on determining that the operator is capable of being used to construct the corresponding archiver query and that the operator is capable of maintaining state information related to the application, constructing the archiver query for the operator, constructing the archiver query comprising;

constructing a structured query language (SQL) equivalent expression corresponding to an attribute utilized by the operator;

constructing an output SQL expression for the operator based at least in part on the SQL equivalent expression; and

constructing the archiver query for the operator based at least in part on the output SQL expression;

executing the archiver query on the historical data in the database to obtain a result set of data records related to the application;

initializing the state of the operator based at least in part on the result set of data records; and

executing the continuous query on the event stream in order to generate a snapshot output of one or more data values related to the application based at least in part on pre-populating the operator with the state of the operator.

2. The computer-implemented method of claim 1, further comprising constructing an archiver query clause for the operator based at least in part on the SQL equivalent expression.

3. The computer-implemented method of claim 2, further comprising constructing the output SQL expression for the operator based at least in part on the archiver query clause.

4. The computer-implemented method of claim 1, wherein the archiver query corresponds to a query that is capable of being used to retrieve historical data related to the application from the archived relation associated with the application.

5. The computer-implemented method of claim 1, further comprising constructing a list of tuples for the operator from the result set of data records, wherein at least one tuple in the list of tuples is constructed based at least in part on a subset of attributes of the result set of data records.

6. The computer-implemented method of claim 5, further comprising:

initializing the state of the operator based at least in part on the list of tuples; and

generating the snapshot output of the one or more data values related to the application based at least in part on the list of tuples.

7. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more computer systems, configure the one or more computer systems to perform at least:

instructions that cause the one or more computer systems to receive a continuous query to be executed on an event stream, the continuous query being identified based at least in part on an archived relation associated with an application, the archived relation indicating availability of historical data related to the event stream, the historical data stored in a database;

instructions that cause the one or more computer systems to generate a physical query plan for the continuous query;

instructions that cause the one or more computer systems to determine that an operator identified in the physical query plan is capable of being used to construct a corresponding archiver query based at least in part on a function being performed by the operator and a type of the operator;

when it is determined that the operator is capable of being used to construct a corresponding archiver query, instructions that cause the one or more computer systems to determine that the operator is capable of maintaining state information related to the application such that the operator can be used on the event stream after being pre-populated with a state of the operator, the state of the operator providing historical context associated with querying the historical data stored in the database;

based at least in part on the instructions that cause the one or more computer systems to determine that the operator is capable of being used to construct the corresponding archiver query and the instructions that cause the one or more computer systems to determine that the operator is capable of maintaining state information, instructions that cause the one or more computer systems to construct the archiver query for the operator;

instructions that cause the one or more computer systems to execute the archiver query on the historical data in the database to obtain a result set of data records related to the application;

instructions that cause the one or more computer systems to initialize the state of the operator based at least in part on the result set of data records; and

instructions that cause the one or more computer systems to execute the continuous query on the event stream in order to generate a snapshot output of one or more data values related to the application based at least in part on pre-populating the operator with the state of the operator.

8. The non-transitory computer-readable storage medium of claim 7, further comprising:

instructions that cause the one or more computer systems to construct a structured query language (SQL) equivalent expression corresponding to an attribute utilized by the operator;

instructions that cause the one or more computer systems to construct an output SQL expression for the operator based at least in part on the SQL equivalent expression; and

instructions that cause the one or more computer systems to construct the archiver query for the operator based at least in part on the output SQL expression.

9. The non-transitory computer-readable storage medium of claim 8, further comprising instructions that cause the one or more computer systems to construct an archiver query clause for the operator based at least in part on the SQL equivalent expression.

10. The non-transitory computer-readable storage medium of claim 9, further comprising instructions that cause the one or more computer systems to construct the output SQL expression for the operator based at least in part on the archiver query clause.

11. The non-transitory computer-readable storage medium of claim 7, further comprising instructions that cause the one or more computer systems to display the snapshot output of the one or more data values related to the application to a user of the application via a display device.

12. The non-transitory computer-readable storage medium of claim 7, further comprising instructions that cause the one or more computer systems to process incoming real-time events related to the application based at least in part on the snapshot output of the one or more data values.

13. A system, comprising:

a memory storing a plurality of instructions; and

a central processing unit configured to access the memory, wherein the central processing unit is further configured to execute the plurality of instructions to at least;

receive a continuous query to be executed on an event stream, the continuous query being identified based at least in part on an archived relation associated with an application, the archived relation indicating availability of historical data related to the event stream, the historical data stored in a database;

generate a physical query plan for the continuous query;

determine that an operator identified in the physical query plan is capable of being used to construct a corresponding archiver query based at least in part on a function being performed by the operator and a type of the operator;

when it is determined that the operator is capable of being used to construct a corresponding archiver query, determining that the operator is capable of maintaining state information related to the application such that the operator can be used on the event stream after being pre-populated with a state of the operator, the state of the operator providing historical context associated with querying the historical data in the database;

based at least in part on the instructions to determine that the operator is capable of being used to construct the corresponding archiver query and the instructions to determine that the operator is capable of maintaining state information related to the application, instructions to construct the archiver query for the operator, the instructions to construct the archiver query comprising instructions to;

construct a structured query language (SQL) equivalent expression corresponding to an attribute utilized by the operator;

construct an output SQL expression for the operator based at least in part on the SQL equivalent expression;

construct the archiver query for the operator based at least in part on the output SQL expression;

execute the archiver query on the historical data in the database to obtain a result set of data records related to the application;

initialize the state of the operator based at least in part on the result set of data records; and

execute the continuous query on the event stream in order to generate a snapshot output of one or more data values related to the application based at least in part on pre-populating the operator with the state of the operator.

14. The system of claim 13, wherein the central processing unit is further configured to execute the plurality of instructions to at least construct an archiver query clause for the operator based at least in part on the SQL equivalent expression.

15. The system of claim 14, wherein the central processing unit is further configured to execute the plurality of instructions to at least construct the output SQL expression for the operator based at least in part on the archiver query clause.