Support for a new insert stream (ISTREAM) operation in complex event processing (CEP)

• US 8,990,416 B2
• Filed: 05/06/2011
• Issued: 03/24/2015
• Est. Priority Date: 05/06/2011
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Shukla, Vikram, Srinivasan, Anand
• Primary Examiner(s): Hoang, Hieu
• Assistant Examiner(s): TRAN, NAM T
• Application Number:
  US13/102,665
• Publication Number:
  US 20120284420A1
• Time in Patent Office: 1,418 Days
• US Class Current: 709/231
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 47/28 in relation to timing considerations
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355

Abstract

One embodiment of the invention includes a method of processing streaming data. The method includes initializing a stream of data and setting a time interval to apply to the stream of data. The time interval comprises a window for analyzing the data within the stream of data. The method further includes identifying one or more columns within the stream of data, designating one or more of the columns to be monitored for differences within the data over the time interval, and monitoring the designated columns over the time interval. Further, the method includes determining that at least one value from at least one of the designated columns has changed and in response to at least one value changing, outputting the changed values from the designated columns.

Claims

1. A method of processing streaming data, the method comprising:

initializing, by a computer processor, a stream of data for a continuous query logic (CQL) operation;

setting, by the computer processor, a time interval of the CQL operation to apply to the stream of data, wherein the time interval comprises a window for analyzing the data within the stream of data;

identifying, by the computer processor, one or more columns within the stream of data;

designating, by the computer processor in the CQL operation, one or more of the columns to be monitored for differences within the data over the time interval by executing a SELECT list expressions and applying the SELECT list expressions to a subset of the stream of data, wherein the one or more designated column are columns of interest;

monitoring, by the computer processor, the designated columns over the time interval of the CQL operation;

determining, by the computer processor, that at least one value from at least one of the designated columns has changed by applying an ISTREAM operator of the CQL operation on a subset of the one or more columns with a NOT IN semantic to provide a syntactic notation to express output, wherein the ISTREAM operator currently considers all of the one or more columns and reports tuples even when values of the one or more columns of interest do not change and further outputs changes in values in the one or more columns which are not columns of interest; and

in response to at least one value changing, outputting, by the computer processor, the changed values from the designated columns using the syntactic notation of the CQL operation and outputting changes in data in the one or more columns which are not columns of interest.

2. The method of processing streaming data as in claim 1, further comprising continuing to receive data from the stream of data for a next time interval.

3. The method of processing streaming data as in claim 2, wherein the receiving of the data from the stream of data is substantially in real-time.

4. The method of processing streaming data as in claim 1, wherein the one or more columns are included in one or more tables constructed from the stream of data over the time interval.

5. The method of processing streaming data as in claim 1, wherein the output only includes changes within the stream of data.

6. The method of processing streaming data as in claim 1, wherein the processing of the streaming data comprises complex event processing (CEP).

7. The method of processing streaming data as in claim 1, wherein the output comprises a subset of data within the streaming data which has changed over the time interval.

8. A non-transitory computer-readable medium for processing streaming data having sets of instructions stored thereon which, when executed by a computer, cause the computer to:

convert relational data into streaming data by applying an istream operator of a continuous query logic (CQL) operation;

determine one or more segments within the streaming data as applied by a bounding constraint, wherein the bounding constraint designates segment boundaries of the CQL operation;

identify a column from the data stream for the CQL operation;

select the identified column over the determined segment;

select a column to monitor changes in the data within the column over the determined segment by executing a single SELECT list expressions and applying the single SELECT list expressions to a subset of the stream of data for the CQl operation;

monitoring the designated columns over a time interval of the CQL operation, wherein the designated column are columns of interest;

determining that at least one value from at least one of the designated columns has changed by applying an istream operator of the CQL operation on a subset of the one or more columns with a NOT IN semantic to provide a syntactic notation to express output, wherein the ISTREAM operator currently considers all of the columns and reports tuples even when values of the columns of interest do not change and further outputs changes in values in the columns which are not columns of interest;

execute a multiset istream operation of the CQL operation of the selected column over the determined segment as applied to the monitored column; and

in response to at least one value changing, output the resulting data from the multiset istream operation using the syntactic notation of the CQL operation and output changes in data in the columns which are not columns of interest.

9. The non-transitory computer-readable medium for processing streaming data as in claim 8, wherein the sets of instructions when further executed by the computer, cause the computer to convert the streaming data back into relational data.

10. The non-transitory computer-readable medium for processing streaming data as in claim 8, wherein the segment boundaries comprise a time interval.

11. The non-transitory computer-readable medium for processing streaming data as in claim 10, wherein the time interval comprises a time window for analyzing changes within the designated column data.

12. The non-transitory computer-readable medium for processing streaming data as in claim 10, wherein the output comprises a subset of data within the data stream which has changed over the segment.

13. A system for processing streaming data, the system comprising:

a storage memory having sets of instructions stored thereon; and

a processor coupled with the storage memory, wherein the sets of instructions when executed by the processor, cause the processor to;

initialize a stream of data for a continuous query logic (CQL) operation;

set a time interval to apply to the stream of data of the CQL operation, wherein the time interval comprises a window for analyzing the data within the stream of data;

identify one or more columns within the stream of data;

designate in the CQL operation one or more of the columns to be monitored for differences within the data over the time interval by executing a SELECT list expressions and applying the SELECT list expressions to a subset of the stream of data, wherein the one or more designated column are columns of interest;

monitor the designated columns over the time interval of the CQL operation;

determine that at least one value from at least one of the designated columns has changed by applying an ISTREAM operator if the CQL operation on a subset of the one or more columns with a NOT IN semantic to provide a syntactic notation to express output, wherein the ISTREAM operator currently considers all of the one or more columns and reports tuples even when values of the one or more columns of interest do not change and further outputs changes in values in the one or more columns which are not columns of interest; and

in response to at least one value changing, output the changed values from the designated columns using the syntactic notation of the CQL operation and output changes in data in the one or more columns which are not columns of interest.

14. The system for processing streaming data as in claim 13, further comprising a database, wherein the database is configured to store the data within the stream of data.

15. The system for processing streaming data as in claim 14, wherein the sets of instructions further cause the processor to continue to receive data from the stream of data for a next time interval.

16. The system for processing streaming data as in claim 15, wherein the receiving of the data from the stream of data is substantially in real-time.

17. The system for processing streaming data as in claim 13, wherein the one or more columns are included in one or more tables constructed from the stream of data over the time interval.

18. The system for processing streaming data as in claim 13, wherein the output only includes changes within the stream of data over the time interval.

19. The system for processing streaming data as in claim 13, wherein the processor is configured to implement a monitoring application which implements the sets of instructions executed by the processor.

20. The method for processing streaming data as in claim 13, wherein the processing of the streaming data comprises complex event processing (CEP).