QUERY TO STREAMING DATA

• US 20130091123A1
• Filed: 10/10/2011
• Published: 04/11/2013
• Est. Priority Date: 10/10/2011
• Status: Active Grant

• Current Assignee: Micro Focus LLC (Open Text Corporation)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Chen, Qiming, Hsu, Meichun
• Granted Patent: US 9,361,342 B2
• Time in Patent Office: Days
• US Class Current: 707/722
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements

Abstract

A client computer buffers a continuous flow of streaming data during a sliding window that is defined by a time boundary. The client computer processes a query on a portion of the streaming data buffered during the time boundary of the sliding window and a portion of the streaming data stored in a data warehouse.

Claims

1. ) A method, comprising:

buffering, on a client computer, a continuous flow of streaming data during a sliding window that is defined by a time boundary; and

processing, by the client computer, a query on a portion of the streaming data buffered during the time boundary of the sliding window and on a portion of the streaming data stored in a data warehouse.

2. ) The method of claim 1 further comprising, executing a request-and-rewind mechanism to provide on-demand query evaluations for the streaming data.

3. ) The method of claim 1 further comprising, continuously updating the streaming data buffered during the time boundary of the sliding window even when no query is pending for the streaming data.

4. ) The method of claim 1 further comprising, accessing the streaming data buffered in an event pipe during the time boundary of the sliding window and in the data warehouse after expiration of the time boundary.

5. ) The method of claim 1 further comprising:

storing the streaming data in an event pipe;

analyzing events in the event pipe based on a continuous data access object (CDAO) pattern.

6. ) A non-transitory computer readable storage medium comprising instructions that when executed causes a computer system to:

transmit, from a server to a client computer, continuous streaming data to an event pipe;

buffer, in the client computer, the streaming data in the event pipe during a time period defined by a sliding window;

store, in a data warehouse, the streaming data after expiration of the time period; and

execute a query based on the streaming data buffered in the client computer.

7. ) The non-transitory computer readable storage medium of claim 6 including instructions to further cause the computer system to:

access, with an application executing on the client computer, the streaming data buffered in the client computer and stored in the data warehouse in order to execute the query.

8. ) The non-transitory computer readable storage medium of claim 6 including instructions to further cause the computer system to:

execute a continuous data access object (CDAO) for merging query results from events retrieved from the event pipe and query results retrieved from the data warehouse.

9. ) The non-transitory computer readable storage medium of claim 6 including instructions to further cause the computer system to:

execute a Streaming Capture Function (SCF) that receives an information-request, signals a query engine to terminate and commit a current query execution, and rewinds a query instance for serving a next query request.

10. ) The non-transitory computer readable storage medium of claim 6 including instructions to further cause the computer system to:

execute a continuous data access object (CDAO) with plural event pipes implemented in terms of Event Pipe Queries (EPQs) that integrate event buffering and analysis in a single query.

11. ) A computer system, comprising:

a memory storing instructions; and

a processor executing the instructions to buffer streaming data in an event pipe on a client computer during a time boundary defined by a sliding window, and merge query results from one query to the streaming data in the event pipe and another query to the streaming data in a data warehouse.

12. ) The computer system of claim 11 wherein the processor further executes the instructions to use time marks to know a location of data available in the event pipe and a location of data available in the data warehouse.

13. ) The computer system of claim 11 further comprising a continuous data access object (CDAO) executing on a client computer, wherein the CDAO includes multiple Event Pipe Queries (EPQs) on a same event stream but with different query constructs expressing different event analysis functionalities and with different sliding window coverage.

14. ) The computer system of claim 11 wherein the processor further executes the instructions to cache events in the event pipe, maintain most recent events in the event pipe while the events fall in the time boundary defined by the sliding window, and query content of the event pipe on-demand.

15. ) The computer system of claim 11 wherein the processor further executes the instructions to continuously maintain and update the streaming data in the event pipe by appending new elements and removing the older ones.