Facilitating flexible windows in data stream management systems

• US 8,019,747 B2
• Filed: 10/30/2007
• Issued: 09/13/2011
• Est. Priority Date: 10/30/2007
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Mishra, Shailendra, Jain, Namit, Jain, Parul, Srinivasan, Anand
• Primary Examiner(s): Trujillo; James
• Assistant Examiner(s): Casanova; Jorge A
• Application Number:
  US11/927,681
• Publication Number:
  US 20090112802A1
• Time in Patent Office: 1,414 Days
• Field of Search: 707/713, 707/769
• US Class Current: 707/713
• CPC Class Codes: G06F 16/903 Querying for retrieval from the web G06F16/953

Abstract

Facilitating flexible windows in querying continuous data streams. In one embodiment, a software code is associated with a window, wherein execution of the software code determines the values to be included in the window. On receiving a query indicating the window, the result of the query is generated based on the values in the window determined by execution of the software code. The software code may be identified by an identifier and thus used for different queries on the same or different continuous data streams.

Claims

1. A method of processing continuous data streams in a data stream management system, said method comprising:

receiving a query to be executed in a window on a continuous data stream and a software code associated with said window;

determining a set of data values to be included in said window based on execution of said software code, wherein said set of data values is contained in a plurality of data values received in said continuous data stream; and

generating a output of said query based on said set of data values included in said window,

wherein said determining comprises;

receiving a first data value contained in said plurality of data values at a first time instant in said continuous data stream;

checking whether said first data value is to be included in said window by executing said software code; and

adding said first data value to said set of data values, only if said first data value is to be included in said window.

2. The method of claim 1, wherein said receiving receives an identifier in said query, wherein said identifier identifies said software code, wherein said software code is provided external to said query.

3. The method of claim 2, further comprising receiving a command specifying a window identifier associated with said software code, wherein said window identifier identifies said window, wherein said identifier comprises said window identifier.

4. The method of claim 2, further comprising:

receiving a second query also containing said identifier,

wherein said determining determines a second set of data values contained in said plurality of data values to be included in a second window for said second query based on said execution of said software code,

wherein said generating generates a second output of said second query based on said second set of data values forming said second window at a corresponding time instant.

5. The method of claim 4, wherein said software code is received from a first system and said second query is received from a second system.

6. The method of claim 2, further comprising:

receiving a third query also containing said identifier, wherein said third query specifies a third continuous data stream,

wherein said determining determines a third set of data values to be included in a third window based on said execution of said software code, wherein said third set of data values is contained in a third plurality of data values received on said third continuous data stream,

wherein said generating generates a third output of said third query based on said third set of data values forming said third window.

7. The method of claim 1, wherein said determining further comprises:

verifying whether a second data value is to be excluded from said window by executing said software code at a present time instant, wherein said second data value is already included in said set of data values at a previous time instant; and

removing said second data value from said set of data values to form said window at said present time instant, if said second data value is to be excluded from said window.

8. The method of claim 1, wherein said plurality of data values is received at discrete time instants in said continuous data stream, wherein said determining and said generating are performed at some of said discrete time instants.

9. A method of retrieving desired information from continuous data streams, said method being executed in a client system, said method comprising:

sending a query to be executed in a window on a continuous data stream and a software code associated with said window, wherein said software code is to be used to determine the values to be included in said window; and

receiving a result comprising a plurality of outputs at corresponding time instants in response to said sending,

wherein each of said plurality of outputs is generated by executing said query on a set of data values included in said window at said corresponding time instant,

wherein said set of data values are determined to be included in said window at each of said corresponding time instants based on execution of said software code, wherein said set of data values are contained in a plurality of values received in said continuous data stream,

wherein said software code, when executed, specifies a corresponding width for said window at each of said corresponding time instants, wherein the width is variable and not equal for at least two of said time instants.

10. A computing system comprising:

a data source to send a plurality of data values on a continuous data stream;

a client system to send a query to be executed in a window on said continuous data stream and a software code associated with said window; and

a data stream manager comprising;

a request manager to receive said query and said software code from said client system;

a query processor to receive said plurality of data values from said data source and to determine a set of data values to be included in said window based on execution of said software code, wherein said set of data values is contained in said plurality of data values,

to determine said set of data values to be included in said window, said query processor is operable to;

receive a first data value contained in said plurality of data values at a first time instant in said continuous data stream;

check whether said first data value is to be included in said window by executing said software code; and

add said first data value to said set of data values, only if said first data value is to be included in said window; and

an output generator to generate an output of said query based on said set of data values included in said window and to send said output to said client system as a response to said query,

wherein at least one of said data source, said client system and said data stream manager is implemented to contain a processor and a memory.

11. The computing system of claim 10, wherein said query contains an identifier identifying said software code, wherein said software code is provided external to said query.

12. The computing system of claim 11, further comprising:

a second client system to send only a second query containing said identifier,

wherein said request manager receives said second query from said second client system,

wherein said query processor determines a second set of data values to be included in a second window for said second query based on said execution of said software code, wherein said second set of data values is also contained in said plurality of data values,

wherein said output generator generates a second output of said second query based on said second set of data values forming said second window at a corresponding time instant and sends said second output to said second client system.

13. The computing system of claim 11, further comprising:

a third data source to send a third plurality of data values on a third continuous data stream; and

a third client system to send only a third query to be executed in a window on said third continuous data stream, wherein said third query also contains said identifier,

wherein said request manager determines a third set of data values to be included in a third window for said third query based on said execution of said software code, wherein said third set of data values is contained in said third plurality of data values,

wherein said output generator generates a third output of said third query based on said third set of data values forming said third window and sends said third output to said third client system.

14. The computing system of claim 10, further comprising:

a fourth client system to send a request to said data stream manager for said output,

wherein said output generator sends said output to said fourth client system as well as said client system.

15. A machine readable medium storing one or more sequences of instructions for causing a system to process continuous data streams, wherein execution of said one or more sequences of instructions by one or more processors contained in said system causes said system to perform the actions of:

receiving a query to be executed in a window on a continuous data stream and a software code associated with said window;

determining a set of data values to be included in said window based on execution of said software code, wherein said set of data values is contained in a plurality of data values received in said continuous data stream; and

generating a output of said query based on said set of data values included in said window,

wherein said determining further comprises;

receiving a first data value contained in said plurality of data values at a first time instant in said continuous data stream;

checking whether said first data value is to be included in said window by executing said software code; and

adding said first data value to said set of data values, only if said first data value is to be included in said window.

16. The machine readable medium of claim 15, wherein said receiving receives an identifier in said query, wherein said identifier identifies said software code, wherein said software code is provided external to said query.

17. The machine readable medium of claim 15, further comprising one or more instructions for:

receiving a second query also containing said identifier,

wherein said determining determines a second set of data values contained in said plurality of data values to be included in a second window for said second query based on said execution of said software code,

wherein said generating generates a second output of said second query based on said second set of data values forming said second window at a corresponding time instant.

18. The machine readable medium of claim 15, wherein said determining further comprises one or more instructions for:

verifying whether a second data value is to be excluded from said window by executing said software code at a present time instant, wherein said second data value is already included in said set of data values at a previous time instant; and

removing said second data value from said set of data values to form said window at said present time instant, if said second data value is to be excluded from said window.

19. The machine readable medium of claim 15, wherein said plurality of data values is received at discrete time instants in said continuous data stream, wherein said determining and said generating are performed at some of said discrete time instants.

20. A machine readable medium storing one or more sequences of instructions for causing a client system to retrieve desired information from continuous data streams, wherein execution of said one or more sequences of instructions by one or more processors contained in said client system causes said client system to perform the actions of:

sending a query to be executed in a window on a continuous data stream and a software code associated with said window, wherein said software code is to be used to determine the values to be included in said window; and

receiving a result comprising a plurality of outputs at corresponding time instants in response to said sending,

wherein each of said plurality of outputs is generated by executing said query on a set of data values included in said window at said corresponding time instant,

wherein said set of data values are determined to be included in said window at each of said corresponding time instants based on execution of said software code, wherein said set of data values are contained in a plurality of values received in said continuous data stream,

wherein said software code contains at least one programming instruction which, when executed, specifies a corresponding width for said window at each of said corresponding time instants, wherein the width is variable and not equal for at least two of said time instants.