Query processing method for stream data processing systems

• US 20060277230A1
• Filed: 08/03/2005
• Published: 12/07/2006
• Est. Priority Date: 06/03/2005
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Fujiwara, Shinji, Imaki, Tsuneyuki, Nishizawa, Itaru
• Granted Patent: US 7,403,959 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A stream data processing system capable of highly reliable and highly usable real time data processing, is provided with: (1) a mechanism of copying some or all of stream data, and archiving the stream data in a non-volatile memory to allow real time data and archive data to be used seamlessly; and (2) a mechanism of improving the performance of query processings by using a plurality of stream data processing systems cooperatively.

Claims

1. A query processing method for a stream data processing system, comprising steps of:

receiving stream data from at least one stream data source;

continuously processing said received stream data by a pre-registered query processing; and

archiving some or all of said received stream data.

2. The query processing method for a stream data processing system according to claim 1, wherein when some or all of said received stream data is archived, stream data to be archived is subjected to sampling.

3. The query processing method for a stream data processing system according to claim 1, wherein when some or all of said received stream data is archived, stream data to be archived is subjected to encryption.

4. The query processing method for a stream data processing system according to claim 1, wherein a process of archiving some or all of said received stream data is executed cooperatively with an external data management system.

5. A query processing method for a stream data processing system, in which stream data is received from at least one stream data source, for continuously processing the received stream data by a pre-registered query processing, the method comprising steps of:

archiving some or all of said received stream data and

rewriting a query to be processed in a new query which refers to said archived data.

6. A query processing method for a stream data processing system, in which stream data is received from at least one stream data source, for continuously processing by a pre-registered query processing, the method comprising steps of:

during the pre-registration of query processing, designating an effective term of the query; and

executing query during the effective term thereof.

7. A query processing method for a stream data processing system in which stream data is received from at least one stream data source, for continuously processing the received data by pre-registered query processing, the method comprising steps of:

designating an effective term of stream in addition to stream designation, and

accepting the stream as an object to be processed during said effective term thereof.

8. A query processing method for a stream data processing system in which stream data is received from at least one stream data source, for continuously processing the received data, the method comprising steps of:

designating an effective term of archive processing in addition to archive designation,

generating archive data during said effective term of the archive processing.

9. A query processing method of processing a query cooperatively by two or more stream data processing systems, the method comprising:

deciding a process node to be assigned with a query processing in accordance with cost calculation to assign the query processing to the process node in accordance with a decision; and

if query processings required to be performed in order are assigned to different process nodes, generating an intermediate stream interconnecting said process nodes.

10. The query processing method of processing a query cooperatively by two or more stream data processing systems according to claim 9, wherein in accordance with assignment of the process nodes, archive data necessary for the query processing assigned to each process node is copied or transferred to the process node.