Stream data processing method and computer systems
First Claim
1. A stream data processing method for causing a computer to execute a processing of receiving stream data input to the computer as primary information and of generating secondary information by acquiring primary information within a predetermined period from among the received primary information, comprising the steps of:
- receiving the stream data input to the computer as the primary information;
determining whether or not the received primary information includes delay information indicating that there is primary information to arrive with a delay; and
performing a first real-time processing when a result of the determination includes delay information, wherein;
the step of performing the first real-time processing includes the steps of;
extracting primary information corresponding to a predetermined lifetime from among the received primary information as secondary information, and generating a real-time processing result from the extracted secondary information;
receiving primary information corresponding to the delay information; and
recalculating the real-time processing result after receiving the primary information that arrives with a delay;
the step of generating the real-time processing result from the extracted secondary information includes the steps of;
obtaining secondary information based on the lifetime from primary information excluding primary information that is to arrive with a delay when the delay information is received, and outputting the secondary information as a real-time output result that needs to be recalculated; and
retaining result restore information for obtaining the real-time output result as information that needs to be recalculated after receiving the primary information corresponding to the delay information, along with the lifetime; and
the step of recalculating the real-time processing result after receiving the primary information that arrives with a delay includes the step of recalculating the secondary information from the primary information that arrives with a delay and the result restore information, and outputting a result of the recalculation as a delay output result.
1 Assignment
0 Petitions
Accused Products
Abstract
Provided is a stream data processing method that can effectively handle delay data. In the stream data processing method of processing data whose lifetime is defined by a window, an operation result excluding a delay tuple is immediately output along with an unconfirmed flag according to delay processing HBT while a midway processing result necessary for reproduction is retained along with the lifetime, and when the delay tuple arrives, a correct processing result is calculated from the delay tuple and the processing result restore tuple.
-
Citations
19 Claims
-
1. A stream data processing method for causing a computer to execute a processing of receiving stream data input to the computer as primary information and of generating secondary information by acquiring primary information within a predetermined period from among the received primary information, comprising the steps of:
-
receiving the stream data input to the computer as the primary information; determining whether or not the received primary information includes delay information indicating that there is primary information to arrive with a delay; and performing a first real-time processing when a result of the determination includes delay information, wherein; the step of performing the first real-time processing includes the steps of; extracting primary information corresponding to a predetermined lifetime from among the received primary information as secondary information, and generating a real-time processing result from the extracted secondary information; receiving primary information corresponding to the delay information; and recalculating the real-time processing result after receiving the primary information that arrives with a delay; the step of generating the real-time processing result from the extracted secondary information includes the steps of; obtaining secondary information based on the lifetime from primary information excluding primary information that is to arrive with a delay when the delay information is received, and outputting the secondary information as a real-time output result that needs to be recalculated; and retaining result restore information for obtaining the real-time output result as information that needs to be recalculated after receiving the primary information corresponding to the delay information, along with the lifetime; and the step of recalculating the real-time processing result after receiving the primary information that arrives with a delay includes the step of recalculating the secondary information from the primary information that arrives with a delay and the result restore information, and outputting a result of the recalculation as a delay output result. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer system, which is provided with a processor, a storage system, and an interface and set in the storage system, and in which stream data input through the interface is acquired as primary information, and secondary information is generated for the acquired primary information based on a window for defining a lifetime during which the primary information is to be processed, the computer system comprising:
-
a first processing module for outputting, as a real-time processing result, a processing result excluding primary information that arrives with a delay based on delay information indicating that a portion of the primary information arrives with a delay; a result restore information retention module for retaining, along with the lifetime, result restore information necessary for a recalculation performed when primary information corresponding to the delay information arrives; and a delay tuple recalculation module for recalculating, when the primary information corresponding to the delay information arrives, the secondary information from the result restore information and the primary information corresponding to the delay information, and outputting a result of the recalculation as a delay output result. - View Dependent Claims (15, 16, 17)
-
-
18. A machine-readable medium for storing a program for causing a computer to execute a stream data processing of acquiring stream data input to the computer as primary information, and of generating secondary information for the acquired primary information based on a window for defining a lifetime during which the primary information is to be processed, the program executing the computer to execute the procedures of:
-
extracting, based on delay information indicating that a portion of the primary information arrives with a delay, a processing result excluding primary information that arrives with a delay as the secondary information, and outputting the secondary information as a real-time processing result; retaining, along with the lifetime, a midway processing result necessary for a recalculation performed when primary information corresponding to the delay information arrives; and recalculating, when the primary information corresponding to the delay information arrives, the secondary information from the midway processing result and the primary information corresponding to the delay information, and outputting a recalculation result as the delay output result. - View Dependent Claims (19)
-
Specification