Method and system for collecting and retrieving time-series, real-time and non-real-time data
First Claim
1. In an environment with a real-time data source and with a non-real-time data source, a method for storing, in a time-coordinated fashion, data received from the real-time and non-real-time data sources, the method comprising:
- receiving real-time data from the real-time data source;
storing the real-time data as entries in a real-time data file, the entries time-stamped with times associated with when the real-time data were produced;
receiving non-real-time data from the non-real-time data source;
storing the non-real-time data as entries in a non-real-time data file, the entries time-stamped with times of relevance of the non-real-time data; and
writing a header file that associates a time interval with those entries in the real-time and non-real-time data files whose time stamps fall within the time interval.
6 Assignments
0 Petitions
Accused Products
Abstract
Disclosed is a data collection and retrieval system that puts data produced by real-time and non-real-time data sources into parallel “streams” or data files. Real-time data points are stored with time stamps in data files and non-real-time data points with time stamps are stored in other data files. Real-time data points are stamped with the times at which their data were collected. Non-real-time data points are stored in time-sequential order, the sequence time being the time of relevance rather than the time of collection. By referencing the streams that contain data points relevant to a given period, header files facilitate coordinated retrieval of data from multiple parallel streams. The time stamps allow the data points to be merged together into one coordinated, time-sequential data stream for analysis. The parallel stream data collection and retrieval technique allows operators to add or delete data sources without shutting down the process being monitored.
-
Citations
35 Claims
-
1. In an environment with a real-time data source and with a non-real-time data source, a method for storing, in a time-coordinated fashion, data received from the real-time and non-real-time data sources, the method comprising:
-
receiving real-time data from the real-time data source;
storing the real-time data as entries in a real-time data file, the entries time-stamped with times associated with when the real-time data were produced;
receiving non-real-time data from the non-real-time data source;
storing the non-real-time data as entries in a non-real-time data file, the entries time-stamped with times of relevance of the non-real-time data; and
writing a header file that associates a time interval with those entries in the real-time and non-real-time data files whose time stamps fall within the time interval. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 18, 19, 20, 21, 22, 23, 24, 25, 28, 29, 30, 31, 32)
-
-
16. A computer-readable medium containing computer-executable instructions for performing, in an environment with a real-time data source and with a non-real-time data source, a method for storing, in a time-coordinated fashion, data received from the real-time and non-real-time data sources, the method comprising:
-
receiving real-time data from the real-time data source;
storing the real-time data as entries in a real-time data file, the entries time-stamped with times associated with when the real-time data were produced;
receiving non-real-time data from the non-real-time data source;
storing the non-real-time data as entries in a non-real-time data file, the entries time-stamped with times of relevance of the non-real-time data; and
writing a header file that associates the time interval with those entries in the real-time and non-real-time data files whose time stamps fall within the time interval.
-
-
17. A method for retrieving, in a time-coordinated fashion, data entries from a real-time data file and from a non-real-time data file, the method comprising:
-
selecting a time interval of interest;
accessing a header file that associates the time interval of interest with time-stamped data entries in the real-time and non-real-time data files whose time stamps fall within the time interval of interest;
retrieving from the real-time data file data entries associated by the header file with the time interval of interest;
retrieving from the non-real-time data file data entries associated by the header file with the time interval of interest; and
coordinating the retrieval of data entries from the real-time and non-real-time data files based on the time stamps of the data entries.
-
-
26. A computer-readable medium containing computer-executable instructions for performing a method for retrieving, in a time-coordinated fashion, data entries from a real-time data file and from a non-real-time data file, the method comprising:
-
selecting a time interval of interest;
accessing a header file that associates the time interval of interest with time-stamped data entries in the real-time and non-real-time data files whose time stamps fall within the time interval of interest;
retrieving from the real-time data file data entries associated by the header file with the time interval of interest;
retrieving from the non-real-time data file data entries associated by the header file with the time interval of interest; and
coordinating the retrieval of data entries from the real-time and non-real-time data files based on the time stamps of the data entries.
-
-
27. A computer-readable medium having stored thereon a data structure, the data structure comprising:
-
a first data field containing data representing a time interval;
a second data field containing data representing a time-stamped entry in a real-time data file whose time stamp falls within the time interval; and
a third data field containing data representing a time-stamped entry in a non-real-time data file whose time stamp falls within the time interval.
-
-
33. In an environment with a real-time data source and with a non-real-time data source, a system for storing, in a time-coordinated fashion, data received from the real-time and non-real-time data sources, the system comprising:
-
a time interval;
a real-time data file;
a non-real-time data file;
a header file; and
a data storage coordinator for receiving data from the real-time data source, for storing the real-time data in the real-time data file as entries time-stamped with times associated with when the real-time data were produced, for receiving data from the non-real-time data source, for storing the non-real-time data in the non-real-time data file as entries time-stamped with times of relevance of the non-real-time data, and for associating the header file with those entries in the real-time and non-real-time data files whose time stamps fall within the time interval. - View Dependent Claims (34, 35)
-
Specification