Archival and retrieval of data using linked pages and value compression

• US 8,180,982 B2
• Filed: 10/26/2007
• Issued: 05/15/2012
• Est. Priority Date: 08/01/2007
• Status: Active Grant

• Current Assignee: Raytheon Company (Rtx Corporation)
• Original Assignee: Raytheon Company (Rtx Corporation)
• Inventors: Stack, Lance C., Kaas, Gerald E., Payne, Kevin E.
• Primary Examiner(s): Chery, Mardochee
• Application Number:
  US11/924,970
• Publication Number:
  US 20090037675A1
• Time in Patent Office: 1,663 Days
• Field of Search: 711/161, 703/8, 455/414.2, 370/519, 707/705, 707/726
• US Class Current: 711/161
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Abstract

A method for archiving data comprises storing static information in a header compartment, the static information including one or more pointers. The method further comprises writing updated time stamps to a page compartment for one or more measurand updates, and writing, to a page compartment, a pointer to a data compartment entry. The method further comprises writing measurand data to a data compartment entry.

Claims

1. A system for archiving data, comprising:

a data compartment comprising one or more data compartment entries, each data compartment entry comprising a measured value from a sensor;

a page compartment operable to store;

a first page compartment entry, the first page compartment entry further comprising a first timestamp of a first measured value and a first pointer to the first measured value stored in a first data compartment entry; and

a second page compartment entry, the second page compartment entry further comprising a second timestamp of a second measured value and a second pointer, wherein;

the second pointer links the second timestamp in the second page compartment entry with the first measured value stored in the first data compartment entry if the second measured value is the same as the first measured value; and

the second pointer links the second timestamp in the second page compartment entry with the second measured value stored in a second data compartment entry if the second measured value is not the same as the first measured value; and

a header compartment associated with the sensor, the header compartment comprising one or more pieces of static information.

2. The system of claim 1, wherein the header compartment further comprises one or more pointers into the page compartment.

3. The system of claim 1, wherein the page compartment further comprises data stored as a series of separate pages based on a unique identifier of the sensor.

4. The system of claim 3, wherein the header compartment further comprises a pair of pointers to a first page and a last page associated with the sensor.

5. The system of claim 3, wherein the page compartment further comprises a page containing a header with links to a next page and a previous page for the sensor.

6. The system of claim 3, wherein the page compartment further comprises a page containing a header with a time range of records stored within that page.

7. The system of claim 1, wherein the measured value from the sensor comprises telemetry data.

8. The system of claim 1, wherein the static information comprises a unique identifier of the sensor.

9. The system of claim 1, wherein the static information comprises units of measurement associated with the sensor.

10. A method for archiving data, comprising:

receiving a measured value from a sensor;

determining that the received measured value is the same as a previously-stored measured value in a data compartment, and in response;

writing a timestamp associated with the received measured value to a page compartment entry of a page compartment;

writing, to the page compartment entry, a pointer to the previously-stored measured value, the pointer linking the timestamp in the page compartment entry with the previously-stored measured value; and

preventing duplicate data in the data compartment by preventing writing the received measured value to the data compartment; and

storing static information in a header compartment associated with the sensor, the header compartment comprising one or more pointers into the page compartment.

11. The method of claim 10, further comprising:

creating a unique hash map for the sensor.

12. The method of claim 11, further comprising:

if the received measured value from the sensor is not already in the hash map, writing the measured value to a hash map; and

if the received measured value from the sensor is already stored in the hash map, retrieving a position in the hash map of the stored measured value and storing the position in the page compartment.

13. The method of claim 12, further comprising:

if the hash map is full, deleting an oldest stored measured value associated with the sensor; and

writing the received measured value to the hash map.

14. A method for retrieving data, comprising:

selecting a sensor from a plurality of sensors from which to retrieve measured values;

selecting a time range for the selected sensor;

finding a first record in a page compartment within the selected time range for the selected sensor, the page compartment operable to store;

a first page compartment entry, the first page compartment entry further comprising a first timestamp of a first measured value and a first pointer to the first measured value stored in a first data compartment entry of a data compartment; and

a second page compartment entry, the second page compartment entry further comprising a second timestamp of a second measured value and a second pointer, wherein;

the second pointer links the second timestamp in the second page compartment entry with the first measured value stored in the first data compartment entry if the second measured value is the same as the first measured value; and

the second pointer links the second timestamp in the second page compartment entry with the second measured value stored in a second data compartment entry if the second measured value is not the same as the first measured value; and

fetching all records within the selected time range from the page compartment; and

merging the fetched records into a single time-ordered output stream.

15. The method of claim 14, wherein merging the records into a single time-ordered output stream further comprises using a selection tree to perform the merge.

16. The method of claim 14, wherein the method further comprises determining, using the pointers from the records, one or more entries in the data compartment.

17. The method of claim 16, wherein the method further comprises returning the determined one or more data compartment entries.

18. The method of claim 16, wherein the method further comprises returning the fetched records from the page compartment and the determined one or more data compartment entries.