EFFICIENT STORAGE OF DATA ALLOWING FOR MULTIPLE LEVEL GRANULARITY RETRIEVAL

• US 20100211618A1
• Filed: 02/17/2009
• Published: 08/19/2010
• Est. Priority Date: 02/17/2009
• Status: Active Grant

• Current Assignee: Trane Us Incorporated (Trane Technologies plc)
• Original Assignee: Agilewaves, Inc. (Serious Energy, Inc.)
• Inventors: ANDERSON, Darrell, BROCK, David
• Granted Patent: US 8,886,689 B2
• Time in Patent Office: Days
• US Class Current: 707/812
• CPC Class Codes: G05B 23/0264 Control of logging system, e.g. decision on which data to store; time-stamping measurements
• CPC Class Codes: G06F 16/2474 Sequence data queries, e.g. querying versioned data
• CPC Class Codes: G06F 16/2477 Temporal data queries
• CPC Class Codes: G06F 16/285 Clustering or classification

Abstract

Data series are stored at multiple resolutions in a computer-readable data storage medium. In particular, time series data values of the data series are received with associated timestamps. Corresponding storage elements in the computer-readable data storage medium are identified based on the time stamps. Aggregate values are determined by summing the time series data values. The time series data values stored in the corresponding storage elements are replaced by the aggregate values. Combined data values of the aggregate values are stored in storage elements in the computer-readable storage medium at a first resolution and second resolution, where the second resolution is half of the first resolution.

Claims

1. A method for storing a data series at multiple resolutions in a computer-readable data storage medium, wherein data of the data series are sequential data from a sensor, the method comprising:

receiving a first time series data value of the data series, the first time series data value associated with a first timestamp;

identifying a first storage element from a series of storage elements in the computer-readable data storage medium that corresponds to the first time series data value based on the first time stamp, wherein each storage element of the series of storage elements represents a different segment of time;

determining a first aggregate value, wherein the first aggregate value is equal to the sum of the first time series data value and a first stored time series data value, the first stored time series data value stored in the first storage element;

replacing the first stored time series data value with the first aggregate value;

receiving a second time series data value of the data series, the second time series data value associated with a second timestamp;

identifying a second storage element from the series of storage elements that corresponds to the second time series data value based on the second time stamp;

determining a second aggregate value, wherein the second aggregate value is equal to the sum of the second time series data value and a second stored time series data value, the second stored time series data value stored in the second storage element;

replacing the second stored time series data value with the second aggregate value;

receiving a third time series data value of the data series, the third time series data value associated with a third timestamp;

identifying a third storage element from the series of storage elements that corresponds to the third time series data value based on the third timestamp;

determining a third aggregate value, wherein the third aggregate value is equal to the sum of the third time series data value and a third stored time series data value, the third stored time series data value stored in the third storage element;

replacing the third stored time series data value with the third aggregate value;

receiving a fourth time series data value of the data series, the fourth time series data value associated with a fourth timestamp;

identifying a fourth storage element from the series of storage elements that corresponds to the fourth time series data value based on the fourth timestamp;

determining a fourth aggregate value, wherein the fourth aggregate value is equal to the sum of the fourth time series data value and a fourth stored time series data value, the fourth stored time series data value stored in the fourth storage element;

replacing the fourth stored time series data value with the fourth aggregate value;

storing a first combined data value in a fifth storage element in the series of storage elements in the computer-readable data storage medium, the first combined data value equal to the sum of the first and second aggregate values; and

storing a second combined data value in a sixth storage element in the series of storage elements in the computer-readable data storage medium, the second combined data value equal to the sum of the third and fourth aggregate values,

wherein the first, second, third, and fourth aggregate values are stored at a first resolution in the computer-readable data storage medium and the first and second combined data values are stored at a second resolution in the computer-readable data storage medium, wherein the second resolution is half of the first resolution.

2. The method of claim 1, wherein the method further comprises:

replacing a third combined data value with the sum of the first combined data value and the second combined data value, wherein the third combined data value is stored at a third resolution, and wherein the third resolution is half of the second resolution.

3. The method of claim 1, wherein the segments of time represented by the first, second, third, and fourth storage elements are of equal length.

4. The method of claim 1, wherein the first, second, third, and fourth time series data values are associated with at least one of temperature, air quality, soil saturation, pressure, and electrical current measurements obtained by the sensor.

5. A computer-readable data storage medium comprising program code for storing a data series at multiple resolutions, wherein data of the data series are sequential data from a sensor, comprising program code for:

receiving a first time series data value of the data series, the first time series data value associated with a first timestamp;

identifying a first storage element from a series of storage elements in the computer-readable data storage medium that corresponds to the first time series data value based on the first time stamp, wherein each storage element of the series of storage elements represents a different segment of time;

determining a first aggregate value, wherein the first aggregate value is equal to the sum of the first time series data value and a first stored time series data value, the first stored time series data value stored in the first storage element;

replacing the first stored time series data value with the first aggregate value;

receiving a second time series data value of the data series, the second time series data value associated with a second timestamp;

identifying a second storage element from the series of storage elements that corresponds to the second time series data value based on the second time stamp;

determining a second aggregate value, wherein the second aggregate value is equal to the sum of the second time series data value and a second stored time series data value, the second stored time series data value stored in the second storage element;

replacing the second stored time series data value with the second aggregate value;

receiving a third time series data value of the data series, the third time series data value associated with a third timestamp;

identifying a third storage element from the series of storage elements that corresponds to the third time series data value based on the third timestamp;

determining a third aggregate value, wherein the third aggregate value is equal to the sum of the third time series data value and a third stored time series data value, the third stored time series data value stored in the third storage element;

replacing the third stored time series data value with the third aggregate value;

receiving a fourth time series data value of the data series, the fourth time series data value associated with a fourth timestamp;

identifying a fourth storage element from the series of storage elements that corresponds to the fourth time series data value based on the fourth timestamp;

determining a fourth aggregate value, wherein the fourth aggregate value is equal to the sum of the fourth time series data value and a fourth stored time series data value, the fourth stored time series data value stored in the fourth storage element;

replacing the fourth stored time series data value with the fourth aggregate value; and

storing a first combined data value in a fifth storage element in the series of storage elements in the computer-readable data storage medium, the first combined data value equal to the sum of the first and second aggregate values;

storing a second combined data value in a sixth storage element in the series of storage elements in the computer-readable data storage medium, the second combined data value equal to the sum of the third and fourth aggregate values,

wherein the first, second, third, and fourth aggregate values are stored at a first resolution in the computer-readable data storage medium and the first and second combined data values are stored at a second resolution in the computer-readable data storage medium, wherein the second resolution is half of the first resolution.

6. The computer-readable data storage medium of claim 5, further comprising program code for:

replacing a third combined data value with the sum of the first combined data value and the second combined data value, wherein the third combined data value is stored at a third resolution, and wherein the third resolution is half of the second resolution.

7. The computer-readable data storage medium of claim 5, wherein the segments of time represented by the first, second, third, and fourth storage elements are of equal length.

8. The computer-readable data storage medium of claim 5, wherein the first, second, third, and fourth time series data values are associated with at least one of temperature, air quality, soil saturation, pressure, and electrical current measurements obtained by the sensor.

9. A system for storing a data series at multiple resolutions, wherein data of the data series are sequential data from a common source, the system comprising:

a sensor;

memory for storing program code, the program code comprising instructions for;

receiving from the sensor a first time series data value of the data series, the first time series data value associated with a first timestamp;

identifying a first storage element from a series of storage elements in a computer-readable data storage medium that corresponds to the first time series data value based on the first time stamp, wherein each storage element of the series of storage elements represents a different segment of time;

determining a first aggregate value, wherein the first aggregate value is equal to the sum of the first time series data value and a first stored time series data value, the first stored time series data value stored in the first storage element;

replacing the first stored time series data value with the first aggregate value;

receiving from the sensor a second time series data value of the data series, the second time series data value associated with a second timestamp;

identifying a second storage element from the series of storage elements that corresponds to the second time series data value based on the second time stamp;

determining a second aggregate value, wherein the second aggregate value is equal to the sum of the second time series data value and a second stored time series data value, the second stored time series data value stored in the second storage element;

replacing the second stored time series data value with the second aggregate value;

receiving from the sensor a third time series data value of the data series, the third time series data value associated with a third timestamp;

identifying a third storage element from the series of storage elements that corresponds to the third time series data value based on the third timestamp;

determining a third aggregate value, wherein the third aggregate value is equal to the sum of the third time series data value and a third stored time series data value, the third stored time series data value stored in the third storage element;

replacing the third stored time series data value with the third aggregate value;

receiving from the sensor a fourth time series data value of the data series, the fourth time series data value associated with a fourth timestamp;

identifying a fourth storage element from the series of storage elements that corresponds to the fourth time series data value based on the fourth timestamp;

determining a fourth aggregate value, wherein the fourth aggregate value is equal to the sum of the fourth time series data value and a fourth stored time series data value, the fourth stored time series data value stored in the fourth storage element;

replacing the fourth stored time series data value with the fourth aggregate value;

storing a first combined data value in a fifth storage element in the series of storage elements in the computer-readable data storage medium, the first combined data value equal to the sum of the first and second aggregate values; and

storing a second combined data value in a sixth storage element in the series of storage elements in the computer-readable data storage medium, the second combined data value equal to the sum of the third and fourth aggregate values,

wherein the first, second, third, and fourth aggregate values are stored at a first resolution in the computer-readable data storage medium and the first and second combined data values are stored at a second resolution in the computer-readable data storage medium, wherein the second resolution is half of the first resolution; and

a processor for executing the instructions stored in the memory.

10. The system of claim 9, wherein the program code further comprising instructions for:

replacing a third combined data value with the sum of the first combined data value and the second combined data value, wherein the third combined data value is stored at a third resolution, and wherein the third resolution is half of the second resolution.

11. The system of claim 9, wherein the segments of time represented by the first, second, third, and fourth storage elements are of equal length.

12. The system of claim 9, wherein the first, second, third, and fourth time series data values are associated with at least one of temperature, air quality, soil saturation, pressure, and electrical current measurements obtained by the sensor.