Systems and methods for data manipulation using multiple storage formats
First Claim
1. A computer system implemented method for providing a requested data set, the computer system comprising at least one processor, memory and a data store, the method comprising:
- providing a relation store in the memory;
storing a plurality of data sets in the data store, including at least a first data set and a second data set, wherein the date store includes a volatile memory and a non-volatile storage medium and wherein the first data set and the second data set contain the same logical data stored in different physical formats, the first data set being stored in a first physical format having a first size and the second data set being stored in a second physical format having a second size that is smaller than the first size;
composing at least two alternative algebraic relations that each define a result equal to the requested data set, including a first algebraic relation based on at least the first data set stored in the data store and a second algebraic relation based on at least the second data set stored in the data store, wherein the first algebraic relation and the second algebraic relation each comprise a respective first expression including a symbolic representation of at least a first respective data set, a respective second expression including a symbolic representation of at least a second respective data set; and
a relational operator symbolically defining a mathematical relationship between the respective first expression and the respective second expression;
storing the first algebraic relation and the second algebraic relation in the relation store;
determining that the first data set is available in the volatile memory; and
selecting the first algebraic relation to calculate the requested data set.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for storing and accessing data. Algebraic relations may be composed that each define a result equal to a requested data set. The algebraic relations may reference other data sets in storage. Some of the data sets may contain the same logical data stored in different physical formats and/or in different locations in the data store. One of the algebraic relations may be selected for use in providing the requested data set based, at least in part, on the physical format and/or locations of the data sets referenced in the algebraic relations. In other examples, algebraic relations may be selected based, at least in part, on the speed and available bandwidth of the channel(s) used to retrieve data sets referenced in the algebraic relation. Functions may be used to calculate the algebraic relation using the data sets retrieved from storage. The functions may be format specific based on the physical formats of the data sets provided as operands to the functions.
79 Citations
12 Claims
-
1. A computer system implemented method for providing a requested data set, the computer system comprising at least one processor, memory and a data store, the method comprising:
-
providing a relation store in the memory; storing a plurality of data sets in the data store, including at least a first data set and a second data set, wherein the date store includes a volatile memory and a non-volatile storage medium and wherein the first data set and the second data set contain the same logical data stored in different physical formats, the first data set being stored in a first physical format having a first size and the second data set being stored in a second physical format having a second size that is smaller than the first size; composing at least two alternative algebraic relations that each define a result equal to the requested data set, including a first algebraic relation based on at least the first data set stored in the data store and a second algebraic relation based on at least the second data set stored in the data store, wherein the first algebraic relation and the second algebraic relation each comprise a respective first expression including a symbolic representation of at least a first respective data set, a respective second expression including a symbolic representation of at least a second respective data set; and
a relational operator symbolically defining a mathematical relationship between the respective first expression and the respective second expression;storing the first algebraic relation and the second algebraic relation in the relation store; determining that the first data set is available in the volatile memory; and selecting the first algebraic relation to calculate the requested data set. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
Specification