System and method for optimizing storage of multi-dimensional data in data storage
First Claim
1. A method for optimizing storage of multidimensional data, the method comprising:
- analyzing, by an optimization system, a plurality of queries received over a period of time from one or more client machines;
determining, by the optimization system, a query pattern from the plurality of queries;
identifying, by the optimization system, dimensionality of data based on the query pattern and determining a data storage strategy based at least in part on the dimensionality, wherein the dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions; and
performing, based on the determined data storage strategy and by the optimization system, at least one of;
segmenting at least one of the data or columns of a table stored in a data storage based on the identified dimensionality;
storing the data in a remote data storage when the data is an element of a last one of the higher level dimensions;
orfragmenting the higher level dimensions into one or more lower level dimensions when the data is an element greater than the 11 dimensions.
1 Assignment
0 Petitions
Accused Products
Abstract
This technology relates to method and optimization systems for optimizing storage of multi-dimensional data in data storage. The method comprises analyzing a plurality of queries received over period of time from one or more client machines. Then, a query pattern is determined from plurality of queries. Based on query pattern dimensionality of data is identified for determining data storage strategy. The dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions. A highest dimension out of 7 higher dimensions is parallel data storage dimension. Based on storage strategy, at least one of data and columns of a table is segmented in data storage. Next, data is stored in remote data storage when data is an element of last higher level dimension. Then, higher level dimensions are fragmented into one or more smaller level dimensions when data is element greater than 11 dimensions.
-
Citations
18 Claims
-
1. A method for optimizing storage of multidimensional data, the method comprising:
-
analyzing, by an optimization system, a plurality of queries received over a period of time from one or more client machines; determining, by the optimization system, a query pattern from the plurality of queries; identifying, by the optimization system, dimensionality of data based on the query pattern and determining a data storage strategy based at least in part on the dimensionality, wherein the dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions; and performing, based on the determined data storage strategy and by the optimization system, at least one of; segmenting at least one of the data or columns of a table stored in a data storage based on the identified dimensionality; storing the data in a remote data storage when the data is an element of a last one of the higher level dimensions;
orfragmenting the higher level dimensions into one or more lower level dimensions when the data is an element greater than the 11 dimensions. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. An optimization system, comprising:
-
a processor; and a memory communicatively coupled to the processor, wherein the memory stores processor-executable instructions which, on execution by the processor, cause the processor to; analyzing a plurality of queries received over a period of time from one or more client machines; determining a query pattern from the plurality of queries; identifying dimensionality of data based on the query pattern and determining a data storage strategy based at least in part on the dimensionality, wherein the dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions; and performing, based on the determined data storage strategy, at least one of; segmenting at least one of the data or columns of a table stored in a data storage based on the identified dimensionality; storing the data in a remote data storage when the data is an element of a last one of the higher level dimensions;
orfragmenting the higher level dimensions into one or more lower level dimensions when the data is an element greater than the 11 dimensions. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A non-transitory computer readable medium having stored thereon instructions for optimizing storage of multidimensional data comprising executable code which when executed by a processor, cause the processor to perform steps comprising:
-
analyzing a plurality of queries received over a period of time from one or more client machines; determining a query pattern from the plurality of queries; identifying dimensionality of data based on the query pattern and determining a data storage strategy based at least in part on the dimensionality, wherein the dimensionality is characterized into 11 dimensions comprising 4 standard level dimensions and 7 higher level dimensions; and performing, based on the determined data storage strategy, at least one of; segmenting at least one of the data or columns of a table stored in a data storage based on the identified dimensionality; storing the data in a remote data storage when the data is an element of a last one of the higher level dimensions;
orfragmenting the higher level dimensions into one or more lower level dimensions when the data is an element greater than the 11 dimensions. - View Dependent Claims (14, 15, 16, 17, 18)
-
Specification