Data partitioning and ordering
First Claim
Patent Images
1. A method for storing ordered data in a computer data system, the method comprising:
- receiving an electronic message containing one or more data items;
storing the received data items to a first set of one or more first partitions as first stored data in a first electronic data storage device, wherein each of the first set of partitions is not grouped;
remapping the data items stored in the first set of partitions to a second set of one or more second partitions in a second electronic data storage device, each of the second partitions having a respective grouping, wherein each second partition of the second set of partitions corresponds to a directory in a file system, and wherein location keys and retrieval instructions for storage locations of interest for potential query result data are discovered by traversing a directory structure, wherein the location keys each include a partition identifier having a storage unit identifier and a partitioning column value;
storing the remapped first stored data as second stored data in the second set of partitions in the second electronic data storage device according to the respective grouping;
sorting each second partition of the second set of partitions according to a strict ordering to generate ordered second partitions;
organizing a partition of the ordered second partitions into two or more groups having one or more grouping levels based on one or more column values;
storing the ordered second partitions in the second electronic data storage device so as to maintain the strict ordering;
permitting the computer data system to defer accessing data by narrowing from a full set of locations to a sub-set of locations according to a query, and narrowing a set of rows to a sub-set of rows to evaluate prior to handling data; and
executing query operations against the sub-set of locations on a per-partition basis based on the sub-set of locations and the sub-set of rows.
3 Assignments
0 Petitions
Accused Products
Abstract
Described are methods, systems and computer readable media for data partitioning and ordering.
477 Citations
16 Claims
-
1. A method for storing ordered data in a computer data system, the method comprising:
-
receiving an electronic message containing one or more data items; storing the received data items to a first set of one or more first partitions as first stored data in a first electronic data storage device, wherein each of the first set of partitions is not grouped; remapping the data items stored in the first set of partitions to a second set of one or more second partitions in a second electronic data storage device, each of the second partitions having a respective grouping, wherein each second partition of the second set of partitions corresponds to a directory in a file system, and wherein location keys and retrieval instructions for storage locations of interest for potential query result data are discovered by traversing a directory structure, wherein the location keys each include a partition identifier having a storage unit identifier and a partitioning column value; storing the remapped first stored data as second stored data in the second set of partitions in the second electronic data storage device according to the respective grouping; sorting each second partition of the second set of partitions according to a strict ordering to generate ordered second partitions; organizing a partition of the ordered second partitions into two or more groups having one or more grouping levels based on one or more column values; storing the ordered second partitions in the second electronic data storage device so as to maintain the strict ordering; permitting the computer data system to defer accessing data by narrowing from a full set of locations to a sub-set of locations according to a query, and narrowing a set of rows to a sub-set of rows to evaluate prior to handling data; and executing query operations against the sub-set of locations on a per-partition basis based on the sub-set of locations and the sub-set of rows. - View Dependent Claims (2, 3, 4)
-
-
5. A method comprising:
-
receiving an electronic message containing one or more data items; storing the received data items to a first set of one or more first partitions as first stored data in a first electronic data storage device, wherein each of the first set of partitions is not grouped; remapping the data items stored in the first set of partitions to a second set of one or more second partitions in a second electronic data storage device, each of the second partitions having a respective grouping, wherein each second partition of the second set of partitions corresponds to a directory in a file system, and wherein location keys and retrieval instructions for storage locations of interest for potential query result data are discovered by traversing a directory structure, wherein the location keys each include a partition identifier having a storage unit identifier and a partitioning column value; storing the remapped first stored data as second stored data in the second set of partitions in the second electronic data storage device according to the respective grouping; sorting each second partition of the second set of partitions according to a strict ordering to generate ordered second partitions; storing the ordered second partitions in the second electronic data storage device so as to maintain the strict ordering; permitting a computer data system to defer accessing data by narrowing from a full set of locations to a sub-set of locations according to a query, and narrowing a set of rows to a sub-set of rows to evaluate prior to handling data; and executing query operations against the sub-set of locations on a per-partition basis based on the sub-set of locations and the sub-set of rows. - View Dependent Claims (6, 7, 8, 9, 10, 11)
-
-
12. A method comprising:
-
receiving an electronic message containing one or more data items; storing the received data items to a first set of one or more first partitions as first stored data in a first electronic data storage device; remapping the data items stored in the first set of partitions to a second set of one or more second partitions in a second electronic data storage device, each of the second partitions having a respective grouping, wherein each second partition of the second set of partitions corresponds to a directory in a file system, and wherein location keys and retrieval instructions for storage locations of interest for potential query result data are discovered by traversing a directory structure, wherein the location keys each include a partition identifier having a storage unit identifier and a partitioning column value; storing the remapped first stored data as second stored data in the second set of partitions in the second electronic data storage device according to the respective grouping; sorting each second partition of the second set of partitions according to a strict ordering to generate ordered second partitions; organizing a partition of the ordered second partitions into two or more groups having one or more grouping levels based on one or more column values; storing the ordered second partitions in the second electronic data storage device so as to maintain the strict ordering; permitting a computer data system to defer accessing data by narrowing from a full set of locations to a sub-set of locations according to a query, and narrowing a set of rows to a sub-set of rows to evaluate prior to handling data; and executing query operations against the sub-set of locations on a per-partition basis based on the sub-set of locations and the sub-set of rows. - View Dependent Claims (13, 14, 15, 16)
-
Specification