Document-partitioned secondary indexes in a sorted, distributed key/value data store
First Claim
1. A method operative in association with a table in a sorted, distributed key-value primary store, the table having associated therewith one or more tablets, each tablet being a partition of the table and that contains key-value pairs in a given sub-range of keys, the method comprising:
- generating a secondary index adapted to optimize particular search and query operations against the primary store;
storing the secondary index such that secondary index entries are co-partitioned with entries of the primary store to which the secondary index entries refer; and
maintaining co-partitioning of the secondary index throughout a lifecycle of at least one tablet.
3 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus are operative in association with a table in a sorted, distributed key-value primary store. The table has associated therewith one or more tablets, wherein each tablet being a partition of the table and that contains key-value pairs in a given sub-range of keys. According to the method, a secondary index that is adapted to optimize particular search and query operations against the primary store is created. The secondary index is stored in a manner such secondary index entries are co-partitioned with entries of the primary store to which the secondary index entries refer. This co-partitioning of the secondary index is then maintained throughout various tablet lifecycle operations (e.g., ingest, minor compaction, major compaction, scan, split and merge) associated with at least one tablet. An information retrieval system may leverage the secondary indexing scheme together with query processing to find and retrieve documents matching a user'"'"'s query.
78 Citations
13 Claims
-
1. A method operative in association with a table in a sorted, distributed key-value primary store, the table having associated therewith one or more tablets, each tablet being a partition of the table and that contains key-value pairs in a given sub-range of keys, the method comprising:
-
generating a secondary index adapted to optimize particular search and query operations against the primary store; storing the secondary index such that secondary index entries are co-partitioned with entries of the primary store to which the secondary index entries refer; and maintaining co-partitioning of the secondary index throughout a lifecycle of at least one tablet. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 12, 13)
-
-
9. Apparatus, operative in association with a table in a sorted, distributed key-value primary store, the table having associated therewith one or more tablets, each tablet being a partition of the table and that contains key-value pairs in a given sub-range of keys, comprising:
-
one or more hardware processors; computer memory storing computer program instructions executed by the hardware processors to; generate a secondary index adapted to optimize particular search and query operations against the primary store; store the secondary index such that secondary index entries are co-partitioned with entries of the primary store to which the secondary index entries refer; and maintain co-partitioning of the secondary index throughout a lifecycle of at least one tablet. - View Dependent Claims (10, 11)
-
Specification