Dynamic repartitioning for changing a number of nodes or partitions in a distributed search system

• US 9,015,197 B2
• Filed: 08/01/2007
• Issued: 04/21/2015
• Est. Priority Date: 08/07/2006
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Richards, Michael, Mace, James E.
• Primary Examiner(s): Btit, Jacob F.
• Assistant Examiner(s): WILLIS, AMANDA LYNN
• Application Number:
  US11/832,386
• Publication Number:
  US 20080033927A1
• Time in Patent Office: 2,820 Days
• Field of Search: 707610-639, 707/784, 707/999.006, 704/240, 704/251, 704/254, 704/E15.004, 704/243, 704/233, 704/236, 704/E15.009, 704/E15.023, 704/E15.043, 704/226, 704/231, 704/252, 704/255, 704/257, 704/E15.008, 704/E15.013, 704/E15.038, 704/E15.046, 704/E21.004, 704/235, 704/242, 704/256, 704/8, 704/9, 704/E15.014, 704/10, 704/250, 704/E13.012, 704/E15.018, 704/E15.02, 704/E15.028, 704/E15.037, 704/E21.007, 704/244, 704/246, 704/249, 704/256.4, 704/260, 704/266, 704/270, 704/E13.009, 704/E15.001, 704/E15.005, 704/E15.007, 704/E15.015, 704/E15.027, 704/E15.031, 704/E15.039, 704/E15.044, 704/E15.045, 704/E19.002, 704/201, 704/208, 704/211, 704/214, 704/217, 704/221, 704/237, 704/238, 704/239, 704/241, 704/245, 704/256.1, 704/256.5, 704/356.7, 704/256.8, 704/258, 704/270.01, 704/273, 704/275, 704/278, 704/503, 715/234, 715/727, 715/728, 715/763, 715/839
• US Class Current: 707/784
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

A distributed search system can include a group of nodes assigned to different partitions. Each partition can store indexes for a group of documents. Nodes in the same partition can independently processing document-based records to construct the indexes. One of the nodes can process a stored checkpoint to produce a repartitioned checkpoint. The group of nodes can respond to search requests during the construction of the repartitioned checkpoint. The repartitioned checkpoint can be loaded into the group of nodes to repartition the group of nodes.

Claims

1. A distributed search system executed by a processor comprising:

a group of storage nodes assigned to a plurality of different partitions, each partition comprising one or more nodes, each partition storing a different subset of document based records from a set of documents distributed across the plurality of different partitions, each node of each partition storing an index for the subset of documents stored in that partition, wherein;

each of the storage nodes in the same partition independently process the document-based records to construct the indexes,

each of the storage nodes is adapted to perform a repartition to change a number of partitions in the plurality of partitions or a number of storage nodes in one or more partitions of the plurality of partitions by processing a stored checkpoint in a central queue of document based records to be processed by the nodes of one or more of the partitions to produce a repartitioned checkpoint,

the stored checkpoint and the repartitioned checkpoint each include index and document data for documents stored in the storage nodes and a synchronized lexicon of decoding information for each of the partitions, wherein each node maintains the decoding information of the synchronized lexicon for each partition, wherein each node decodes combined query results based on the decoding information of the synchronized lexicon of the partitions in which the combined query results are stored, and

the group of storage nodes responds to search and index update requests during the construction of the repartitioned checkpoint, and

the repartitioned checkpoint is loaded into the group of storage nodes to dynamically repartition the group of storage nodes.

2. The distributed search system of claim 1, wherein the repartition changes the number of partitions.

3. The distributed search system of claim 1, wherein the construction of the repartitioned checkpoint is done using the checkpoint.

4. The distributed search system of claim 1, wherein the checkpoint is created before the repartition.

5. The distributed search system of claim 1, wherein the repartitioned checkpoint is stored to back up the system.

6. The distributed search system of claim 1, wherein topology information is updated when the repartitioned checkpoint is loaded.

7. The distributed search system of claim 1, wherein the repartitioned checkpoint also includes partial data for the storage nodes of the different partitions.

8. The system of claim 1, wherein the group of storage nodes responds to search and update requests during the construction of the repartitioned checkpoint.

9. A non-transitory computer readable medium having stored thereon a series of instructions which, when executed by a processor, cause the processor to perform a repartition in a distributed search system by:

assigning a group of storage nodes to a plurality of different partitions, each partition comprising one or more nodes, each partition storing a different subset of document based records from a set of documents distributed across the plurality of different partitions, each node of each partition storing an index for the subset of documents stored in that partition, wherein each of the storage nodes in the same partition independently process the document- based records to construct the indexes, and wherein each of the storage nodes is adapted to perform a repartition to change a number of partitions in the plurality of partitions or a number of storage nodes in one or more partitions of the plurality of partitions;

performing a reparation by one of the storage nodes by processing a stored checkpoint in a central queue of document based records to be processed by the nodes of one or more of the partitions to produce a repartitioned checkpoint,

wherein the stored checkpoint and the repartitioned checkpoint each include index and document data for documents stored in the storage nodes and a synchronized lexicon of decoding information for each of the partitions,

wherein each node maintains the decoding information of the synchronized lexicon for each partition,

wherein each node decodes combined query results based on the decoding information of the synchronized lexicon of the partitions in which the combined query results are stored, and

wherein the group of storage nodes responds to search and index update requests during the construction of the repartitioned checkpoint, and

wherein the repartitioned checkpoint is loaded into the group of storage nodes to dynamically repartition the group of storage nodes; and

loading the repartitioned checkpoint into a group of storage nodes to dynamically repartition the groups of storage nodes.

10. The computer readable medium of claim 9, wherein the repartition changes the number of partitions.

11. The computer readable medium of claim 9, wherein the construction of the repartitioned checkpoint is done using the checkpoint.

12. The computer readable medium of claim 9, wherein the checkpoint is created before the repartition.

13. The computer readable medium of claim 9, wherein the repartitioned checkpoint is saved to be available to back up the system.

14. The computer readable medium of claim 9, wherein topology information is updated when the repartitioned checkpoint is loaded.

15. The computer readable medium of claim 9, wherein the repartitioned checkpoint also includes partial data for the storage nodes of the different partitions.

16. A method for performing a repartition of a distributed search system, the method comprising:

assigning a group of storage nodes to a plurality of different partitions, each partition comprising one or more nodes, each partition storing a different subset of document based records from a set of documents distributed across the plurality of different partitions, each node of each partition storing an index for the subset of documents stored in that partition, wherein each of the storage nodes in the same partition independently process the document-based records to construct the indexes, and wherein each of the storage nodes is adapted to perform a repartition to change a number of partitions in the plurality of partitions or a number of storage nodes in one or more partitions of the plurality of partitions;

performing a reparation by one of the storage nodes by processing a stored checkpoint in a central queue of document based records to be processed by the nodes of one or more of the partitions to produce a repartitioned checkpoint,

wherein the stored checkpoint and the repartitioned checkpoint each include index and document data for documents stored in the storage nodes and a synchronized lexicon of decoding information for each of the partitions,

wherein each node maintains the decoding information of the synchronized lexicon for each partition,

wherein each node decodes combined query results based on the decoding information of the synchronized lexicon of the partitions in which the combined query results are stored, and

wherein the group of storage nodes responds to search and index update requests during the construction of the repartitioned checkpoint, and

wherein the repartitioned checkpoint is loaded into the group of storage nodes to dynamically repartition the group of storage nodes; and

loading the repartitioned checkpoint into a group of storage nodes to dynamically repartition the groups of storage nodes.

17. The method of claim 16, wherein the repartition changes the number of partitions.

18. The method of claim 16, wherein the construction of the repartitioned checkpoint is done using the checkpoint.

19. The method of claim 16, wherein the checkpoint is created before the repartition.

20. The method of claim 16, wherein the repartitioned checkpoint is stored to back up the system.

21. The method of claim 16, wherein topology information is updated when the repartitioned checkpoint is loaded.

22. The method of claim 16, wherein the repartitioned checkpoint also includes partial data for the storage nodes of the different partitions.