DYNAMIC REPARTITIONING FOR DISTRIBUTED SEARCH

• US 20080033927A1
• Filed: 08/01/2007
• Published: 02/07/2008
• Est. Priority Date: 08/07/2006
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: BEA Systems Incorporated (Oracle Corporation)
• Inventors: Richards, Michael, Mace, James E.
• Granted Patent: US 9,015,197 B2
• Time in Patent Office: Days
• US Class Current: 707/4
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

A distributed search system can comprise a group of nodes assigned to different partitions. Each partition can store indexes for a group of documents. Nodes in the same partition can independently processing document-based records to construct the indexes. One of the nodes can process a stored checkpoint to produce a repartitioned checkpoint. The group of nodes can respond to search requests during the construction of the repartitioned checkpoint. The repartitioned checkpoint can be loaded into the group of nodes to repartition the group of nodes.

Claims

1. A distributed search system comprising:

a group of nodes assigned to different partitions, each partition storing indexes for a subset of documents, nodes in the same partition independently processing document-based records to construct the indexes, wherein one of the nodes processes a stored checkpoint to produce a repartitioned checkpoint, wherein the group of nodes responds to search and index update requests during the construction of the repartitioned checkpoint and wherein the repartitioned checkpoint is loaded into the group of nodes to repartition the group of nodes.

2. The distributed search system of claim 1, wherein the repartition changes the number of partitions.

3. The distributed search system of claim 1, wherein the construction of the repartitioned checkpoint is done using the checkpoint.

4. The distributed search system of claim 1, wherein the checkpoint is created before the repartition.

5. The distributed search system of claim 1, wherein the repartitioned checkpoint is stored to back up the system.

6. The distributed search system of claim 1, wherein topology information is updated when the repartitioned checkpoint is loaded.

7. The distributed search system of claim 1, wherein the repartitioned checkpoint also includes partial data for the nodes of the different partitions.

8. A distributed search system comprising:

a group of nodes assigned to different partitions, each partition storing indexes for a group of documents, nodes in the same partition independently processing document-based records to construct the indexes, wherein one of the nodes processes a stored checkpoint to produce a repartitioned checkpoint, wherein the group of nodes responds to search requests during the construction of the repartitioned checkpoint and wherein the repartitioned checkpoint is loaded into the group of nodes to repartition the group of nodes;

wherein the nodes include document data that is updated with the repartitioned check point.

9. The distributed search system of claim 8, wherein the repartition changes the number of partitions.

10. The distributed search system of claim 8, wherein the construction of the repartitioned checkpoint is done using the checkpoint.

11. The distributed search system of claim 8, wherein the checkpoint is created before the repartition.

12. The distributed search system of claim 8, wherein the repartitioned checkpoint is saved to be available to back up the system.

13. The distributed search system of claim 8, wherein topology information is updated when the repartitioned checkpoint is loaded.

14. The computer readable medium including code to:

process a stored checkpoint to produce a repartitioned checkpoint while nodes respond to search and indexing requests during the construction of the repartitioned checkpoint; and

load the repartitioned checkpoint into a group of nodes to repartition the groups of nodes.

15. The computer readable medium of claim 14, wherein the repartition changes the number of partitions.

16. The computer readable medium of claim 14, wherein the construction of the repartitioned checkpoint is done using the checkpoint.

17. The computer readable medium of claim 14, wherein the checkpoint is created before the repartition.

18. The computer readable medium of claim 14, wherein the repartitioned checkpoint is saved to be available to back up the system.

19. The computer readable medium of claim 14, wherein topology information is updated when the repartitioned checkpoint is loaded.

20. The computer readable medium of claim 14, wherein the repartitioned checkpoint also includes partial data for the nodes of the different partitions.