Data redistribution in data replication systems

• US 8,325,724 B2
• Filed: 03/31/2009
• Issued: 12/04/2012
• Est. Priority Date: 03/31/2009
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Zhong, Hua, Moghe, Dheer, Reddy, Sazzala Venkata
• Primary Examiner(s): Shah, Chirag
• Assistant Examiner(s): Van, Jenkey
• Application Number:
  US12/384,210
• Publication Number:
  US 20100246578A1
• Time in Patent Office: 1,344 Days
• Field of Search: 370/254
• US Class Current: 370/390
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A system includes one or more processors configured to redistribute one or more originator data subsets among a plurality of originator nodes and determine data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes. The system further includes a communication interface configured to send data redistribution information to a replica system. The data redistribution information is used by the replica system to redistribute one or more corresponding replica data subsets among a plurality of replica nodes.

Claims

1. A system comprising:

one or more processors configured to;

redistribute one or more originator data subsets among a plurality of originator nodes, wherein the one or more originator data subsets were initially distributed among the plurality of originator nodes according to an initial distribution arrangement, and redistributing the one or more originator data subsets changes the initial distribution arrangement of the original data subsets to a new distribution arrangement; and

determine data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes; and

a communication interface configured to send data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes to a replica system comprising a plurality of replica nodes;

wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the data redistribution information is used by the replica system to redistribute one or more corresponding replica data subsets among the plurality of replica nodes;

the one or more originator data subsets include one or more data containers;

the data redistribution information includes metadata information associated with the one or more data containers; and

the metadata information including identification information of the one or more data containers, identification information of one or more originator nodes on which the one or more data containers previously resided, and identification information of one or more current nodes to which the containers are redistributed; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

2. The system of claim 1, wherein the data redistribution information includes identification information of one or more previous originator nodes from which the one or more data subsets have been moved, and identification information of one or more current originator nodes on which the originator data subsets currently reside.

3. The system of claim 1, wherein the redistribution information includes metadata associated with the one or more data containers, and each of the one or more data containers includes one or more data segments.

4. The system of claim 1, wherein the one or more originator data subsets and the one or more replica data subsets include identical backup data.

5. The system of claim 1, wherein the plurality of originator nodes are included in a file system.

6. The system of claim 1, wherein the data redistribution information does not include backup data.

7. The system of claim 1, wherein the one or more originator data subsets are redistributed from one or more existing nodes to a newly added node.

8. The system of claim 1, wherein the one or more originator data subsets are redistributed to rebalance load on the plurality of originator nodes.

9. A method for data replication, comprising:

redistributing one or more originator data subsets among a plurality of originator nodes, wherein the one or more originator data subsets were initially distributed among the plurality of originator nodes according to an initial distribution arrangement, and redistributing the one or more originator data subsets changes the initial distribution arrangement of the original data subsets to a new distribution arrangement; and

determining data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes; and

sending data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes to a replica system comprising a plurality of replica nodes;

wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the data redistribution information is used by the replica system to redistribute one or more corresponding replica data subsets among a plurality of replica nodes;

the one or more originator data subsets include one or more data containers;

the data redistribution information includes metadata information associated with the one or more data containers; and

the metadata information including identification information of the one or more data containers, identification information of one or more originator nodes on which the one or more data containers previously resided, and identification information of one or more current nodes to which the containers are redistributed; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

10. The method of claim 9, wherein the data redistribution information includes identification information of one or more previous originator nodes from which the one or more data subsets have been moved, and identification information of one or more current originator nodes on which the originator data subsets currently reside.

11. The method of claim 9, wherein the redistribution information includes metadata associated with the one or more data containers, and each of the one or more data containers includes one or more data segments.

12. The method of claim 9, wherein the one or more originator data subsets and the one or more replica data subsets include identical backup data.

13. A computer program product for data replication, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

redistributing one or more originator data subsets among a plurality of originator nodes, wherein the one or more originator data subsets were initially distributed among the plurality of originator nodes according to an initial distribution arrangement, and redistributing the one or more originator data subsets changes the initial distribution arrangement of the original data subsets to a new distribution arrangement; and

determining data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes; and

sending data redistribution information pertaining to redistribution of the one or more originator data subsets among the plurality of originator nodes to a replica system comprising a plurality of replica nodes;

wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the data redistribution information is used by the replica system to redistribute one or more corresponding replica data subsets among a plurality of replica nodes;

the one or more originator data subsets include one or more data containers;

the data redistribution information includes metadata information associated with the one or more data containers; and

the metadata information including identification information of the one or more data containers, identification information of one or more originator nodes on which the one or more data containers previously resided, and identification information of one or more current nodes to which the containers are redistributed; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

14. A system comprising:

an interface configured to receive data redistribution information from an originator system, the data redistribution information pertaining to redistribution of the one or more originator data subsets among a plurality of originator nodes; and

one or more processors configured to redistribute one or more corresponding replica data subsets among a plurality of replica nodes according to the data redistribution information;

wherein;

the one or more originator data subsets were previously replicated on the system as the one or more corresponding replica data subsets among the plurality of replica nodes;

the one or more replica data subsets were initially distributed among the plurality of replica nodes according to an initial distribution arrangement;

redistributing the one or more replica data subsets among the plurality of replica nodes according to the data redistribution information changes the initial distribution arrangement of the replica data subsets to a new distribution arrangement;

the one or more originator data subsets include one or more data containers;

the data redistribution information includes metadata information associated with the one or more data containers; and

the metadata information including identification information of the one or more data containers, identification information of one or more originator nodes on which the one or more data containers previously resided, and identification information of one or more current nodes to which the containers are redistributed; and

the one or more replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

15. A method for data replication, comprising:

receiving data redistribution information from an originator system, the data redistribution information pertaining to redistribution of the one or more originator data subsets among a plurality of originator nodes; and

redistributing one or more corresponding replica data subsets among a plurality of replica nodes according to the data redistribution information;

wherein;

the one or more originator data subsets were previously replicated on the system as one or more corresponding replica data subsets among the plurality of replica nodes;

the one or more replica data subsets were initially distributed among the plurality of replica nodes according to an initial distribution arrangement;

redistributing the one or more replica data subsets among the plurality of replica nodes according to the data redistribution information changes the initial distribution arrangement of the replica data subsets to a new distribution arrangement;

the one or more originator data subsets include one or more data containers;

the data redistribution information includes metadata information associated with the one or more data containers; and

the metadata information including identification information of the one or more data containers, identification information of one or more originator nodes on which the one or more data containers previously resided, and identification information of one or more current nodes to which the containers are redistributed; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

16. A computer program product for data replication, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving data redistribution information from an originator system, the data redistribution information pertaining to redistribution of the one or more originator data subsets among a plurality of originator nodes; and

redistributing one or more corresponding replica data subsets among a plurality of replica nodes according to the data redistribution information;

wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the one or more replica data subsets were initially distributed among the plurality of replica nodes according to an initial distribution arrangement;

redistributing the one or more replica data subsets among the plurality of replica nodes according to the data redistribution information changes the initial distribution arrangement of the replica data subsets to a new distribution arrangement;

the one or more originator data subsets include one or more data containers;

the data redistribution information includes metadata information associated with the one or more data containers; and

the metadata information including identification information of the one or more data containers, identification information of one or more originator nodes on which the one or more data containers previously resided, and identification information of one or more current nodes to which the containers are redistributed; and

the one or more replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.