Data redistribution in data replication systems

• US 9,025,602 B2
• Filed: 07/23/2014
• Issued: 05/05/2015
• Est. Priority Date: 03/31/2009
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Zhong, Hua, Moghe, Dheer, Reddy, Sazzala Venkata
• Primary Examiner(s): Shah, Chirag
• Assistant Examiner(s): Van, Jenkey
• Application Number:
  US14/339,392
• Publication Number:
  US 20140337293A1
• Time in Patent Office: 286 Days
• Field of Search: None
• US Class Current: 370/390
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

Data replication is disclosed. Originator data subsets are redistributed among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement. Data redistribution information is determined. The redistribution information includes identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement. The redistribution information is sent to a replica system comprising a plurality of replica nodes. The redistribution information is used by the replica system to redistribute corresponding replica data subsets among a plurality of replica nodes from a previously replicated arrangement to a new replicated arrangement.

Claims

1. A system, comprising:

one or more processors configured to;

redistribute one or more originator data subsets among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement; and

determine data redistribution information including identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement; and

a communication interface coupled to the processors and configured to send the redistribution information to a replica system comprising a plurality of replica nodes, wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the redistribution information is used by the replica system to redistribute the one or more corresponding replica data subsets among the plurality of replica nodes from a previously replicated arrangement to a new replicated arrangement; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

2. The system of claim 1, wherein the originator data subsets include one or more data containers.

3. The system of claim 1, wherein the redistribution information includes metadata associated with one or more data containers.

4. The system of claim 1, wherein the redistribution information includes metadata associated with one or more data containers, and each of the data containers includes one or more data segments.

5. The system of claim 1, wherein the originator data subsets and the corresponding replica data subsets include identical backup data.

6. The system of claim 1, wherein the plurality of originator nodes are included in a file system.

7. The system of claim 1, wherein the redistribution information does not include backup data.

8. The system of claim 1, wherein the originator data subsets are redistributed from one or more existing nodes to a newly added node.

9. The system of claim 1, wherein the originator data subsets are redistributed to rebalance load on the plurality of originator nodes.

10. The system of claim 1, wherein the corresponding replica data subsets are redistributed without requiring the originator data subsets to be sent to the replica system.

11. A method, comprising:

redistributing one or more originator data subsets among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement; and

determining data redistribution information including identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement; and

sending the redistribution information to a replica system comprising a plurality of replica nodes, wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the redistribution information is used by the replica system to redistribute one or more corresponding replica data subsets among a plurality of replica nodes from a previously replicated arrangement to a new replicated arrangement; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

12. The method of claim 11, wherein the originator data subsets include one or more data containers.

13. The method of claim 11, wherein the redistribution information includes metadata associated with one or more data containers.

14. The method of claim 11, wherein the redistribution information includes metadata associated with one or more data containers, and each of the data containers includes one or more data segments.

15. The method of claim 11, wherein the originator data subsets and the corresponding replica data subsets include identical backup data.

16. The method of claim 11, wherein the corresponding replica data subsets are redistributed without requiring the originator data subsets to be sent to the replica system.

17. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

redistributing one or more originator data subsets among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement; and

determining data redistribution information including identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement; and

sending the redistribution information to a replica system comprising a plurality of replica nodes, wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the redistribution information is used by the replica system to redistribute one or more corresponding replica data subsets among a plurality of replica nodes from a previously replicated arrangement to a new replicated arrangement; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

18. A system, comprising:

an interface configured to receive data redistribution information from an originator system, the redistribution information pertaining to redistribution of one or more originator data subsets among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement; and

one or more processors coupled to the interface and configured to use the redistribution information to redistribute one or more corresponding replica data subsets among a plurality of replica nodes from a previously replicated arrangement to a new replicated arrangement, wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the redistribution information includes identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

19. A method, comprising:

receiving data redistribution information from an originator system, the redistribution information pertaining to redistribution of one or more originator data subsets among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement; and

using the redistribution information to redistribute one or more corresponding replica data subsets among a plurality of replica nodes from a previously replicated arrangement to anew replicated arrangement, wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the redistribution information includes identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.

20. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving data redistribution information from an originator system, the redistribution information pertaining to redistribution of one or more originator data subsets among a plurality of originator nodes from an initial distribution arrangement to a new distribution arrangement; and

using the redistribution information to redistribute one or more corresponding replica data subsets among a plurality of replica nodes from a previously replicated arrangement to a new replicated arrangement, wherein;

the one or more originator data subsets were previously replicated on the replica system as one or more corresponding replica data subsets among the plurality of replica nodes;

the redistribution information includes identification information of the originator data subsets, identification information of originator nodes comprising the initial distribution arrangement, and identification information of originator nodes comprising the new distribution arrangement; and

the one or more corresponding replica data subsets are redistributed among the plurality of replica nodes without requiring the one or more originator data subsets to be sent to the replica system during redistribution.