Methods and apparatus for managing replication of objects in a storage environment

• US 9,135,016 B1
• Filed: 05/14/2010
• Issued: 09/15/2015
• Est. Priority Date: 05/14/2010
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: O'Connell, Mark
• Primary Examiner(s): Rutz, Jared
• Assistant Examiner(s): Ahmed, Hamdy S
• Application Number:
  US12/800,399
• Time in Patent Office: 1,950 Days
• Field of Search: 711/162
• US Class Current: 1/1
• CPC Class Codes: G06F 11/0769 Readable error formats, e.g. cross-platform generic formats, human understandable formats
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/3891 organised in groups of units sharing resources, e.g. clusters

Abstract

Some embodiments are directed to replicating a content unit stored in a first storage environment comprising a first plurality of storage clusters to a second storage environment comprising a second plurality of storage clusters. The first storage environment may employ a replication policy, instituted at a first time, that specifies to which one of the second plurality of storage clusters content units stored in the first storage environment are to be replicated. The creation time of the first content unit may be determined and it may be determined when the creation time is before the time at which the first storage environment instituted the replication policy. If the creation time is not before the first time, one of the second plurality of storage clusters may be selected to which to replicate the first content unit based on the replication policy, and the content unit may be replicated to the selected one of the second plurality of storage clusters.

Claims

1. A method of replicating a first content unit stored in a first storage environment comprising a first plurality of storage clusters to a second storage environment comprising a second plurality of storage clusters, wherein the first storage environment employs a replication policy, instituted at a first time, that specifies to which one of the second plurality of storage clusters content units stored in the first storage environment are to be replicated, the method comprising acts of:

determining a creation time of the first content unit;

determining whether the creation time is before the first time;

when it is determined that the creation time is not before the first time;

selecting one of the second plurality of storage clusters to which to replicate the first content unit based on the replication policy; and

replicating the first content unit to the one of the second plurality of storage clusters; and

when it is determined that the creation time is before the first time;

searching storage clusters of the second plurality of storage clusters for the first content unit.

2. The method of claim 1, wherein the act of determining the creation time of the first content unit comprises obtaining the creation time from the content of the first content unit.

3. The method of claim 1, wherein:

searching storage clusters of the second plurality of storage clusters for the first content unit, comprises;

sending a read request for the first content unit to each of the second plurality of storage clusters; and

the method further comprises, when a response is received from one of the second plurality of storage clusters indicating that it stores the first content unit;

replicating the first content unit to the one of the second plurality of storage clusters.

4. The method of claim 3, wherein the content unit is identified in the first and second storage environments via an object identifier assigned to the content unit, and the read request identifies the content unit via the object identifier.

5. The method of claim 4, wherein the object identifier assigned to the content unit comprises a content address that is generated, at least in part, from at least a portion of the content of the content unit.

6. The method of claim 4, wherein the act of selecting the one of the second plurality of storage clusters to which to replicate the first content unit based on the replication policy, further comprising:

determining which one of the second plurality of storage cluster the replication policy specifies as the replication target for the first content unit based on the object identifier for the content unit.

7. The method of claim 1, wherein the first time is after a time at which the first storage environment began replicating content units to the second storage environment.

8. At least one non-transitory computer readable medium encoded with instructions that when executed in a first storage environment comprising a first plurality of storage clusters, perform a method of replicating a first content unit stored in the first storage environment to a second storage environment comprising a second plurality of storage clusters, wherein the first storage environment employs a replication policy, instituted at a first time, that specifies to which one of the second plurality of storage clusters content units stored in the first storage environment are to be replicated, the method comprising acts of:

determining a creation time of the first content unit;

determining whether the creation time is before the first time;

when it is determined that the creation time is not before the first time;

selecting one of the second plurality of storage clusters to which to replicate the first content unit based on the replication policy; and

replicating the first content unit to the one of the second plurality of storage clusters; and

when it is determined that the creation time is before the first time;

searching storage clusters of the second plurality of storage clusters for the first content unit.

9. The at least one non-transitory computer readable medium of claim 8, wherein the act of determining the creation time of the first content unit comprises obtaining the creation time from the content of the first content unit.

10. The at least one non-transitory computer readable medium of claim 8, wherein:

searching storage clusters of the second plurality of storage clusters for the first content unit, comprises;

sending a read request for the first content unit to each of the second plurality of storage clusters; and

the method further comprises, when a response is received from one of the second plurality of storage clusters indicating that it stores the first content unit;

replicating the first content unit to the one of the second plurality of storage clusters.

11. The at least one non-transitory computer readable medium of claim 10, wherein the content unit is identified in the first and second storage environments via an object identifier assigned to the content unit, and the read request identifies the content unit via the object identifier.

12. The at least one non-transitory computer readable medium of claim 11, wherein the object identifier assigned to the content unit comprises a content address that is generated, at least in part, from at least a portion of the content of the content unit.

13. The at least one non-transitory computer readable medium of claim 11, wherein the act of selecting the one of the second plurality of storage clusters to which to replicate the first content unit based on the replication policy, further comprising:

determining which one of the second plurality of storage cluster the replication policy specifies as the replication target for the first content unit based on the object identifier for the content unit.

14. The at least one non-transitory computer readable medium of claim 8, wherein the first time is after a time at which the first storage environment began replicating content units to the second storage environment.

15. A computer system implemented as one of a first plurality of clusters in a first storage environment comprising:

at least one memory that stores processor-executable instructions for performing a method of replicating a first content unit stored in the first storage environment to a second storage environment comprising a second plurality of storage clusters, wherein the first storage environment employs a replication policy, instituted at a first time, that specifies to which one of the second plurality of storage clusters content units stored in the first storage environment are to be replicated; and

at least one microprocessor that executes the processor-executable instructions to;

determine a creation time of the first content unit;

determine whether the creation time is before the first time;

when it is determined that the creation time is not before the first time;

select one of the second plurality of storage clusters to which to replicate the first content unit based on the replication policy; and

replicate the first content unit to the one of the second plurality of storage clusters; and

when it is determined that the creation time is before the first time;

search storage clusters of the second plurality of storage clusters for the first content unit.

16. The computer system of claim 15, wherein the at least one microprocessor executes the processor-executable instructions to:

obtain the creation time from the content of the first content unit.

17. The computer system of claim 15, wherein:

search storage clusters of the second plurality of storage clusters for the first content unit, comprises;

send a read request for the first content unit to each of the second plurality of storage clusters; and

the at least one microprocessor further executes the processor-executable instructions to, when a response is received from one of the second plurality of storage clusters indicating that it stores the first content unit;

replicate the first content unit to the one of the second plurality of storage clusters.

18. The computer system of claim 17, wherein the content unit is identified in the first and second storage environments via an object identifier assigned to the content unit, and the read request identifies the content unit via the object identifier.

19. The computer system of claim 18, wherein the object identifier assigned to the content unit comprises a content address that is generated, at least in part, from at least a portion of the content of the content unit.

20. The computer system of claim 18, wherein the wherein the at least one microprocessor executes the processor-executable instructions to:

determine which one of the second plurality of storage cluster the replication policy specifies as the replication target for the first content unit based on the object identifier for the content unit.