Replicating selected snapshots from one storage array to another, with minimal data transmission

• US 9,471,579 B1
• Filed: 07/18/2014
• Issued: 10/18/2016
• Est. Priority Date: 06/24/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Natanzon, Assaf
• Primary Examiner(s): Fleurantin, Jean B
• Application Number:
  US14/335,239
• Time in Patent Office: 823 Days
• Field of Search: 707/622, 707/639, 707/640, 707/641, 707/645, 707/646, 707/652, 707/653, 711/161, 711/162, 714/15
• US Class Current: 1/1
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2074 Asynchronous techniques
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 2201/855 Details of asynchronous mirroring using a journal to transfer not-yet-mirrored changes

Abstract

Example embodiments of the present invention provide methods for replicating a production site snapshot to a replication site. A first example embodiment creates a snapshot of the production volume at the production site and creates a bookmark in a do metadata stream. The bookmark may be sent to the replication site and, when processed from the do metadata stream at the replication site, cause the replication site to create a snapshot of the replication volume according to the bookmark. A second example embodiment replicates to a replication site snapshot by generating a list of differences between the production site snapshot and the replication site snapshot and performs replication according to the differences. The differences may include differences between the production site volume and the production site snapshot, differences between the production site volume and the replication site volume and differences between the replication site volume and the replication site snapshot.

Claims

1. A method comprising:

creating a snapshot of a production volume at a production site storage array;

creating a bookmark indicative of a point in time the snapshot of the production volume was created;

replicating the bookmark from a production site replication appliance to a replication site replication appliance; and

creating a replica of the snapshot of the production volume at the production site storage array at the replication site storage array by creating a snapshot of a replication volume at a replication site storage array according to the replicated bookmark.

2. The method of claim 1 further comprising:

prior to creating the snapshot, notifying a production site replication appliance to quiesce commands received by the production site replication appliance; and

after creating the bookmark, notifying the production site replication appliance to unquiesce commands received by the production site replication appliance.

3. The method of claim 1 wherein replicating the bookmark from a production site replication appliance to a replication site replication appliance comprises:

sending the bookmark to the replication site; and

storing the bookmark in a do metadata stream of a journal maintained at the replication site.

4. The method of claim 3 further comprising:

applying data to the replication volume from the do metadata stream of the journal maintained at the replication site; and

creating the snapshot of the replication volume at the replication site if the data applied to the replication volume from the do metadata stream is the bookmark.

5. A system comprising:

a production site, comprising a production site replication appliance and a production site storage array, configured to create a snapshot of a production volume at the production site storage array, create a bookmark indicative of a point in time the snapshot of the production volume was created, and replicate the bookmark to a replication site; and

a replication site, comprising a replication site replication appliance and a replication site storage array, configured to create a replica of the snapshot of the production volume at the production site storage array at the replication site storage array by creating a snapshot of a replication volume at the replication site storage array according to the replicated bookmark.

6. The system of claim 5 wherein the production site is further configured to notify the production site replication appliance to quiesce commands received by the production site replication appliance prior to creating the snapshot and notify the production site replication appliance to unquiesce commands received by the production site replication appliance after creating the bookmark.

7. The system of claim 5

wherein the production site is further configured to send the bookmark to the replication site;

and

wherein the replication site is further configured to store the bookmark in a do metadata stream of a journal maintained at the replication site.

8. The system of claim 7 wherein the replication site is further configured to apply data to the replication volume from the do metadata stream of the journal maintained at the replication site and create the snapshot of the replication volume at the replication site if the data applied to the replication volume from the do metadata stream is the bookmark.

9. A computer-program product including a non-transitory computer-readable storage medium encoded with computer-program code that, when executed on a processor of a computer, cause the computer to replicate a snapshot, the computer-program code comprising:

computer-program code for creating a snapshot of a production volume at a production site storage array;

computer-program code for creating a bookmark indicative of a point in time the snapshot of the production volume was created;

computer program code for replicating the bookmark from a production site replication appliance to a replication site replication appliance; and

computer program code for creating a replica of the snapshot of the production volume at the production site storage array at the replication site storage array by creating a snapshot of a replication volume at a replication site storage array according to the replicated bookmark.

10. The computer-program product of claim 9 further comprising:

computer-program code for notifying a production site replication appliance to quiesce commands received by the production site replication appliance prior to creating the snapshot; and

computer-program code for notifying the production site replication appliance to unquiesce commands received by the production site replication appliance after creating the bookmark.

11. The computer-program product of claim 9

wherein computer-program code for replicating the bookmark from a production site replication appliance to a replication site replication appliance comprises:

computer-program code for sending the bookmark to the replication site; and

computer-program code for storing the bookmark in a do metadata stream of a journal maintained at the replication site; and

wherein computer-program code for creating a replica of the snapshot of the production volume at the production site storage array by creating a snapshot of a replication volume at a replication site storage array according to the replicated bookmark comprises;

computer-program code for applying data to the replication volume from a do metadata stream of the journal maintained at the replication site; and

computer-program code for creating the snapshot of the replication volume at the replication site if the data applied to the replication volume from the do metadata stream is the bookmark.

12. A method comprising:

generating, by one or more splitters, a list of differences between a snapshot of a production site volume at a production site storage array and a snapshot of a replication site volume at a replication site storage array, the production site volume replicated to the replication site volume via a production site replication appliance and a replication site replication appliance;

replicating the list of differences between the snapshot of the production site volume at the production site storage array and the snapshot of the replication site volume at the replication site storage array via the production site replication appliance and the replication site replication appliance; and

creating a replica of the snapshot of the production volume at the production site storage array at the replication site storage array by applying the replicated list of differences at the replication site storage array to the snapshot of the replication volume at the replication site storage array.

13. The method of claim 12 wherein generating, by one or more splitters, a list of differences between a snapshot of a production site volume at a production site storage array and a snapshot of a replication site volume at a replication site storage array, the production site volume replicated to the replication site volume via a production site replication appliance and a replication site replication appliance comprises:

determining differences between the production site volume and the snapshot of the production site volume;

determining differences between the production site volume and the replication site volume; and

determining differences between the replication site volume and the snapshot of the replication site volume.

14. The method of claim 13 wherein determining differences between the production site volume and the snapshot of the production site volume comprises obtaining from a production site splitter a list of changes between the production site volume and the snapshot of the production site volume.

15. The method of claim 13 wherein determining differences between the production site volume and the replication site volume comprises:

obtaining data in a delta marking stream of the production site volume;

obtaining data in a do stream at the replication site; and

obtaining locations in an image access stream if the replication site is in an image access mode.

16. The method of claim 13 wherein determining differences between the replication site volume and the snapshot of the replication site volume comprises obtaining from a replication site splitter a list of changes between the replication site volume and the snapshot of the replication site volume.

17. The method of claim 12 further comprising:

creating a consistency group for the production site volume and the replication site volume;

attaching the snapshot of the production site volume to a production site splitter as clean; and

attaching the snapshot of the replication site volume to a replication site splitter as clean.

18. A system comprising:

a production site comprising a production site replication appliance and a production site storage array;

a replication site comprising a replication site replication appliance and a replication site storage array; and

one or more splitters configured to generate a list of differences between a snapshot of a production site volume at the production site storage array and a snapshot of a replication site volume at the replication site storage array;

the production site replication appliance configured to replicate the production site volume, the list of differences between the snapshot of the production site volume at the production site storage array, and the snapshot of the replication site volume at the replication site storage array to the replication site via the replication site replication appliance; and

the replication site replication appliance configured to create a replica of the snapshot of the production volume at the production site storage array at the replication site storage array by applying the replicated list of differences at the replication site storage array to the snapshot of the replication volume at the replication site storage array.

19. The system of claim 18 wherein the one or more splitters are further configured to determine differences between the production site volume and the snapshot of the production site volume, determine differences between the production site volume and the replication site volume, and determine differences between the replication site volume and the snapshot of the replication site volume.

20. The system of claim 19 wherein the production site is further configured to obtain from a production site splitter a list of changes between the production site volume and the snapshot of the production site volume.

21. The system of claim 19 wherein the production site is further configured to obtain data in a delta marking stream of the production site volume, obtain data in a do stream at the replication site, and obtain locations in an image access stream if the replication site is in an image access mode.

22. The system of claim 19 wherein the production site is further configured to obtain from a replication site splitter a list of changes between the replication site volume and the snapshot of the replication site volume.

23. The system of claim 18

wherein the production site replication appliance is further configured to create a consistency group for the production site volume and the replication site volume, attach the snapshot of the production site volume to a production site splitter as clean, and attach the snapshot of the replication site volume to a replication site splitter as clean.

24. A computer-program product including a non-transitory computer-readable storage medium encoded with computer-program code that, when executed on a processor of a computer, cause the computer to replicate a snapshot, the computer-program code comprising:

computer-program code for generating, by one or more splitters, a list of differences between a snapshot of a production site volume at a production site storage array and a snapshot of a replication site volume at a replication site storage array, the production site volume replicated to the replication site volume via a production site replication appliance and a replication site replication appliance;

computer-program code for replicating the list of differences between the snapshot of the production site volume at the production site storage array and the snapshot of the replication site volume at the replication site storage array via the production site replication appliance and the replication site replication appliance; and

computer-program code for creating a replica of the snapshot of the production volume at the production site storage array at the replication site storage array by applying the replicated list of differences at the replication site storage array to the snapshot of the replication volume at the replication site storage array.

25. The computer-program product of claim 24 wherein computer-program code for generating, by one or more splitters, a list of differences between a snapshot of a production site volume at a production site storage array and snapshot if a replication site volume at a replication site storage array, the production site volume replicated to the replication site volume via a production site replication appliance and a replication site replication appliance, comprises:

computer-program code for determining differences between the production site volume and the snapshot of the production site volume;

computer-program code for determining differences between the production site volume and the replication site volume; and

computer-program code for determining differences between the replication site volume and the snapshot of the replication site volume.

26. The computer-program product of claim 25

wherein computer-program code for determining differences between the production site volume and the snapshot of the production site volume comprises computer-program code for obtaining from a production site splitter a list of changes between the production site volume and the snapshot of the production site volume;

and

wherein computer-program code for determining differences between the replication site volume and the snapshot of the replication site volume comprises computer-program code for obtaining from a replication site splitter a list of changes between the replication site volume and the snapshot of the replication site volume.

27. The computer-program product of claim 25 wherein computer-program code for determining differences between the production site volume and the replication site volume comprises:

computer-program code for obtaining data in a delta marking stream of the production site volume;

computer-program code for obtaining data in a do stream at the replication site; and

computer-program code for obtaining locations in an image access stream if the replication site is in an image access mode.

28. The computer-program product of claim 24 further comprising:

computer-program code for creating a consistency group for the production site volume and the replication site volume;

computer-program code for attaching the snapshot of the production site volume to a production site splitter as clean; and

computer-program code for attaching the snapshot of the replication site volume to a replication site splitter as clean.