Replicating selected snapshots from one storage array to another, with minimal data transmission

• US 8,805,786 B1
• Filed: 06/24/2011
• Issued: 08/12/2014
• Est. Priority Date: 06/24/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Natanzon, Assaf
• Primary Examiner(s): Fleurantin, Jean B
• Application Number:
  US13/168,391
• Time in Patent Office: 1,145 Days
• Field of Search: 707/622, 707/639, 707/640, 707/641, 707/645, 707/646, 707/652, 707/653, 707/610, 707/648, 707/649, 707/674, 707/679, 707/682, 711/161, 711/162, 711/114, 711/152, 711/156, 714/15
• US Class Current: 707/639
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2074 Asynchronous techniques
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 2201/815 Virtual
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 2201/855 Details of asynchronous mirroring using a journal to transfer not-yet-mirrored changes

Abstract

Example embodiments of the present invention provide methods for replicating a production site snapshot to a replication site. A first example embodiment creates a snapshot of the production volume at the production site and creates a bookmark in a do metadata stream. The bookmark may be sent to the replication site and, when processed from the do metadata stream at the replication site, cause the replication site to create a snapshot of the replication volume according to the bookmark. A second example embodiment replicates to a replication site snapshot by generating a list of differences between the production site snapshot and the replication site snapshot and performs replication according to the differences. The differences may include differences between the production site volume and the production site snapshot, differences between the production site volume and the replication site volume and differences between the replication site volume and the replication site snapshot.

Claims

1. A computer-implemented method for replicating a snapshot of a production volume at a production site storage array to a snapshot of a replication volume at a replication site storage array, the method comprising:

creating the snapshot of the production volume at the production site storage array; and

creating a bookmark indicative of a time the snapshot of the production volume was created, comprising;

creating the bookmark at the production site;

sending the bookmark to the replication site; and

storing the bookmark in a do metadata stream of a journal maintained at the replication site;

creating a snapshot of the replication volume at the replication site storage array according to the bookmark, comprising;

applying data to the replication volume from the do metadata stream of the journal maintained at the replication site; and

creating the snapshot of the replication volume at the replication site if the data applied to the replication volume from the do metadata stream is the bookmark.

2. The method of claim 1 further comprising:

prior to creating the snapshot, notifying a production site replication appliance to quiesce commands received by the replication appliance; and

after creating the bookmark, notifying the production site replication appliance to unquiesce commands received by the production site replication appliance.

3. A system for replicating a snapshot of a production volume at a production site storage array to a snapshot of a replication volume at a replication site storage array, the system comprising:

one or more processors

a production site;

a replication site;

a replicator at the production site configured to create the snapshot of the production volume at the production site storage array, create a bookmark indicative of a time the snapshot of the production volume was created; and

a manager at the replication site configured to store the bookmark in a do metadata stream of a journal maintained at the replication site and create a snapshot of the replication volume at the replication site storage array according to the bookmark;

wherein the replicator is further configured to create the bookmark at the production site and send the bookmark to the replication site, apply data to the replication volume from the do metadata stream of the journal maintained at the replication site and create the snapshot of the replication volume at the replication site if the data applied to the replication volume from the do metadata stream is the bookmark.

4. The system of claim 3 further comprising a manager at the production site configured to notify a production site replication appliance to quiesce commands received by the replication appliance prior to creating the snapshot and notify the production site replication appliance to unquiesce commands received by the production site replication appliance after creating the bookmark.

5. A computer-program product including a non-transitory computer-readable storage medium encoded with computer-program code that, when executed on a processor of a computer, cause the computer to replicate a snapshot of a production volume at a production site storage array to a snapshot of a replication volume at a replication site storage array, the computer-program code comprising:

computer-program code for creating the snapshot of the production volume at the production site storage array; and

computer-program code for creating a bookmark, comprising

computer-program code for creating the bookmark at the production site;

computer-program code for sending the bookmark to the replication site; and

computer-program code for storing the bookmark in a do metadata stream of a journal maintained at the replication site;

computer-program code for creating a snapshot of the replication volume at the replication site storage array according to the bookmark, comprising;

computer-program code for applying data to the replication volume from a do metadata stream of the journal maintained at the replication site; and

computer-program code for creating the snapshot of the replication volume at the replication site if the data applied to the replication volume from the do metadata stream is the bookmark.

6. The computer-program product of claim 5 further comprising:

computer-program code for notifying a production site replication appliance to quiesce commands received by the replication appliance prior to creating the snapshot; and

computer-program code for notifying the production site replication appliance to unquiesce commands received by the production site replication appliance after creating the bookmark.

7. A computer-implemented method for replicating a production site snapshot of a production site volume to an existing replication site snapshot, the production site volume replicated by a replication appliance to a replication site volume, the method comprising:

creating a consistency group for the production site volume and the replication site volume;

attaching the production site snapshot to a production site splitter as clean; and

attaching the replication site snapshot to a replication site splitter as clean

generating, by one or more splitters, a list of differences between the production site snapshot and the replication site snapshot;

determining differences between the production site volume and the production site snapshot;

determining differences between the production site volume and the replication site volume;

determining differences between the replication site volume and the replication site snapshot; and

performing replication by the replication appliance from the production site snapshot to the replication site snapshot according to the list of differences.

8. The method of claim 7 wherein determining differences between the production site volume and the production site snapshot comprises obtaining from a production site splitter a list of changes between the production site volume and the production site snapshot.

9. The method of claim 7 wherein determining differences between the production site volume and the replication site volume comprises:

obtaining data in a delta marking stream of the production site volume;

obtaining data in a do stream at the replication site; and

obtaining locations in an image access stream if the replication site is in an image access mode.

10. The method of claim 7 wherein determining differences between the replication site volume and the replication site snapshot comprises obtaining from a replication site splitter a list of changes between the replication site volume and the replication site snapshot.

11. A system for replicating a production site snapshot of a production site volume to a replication site snapshot, the production site volume replicated to a replication site volume, the system comprising:

one or more processors;

a production site splitter;

a replication site splitter;

a manager configured to create a consistency group for the production site volume and the replication site volume, attach the production site snapshot to the production site splitter as clean;

attach the replication site snapshot to the replication site splitter as clean, and generate a list of differences between the production site snapshot and the replication site snapshot by determining differences between the production site volume and the production site snapshot, determining differences between the production site volume and the replication site volume, and determining differences between the replication site volume and the replication site snapshot; and

a replicator configured to perform replication from the production site snapshot to the replication site snapshot according to the list of differences.

12. The system of claim 11 further comprising a production site splitter, wherein the manager is further configured to obtain from the production site splitter a list of changes between the production site volume and the production site snapshot.

13. The system of claim 11 wherein the manager is further configured to obtain data in a delta marking stream of the production site volume, obtain data in a do stream at the replication site and obtain locations in an image access stream if the replication site is in an image access mode.

14. The system of claim 11 further comprising a replication site splitter, wherein the manager is further configured to obtain from the replication site splitter a list of changes between the replication site volume and the replication site snapshot.

15. A computer-program product including a non-transitory computer-readable storage medium encoded with computer-program code that, when executed on a processor of a computer, cause the computer to replicate a production site snapshot of a production site volume to a replication site snapshot, the production site volume replicated to a replication site volume, the computer-program code comprising:

computer-program code for creating a consistency group for the production site volume and the replication site volume;

computer-program code for attaching the production site snapshot to a production site splitter as clean;

computer-program code for attaching the replication site snapshot to a replication site splitter as clean;

computer-program code for generating a list of differences between the production site snapshot and the replication site snapshot;

computer-program code for determining differences between the production site volume and the production site snapshot;

computer-program code for determining differences between the production site volume and the replication site volume;

computer-program code for determining differences between the replication site volume and the replication site snapshot; and

computer-program code for performing replication from the production site snapshot to the replication site snapshot according to the list of differences.

16. The computer-program product of claim 15

wherein computer-program code for determining differences between the production site volume and the production site snapshot comprises computer-program code for obtaining from a production site splitter a list of changes between the production site volume and the production site snapshot;

and

wherein computer-program code for determining differences between the replication site volume and the replication site snapshot comprises computer-program code for obtaining from a replication site splitter a list of changes between the replication site volume and the replication site snapshot.

17. The computer-program product of claim 15 wherein computer-program code for determining differences between the production site volume and the replication site volume comprises:

computer-program code for obtaining data in a delta marking stream of the production site volume;

computer-program code for obtaining data in a do stream at the replication site; and

computer-program code for obtaining locations in an image access stream if the replication site is in an image access mode.