Mirroring metadata in a continuous data protection environment

• US 8,271,447 B1
• Filed: 06/18/2010
• Issued: 09/18/2012
• Est. Priority Date: 06/18/2010
• Status: Active Grant

• Current Assignee: EMC International Company (Dell Technologies Inc.)
• Original Assignee: EMC International Company (Dell Technologies Inc.)
• Inventors: Natanzon, Assaf, Cohen, Saar, Vitek, Sharon, Kulik, Ariel
• Primary Examiner(s): Vital, Pierre
• Assistant Examiner(s): OBISESAN, AUGUSTINE KUNLE
• Application Number:
  US12/818,236
• Time in Patent Office: 823 Days
• Field of Search: None
• US Class Current: 707/660
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2069 Management of state, configuration or failover
• CPC Class Codes: G06F 11/2079 Bidirectional techniques

Abstract

In one aspect, a method includes providing data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using a second data protection appliance, tracking changes between data locations in the first volume and the second volume using a delta marking stream (DMS) and receiving, at the first data protection appliance, metadata. The metadata is intended to be committed to the DMS. The method further includes mirroring the metadata at a third data protection appliance.

Claims

1. A method comprising:

providing data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using a second data protection appliance;

tracking changes between data locations in the first volume and the second volume using a delta marking stream (DMS), the DMS comprising a stream of metadata comprising input/output completed to the first volume which have not yet been applied to a replication journal and input/output applied to the replication journal which have not been completed to the second volume, the replication journal comprising a DO stream, an UNDO stream, a DO metadata stream and an UNDO metadata stream;

receiving, at the first data protection appliance, metadata not yet committed to the DMS;

mirroring the metadata at a third data protection appliance in a same cluster as the first data protection appliance, wherein the same cluster comprises the first data protection appliance and the third data protection appliance;

committing the metadata to the DMS;

removing the metadata from the third data protection appliance if the metadata is committed to the DMS

determining if the acquiring of the metadata at the third data protection appliance is successful;

moving the metadata to the DMS and moving the system to stable mode if acquiring the metadata is successful;

receiving a request to recover the metadata; and

performing a full sweep on the first and second volumes if in a fragile mode.

2. The method of claim 1 wherein the second data protection appliance is the first data protection appliance.

3. The method of claim 1 wherein the mirroring comprises storing the metadata at the third data protection appliance until at least one of a predefined amount of time has elapsed or the metadata reaches a predefined size.

4. The method of claim 3, wherein storing the metadata comprises storing the metadata using a basket system.

5. The method of claim 1, further comprising if mirroring fails:

moving into a fragile mode if the fragile mode is allowed; and

moving into a stable mode if the fragile mode is not allowed.

6. The method of claim 1, further comprising:

establishing a connection between the first data protection appliance and the second data protection appliance;

connecting a protection agent to the first data protection appliance if the connection between the first data protection appliance and the second data protection appliance has been established; and

sending I/Os from the protection agent to the first data protection appliance.

7. An article comprising:

a non-transitory machine-readable medium that stores executable instructions to perform mirroring, the instructions causing a machine to;

provide data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using a second data protection appliance;

track changes between data locations in the first volume and the second volume using a delta marking stream (DMS), the DMS comprising a stream of metadata comprising input/output completed to the first volume which have not yet been applied to a replication journal and input/output applied to the replication journal which have not been completed to the second volume, the replication journal comprising a DO stream, an UNDO stream, a DO metadata stream and an UNDO metadata stream;

receive, at the first data protection appliance, metadata, the metadata intended to be committed to the DMS;

mirror the metadata at a third data protection appliance in a same cluster as the first data protection appliance, the mirroring comprises storing the initial set of metadata at the third data protection appliance until at least one of a predefined amount of time has elapsed or the initial set of metadata reaches a predefined size;

commit the metadata to the DMS;

remove the metadata from the third data protection appliance if the initial set of metadata is committed to the DMS;

determine if the acquiring of the metadata at the third data protection appliance is successful;

move the metadata to the DMS and move the system to stable mode if acquiring the metadata is successful;

receive a request to recover the metadata; and

perform a full sweep on the first and second volumes if in a fragile mode.

8. The article of claim 7, further comprising instructions causing the machine to:

receive a request to recover the metadata; and

perform a full sweep on the first and second volumes if in a fragile mode.

9. An apparatus to perform mirroring, comprising:

circuitry to;

provide data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using second data protection appliance;

track changes between data locations in the first volume and the second volume using a delta marking stream (DMS), the DMS comprising a stream of metadata comprising input/output completed to the first volume which have not yet been applied to a replication journal and input/output applied to the replication journal which have not been completed to the second volume, the replication journal comprising a DO stream, an UNDO stream, a DO metadata stream and an UNDO metadata stream;

receive, at the first data protection appliance, metadata, the metadata intended to be committed to the DMS;

mirror the metadata at a third data protection appliance, the mirroring comprises storing the metadata at the third data protection appliance until at least one of a predefined amount of time has elapsed or the initial set of metadata reaches a predefined size;

commit the metadata to the DMS;

remove the metadata from the third data protection appliance if metadata is committed to the DMS;

determine if the acquiring of the metadata at the third data protection appliance is successful;

move the metadata to the DMS and move the system to stable mode if acquiring the metadata is successful;

receive a request to recover the metadata; and

perform a full sweep on the first and second volumes if in a fragile mode.

10. The apparatus of claim 9 wherein the circuitry comprises at least one of a processor, a memory, programmable logic and logic gates.

11. The apparatus of claim 9, further comprising circuitry to:

receive a request to recover the metadata; and

perform a full sweep on the first and second volumes if in a fragile mode.