Mirroring metadata in a continuous data protection environment

• US 8,438,135 B1
• Filed: 07/03/2012
• Issued: 05/07/2013
• Est. Priority Date: 06/18/2010
• Status: Active Grant

• Current Assignee: EMC International Company (Dell Technologies Inc.)
• Original Assignee: EMC International Company (Dell Technologies Inc.)
• Inventors: Natanzon, Assaf, Cohen, Saar, Vitek, Sharon, Kulik, Ariel
• Primary Examiner(s): OBISESAN, AUGUSTINE KUNLE
• Application Number:
  US13/541,198
• Time in Patent Office: 308 Days
• Field of Search: None
• US Class Current: 707/660
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2069 Management of state, configuration or failover
• CPC Class Codes: G06F 11/2079 Bidirectional techniques

Abstract

In one aspect, a method includes providing data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using a second data protection appliance, tracking changes between data locations in the first volume and the second volume using a delta marking stream (DMS) and receiving, at the first data protection appliance, metadata. The metadata is intended to be committed to the DMS. The method further includes mirroring the metadata at a third data protection appliance.

Claims

1. A method comprising:

providing data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using a second data protection appliance;

tracking changes between data locations in the first volume and the second volume using a delta marking stream (DMS), the DMS comprising a stream of metadata comprising input/output requests (I/Os) completed to the first volume which have not yet been applied to a replication journal and I/Os applied to the replication journal which have not been completed to the second volume, the replication journal comprising a DO stream, an UNDO stream, a DO metadata stream and an UNDO metadata stream;

receiving, at the first data protection appliance, metadata not yet committed to the DMS; and

mirroring the metadata at a third data protection appliance,

wherein mirroring the metadata at the third data protection appliance comprises mirroring the metadata at a third data protection appliance in a same cluster as the first data protection appliance, wherein the same cluster comprises the first data protection appliance and the third data protection appliance.

2. The method of claim 1 wherein the second data protection appliance is the first data protection appliance.

3. The method of claim 1, further comprising:

committing the metadata to the DMS; and

removing the metadata from the third data protection appliance if the metadata is committed to the DMS.

4. The method of claim 1 wherein the mirroring comprises storing the metadata at the third data protection appliance until at least one of a predefined amount of time has elapsed or the metadata reaches a predefined size.

5. The method of claim 4, wherein storing the metadata comprises storing the metadata using a basket system.

6. The method of claim 1, further comprising:

receiving a request to recover the metadata; and

acquiring the metadata stored at the third data protection appliance.

7. The method of claim 6, further comprising:

determining if the acquiring of the metadata stored at the third data protection appliance is successful;

moving the metadata to the DMS if acquiring the metadata is successful moving the system to stable mode; and

performing a full sweep on the first and second volumes if acquiring the metadata is not successful.

8. The method of claim 1, further comprising:

receiving a request to recover the metadata; and

performing a full sweep on the first and second volumes if in a fragile mode.

9. The method of claim 1, further comprising if mirroring fails:

moving into a fragile mode if the fragile mode is allowed; and

moving into a stable mode if the fragile mode is not allowed.

10. The method of claim 1, further comprising:

establishing a connection between the first data protection appliance and the second data protection appliance;

connecting a protection agent to the first data protection appliance if the connection between the first data protection appliance and the second data protection appliance has been established; and

sending I/Os from the protection agent to the first data protection appliance.

11. An article comprising:

a non-transitory machine-readable medium that stores executable instructions to perform mirroring, the instructions causing a machine to;

provide data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using a second data protection appliance;

track changes between data locations in the first volume and the second volume using a delta marking stream (DMS), the DMS comprising a stream of metadata comprising input/output requests (I/Os) completed to the first volume which have not yet been applied to a replication journal and I/Os applied to the replication journal which have not been completed to the second volume, the replication journal comprising a DO stream, an UNDO stream, a DO metadata stream and an UNDO metadata stream;

receive, at the first data protection appliance, metadata, the metadata intended to be committed to the DMS;

mirror the metadata at a third data protection appliance in a same cluster as the first data protection appliance, the mirroring comprises storing the initial set of metadata at the third data protection appliance until at least one of a predefined amount of time has elapsed or the initial set of metadata reaches a predefined size, wherein the same cluster comprises the first data protection appliance and the third data protection appliance;

commit the metadata to the DMS; and

remove the metadata from the third data protection appliance if the initial set of metadata is committed to the DMS.

12. The article of claim 11, further comprising instructions causing the machine to:

receive a request to recover the metadata; and

acquire the metadata stored at the third data protection appliance.

13. The article of claim 12, further comprising instructions causing the machine to:

determine if the acquiring of the metadata at the third data protection appliance is successful;

move the metadata to the DMS if acquiring the metadata is successful moving the system to stable mode; and

perform a full sweep on the first and second volumes if acquiring the metadata is not successful.

14. The article of claim 11, further comprising instructions causing the machine to:

receive a request to recover the metadata; and

perform a full sweep on the first and second volumes if in a fragile mode.

15. An apparatus to perform mirroring, comprising:

circuitry to;

provide data protection to data in a first volume at a first data protection appliance by storing a copy of the data in a second volume using second data protection appliance;

track changes between data locations in the first volume and the second volume using a delta marking stream (DMS), the DMS comprising a stream of metadata comprising input/output requests (I/Os) completed to the first volume which have not yet been applied to a replication journal and I/Os applied to the replication journal which have not been completed to the second volume, the replication journal comprising a DO stream, an UNDO stream, a DO metadata stream and an UNDO metadata stream;

receive, at the first data protection appliance, metadata, the metadata intended to be committed to the DMS;

mirror the metadata at a third data protection appliance, the mirroring comprises storing the metadata at the third data protection appliance until at least one of a predefined amount of time has elapsed or the initial set of metadata reaches a predefined size, wherein the same cluster comprises the first data protection appliance and the third data protection appliance;

commit the metadata to the DMS; and

remove the metadata from the third data protection appliance if metadata is committed to the DMS.

16. The apparatus of claim 15 wherein the circuitry comprises at least one of a processor, a memory, programmable logic and logic gates.

17. The apparatus of claim 15, further comprising circuitry to:

receive a request to recover the metadata; and

acquire the metadata stored at the third data protection appliance.

18. The apparatus of claim 17, further comprising circuitry to:

determine if the acquiring of the metadata at the third data protection appliance is successful;

move the metadata to the DMS if acquiring the metadata is successful moving the system to stable mode; and

perform a full sweep on the first and second volumes if acquiring the metadata is not successful.

19. The apparatus of claim 15, further comprising circuitry to:

receive a request to recover the metadata; and

perform a full sweep on the first and second volumes if in a fragile mode.