Method, system, and apparatus for providing resilient data transfer in a data protection system

• US 8,463,749 B2
• Filed: 01/23/2012
• Issued: 06/11/2013
• Est. Priority Date: 09/09/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zizys, Giedrius, Patiejunas, Kestutis
• Primary Examiner(s): WILSON, KIMBERLY LOVEL
• Application Number:
  US13/356,444
• Publication Number:
  US 20120124006A1
• Time in Patent Office: 505 Days
• Field of Search: 707/634, 707/999.001, 707/640, 707/649, 707/690
• US Class Current: 707/649
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning

Abstract

A method for transmitting records of changes to data from a production location to a storage location is provided. The method stores in a log, records of changes to data stored at a production location. Those records are transmitted and a transmitted records checkpoint is generated that is transmitted at the end of the transmitted records. A records checkpoint confirmation is received and the plurality of transmitted records are purged from the log.

Claims

1. In a data protection system having a production location, a storage location, and a data protector, a method for restarting a validation of a data process between data stored on a production location and data stored on a storage location using metadata, the method comprising:

at the data protector, receiving a metadata checkpoint from the storage location, the checkpoint including an identification of a particular protected object up to which metadata has been calculated independently by both the production location and the storage location so as to validate data sent by the production location against data applied to a replica data store by the storage location;

at the data protector, transmitting a command to restart application of records at the storage location;

at the data protector, transmitting a command to restart transmission of records from the production location;

at the data protector, generating a marker, wherein the marker is a token generated by the data protector that is cycled through the system to clear metadata and metadata checkpoints before validation of data resumes;

at the data protector, transmitting the marker to the production location, causing metadata and metadata checkpoints at the production location to be cleared, and causing metadata and metadata checkpoints at the storage location to be cleared as a result of the production location sending the marker to the production location;

at the data protector, receiving the marker from the storage location, which was received by the storage location from the production location; and

at the data protector, and as a result of receiving the marker, such that the data protector is aware that metadata for the system that had previously been generated has been transmitted from the production location to the storage location, transmitting a command to restart validation the command including an indication of a position from which to restart validation, the position being from the particular protected object identified in the received metadata checkpoint.

2. The method of claim 1, wherein restarting validation comprises:

determining a data location from which validation is to resume; and

transmitting the determined data location with a command to restart validation from the determined location.

3. The method of claim 2, wherein the data location is determined from a checkpoint received from the storage location.

4. The method of claim 1, wherein the marker is unique.

5. The method of claim 1, wherein the marker is received by the production location and transmitted to the storage location.

6. A system for restarting a validation of a data process between data stored on a production location and data stored on a storage location using metadata, the system comprising:

a computer;

the computer implementing a data protector, wherein the data protector is configured to perform the following;

receive a metadata checkpoint from the storage location, the checkpoint including an identification of a particular protected object up to which metadata has been calculated independently by both the production location and the storage location so as to validate data sent by the production location against data applied to a replica data store by the storage location;

transmit a command to restart application of records at the storage location;

transmit a command to restart transmission of records from the production location;

generate a marker, wherein the marker is a token generated by the data protector that is cycled through the system to clear metadata and metadata checkpoints before validation of data resumes;

transmit the marker to the production location, causing metadata and metadata checkpoints at the production location to be cleared, and causing metadata and metadata checkpoints at the storage location to be cleared as a result of the production location sending the marker to the production location;

receive the marker from the storage location, which was received by the storage location from the production location; and

as a result of receiving the marker, such that the data protector is aware that metadata for the system that had previously been generated has been transmitted from the production location to the storage location, transmit a command to restart validation the command including an indication of a position from which to restart validation, the position being from the particular protected object identified in the received metadata checkpoint.

7. The system of claim 6, wherein restarting validation comprises:

determining a data location from which validation is to resume; and

transmitting the determined data location with a command to restart validation from the determined location.

8. The system of claim 7, wherein the data location is determined from a checkpoint received from the storage location.

9. The system of claim 6, wherein the marker is unique.

10. The system of claim 6, wherein the marker is received by the production location and transmitted to the storage location.