Efficient backup replication

• US 8,972,678 B2
• Filed: 12/21/2011
• Issued: 03/03/2015
• Est. Priority Date: 12/21/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Huang, Mark
• Primary Examiner(s): DOAN, DUC T
• Application Number:
  US13/332,474
• Publication Number:
  US 20130166862A1
• Time in Patent Office: 1,168 Days
• Field of Search: None
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/202 where processing functionality is redundant redundant communication control functionality G06F11/2005, redundant storage control functionality G06F11/2089
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 2201/83 the solution involving signatures
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A system for backup replication comprises a processor and a memory. The processor is configured to determine data present in a most recent backup not present in a previous backup; transmit an extent specification; and transmit data segment fingerprints of the one or more data segments. The memory is coupled to the processor and is configured to provide the processor with instructions.

Claims

1. A system for backup replication, comprising:

a data storage system comprising;

a data differencer that determines difference data between a most recent backup file and a previous backup file, wherein the difference data comprises data present in the most recent backup file not present in the previous backup file;

a data storage system interface that transmits an extent specification to a replica backup system, wherein the extent specification comprises a description of regions of unchanged data from the previous backup file to the most recent backup file, wherein the extent specification comprises file locations in the previous backup file, wherein the data storage system interface also transmits a checksum, wherein the checksum comprises a checksum for the most recent backup file; and

a data sender that;

transmits data segment fingerprints of the one or more data segments to the replica backup system using the data sender;

receives one or more data segment requests from the replica backup system using the data storage system interface, wherein a data segment request of the one or more data segment requests comprises an indication that a segment from the transmitted data fingerprints is not previously stored on the replica backup system and is requested of the data storage system; and

transmit the one or more data segments from the data storage system to the replica backup system through the data storage system interface, wherein the transmitted one or more data segments are combined with segments previously stored on the replica backup system into a replica backup file using the transmitted extent specification.

2. A system as in claim 1, wherein data segment fingerprints comprise a data segment identifying information for each of the one or more data segments.

3. A system as in claim 1, wherein data segment fingerprints are calculated for each of the one or more data segments using a hash function.

4. A system as in claim 1, wherein the data storage system interface also transmits meta information.

5. A system as in claim 1, wherein the data differencer also determines the extent specification.

6. A system as in claim 1, wherein the data storage system interface also receives a checksum response.

7. A system as in claim 6, wherein the data sender retransmits data segment fingerprints through the data storage system interface and the data storage system interface sends meta information in the event that the checksum response indicates that the checksum failed.

8. A system as in claim 7, wherein the meta information comprises information enabling the reconstruction of the most recent backup using the one or more segments on the replica backup system.

9. The system as in claim 1, wherein the replica backup file comprises re-referenced segments on the replica backup system as described in the extent specification.

10. The system as in claim 1, wherein the data differencer determines the difference data by comparing a set of data segment fingerprints that represent the most recent backup file with a set of data segment fingerprints that represent the previous backup file.

11. The system as in claim 1, wherein the most recent backup file and the previous backup file have been segmented and stored on a data storage unit of the data storage system.

12. The system as in claim 1, wherein the extent specification further includes locations of the difference data.

13. A method for backup replication comprising:

determining difference data between a most recent backup, file and a previous backup file, using a data differencer of a data storage system, wherein the difference data comprises data present in the most recent backup file not present in the previous backup file;

transmitting an extent specification to a replica backup system using a data storage system interface, wherein the extent specification comprises a description of regions of unchanged data from the previous backup file to the most recent backup file, wherein the extent specification comprises file locations in the previous backup file,

transmitting a checksum using the data storage system interface, wherein the checksum comprises a checksum for the most recent backup file;

transmitting data segment fingerprints of the one or more data segments to the replica backup system using a data sender;

receiving one or more data segment requests at the data sender from the replica backup system using the data storage system interface, wherein a data segment request of the one or more data segment requests comprises an indication that a segment from the transmitted data fingerprints is not previously stored on the replica backup system and is requested of the data storage system; and

transmitting the one or more data segments from the data storage system to the replica backup system using the data sender, wherein the transmitted one or more data segments are combined with segments previously stored on the replica backup system into a replica backup file using the transmitted extent specification.

14. A computer program product for backup replication, the computer program product being embedded in a non-transitory computer readable storage medium and comprising computer instructions for:

determining difference data between a most recent backup file and a previous backup file on a data storage system, wherein the difference comprises data present in the most recent backup file not present in the previous backup file;

transmitting an extent specification from a primary backup system to a replica backup system, wherein the extent specification comprises a description of regions of unchanged data from the previous backup file to the most recent backup file, wherein the extent specification comprises file locations in the previous backup file;

transmitting a checksum using the data storage system interface, wherein the checksum comprises a checksum for the most recent backup file;

transmitting data segment fingerprints of the one or more data segments to a replica backup system using a data sender;

receiving one or more data segment requests at the data sender from the replica backup system, wherein a data segment request of the one or more data segment requests comprises an indication that a segment from the transmitted data fingerprints is not previously stored on the replica backup system and is requested of the data storage system; and

transmitting the one or more data segments from the data storage system to the replica backup storage system, wherein the transmitted one or more data segments are combined with segments previously stored on the replica backup system into a replica backup file using the transmitted extent specification.