Synchronization of storage using comparisons of fingerprints of blocks

• US 9,400,717 B2
• Filed: 04/02/2015
• Issued: 07/26/2016
• Est. Priority Date: 05/13/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Patterson, R. Hugo
• Primary Examiner(s): Perveen, Rehana
• Assistant Examiner(s): BUI, THUY T
• Application Number:
  US14/677,231
• Publication Number:
  US 20150278028A1
• Time in Patent Office: 481 Days
• Field of Search: 707/639, 707/640
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 2201/83 the solution involving signatures
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A system for processing data comprises a deduplicating system, an interface, and a processor. The deduplicating system stores a copy of data stored in a data storage system by storing a set of segments that is able to reconstruct the data stored in the data storage system. The interface receives an indication to revert data stored in the data storage system to a state of data at a snapshot time stored in the deduplicating system. The processor is configured to determine a subset of the data stored in the data storage system that has changed between the data stored in the data storage system and the state of data at the snapshot time stored in the deduplicating system using a first list of fingerprints associated with the data stored on the data storage system and a second list of fingerprints associated with the state of data at the snapshot time stored in the deduplicating system.

Claims

1. A system for processing data, comprising:

a deduplicating system for storing data segments, wherein the deduplicating system stores a copy of data stored in a data storage system by storing a set of segments that is able to reconstruct the data stored in the data storage system;

an interface for receiving an indication to revert data stored in the data storage system to a state of data at a snapshot time stored in the deduplicating system; and

a processor configured to;

determine a subset of the data segments stored in the data storage system that have changed between the data segments stored in the data storage system and the state of the data segments at the snapshot time stored in the deduplicating system using a first set of fingerprints associated with the data segments stored on the data storage system and a second set of fingerprints associated with the state of the data segments at the snapshot time stored in the deduplicating system; and

transfer data associated with the determined subset from the deduplicating system to the data storage system, wherein transferring comprises;

retrieving a subset of the data segments stored in the deduplicating system associated with the state of the data segments at the snapshot time, wherein the retrieved subset of the data segments corresponds to the subset of the data segments stored in the data storage system that have changed; and

storing the retrieved subset of data segments in the appropriate locations in the data storage system as indicated in the state of the data segments at the snapshot time.

2. The system as in claim 1, wherein the data storage system for storing data comprises a block storage system.

3. The system as in claim 1, wherein the determined subset of the data comprises a list of blocks.

4. The system as in claim 3, wherein one block in the list of blocks is associated with one or more segments stored in the deduplicating storage system.

5. The system as in claim 4, wherein the one or more segments are read from the deduplicating storage system and used to reconstruct the block.

6. The system as in claim 1, wherein transferring data comprises transferring data requested by a user.

7. The system as in claim 1, wherein transferring data comprises transferring all data associated with the determined subset.

8. The system as in claim 1, wherein the snapshot time is one of a plurality of snapshot times.

9. A method for processing data, comprising:

receiving an indication to revert data stored in a data storage system to a state of data at a snapshot time stored in the deduplicating system, wherein a deduplicating system stores data segments, wherein the deduplicating system stores a copy of data stored in the data storage system by storing a set of segments that is able to reconstruct the data stored in the data storage system; and

determining, using a processor, a subset of the data segments stored in the data storage system that has changed between the data segments stored in the data storage system and the state of the data segments at the snapshot time stored in the deduplicating system using a first set of fingerprints associated with the data segments stored on the data storage system and a second set of fingerprints associated with the state of the data segments at the snapshot time stored in the deduplicating system; and

transferring data associated with the determined subset from the deduplicating system to the data storage system, wherein transferring comprises;

retrieving a subset of the data segments stored in the deduplicating system associated with the state of the data segments at the snapshot time, wherein the retrieved subset of the data segments corresponds to the subset of the data segments stored in the data storage system that have changed; and

storing the retrieved subset of data segments in the appropriate locations in the data storage system as indicated in the state of the data segments at the snapshot time.

10. The method as in claim 9, wherein the data storage system for storing data comprises a block storage system.

11. The method as in claim 9, wherein the determined subset of the data comprises a list of blocks.

12. The method as in claim 11, wherein one block in the list of blocks is associated with one or more segments stored in the deduplicating storage system.

13. The method as in claim 12, wherein the one or more segments are read from the deduplicating storage system and used to reconstruct the block.

14. The method as in claim 9, wherein transferring data comprises transferring data requested by a user.

15. The method as in claim 9, wherein transferring data comprises transferring all data associated with the determined subset.

16. The method as in claim 9, wherein the snapshot time is one of a plurality of snapshot times.

17. A computer program product for processing data, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving an indication to revert data stored in a data storage system to a state of data at a snapshot time stored in the deduplicating system, wherein a deduplicating system stores data segments, wherein the deduplicating system stores a copy of data stored in the data storage system by storing a set of segments that is able to reconstruct the data stored in the data storage system; and

determining a subset of the data segments stored in the data storage system that have changed between the data segments stored in the data storage system and the state of the data segments at the snapshot time stored in the deduplicating system using a first set of fingerprints associated with the data segments stored on the data storage system and a second set of fingerprints associated with the state of the data segments at the snapshot time stored in the deduplicating system; and

transferring data associated with the determined subset from the deduplicating system to the data storage system, wherein transferring comprises;

retrieving a subset of the data segments stored in the deduplicating system associated with the state of the data segments at the snapshot time, wherein the retrieved subset of the data segments corresponds to the subset of the data segments stored in the data storage system that have changed; and

storing the retrieved subset of data segments in the appropriate locations in the data storage system as indicated in the state of the data segments at the snapshot time.