Managing data deduplication in storage systems based on storage space characteristics

• US 9,529,545 B1
• Filed: 12/26/2013
• Issued: 12/27/2016
• Est. Priority Date: 12/26/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Bono, Jean-Pierre, Duprey, Dennis T., Chen, Xiangping, Armangau, Philippe, Chaudhary, Monica, Ku, Mark K.
• Primary Examiner(s): Chappell, Daniel C
• Application Number:
  US14/141,258
• Time in Patent Office: 1,097 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A method is used in managing data deduplication in storage systems based on storage space characteristics. Characteristics of first and second storage tiers are evaluated. A first data object resides on the first storage tier and a second data object resides on the second storage tier. The first and second data objects are selected for applying a deduplicating technique. A data storage system includes the first and second storage tiers configured such that performance characteristics associated with the first storage tier is different from the second storage tier. Based on the evaluation, the deduplicating technique is applied to the first and second data objects.

Claims

1. A method for use in managing data deduplication in storage systems based on storage space characteristics, the method comprising:

receiving a request to deduplicate a data object;

identifying a candidate data object for deduplicating the data object;

evaluating characteristics of storage tiers on which the data object and the candidate data object reside, wherein the data object resides on a first storage tier and the candidate data object resides on a second storage tier, wherein a data storage system includes the first storage tier and the second storage tier configured such that performance characteristics associated with the first storage tier are different from performance characteristics associated with the second storage tier; and

based on the evaluating, selecting a master deduplicated copy from a group consisting of the data object and the candidate data object, wherein the data object is selected as the master deduplicated copy upon determining that performance characteristics associated with the first storage tier are higher than performance characteristics associated with the second storage tier, wherein the candidate data object is selected as the master deduplicated copy upon determining that performance characteristics associated with the second storage tier are higher than performance characteristics associated with the first storage tier; and

based on the selecting, applying a deduplicating technique to the data object and the candidate data object, wherein the data object is deduplicated to the candidate data object by updating mapping information of the data object to point to the candidate data object upon selection of the candidate data object as the master deduplicated copy, wherein the candidate data object is deduplicated to the data object by updating mapping information of the candidate data object to point to the data object upon selection of the data object as the master deduplicated copy.

2. The method of claim 1, wherein evaluating characteristics of the first and second storage tiers further comprises:

comparing performance characteristics of the first and second storage tiers.

3. The method of claim 1, wherein the data object and the candidate data object are selected from the group consisting of a deduplication domain, a storage extent, a Logical Unit Number (LUN), a file, a slice and a data block, wherein the data block is a fixed size chunk of a physical disk storage.

4. The method of claim 3, wherein a slice is a logical representation of a subset of physical disk storage.

5. The method of claim 1, wherein a storage tier includes a disk drive system comprising a plurality of Redundant Array of Inexpensive Disks (RAID) systems, each RAID system of the plurality of RAID systems having a first disk drive and a second disk drive.

6. The method of claim 3, wherein a deduplication domain comprises a set of storage extents, wherein each storage extent of the set of storage extents comprises a set of LUNs, wherein each LUN of the set of LUNs is a logical representation of a subset of physical disk storage.

7. The method of claim 1, wherein applying a deduplicating technique further comprises:

based on the evaluating, updating mapping information of the data object and the candidate data object.

8. A system for use in managing data deduplication in storage systems based on storage space characteristics, the system comprising:

first logic receiving a request to deduplicate a data object;

second logic identifying a candidate data object for deduplicating the data object;

third logic evaluating characteristics of storage tiers on which the data object and the candidate data object reside, wherein the data object resides on a first storage tier and the candidate data object resides on a second storage tier, wherein a data storage system includes the first storage tier and the second storage tier configured such that performance characteristics associated with the first storage tier are different from performance characteristics associated with the second storage tier;

fourth logic selecting, based on the evaluating, a master deduplicated copy from a group consisting of the data object and the candidate data object, wherein the data object is selected as the master deduplicated copy upon determining that performance characteristics associated with the first storage tier are higher than performance characteristics associated with the second storage tier, wherein the candidate data object is selected as the master deduplicated copy upon determining that performance characteristics associated with the second storage tier are higher than performance characteristics associated with the first storage tier; and

fifth logic applying, based on the selecting, a deduplicating technique to the data object and the candidate data object, wherein the data object is deduplicated to the candidate data object by updating mapping information of the data object to point to the candidate data object upon selection of the candidate data object as the master deduplicated copy, wherein the candidate data object is deduplicated to the data object by updating mapping information of the candidate data object to point to the data object upon selection of the data object as the master deduplicated copy.

9. The system of claim 8, wherein evaluating characteristics of the first and second storage tiers further comprises:

sixth logic comparing performance characteristics of the first and second storage tiers.

10. The system of claim 8, wherein the data object and the candidate data object are selected from the group consisting of a deduplication domain, a storage extent, a Logical Unit Number (LUN), a file, a slice and a data block, wherein the data block is a fixed size chunk of a physical disk storage.

11. The system of claim 10, wherein a slice is a logical representation of a subset of physical disk storage.

12. The system of claim 8, wherein a storage tier includes a disk drive system comprising a plurality of Redundant Array of Inexpensive Disks (RAID) systems, each RAID system of the plurality of RAID systems having a first disk drive and a second disk drive.

13. The system of claim 10, wherein a deduplication domain comprises a set of storage extents, wherein each storage extent of the set of storage extents comprises a set of LUNs, wherein each LUN of the set of LUNs is a logical representation of a subset of physical disk storage.

14. The system of claim 8, wherein applying a deduplicating technique further comprises:

sixth logic updating, based on the evaluating, mapping information of the data object and the candidate data object.