Selective deduplication
First Claim
Patent Images
1. A method comprising:
- determining, by a processor of a computing device, a first deduplication priority for a first data object based upon a first projected likelihood that deduplication of the first data object will provide a storage space benefit to reduce storage consumption of a storage device;
determining a second deduplication priority for a second data object based upon a second projected likelihood that deduplication of the second data object will provide the storage space benefit; and
performing inline deduplication for the first data object but not the second data object based upon the first deduplication priority exceeding the second deduplication priority that is indicative of inline deduplication of the first data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the second data object.
0 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatuses for performing selective deduplication in a storage system are introduced herein. Techniques are provided for determining deduplication priorities of data objects based upon projected likelihoods that deduplication of such data objects will provide a storage space benefit. Inline deduplication and/or post processing deduplication is selectively provided on an individual data object basis based upon deduplication priorities assigned to respective data objects.
-
Citations
20 Claims
-
1. A method comprising:
-
determining, by a processor of a computing device, a first deduplication priority for a first data object based upon a first projected likelihood that deduplication of the first data object will provide a storage space benefit to reduce storage consumption of a storage device; determining a second deduplication priority for a second data object based upon a second projected likelihood that deduplication of the second data object will provide the storage space benefit; and performing inline deduplication for the first data object but not the second data object based upon the first deduplication priority exceeding the second deduplication priority that is indicative of inline deduplication of the first data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the second data object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A computing device comprising:
-
a memory containing machine-readable storage media having stored thereon instructions for performing a method; and a processor coupled to the memory, the processor configured to execute the instructions to cause the processor to; determine a first deduplication probability threshold and a second deduplication probability threshold based upon a performance characteristic; create a multi-level deduplication probability comprising a hierarchical relationship between the first deduplication probability threshold and the second deduplication probability threshold; utilize the multi-level deduplication probability to assign deduplication priorities to data objects; and selectively perform inline deduplication but not post processing deduplication for the data objects based upon the deduplication priorities indicating that inline deduplication has a greater likelihood of achieving a storage space benefit to reduce storage consumption of a storage device than post processing deduplication.
-
-
20. A non-transitory machine-readable storage media having stored thereon instructions, for performing a method, which causes a computing device to:
-
determine a first deduplication priority for a first data object based upon a first projected likelihood that deduplication of the first data object will provide a storage space benefit to reduce storage consumption of a storage device; determine a second deduplication priority for a second data object based upon a second projected likelihood that deduplication of the second data object will provide the storage space benefit; perform inline deduplication for the first data object and post-processing deduplication for the second data object based upon the first deduplication priority exceeding the second duplication priority that is indicative of inline deduplication of the first data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the second data object; and perform inline deduplication for the second data object and post-processing duplication for the first data object based upon the second deduplication priority exceeding the first deduplication priority that is indicative of inline deduplication of the second data object having a greater likelihood of achieving the storage space benefit than inline deduplication for the first data object.
-
Specification