RESPONDING TO SERVICE LEVEL OBJECTIVES DURING DEDUPLICATION

• US 20150088837A1
• Filed: 09/20/2013
• Published: 03/26/2015
• Est. Priority Date: 09/20/2013
• Status: Abandoned Application

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Nag, Yasa, Giridhar Appaji, Kathpal, Atish
• Application Number:
  US14/032,860
• Publication Number:
  US 20150088837A1
• Time in Patent Office: Days
• US Class Current: 707/692
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

Technology is described for responding to service level objectives during deduplication. In various embodiments, the technology receives a service level objective (SLO); receives data to be stored at the data storage system; computes an amount of deduplication to apply to the received data responsive to the SLO; deduplicates the data to the computed amount; and stores the deduplicated data. The deduplicated data may be stored in such a manner that the data can be read in a manner that meets the SLO.

Claims

1. A method performed by a data storage system, comprising:

receiving a service level objective (SLO);

receiving data to be stored at the data storage system;

computing an amount of deduplication to apply to the received data responsive to the SLO;

deduplicating the data to the computed amount; and

storing the deduplicated data.

2. The method of claim 1, wherein the SLO specifies at least one of a latency or a throughput.

3. The method of claim 1, wherein the computing comprises identifying a window of a set of partitions and deduplicating data within the identified window.

4. The method of claim 3, wherein a data and a first reference to the data is stored in a first window, and a copy of the data and a second reference to the copy of the data is stored in the second window, wherein the first and second windows are both stored on a common media element.

5. The method of claim 1, further comprising storing a replica after storing the deduplicated data, wherein the replica does not have a reference to data stored as part of the deduplicated data.

6. The method of claim 1, further comprising computing based on the received SLO a number of media elements to include in each group of media elements.

7. The method of claim 6, further comprising deduplicating data within each group of media elements but not across groups of media elements.

8. The method of claim 7, wherein deduplicated data is stored in a first group of media elements and a replica of the deduplicated data is stored in a second group of media elements.

9. The method of claim 1, further comprising computing at least two cliques wherein data in a second clique does not reference data in a first clique.

10. The method of claim 9, further comprising storing the data corresponding to the first clique in a first media element and storing data corresponding to the second clique in a second media element.

11. The method of claim 9, wherein computing a clique comprises:

creating an directed acyclic graph, wherein each node of the graph corresponds to either data or a reference to the data and each edge between each node has associated therewith a weight indicating a count of a number of times the data is referenced.

12. A computer-readable storage medium comprising computer-executable instructions, comprising:

instructions for receiving a service level objective (SLO);

instructions for receiving data to be stored at a data storage system;

instructions for computing an amount of deduplication to apply to the received data responsive to the SLO;

instructions for deduplicating the data to the computed amount; and

instructions for storing the deduplicated data.

13. The computer-readable medium of claim 12, wherein a first portion of the received data is stored on a first media element and a second portion of the received data is stored on a second media element, and the instructions for deduplicating deduplicate the two portions of the received data separately so that the deduplicated data stored on either media element does not reference the deduplicated data stored on the other media element.

14. The computer-readable medium of claim 12, further comprising:

instructions for storing at a cache volume metadata corresponding to the stored deduplicated data.

15. The computer-readable medium of claim 12, further comprising instructions for creating a replica of the stored deduplicated data.

16. The computer-readable medium of claim 15, wherein the deduplicated data and the replica are stored on two different media elements.

17. A system, comprising:

a data storage system configured to store and retrieve data;

a service level objective (SLO) processor component configured to receive and process a SLO;

a media layout processor component configured to store data to a media element according to a specified media layout and read the stored data from the media element; and

a deduplication engine component configured to deduplicate data responsive to the received SLO.

18. The system of claim 18, wherein the media element is a tape cartridge.

19. The system of claim 18 wherein the media element is a high density data storage.

20. The system of claim 18, wherein the data storage system is a low speed data storage system.