Auto adaptive deduplication to cloud based storage

• US 9,384,205 B1
• Filed: 12/18/2013
• Issued: 07/05/2016
• Est. Priority Date: 12/18/2013
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Inventors: Gipp, Stephan, Wartnick, Jeremy
• Primary Examiner(s): Dang, Thanh-Ha
• Application Number:
  US14/133,212
• Time in Patent Office: 930 Days
• Field of Search: 707/692
• US Class Current: 1/1
• CPC Class Codes: G06F 16/152 using file content signatures, e.g. hash values
• CPC Class Codes: G06F 16/174 Redundancy elimination performed by the file system management of the data involved in backup or backup restore using de-duplication of the data G06F11/14
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/1752 based on file chunks
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques

Abstract

A computer-implemented method for managing an inline deduplication module is described. Congestion information is collected about a level of congestion on a network that communicates with an inline deduplication module. An instruction is sent to the inline deduplication module to adjust a deduplication rate based at least in part on the congestion information.

Claims

1. A computer-implemented method for managing an inline deduplication module, comprising:

collecting congestion information about a level of congestion experienced by one or more external computing devices when sending data on a network, wherein the network communicates with the inline deduplication module;

determining from the collected congestion information a wait time before the inline deduplication module is able to send deduplicated data over the network due to the level of congestion on the network experienced by the one or more external computing devices;

sending an instruction to the inline deduplication module to adjust a deduplication rate based at least in part on the determined wait time;

wherein the instruction includes a command for the inline deduplication module to increase a search time of an existing process to look for a data segment signature when the determined wait time indicates a delay; and

wherein the instruction includes a command for the inline deduplication module to decrease a search time of the existing process to look for a data segment signature when the determined wait time indicates no delay.

2. The method of claim 1, wherein the instruction includes a command for the inline deduplication module to decrease a number of transaction counts associated with looking for a data segment signature.

3. The method of claim 1, wherein the instruction includes a command for the inline deduplication module to increase a number of transaction counts associated with looking for a data segment signature.

4. The method of claim 1, wherein collecting the congestion information about the level of congestion comprises:

collecting the congestion information from on-premise devices that are sending data through the inline deduplication module over a communication channel.

5. The method of claim 4, wherein the communication channel is independent of the network.

6. The method of claim 1, wherein the network is a cloud based storage network.

7. The method of claim 1, wherein the congestion information includes at least one of a count of on-premise devices utilizing the network, classifications of on-premise devices using the network, priorities, types of transfers, and types of resources used.

8. A computing device configured for managing an inline deduplication module, comprising:

a processor;

memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to;

collect congestion information about a level of congestion experienced by one or more external computing devices when sending data on a network, wherein the network communicates with the inline deduplication module;

determine from the collected congestion information a wait time before the inline deduplication module is able to send deduplicated data over the network due to the level of congestion on the network experienced by the one or more external computing devices;

send an instruction to the inline deduplication module to adjust a deduplication rate based at least in part on the determined wait time;

wherein the instruction includes a command for the inline deduplication module to increase a search time of an existing process to look for a data segment signature when the determined wait time indicates a delay; and

wherein the instruction includes a command for the inline deduplication module to decrease a search time of the existing process to look for a data segment signature when the determined wait time indicates no delay.

9. The computing device of claim 8, wherein the instruction includes a command for the inline deduplication module to adjust a number of transaction counts associated with looking for a data segment signature.

10. The computing device of claim 8, wherein the instructions are further executable by the processor to collect the congestion information from on-premise devices that are sending data through the inline deduplication module over a communication channel.

11. The computing device of claim 10, wherein the communication channel is independent of the network.

12. The computing device of claim 8, wherein the network is a cloud based storage network.

13. The computing device of claim 8, wherein the congestion information includes at least one of a count of on-premise devices utilizing the network, classifications of on-premise devices using the network, priorities, types of transfers, and types of resources used.

14. A computer-program product for managing an inline deduplication module, the computer-program product comprising a non-transitory computer-readable medium having instructions thereon, the instructions being executable by a processor to:

collect congestion information about a level of congestion experienced by one or more external computing devices when sending data on a network, wherein the network communicates with the inline deduplication module;

determine from the collected congestion information a wait time before the inline deduplication module is able to send deduplicated data over the network due to the level of congestion on the network experienced by the one or more external computing devices;

send an instruction to the inline deduplication module to adjust a deduplication rate based at least in part on the determined wait time;

wherein the instruction includes a command for the inline deduplication module to increase a search time of an existing process to look for a data segment signature when the determined wait time indicates a delay; and

wherein the instruction includes a command for the inline deduplication module to decrease a search time of the existing process to look for a data segment signature when the determined wait time indicates no delay.

15. The computer-program product of claim 14, wherein the instruction includes a command for the inline deduplication module to adjust a number of transaction counts associated with looking for a data segment signature.