Distributed deduplicated storage system

• US 9,020,900 B2
• Filed: 12/13/2011
• Issued: 04/28/2015
• Est. Priority Date: 12/14/2010
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Vijayan Retnamma, Manoj Kumar, Kottomtharayil, Rajiv, Attarde, Deepak Raghunath
• Primary Examiner(s): Jalil, Neveen Abel
• Assistant Examiner(s): BISKEBORN, KRISTOFER M
• Application Number:
  US13/324,613
• Publication Number:
  US 20120150826A1
• Time in Patent Office: 1,232 Days
• Field of Search: 707/712, 707/692, 707/698, 707/652
• US Class Current: 707/652
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: G06F 16/174 Redundancy elimination performed by the file system management of the data involved in backup or backup restore using de-duplication of the data G06F11/14
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]

Abstract

A distributed, deduplicated storage system according to certain embodiments is arranged in a parallel configuration including multiple deduplication nodes. Deduplicated data is distributed across the deduplication nodes. The deduplication nodes can be networked together and communicate with one another according using a light-weight, customized communication scheme (e.g., a scheme based on FTP or HTTP). In some cases, deduplication management information including deduplication signatures and/or other metadata is stored separately from the deduplicated data in deduplication management nodes, improving performance and scalability.

Claims

1. A method of performing a storage operation in a distributed, deduplicated storage system, comprising:

creating with a first deduplication node of a plurality of deduplication nodes, a first hash signature of a first data block of a plurality of data blocks associated with a file, a first header that at least identifies a first media agent that stored a copy of the first data block in a first storage device, and a first link to at least a location of the copy of the first data block in the first storage device;

creating with a second deduplication node, a second hash signature of at least a second data block associated with the file, a second header that at least identifies a second media agent that stored a copy of the second data block in a second storage device, and a second link to at least a location of the second data block in the second storage device;

sending from the second deduplication node to the first deduplication node, a copy of the second hash signature, a copy of the second header, and a copy of the second link;

receiving a first request from a client computing device to restore the file comprising the plurality of data blocks;

in response to the first request and using computer hardware, determining with the first deduplication node that the copy of the first data block of the plurality of data blocks in the requested file is stored at the first storage device;

accessing with the first media agent the first data block in the first storage device;

further determining with the first deduplication node that the copy of the second data block is stored on the second storage device based at least in part on accessing the copy of the second hash signature, the copy of the second header, and the copy of the second link stored in association with the first deduplication node;

sending a second request from the first media agent to the second media agent via a lightweight network that requests the second data block from the second media agent, wherein the second request comprises at least the copy of the second header, and the copy of second link; and

accessing with the second media agent, the second data block from the second storage device based at least in part on the copy of the second header and the copy of the second link in the second request.

2. The method of claim 1, wherein the second media agent transmits a copy of the particular data block in response to said request for the second data block, and wherein the method further comprises receiving the transmitted copy of the second data block from the second media agent.

3. The method of claim 1, wherein the first and second media agents communicate hash signatures, headers and links without using network shares.

4. The method of claim 3, wherein the first and second media agents communicate hash signatures, headers and links between one another without having a shared static mount path configuration.

5. The method of claim 1, wherein sending the second request for the second data block is performed using a file-transfer protocol (FTP)-based service routine.

6. The method of claim 1, wherein sending the second request for the second data block is performed using a hyper-text transfer protocol (HTTP)-based service routine.

7. The method of claim 1, further comprising, before receiving the request to restore the file:

performing a copy operation in which a file including a plurality of data blocks is copied in a deduplicated fashion,

wherein the copied file comprises a plurality of data blocks, at least one of which is the second data block,

further wherein the second link corresponding to the second data block was received by the first deduplication node during the copy operation and from one of at least one deduplication management node that is separate from the plurality of deduplication nodes and that stores deduplication management information.

8. The method of claim 7, wherein there are a plurality of deduplication management nodes performing the file copy operation comprises, for the second data block in the file:

determining which of the deduplication management nodes to inquire of as to the presence of the second data block;

consulting the determined deduplication management node as to whether the particular data block is already stored in the first or second storage devices;

if the second data block is already stored on a deduplication node, receiving the second link to the second data block from the determined deduplication management node.

9. The method of claim 8, further comprising determining which of the plurality of deduplication management nodes to inquire of comprises performing a modulo operation on the second hash signature of the second data block.

10. A distributed deduplicated storage system, comprising:

a plurality of deduplication nodes each comprising one or more processors and storage, the deduplication nodes in communication with one another via a network and a plurality of data blocks corresponding to a plurality of deduplicated files distributed across the deduplication nodes,

a first deduplication node of the plurality of deduplication nodes creates a first hash signature of a first data block of the plurality of data blocks associated with a file, a first header that at least identifies a first media agent that stored a copy of the first data block in a first storage device, and a first link to at least a location of the copy of the first data block in the first storage device and

a second deduplication node of the plurality of deduplication nodes creates a second hash signature of at least a second data block associated with the file, a second header that at least identifies a second media agent that stored a copy of the second data block in a second storage device, and a second link to at least a location of the second data block in the second storage device,

wherein the second deduplication node sends a copy of second hash signature, the second header, and the second link to the first deduplication node;

computer hardware configured to;

receive a request for the file comprised of a plurality of data blocks;

in response to the request, determine with the first deduplication node that the copy of the first data block of the plurality of data blocks exists at the first storage device;

access with the first media agent the particular data block from the first storage device based at least in part on the first header and the first link stored in association with the first deduplication node;

determine with the first deduplication node that the copy of the second data block exists at the second storage device based at least in part on the copy of the second hash signature, the copy of the second header, and the copy of the second link stored in association with the first deduplication node; and

sending a second request from the first media agent to the second media agent via a lightweight network to obtain the second data block from the second storage device, the second media agent accesses the second data block from the second storage device based at least in part on the copy of the second header and the copy of the second link in the second request.

11. The distributed deduplicated storage system of claim 10, wherein the second media agent server transmits a copy of the second data block to the first media agent in response to the second request for the second data block.

12. The distributed deduplicated storage system of claim 10, wherein the first and second media agents communicate without using network shares.

13. The distributed deduplicated storage system of claim 10, wherein the first and second media agents communicate without having a shared static mount path configuration.

14. The distributed deduplicated storage system of claim 10, wherein the second media agent is configured to respond to the second request using a file-transfer protocol (FTP)-based service routine.

15. The distributed deduplicated storage system of claim 10, wherein the media agent is configured to perform the request using a hyper-text transfer protocol (HTTP)-based service routine.

16. The distributed deduplicated storage system of claim 10, further comprising determining which of the plurality of deduplication nodes to inquire of comprises performing a modulo operation on the second hash signature of the second data block.

17. The distributed deduplicated storage of claim 10 wherein the second deduplication node uses the second hash signature to locate a storage location of the second data block.

18. The distributed deduplicated storage of claim 10 wherein the first deduplication node further provides block offset information associated with the second data block to the second media agent.