Systems and methods for creating copies of data, such as archive copies

• US 8,392,677 B2
• Filed: 03/20/2012
• Issued: 03/05/2013
• Est. Priority Date: 12/04/2006
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Bunte, Alan, Prahlad, Anand, Brockway, Brian
• Primary Examiner(s): Rones, Charles
• Assistant Examiner(s): BIRKHIMER, CHRISTOPHER D
• Application Number:
  US13/424,830
• Publication Number:
  US 20120179656A1
• Time in Patent Office: 350 Days
• Field of Search: None
• US Class Current: 711/161
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/325 Hash tables
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database

Abstract

A system and method of creating archive copies of data sets is described. In some examples, the system creates an archive copy from an original data set. In some examples, the system creates an archive copy when creating a recovery copy for a data set. In some examples, the system creates a copy without redundant data, and then encrypts the data set.

Claims

1. A method for rebuilding at least a portion of a signature database that reflects contents of an archive copy of a data set, comprising:

receiving a substantially unique identifier for data objects within the data set;

storing the substantially unique identifiers in a signature database,

wherein a substantially unique identifier for a data object reflects contents of the data object;

storing the data set as an archive copy having one or more data chunks,

wherein each chunk is stored with header information that includes at least one substantially unique identifier;

receiving an indication that the signature database is unrecoverable or unavailable;

determining at least one substantially unique identifier within the header information; and

using the determined at least one substantially unique identifier from the header information in order to rebuild at least part of the signature database.

2. The method of claim 1, further comprising using the generated substantially unique identifiers to identify redundant data objects in the data set and deduplicate the redundant data objects in order to create a deduplicated archive copy of the data set that comprises the encrypted data objects.

3. The method of claim 1 wherein the archive copy is stored on sequential media, and wherein the method further comprises storing information related to locations of the data objects on the sequential media in a location database separate from the signature database.

4. The method of claim 1, wherein the data objects are stored to locations on sequential media.

5. The method of claim 1, further comprising encrypting a data object after generating the substantially unique identifier for the data object.

6. A method of rebuilding a deduplication index that reflects contents of an archive of data objects, the method comprising:

storing in a data file a copy of the data objects and hash values generated from the data objects,

wherein a header region of the file stores the hash values, and

wherein the data file is stored on sequential media;

updating an entry in a deduplication index to reflect identification of the data objects,

wherein the entry is updated using the hash values;

upon receiving an indication that the deduplication index is unavailable or unrecoverable, accessing the hash value from the header region of the data file stored on the sequential media; and

using the accessed hash value to rebuild a portion of a new, rebuilt version of the deduplication index.

7. The method of claim 6, further comprising:

identifying a data object to be stored in an archive of data objects that form a data set;

creating a hash value for the identified data object, wherein creating the hash value includes calculating a hash value that represents contents of the data object;

deduplicating the data set by;

comparing the hash value with other hash values for data objects already stored in the archive of data objects;

when the comparison determines that the hash value for the data object is different than the other hash values, then adding the object to, or retaining the data object in, the data set; and

,

encrypting a copy of the data object, and transferring the encrypted copy of the data object and the hash value to the archive of data objects.

8. The method of claim 6, further comprising determining that the hash value for a particular data object is identical to one or more of the other hash values;

transferring the hash value that represents contents of the data object to the archive of data objects; and

storing in a file on the sequential media, the transferred hash value, wherein a header region of the file stores the transferred hash value.

9. The method of claim 6, wherein the data object is identified when the data storage system receives a request from a user to store a copy of the data object in the archive of data objects.

10. At least one tangible, computer-readable medium, which when executed by at least one data processing device, rebuilds at least a portion of a single instancing index containing hash values that represent contents of a single instanced data set, comprising:

obtaining substantially unique hash values that represent the data set;

storing at least some of the obtained hash values that represent the data set in a single instancing index,

wherein storing the obtained hash values includes storing the obtained hash values within headers of one or more data files, and

wherein the one or more data files form part of an archive file;

receiving an indication that at least part of the single instancing index storing hash values that represent the data set is unrecoverable or unavailable;

extracting stored hash value information from a header of at least one data file that forms part of the archive file; and

,

adding the extracted hash value information to a new, rebuilt version of the single instancing index.

11. The computer-readable medium of claim 10, further comprising:

encrypting one or more data files that form part of the archive file;

before extracting stored hash value, decrypting the at least one data file to gain access to the stored hash value information from the header of the at least one data file; and

re-encrypting the decrypted at least one data file.

12. The computer-readable medium of claim 10, further comprising:

receiving a request to restore a data object; and

using the new, rebuilt version of the single instancing index to locate the data object within the archive file.

13. The computer-readable medium of claim 10, further comprising:

creating a deduplicated data set organized as the archive file and physically stored on one or more magnetic tapes,

wherein the one or more data files are separate from the single instancing index and also store at least a subset of the data set, and

wherein the one or more data files are stored on the one or more tapes.

14. The computer-readable medium of claim 10, further comprising:

in response to receiving the indication, identifying at least one data file that forms part of the archive file on the one or more tapes.