ARCHIVING DATA OBJECTS USING SECONDARY COPIES

• US 20170206206A1
• Filed: 03/31/2017
• Published: 07/20/2017
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Gokhale, Parag, Kottomtharayil, Rajiv, Varadharajan, Prakash
• Granted Patent: US 10,762,036 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1402 Saving, restoring, recovering or retrying
• CPC Class Codes: G06F 11/1415 at system level
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/219 Managing data history or versioning querying versioned data G06F16/2474; querying temporal data G06F16/2477
• CPC Class Codes: G06F 16/24544 Join order optimisation
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0641 De-duplication techniques

Abstract

A system for archiving data objects using secondary copies is disclosed. The system creates one or more secondary copies of primary copy data that contains multiple data objects. The system maintains a first data structure that tracks the data objects for which the system has created secondary copies and the locations of the secondary copies. To archive data objects in the primary copy data, the system identifies data objects to be archived, verifies that previously-created secondary copies of the identified data objects exist, and replaces the identified data objects with stubs. The system maintains a second data structure that both tracks the stubs and refers to the first data structure, thereby creating an association between the stubs and the locations of the secondary copies.

Claims

1. A system to create archive copies of one or more secondary copies of production data stored by a production computing system, wherein the production data contains multiple data files, the system comprising:

at least one processor; and

at least one data storage device storing a data structure, wherein the data structure tracks

data identifying the data files for which the system has created secondary copies, and

logical locations of the secondary copies of the data files;

wherein the secondary copies are stored on a different data storage device than the production data; and

wherein the data storage device stores instructions to be executed by the at least one processor, the instructions comprising steps to archive data files for the production data by

applying rules to determine that certain data files are to be archived;

verifying that previously-created secondary copies of the certain data files to be archived exist in the different data storage device; and

replacing the certain data files in the production data with stubs, pointers or logical addresses;

wherein the first data structure provides an association between the stubs, pointers or logical addresses and the logical locations of the secondary copies of the certain data files,

whereby the system archives the certain data files without creating an additional secondary copy of the certain data files.

2. The system of claim 1 wherein the rules include predetermined archival criteria related to at least one of:

a data object type, a data object age, a data object size, a percentage of disk quota, remaining storage, and metadata.

3. The system of claim 1, further comprising:

providing access for users to an interface, wherein the interface permits users to perform certain storage operations, to adjust the rules, and to display or provide specific data storage information.

4. A non-transitory computer-readable storage medium whose contents cause a data storage system to perform a method for archiving multiple data objects included in primary copy data, the method comprising:

obtaining, from a client computing device, both full and incremental backup copies of the client'"'"'s primary copy data;

using the received backup copies to create a secondary copy of multiple data objects included in the primary copy data;

for each of the multiple data objects for which a secondary copy was created, adding an entry for the data object to a data structure,

wherein the entry includes an identifier associated with the data object;

after creating the secondary copy, identifying one or more of the multiple data objects that satisfy one or more predetermined archival criteria; and

,

for each of the identified one or more data objects;

looking up the identified data object in the data structure using the identifier associated with the identified data object;

receiving a token for the identified data object; and

replacing the identified data object in the primary copy data with a stub referencing the secondary copy of the identified data object,

wherein the stub includes the token.

5. The computer-readable storage medium of claim 4 wherein the predetermined archival criteria includes at least one of:

a data object type, a data object age, a data object size, a percentage of disk quota, remaining storage, and metadata.

6. The computer-readable storage medium of claim 4 wherein the method further comprises:

receiving information regarding a first data object included in the primary copy data from a driver or file system that detects deletions;

using the received information to determine that the first data object has been deleted from the primary copy data and a corresponding deletion time; and

in response to determining that the deletion time is more than a predetermined period of time ago, deleting the secondary copy of the first data object.

7. The computer-readable storage medium of claim 6 wherein the predetermined period of time is determined at least in part by an object type of the first data object.

8. The computer-readable storage medium of claim 6 wherein the predetermined period of time is determined by a storage policy.

9. A computer-implemented method for managing backup and archiving of information in an information management system, wherein the information management system includes first and second data storage systems, the computer-implemented method comprising:

scanning a first data storage system,

wherein the first storage system includes primary copies of data objects, and

wherein the scanning includes gathering metadata from the primary copies;

on a second, different data storage system, creating corresponding secondary copies of the primary copies of the data objects,

creating a database of the gathered metadata; and

when the primary copies of the data objects meet one or more archiving conditions, then creating stubs in the primary copy for the data objects,

wherein the stubs replace the data objects in the primary copies, and

wherein the stubs reference a logical location of the secondary copy in the second data storage system.

10. The method of claim 9, further comprising:

providing access for users to an interface, via consoles, with the information management system, wherein the interface displays the gathered metadata and permits users to perform certain storage operations and to display or provide specific data storage information.

11. The method of claim 9, further comprising:

if the primary copies of data objects located on the first storage system have not been modified within a predetermined time, deleting the primary copies from the first storage system; and

if the primary copies with data objects located on the first storage system have been modified within a predetermined time, modifying the data objects in the corresponding secondary copies.

12. The method of claim 9, wherein the method further comprises:

after creating stubs in the primary copy for the data objects, performing at least one of the following operations on the corresponding secondary copies;

deduplication, decompression, compression, content-indexing, encryption, decryption, or data classification.

13. The method of claim 9, wherein the archiving conditions is set by an administrator at least partially based on:

available storage space in the first storage system, available storage space in the second storage system, the type of data object, data object age, a percentage disk quota, or on storage policies.

14. The method of claim 9, wherein providing access further comprises:

providing an interface for users or system processors to;

modify storage policy, view secondary copies, view primary copies, view copy format, view location of copies, or edit or modify primary or secondary copies.

15. The method of claim 9, further comprising:

creating a data structure, wherein the data structure includes locations of the primary copies having multiple data objects and the corresponding secondary copies.

16. A system for archiving data objects using secondary copies, the system comprising:

at least one processor;

at least one memory coupled to the processor;

a first software component stored on the memory that creates one or more secondary copies of primary copy data that contains multiple data objects;

a first data structure stored on the memory that tracks the data objects for which secondary copies have been created and locations of the secondary copies;

a second software component stored on the memory that identifies data objects to be archived, verifies that previously-created secondary copies of the identified data objects exist, and replaces the identified data objects with stubs; and

a second data structure stored on the memory that both tracks the stubs and refers to the first data structure, thereby creating an association between the stubs and the locations of the secondary copies.

17. The system of claim 16, wherein after a predetermined period of time set by a storage policy the data objects to be archived are replaced with stubs, and wherein the predetermined period of time is determined at least in part by an object type of the data objects.

18. The system of claim 16, wherein the secondary copies of is a backup copy created at least in part by an incremental or full backup operation.

19. The system of claim 16 wherein the second software component:

determines that a first data object included in the primary copy data satisfies predetermined criteria; and

in response to determining that the first data object satisfies the predetermined criteria, deleting the secondary copy of the first data object.