Archiving data objects using secondary copies

• US 9,639,563 B2
• Filed: 02/02/2016
• Issued: 05/02/2017
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Gokhale, Parag, Kottomtharayil, Rajiv, Varadharajan, Prakash
• Primary Examiner(s): GIARDINO JR, MARK A
• Application Number:
  US15/013,138
• Publication Number:
  US 20160224598A1
• Time in Patent Office: 455 Days
• CPC Class Codes: G06F 11/1402 Saving, restoring, recovering or retrying
• CPC Class Codes: G06F 11/1415 at system level
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/219 Managing data history or versioning querying versioned data G06F16/2474; querying temporal data G06F16/2477
• CPC Class Codes: G06F 16/24544 Join order optimisation
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0641 De-duplication techniques

Abstract

A system for archiving data objects using secondary copies is disclosed. The system creates one or more secondary copies of primary copy data that contains multiple data objects. The system maintains a first data structure that tracks the data objects for which the system has created secondary copies and the locations of the secondary copies. To archive data objects in the primary copy data, the system identifies data objects to be archived, verifies that previously-created secondary copies of the identified data objects exist, and replaces the identified data objects with stubs. The system maintains a second data structure that both tracks the stubs and refers to the first data structure, thereby creating an association between the stubs and the locations of the secondary copies.

Claims

1. A non-transitory computer-readable storage medium storing computer-executable instructions, which when executed cause a system to perform a method for archiving multiple data objects included in primary copy data, the method comprising:

determining that a first data object included in the primary copy data has been deleted;

if the primary copy data has been deleted less than a predetermined period of time, then producing a second secondary copy of the first data object,

wherein the second secondary copy is produced from a first secondary copy of the first data object, and

providing, from the first secondary copy of other data objects, a corresponding second secondary copy of the other data objects.

2. The computer-readable storage medium of claim 1, wherein providing a corresponding second secondary copy of the other data objects includes providing the corresponding second secondary copy of the other data objects except for the first data object.

3. The computer-readable storage medium of claim 1, further comprising:

for each of one or more data objects to be archived, replacing the data object in the primary copy data with a stub referencing a secondary copy of the identified data object.

4. The non-transitory computer-readable storage medium of claim 1, wherein the determining that the first data object included in the primary copy data has been deleted further comprises:

scanning the primary data to populate an image map; and

comparing the image map to a data structure that indicates a location of the first secondary copy.

5. The non-transitory computer-readable storage medium of claim 1, wherein the predetermined period of time is set by a storage policy.

6. The non-transitory computer-readable storage medium of claim 1, wherein the determining that the first data object included in the primary copy data has been deleted further comprises receiving information from a driver or file system that detects deletions.

7. The non-transitory computer-readable storage medium of claim 1, wherein the predetermined period of time is determined at least in part by an object type of the first data object.

8. The non-transitory computer-readable storage medium of claim 1, wherein the secondary copy of the multiple data objects is a backup copy created at least in part by an incremental or full backup operation.

9. The non-transitory computer-readable storage medium of claim 1, further comprising:

identifying the one or more of the multiple data objects that are to be archived, wherein the identifying comprises determining that the one or more of the multiple data objects satisfy predetermined retention criteria, including at least one of;

a data object type, a data object age, a data object size, a percentage of disk quota, remaining storage, and metadata.

10. The non-transitory computer-readable storage medium of claim 1, further comprising:

identifying one or more of the multiple data objects that are to be archived, wherein the identifying comprises determining that the one or more of the multiple data objects satisfy predetermined retention criteria.

11. The non-transitory computer-readable storage medium of claim 1, wherein at least one of the multiple data objects is an email or email attachment.

12. The non-transitory computer-readable storage medium of claim 1, further comprising:

determining that a first data object included in the primary copy data satisfies predetermined criteria; and

in response to determining that the first data object satisfies the predetermined criteria, deleting the secondary copy of the first data object.

13. A method for archiving multiple data objects included in primary copy data, the method comprising:

determining that a first data object included in the primary copy data has been deleted;

if the primary copy data has been deleted less than a predetermined period of time, then producing a second secondary copy of the first data object,

wherein the second secondary copy is produced from a first secondary copy of the first data object, and

providing, from the first secondary copy of other data objects, a corresponding second secondary copy of the other data objects.

14. The method of claim 13, wherein providing a corresponding second secondary copy of the other data objects includes providing the corresponding second secondary copy of the other data objects except for the first data object.

15. The method of claim 13, further comprising:

for each of one or more data objects to be archived, replacing the data object in the primary copy data with a stub referencing a secondary copy of the identified data object.

16. The method of claim 13, wherein the determining that the first data object included in the primary copy data has been deleted further comprises:

scanning the primary data to populate an image map; and

comparing the image map to a data structure that indicates a location of the first secondary copy.

17. The method of claim 13, wherein the predetermined period of time is set by a storage policy.

18. The method of claim 13, wherein the predetermined period of time is determined at least in part by an object type of the first data object.

19. The method of claim 13, wherein the secondary copy of the multiple data objects is a backup copy created at least in part by an incremental or full backup operation.

20. A system for archiving multiple data objects included in primary copy data, the system comprising:

means for determining that a first data object included in the primary copy data has been deleted;

means for producing a second secondary copy of the first data object when the primary copy data has been deleted less than a predetermined period of time,

wherein the second secondary copy is produced from a first secondary copy of the first data object, and

means for providing, from the first secondary copy of other data objects, a corresponding second secondary copy of the other data objects.