Archiving using data obtained during backup of primary storage

• US 10,338,823 B2
• Filed: 07/31/2017
• Issued: 07/02/2019
• Est. Priority Date: 12/21/2012
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kottomtharayil, Rajiv, Kumarasamy, Paramasivam
• Primary Examiner(s): Bragdon, Reginald G
• Assistant Examiner(s): Knight, Paul M
• Application Number:
  US15/664,817
• Publication Number:
  US 20180018236A1
• Time in Patent Office: 701 Days
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/2058 using more than 2 mirrored copies
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

A data storage system can scan one or more information stores of primary storage and analyze the metadata of files stored in the one or more information stores of primary storage to identify multiple, possibly relevant, secondary copy operations that can be performed on the files. The storage system can also identify primary storage usage information of each file during the scan and use that information to generate reports regarding the usage of the primary storage.

Claims

1. A method, comprising:

copying, during a backup of one or more non-volatile information stores of primary storage, metadata of a plurality of files stored in the one or more non-volatile information stores to an index, the metadata copied to the index including at least modification date data of each file of the plurality of files, wherein the backup comprises;

identifying a first set of one or more files of the plurality of files for a backup operation based at least in part on a determination that the first set of one or more files were modified since a previous backup date, and

performing the backup operation on the first set of one or more files of the plurality of files, wherein the previous backup date indicates a date when modifications to files in the one or more non-volatile information stores were most recently copied to secondary storage;

following the backup operation of the one or more non-volatile information stores, reviewing the metadata copied to the index during the backup to identify a second set of one or more files of the plurality of files that were last modified prior to a system archival date; and

performing an archive operation on the second set of one or more files of the plurality of files, wherein the archive operation includes replacing a particular file of the second set of one or more files with an identifier indicating a location of one or more copies of the particular file in the secondary storage.

2. The method of claim 1, wherein the system archival date is based at least in part on at least one of a creation date, last access date, and last modify date of each file.

3. The method of claim 1, wherein the system archival date is based at least in part on an identity of at least one of a user of each file and a creator of each file.

4. The method of claim 1, wherein the system archival date is based at least in part on a rating of each file.

5. The method of claim 1, further comprising verifying the one or more copies of the second set of one or more files are located in the secondary storage prior to performing the archive operation.

6. The method of claim 1, further comprising identifying primary storage usage data of each file of the plurality of files using the metadata copied to the index.

7. The method of claim 6, wherein the primary storage usage data of each file comprises at least file size data, disk type data, and volume type data.

8. The method of claim 6, further comprising generating a report of the primary storage usage data.

9. The method of claim 8, wherein the report comprises usage trending of the primary storage, fault trending in the primary storage, number of mount points, number of volumes, types of disks in the primary storage, and disk trending.

10. A system, comprising:

one or more processors configured to;

copy, during a backup of one or more non-volatile information stores of primary storage, metadata of a plurality of files stored in the one or more non-volatile information stores to an index, the metadata copied to the index including at least modification date data of each file of the plurality of files, wherein to perform the backup, the one or more processors are configured to;

identify a first set of one or more files of the plurality of files for a backup operation based at least in part on a determination that the first set of one or more files were modified since a previous backup date, and

perform the backup operation on the first set of one or more files of the plurality of files, wherein the previous backup date indicates a date when modifications to files in the one or more non-volatile information stores were most recently copied to secondary storage;

following the backup operation of the one or more non-volatile information stores, review the metadata copied to the index during the backup to identify a second set of one or more files of the plurality of files that were last modified prior to a system archival date; and

perform an archive operation on the second set of one or more files of the plurality of files, wherein the archive operation includes replacing a particular file of the second set of one or more files with an identifier indicating a location of one or more copies of the particular file in the secondary storage.

11. The system of claim 10, wherein the system archival date is based at least in part on at least one of a creation date, last access date, and last modify date of each file.

12. The system of claim 10, wherein the system archival date is based at least in part on an identity of at least one of a user of each file and a creator of each file.

13. The system of claim 10, wherein the system archival date is based at least in part on a rating of each file.

14. The system of claim 10, wherein the one or more processors are further configured to verify the one or more copies of the second set of one or more files are located in the secondary storage prior to performing the archive operation.

15. The system of claim 10, wherein the one or more processors are further configured to identify primary storage usage data of each file of the plurality of files using the metadata copied to the index.

16. The system of claim 15, wherein the primary storage usage data of each file comprises at least file size data, disk type data, and volume type data.

17. The system of claim 15, wherein the one or more processors are further configured to generate a report of the primary storage usage data.

18. The system of claim 17, wherein the report comprises usage trending of the primary storage, fault trending in the primary storage, number of mount points, number of volumes, types of disks in the primary storage, and disk trending.

19. Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:

copy, during a backup of one or more non-volatile information stores of primary storage, metadata of a plurality of files stored in the one or more non-volatile information stores to an index, the metadata copied to the index including at least modification date data of each file of the plurality of files, wherein the backup comprises;

identifying a first set of one or more files of the plurality of files for a backup operation based at least in part on a determination that the first set of one or more files were modified since a previous backup date, and

performing the backup operation on the first set of one or more files of the plurality of files, wherein the previous backup date indicates a date when modifications to files in the one or more non-volatile information stores were most recently copied to secondary storage;

following the backup operation of the one or more non-volatile information stores, review the metadata copied to the index during the backup to identify a second set of one or more files of the plurality of files that were last modified prior to a system archival date; and

perform an archive operation on the second set of one or more files of the plurality of files, wherein the archive operation includes replacing a particular file of the second set of one or more files with an identifier indicating a location of one or more copies of the particular file in the secondary storage.

20. The non-transitory computer readable media of claim 19, wherein the non-transitory computer readable media further cause the computing system to verify the one or more copies of the second set of one or more files are located in the secondary storage prior to performing the archive operation.