Systems and methods to detect deleted files

• US 10,296,607 B2
• Filed: 04/02/2018
• Issued: 05/21/2019
• Est. Priority Date: 12/21/2012
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Pawar, Rahul S., Kottomtharayil, Rajiv, Swallow, Douglas Cary, Varadharajan, Prakash
• Primary Examiner(s): Tran, Anhtai V
• Application Number:
  US15/943,074
• Publication Number:
  US 20190065329A1
• Time in Patent Office: 414 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1474 in transactions G06F16/20 takes precedence
• CPC Class Codes: G06F 11/2056 by mirroring
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3485 for I/O devices
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/162 Delete operations erasing in storage systems G06F3/0652
• CPC Class Codes: G06F 16/1865 Transactional file systems
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/815 Virtual
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A data storage system protects data identified for deletion which has been created or modified between scheduled data backups. For instance, the system monitors data operations and when the data operation is a delete, the system determines whether the data identified for deletion has been protected by a backup operation. Data that has not been backed up, such as newly created data, is copied to temporary storage before deletion. When the data has been protected, the system determines whether the data has been modified after the backup operation. Data modified after the backup operation is copied to temporary storage before deletion.

Claims

1. A method to protect data deleted between data protection operations in a data management system, the method comprising:

monitoring, with one or more computer processors comprising hardware, data that has been protected with one or more data protection operations;

automatically monitoring, with the one or more computer processors, one or more data operations in primary storage that occur after the one or more data protection operations;

when the one or more data operations is a deletion operation, automatically identifying with the one or more computer processors, deletion data associated with the deletion operation and a file path associated with the deletion data;

prior to performing the deletion operation, determining with the one or more computer processors, whether the deletion data has been protected by the one or more data protection operations, and when the deletion data has not been protected, automatically converting the deletion data to at least one hidden file;

automatically copying with the one or more computer processors the at least one hidden file and the file path to temporary storage;

performing the deletion operation; and

automatically copying, during a subsequent second data protection operation, the at least one hidden file stored in the temporary storage to a location on one or more secondary storage devices based at least in part on the file path stored in the temporary storage.

2. The method of claim 1 further comprising merging the at least one hidden file with secondary data stored on the one or more secondary storage devices based at least in part on the file path stored in temporary storage.

3. The method of claim 1 further comprising automatically deleting the hidden file from primary storage after the hidden file is copied to the temporary storage.

4. The method of claim 1 further comprising automatically migrating differences between the deletion data and previously backed up data.

5. The method of claim 1 further comprising tracking the one or more data operations that result from actions of a user.

6. The method of claim 1 further comprising:

automatically receiving the time of a previous data protection operation from a storage information manager; and

automatically receiving the time of a last edit operation of the deletion data.

7. The method of claim 6 wherein the time of the last edit operation comprises a creation time when the deletion data comprises new data.

8. The method of claim 6 further comprising, when the time of a previous data protection operation is before the time of the last edit operation, automatically determining, with the driver module, that the deletion data is not protected, the deletion data comprising data created or modified since the previous data protection operation.

9. The method of claim 1 further comprising automatically receiving an indication from a storage information manager that the deletion data has not been protected.

10. The method of claim 1 further comprising automatically receiving a Universal Sequence Number (USN) from a file system change journal associated with the client computing device to determine whether the deletion data is protected.

14. The system of claim 1 wherein the one or more computer processors automatically migrate differences between the deletion data and previously backed up data.

11. A system to protect data deleted between data protection operations in an information management cell, the system comprising:

one or more computer processors comprising computer hardware that monitor data that has been protected with one or more data protection operations;

the one or more computer processors automatically monitor data operations in primary storage that occur after the one or more data protection operations;

when the one or more data protection operations is a deletion operation, the one or more computer processors automatically identifies deletion data associated with the deletion operation and a file path associated with the deletion data;

prior to performing the deletion operation, the one or more computer processors determine whether the deletion data has been protected by the one or more data protection operations, and when the deletion data has not been protected, automatically converting the deletion data to at least one hidden file;

the one or more computer processors copy the hidden file and the file path to temporary storage;

the one or more computer processors perform the deletion operation;

the one or more computer processors copy, during a subsequent data protection operation, the at least one hidden file stored in the temporary storage to a location on the secondary storage based at least in part on the file path stored in the temporary storage.

12. The system of claim 11 further comprising merging the at least one hidden file with secondary data stored on the secondary storage devices based at least in part on the file path stored in temporary storage.

13. The system of claim 11 wherein the one or more computer processors automatically delete the hidden file from primary storage after the hidden file is copied to the temporary storage.

15. The system of claim 11 wherein the one or more computer processors tracks the one or more data operations that result from actions of a user.

16. The system of claim 11 wherein the one or more computer processors automatically receive the time of a previous data protection operation from a storage information manager and automatically receive the time of a last edit operation of the deletion data.

17. The system of claim 16 wherein the time of the last edit operation comprises a creation time when the deletion data comprises new data.

18. The system of claim 16 wherein when the time of a previous data protection operation is before the time of the last edit operation, the driver module is further configured to automatically determine that the deletion data is not protected, the deletion data comprising data created or modified since the previous data protection operation.

19. The system of claim 11 wherein the one or more computer processors automatically receive an indication from a storage information manager that the deletion data has not been protected.

20. The system of claim 11 wherein the one or more computer processors automatically receive a Universal Sequence Number (USN) from a file system change journal associated with the client computing device to determine whether the deletion data is protected.