Highly reusable deduplication database after disaster recovery

• US 10,339,106 B2
• Filed: 04/09/2015
• Issued: 07/02/2019
• Est. Priority Date: 04/09/2015
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Vijayan, Manoj Kumar, Haridas, Ganesh, Attarde, Deepak Raghunath
• Primary Examiner(s): Featherstone, Mark D
• Assistant Examiner(s): Forouharnejad, Faezeh
• Application Number:
  US14/682,988
• Publication Number:
  US 20160299818A1
• Time in Patent Office: 1,545 Days
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/162 Delete operations erasing in storage systems G06F3/0652
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/1752 based on file chunks
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/83 the solution involving signatures

Abstract

According to certain aspects, a method can include receiving, in response to an indication that a data storage database is being restored to a second time before a first time such that the data storage database comprises a plurality of first archive file identifiers associated at the second time, a first instruction from a data storage computer, where the first instruction instructs a media agent to stop scheduled secondary storage operations associated with a deduplication database, and where the deduplication database comprises a plurality of second archive file identifiers; determining at least one second archive file identifier in the plurality of second archive file identifiers that does not correlate with any first archive identifier in the plurality of first archive file identifiers; and, for each of the at least one second archive identifier, instructing the deduplication database to prune an entry associated with the respective second archive file identifier.

Claims

1. A networked information management system configured to verify synchronization of deduplication information, the networked information management system comprising:

a data storage database comprising a plurality of first job identifiers, wherein each first job identifier comprises a time that a respective job occurred;

a data storage computer, the data storage computer comprising computer hardware configured to receive an indication that the data storage database is being restored to an earlier version of the data storage database; and

a media agent that executes on one or more computer processors and that is configured to;

receive a first instruction from the data storage computer in response to the data storage computer receiving the indication, wherein the first instruction instructs the media agent to stop scheduled secondary storage operations associated with a deduplication database, wherein the deduplication database comprises a job identifier table which correlates deduplication information with a plurality of second job identifiers, wherein the deduplication database comprises a plurality of reference counters, each reference counter representing a number of links to a respective data block in a secondary storage system; and

for each of the second job identifiers that does not correlate with any first job identifiers in a subset of the first job identifiers, instruct the deduplication database to prune an entry in the job identifier table associated with the second job identifier and to decrement by one each of the reference counters of data blocks that are associated with the second job identifier.

2. The networked information management system of claim 1, further comprising a second media agent configured to:

receive a second instruction from the data storage computer in response to the data storage computer receiving the indication, wherein the second instruction instructs the second media agent to stop scheduled secondary storage operations associated with a second deduplication database, wherein the second deduplication database comprises a second job identifier table which correlates deduplication information with a plurality of third job identifiers, wherein the second deduplication database comprises a plurality of second reference counters, each second reference counter representing a number of links to a respective data block in the secondary storage system; and

for each of the third job identifiers that does not correlate with any of the first job identifiers in a subset of the plurality of first job identifiers, instruct the second deduplication database to prune an entry in the second job identifier table associated with the third job identifier and to decrement by one each of the second reference counters of data blocks that are associated with the third job identifier.

3. The networked information management system of claim 2, wherein the data storage computer transmits the first instruction and the second instruction at a same time.

4. The networked information management system of claim 1, wherein each second job identifier is associated with a data block stored in secondary storage.

5. The networked information management system of claim 4, wherein each data block associated with the at least one second job identifier is removed from the secondary storage.

6. A computer-implemented method for verifying synchronization of deduplication information, the computer-implemented method comprising:

receiving, in response to an indication that a data storage database is being restored to an earlier version of the data storage database, a first instruction from a data storage computer, wherein individual first job identifiers correspond with a time that a respective job occurred, wherein the first instruction instructs a media agent to stop scheduled secondary storage operations associated with a deduplication database, wherein the deduplication database comprises a job identifier table which correlates deduplication information with a plurality of second job identifiers, wherein the deduplication database comprises a plurality of reference counters, each reference counter representing a number of links to a respective data block in a secondary storage system; and

for each of the second job identifiers that does not correlate with any first job identifiers in a subset of the first job identifiers, instructing the deduplication database to prune an entry in the job identifier table associated with the second job identifier and to decrement by one each of the reference counters of data blocks that are associated with the second job identifier.

7. The computer-implemented method of claim 6, wherein each second job identifier is associated with a data block stored in secondary storage.

8. The computer-implemented method of claim 7, wherein each data block associated with the at least one second job identifier is removed from the secondary storage.

9. A networked information management system configured to verify synchronization of deduplication information, the networked information management system comprising:

a storage manager database comprising a plurality of first job identifiers, wherein each first job identifier corresponds to a respective job;

a storage manager, the storage manager comprising computer hardware configured to receive an indication that the storage manager database is being restored to an earlier version of the storage manager database; and

a deduplication database media agent comprising an electronically stored deduplication database and computer hardware configured to;

receive a first instruction from the storage manager in response to the storage manager receiving the indication, wherein the first instruction instructs the deduplication database media agent to stop scheduled secondary storage operations associated with the deduplication database, wherein the deduplication database comprises a job identifier table which correlates deduplication information with a plurality of second job identifiers, the deduplication database comprises a plurality of reference counters, each reference counter representing a number of links to a respective data block in a secondary storage system; and

for each of the second job identifiers that does not correlate with any first job identifiers in a subset of the plurality of first job identifiers, instruct the deduplication database to prune an entry in the job identifier table associated with that second job identifier and to decrement by one each of the reference counters of the data blocks that are associated with that second job identifier.

10. The networked information management system of claim 9, wherein the deduplication database media agent is further configured to determine at least one second job identifier that does not match any first job identifiers in the plurality of first job identifiers.

11. The networked information management system of claim 9, further comprising a second deduplication database media agent comprising an electronically stored second deduplication database and computer hardware configured to:

receive a second instruction from the storage manager in response to the storage manager receiving the indication, wherein the second instruction instructs the second deduplication database media agent to stop scheduled secondary storage operations associated with a second deduplication database, wherein the second deduplication database comprises a second job identifier table which correlates deduplication information with a plurality of third job identifiers, the second deduplication database comprises a plurality of second reference counters, each second reference counter representing a number of links to a respective data block in the secondary storage system; and

for each of the third job identifiers that does not correlate with any first job identifiers in a subset of the plurality of first job identifiers, instruct the second deduplication database to prune an entry in the second job identifier table associated with that third job identifier and to decrement by one each of the second reference counters of the data blocks that are associated with that third job identifier.

12. The networked information management system of claim 11, wherein the storage manager transmits the first instruction and the second instruction at a same time.