Systems and methods of unified reconstruction in storage systems

• US 9,633,064 B2
• Filed: 08/08/2014
• Issued: 04/25/2017
• Est. Priority Date: 12/19/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Gokhale, Parag
• Primary Examiner(s): Chea, Philip
• Assistant Examiner(s): Nguyen, Van Kim T
• Application Number:
  US14/455,201
• Publication Number:
  US 20150032702A1
• Time in Patent Office: 991 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

Systems and methods for reconstructing unified data in an electronic storage network are provided which may include the identification and use of metadata stored centrally within the system. The metadata may be generated by a group of storage operation cells during storage operations within the network. The unified metadata is used to reconstruct data throughout the storage operation cells that may be missing, deleted or corrupt.

Claims

1. A system for maintaining metadata in an electronic storage network comprising:

primary data stored on at least a first storage device;

at least a first and second media agents that create at least secondary copies of first and second portions of the primary data on at least a second storage device, the first media agent creates a first set of metadata that is stored in a first metadata storage device, and the second media agent creates a second set of metadata that is stored in a second metadata storage device;

a centralized metadata storage device that stores at least a copy of the first set of metadata and a copy of the second set of metadata, wherein the centralized metadata storage device is different than the first and second metadata storage devices; and

at least one storage management component that;

associates the first media agent with the copy of the first set of metadata stored in the centralized metadata storage device;

associates the second media agent with the copy of the second set of metadata stored in the centralized metadata storage device; and

reconstructs a loss of the portion of the first set of metadata on the first metadata storage device using the copy of the first set of metadata stored on the centralized metadata storage device based on the association of the copy of the first set of metadata with the first media agent.

2. The system of claim 1 wherein the copies of the first and second set of metadata stored on the centralized metadata storage device are copied to a third storage device.

3. The system of claim 1 wherein the storage management component identifies portions of metadata stored in different locations.

4. The system of claim 1 wherein the storage management component determines that at least a portion of the first set of metadata is missing.

5. The system of claim 1 wherein the storage management component analyzes a missing portion of the first set of metadata to determine whether the missing portion may be reconstructed.

6. The system of claim 5 wherein the storage management component determines whether the missing portion may be reconstructed based at least in part whether metadata associated with one or more storage operations has been identified.

7. The system of claim 1 wherein the storage management component determines that a missing portion of the first set of metadata exists in the centralized metadata storage device based on an identifier associated with the first media agent.

8. The system of claim 7 wherein the storage management component sends a reconstruction of the missing portion of the first set of metadata to the first media agent.

9. The system of claim 1 wherein the storage management component determines that a missing portion of the first set of metadata exists in the centralized metadata storage device based on an identifier associated with the first storage device.

10. The system of claim 1 wherein the storage management component reconstructs a loss of the portion of the second set of metadata on the second metadata storage device using the copy of the second set of metadata stored on the centralized metadata storage device based on the association of the copy of the second set of metadata with the second media agent.

11. A method for maintaining and restoring metadata in an electronic storage network which includes a client computer networked to at least another client computer or a server, comprising:

copying with at least first and second media agents comprising computer hardware, first and second portions of primary data stored on at least a first storage device to at least a second storage device to create at least secondary copies of the first and second portions of the primary data on the second storage device, wherein a first media agent creates a first set of metadata that is stored in a first metadata storage device, and wherein the second media agent creates a second set of metadata that is stored in a second metadata storage device;

copying the first and second sets of metadata to a centralized metadata storage device to create a copy of the first set of metadata and a copy of the second set of metadata on the centralized metadata storage device, wherein the centralized metadata storage device is different than the first and second metadata storage devices; and

associating the first media agent with the copy of the first set of metadata stored in the centralized storage device;

associating the second media agent with the copy of the second set of metadata stored in the centralized metadata storage device;

reconstructing the loss of the portion of the first set of metadata on the first metadata storage device using the copy of the first set of metadata stored on the centralized metadata storage device based on the association of the copy of the first set of metadata with the first media agent.

12. The method of claim 11 further comprising storing copies of the first and second set of metadata stored on the centralized metadata storage device are copied to a third storage device.

13. The method of claim 11 further comprising identifies portions of metadata stored in different locations.

14. The method of claim 11 further comprising determining that at least a portion of the first set of metadata is missing.

15. The method of claim 11 further comprising analyzing a missing portion of the first set of metadata to determine whether the missing portion may be reconstructed.

16. The method of claim 15 further comprising determining whether the missing portion may be reconstructed based at least in part whether metadata associated with one or more storage operations has been identified.

17. The method of claim 11 further comprising determining that a missing portion of the first set of metadata exists in the centralized metadata storage device based on an identifier associated with the first media agent.

18. The method of claim 17 further comprising sending a reconstruction of the missing portion of the first set of metadata to the first media agent.

19. The method of claim 11 further comprising reconstructing a loss of the portion of the second set of metadata on the second metadata storage device using the copy of the second set of metadata stored on the centralized metadata storage device based on the association of the copy of the second set of metadata with the second media agent.

20. The method of claim 11 further comprising determining that a missing portion of the first set of metadata exists in the centralized metadata storage device based on an identifier associated with the first storage device.