System and method for providing redundant access to metadata over a network

• US 7,725,671 B2
• Filed: 11/28/2006
• Issued: 05/25/2010
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Schwartz, Jeremy A., Ngo, David, Prahlad, Anand, Muller, Marcus S.
• Primary Examiner(s): Nguyen; Hiep T
• Application Number:
  US11/564,194
• Publication Number:
  US 20070198601A1
• Time in Patent Office: 1,274 Days
• Field of Search: None
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A method of distributing metadata throughout a network, comprising:

receiving an indication to perform a copy operation on one or more data objects;

analyzing a first metabase to identify data objects in a first data store associated with the first metabase that satisfy a selection criteria;

copying the identified data objects from the first data store to a second data store; and

copying metadata associated with the identified data objects from the first metabase to a second metabase, wherein the second metabase is associated with the second data store.

2. The method of claim 1 further comprising, after copying the identified data objects, updating the first metabase with information describing the copied data objects.

3. The method of claim 1 wherein the selection criteria is based on a type of the identified data objects.

4. The method of claim 1 wherein the selection criteria is based on a source of the identified data objects.

5. The method of claim 1 wherein the selection criteria is based on a topology of the network.

6. The method of claim 1 wherein the selection criteria is based on information within the metadata.

7. The method of claim 1 wherein sending the selection criteria is based on a migration policy.

8. The method of claim 1 wherein the first data store and first metabase are associated with a first computing device and the second data store and second metabase are associated with a second computing device.

9. The method of claim 1 wherein a computing device accesses data at the second data store when the first data store is unavailable.

10. The method of claim 1 wherein copying metadata includes adding one or more data classifications describing an availability of the copied data at the first data store and the second data store.

11. The method of claim 1 wherein copying metadata includes adding one or more data classifications describing the copy operation.

12. A system of distributing metadata throughout a network, comprising:

a primary data store that contains a production copy of stored data;

a primary metabase component that stores metadata associated with the primary data store, wherein the metadata contains information about data stored at the primary data store and describes characteristics of the data that are not stored with the data;

a secondary data store that contains one or more secondary copies of the data;

a secondary metabase that stores metadata associated with the secondary data store; and

a data management operation component that performs data management operations on the stored data and uses the primary and secondary metabases to facilitate performing data management operations.

13. The system of claim 12 further comprising a metadata migration component that migrates metadata from the primary metabase to the secondary metabase when data is copied from the primary data store to the secondary data store.

14. The system of claim 12 further comprising a data restoration component that copies a subset of the stored data from the secondary data store to the primary data store upon the occurence of an event, wherein the subset of the stored data is determined using the metadata stored at the primary and secondary metabases.

15. A computer-readable medium encoded with instructions, which when executed by a computer system, perform a method of moving data objects from a primary data store to a secondary data store, the method comprising:

analyzing a primary metabase to determine data objects stored within a primary data store satisfying a data object query;

identifying a secondary data store based on metadata stored within a secondary metabase to receive the determined data objects;

copying the data objects from the primary data store to the secondary data store; and

updating the secondary metabase with information describing the copied data objects.

16. The computer-readable medium of claim 15, wherein the method further comprises, after copying the data objects from the primary data store, deleting the data objects from the primary data store.

17. The computer-readable medium of claim 15, wherein the method further comprises, after copying the data objects from the primary data store, deleting metadata describing the data objects from the primary metabase.

18. The computer-readable medium of claim 15, wherein the method further comprises, after copying the data objects from the primary data store, updating the primary metabase with information describing the copied data objects.

19. A system for providing redundant access to metadata over a network, comprising:

a means for storing at a centralized primary storage metabase, metadata that contains information about data stored at a computing device and describes characteristics of the data that are not stored with the data;

a means for selecting one of multiple distributed secondary storage metabases to store a copy of at least some of the metadata stored at the centralized primary storage metabase; and

a means for storing metadata at the selected one of multiple distributed secondary storage metabases via the network.

20. The system of claim 19 further comprising a means for determining which of the centralized primary storage metabases and the one of multiple distributed secondary storage metabases to use to access the metadata.