Systems and methods for classifying and transferring information in a storage network

• US 7,831,553 B2
• Filed: 01/28/2010
• Issued: 11/09/2010
• Est. Priority Date: 11/28/2005
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Schwartz, Jeremy A., Ngo, David, Prahlad, Anand, Muller, Marcus S.
• Primary Examiner(s): Cottingham; John R.
• Assistant Examiner(s): Reyes; Mariela D
• Application Number:
  US12/695,289
• Publication Number:
  US 20100131467A1
• Time in Patent Office: 285 Days
• Field of Search: 707/617, 707/618, 707/621, 707/694
• US Class Current: 707/617
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A system for integrating metadata with a metabase, wherein the system is coupled, via a network, to multiple computers, the system comprising:

a centralized metabase component that stores metadata identifying one or more data objects and one or more data classifications associated with each data object,

wherein the data classifications describe one or more characteristics of the data object, and

wherein the centralized metabase is coupled to the multiple computers via the network;

a metadata receiving component that receives, via the network, multiple metadata entries for integration with the metabase;

a metadata locating component for locating metadata in the metabase related to the received metadata; and

,

a metadata integration component for adding the received metadata into the metabase

wherein the metadata integration component is configured to;

receive one or more rules to apply to the multiple metadata entries, wherein the one or more rules provide an order of preference by which the multiple metadata entries are to be integrated into the centralized metabase;

apply the one or more rules to the multiple metadata entries after detecting that at least one of the computers has been disconnected from the network and then reconnected to the network;

based on the application of the one or more rules, determine the order of preference by which to integrate the multiple metadata entries into the centralized metabase; and

integrate the multiple metadata entries into the centralized metabase according to the determined order of preference.

2. The system of claim 1 wherein the metadata locating component locates metadata that refers to a data object referred to by the received metadata.

3. The system of claim 1 wherein the metadata locating component locates metadata associated with an identified user.

4. The system of claim 1 wherein the metadata receiving component receives metadata that identifies the location of auxiliary copies of data.

5. The system of claim 1 wherein the metadata receiving component receives notifications of storage operations performed on data objects and updates the metadata based on the received notifications.

6. The system of claim 1 wherein the metadata integration component comprises a metabase migration component for moving metadata when a copy of data associated with the metadata is made.

7. The system of claim 1, further comprising a data classification component for adding data classifications to the received metadata.

8. A computer-readable storage medium whose stored contents cause a data storage system to perform a method for updating a database, wherein the data storage system includes at least one computer and at least one data store, the method comprising:

receiving an indication of changes made to data objects contained by the data store managed by the data storage system; and

for data objects that have changed;

generating multiple classifications for the changed data objects;

determining an order of preference by which to integrate the multiple classifications into a database based on at least one rule,

wherein the database includes metadata associated with the changed data objects; and

integrating the multiple classifications into the database according to the determined order of preference,

wherein the multiple classifications are integrated into the database beginning at a first time, and

wherein the database has had been disconnected from the data store or from the computer for a period of time prior to the first time.

9. The computer-readable storage medium of claim 8, wherein the method further comprises:

storing an additional instance of the generated multiple classifications in the data store.

10. The computer-readable storage medium of claim 8, wherein integrating the multiple classifications entries into the database according to the determined order of preference includes:

searching, within the database for one or more entries previously associated with a first data object;

if one or more entries associated with the first data object are not found, then adding entries associated with the first data object to the database;

or

if one or more entries associated with the first data object are found, then updating the entries in the database to include the information identifying the first data object and one or more classifications generated for the first data object.

11. The computer-readable storage medium of claim 8, wherein the method further comprises:

identifying one or more characteristics of the changed data objects;

based upon the identified one or more characteristics, generating one or more classifications for the changed data objects; and

generating multiple metadata entries, wherein a metadata entry includes information identifying a changed data object and the one or more classifications generated for the changed data object.