SYSTEMS AND METHODS FOR CLASSIFYING AND TRANSFERRING INFORMATION IN A STORAGE NETWORK

• US 20070198570A1
• Filed: 11/28/2006
• Published: 08/23/2007
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Ngo, David, Prahlad, Anand, Muller, Marcus, Schwartz, Jeremy
• Granted Patent: US 7,707,178 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A method of updating metadata associated with data objects, comprising:

receiving an update identifying a data object and one or more data classifications related to the data object, wherein the data classifications describe one or more storage characteristics of the data object;

searching for metadata previously associated with the object;

if previous metadata is not found, creating metadata associated with the object based on the received update and identified data classifications; and

if previous metadata is found, updating the metadata based on the received update and identified data classifications.

2. The method of claim 1 wherein the received update comprises a change journal entry.

3. The method of claim 1 wherein the received update identifies a data object that has been deleted.

4. The method of claim 1 wherein the received update identifies a data object that has been modified by a particular user.

5. The method of claim 1 wherein the received update identifies a data object that has been moved to a new location.

6. The method of claim 1 wherein the received update identifies a data object that has been copied from a first computing device to a second computing device.

7. The method of claim 1 wherein the identified data classifications specify a storage retention policy for the data object.

8. The method of claim 1 wherein the identified data classifications specify a storage aging policy for the data object.

9. The method of claim 1 wherein the identified data classifications specify an access history of the data object.

10. A system for integrating metadata with a metabase, comprising:

a metabase component that stores metadata identifying one or more data objects and one or more data classifications associated with each data object, wherein the data classifications describe one or more characteristics of the data object;

a metadata receiving component that receives metadata for integration with the metabase;

a metadata locating component for locating metadata in the metabase related to the received metadata; and

, a metadata integration component for adding the received metadata into the metabase.

11. The system of claim 10 wherein the metadata locating component locates metadata that refers to a data object referred to by the received metadata.

12. The system of claim 10 wherein the metadata locating component locates metadata associated with an identified user.

13. The system of claim 10 wherein the metadata receiving component receives metadata that identifies the location of auxiliary copies of data.

14. The system of claim 10 wherein the metadata receiving component receives notifications of storage operations performed on data objects and updates the metadata based on the received notifications.

15. The system of claim 10 wherein the metadata integration component comprises a metabase migration component for moving metadata when a copy of data associated with the metadata is made.

16. The system of claim 10 further comprising a data classification component for adding data classifications to the received metadata.

17. A computer-readable media encoded with instructions for controlling a computer system to create a copy of a metabase, by a method comprising:

receiving a storage operation containing a request to create a secondary copy of a metabase, wherein the metabase contains metadata that includes one or more data categories that classify data tracked by the metabase;

identifying a layout for the secondary copy of the metabase;

partitioning the metadata according to the identified layout; and

copying at least a portion of the metadata from a source metabase to a target location to create a secondary copy of the metabase.

18. The computer-readable media of claim 17 wherein identifying the layout comprises identifying a distribution architecture for a distributed secondary metabase.

19. The computer-readable media of claim 17 wherein partitioning the metadata comprises determining the metadata for which the secondary copy of the metabase will handle requests.

20. The computer-readable media of claim 17 wherein partitioning the metadata comprises identifying a distribution of data associated with the metadata among data storage devices associated with the secondary copy of the metabase.