Systems and methods for classifying and transferring information in a storage network

• US 8,010,769 B2
• Filed: 11/04/2010
• Issued: 08/30/2011
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Schwartz, Jeremy A., Ngo, David, Prahlad, Anand, Muller, Marcus S.
• Primary Examiner(s): NGUYEN, HIEP T
• Application Number:
  US12/939,244
• Publication Number:
  US 20110047180A1
• Time in Patent Office: 299 Days
• Field of Search: None
• US Class Current: 711/170
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A computer-readable media encoded with instructions for controlling a data storage system to perform data management operations, by a method comprising:

receiving a request to perform a data management operation specifying a time-based criteria;

searching a metabase containing metadata that describes data objects managed by the data storage system to identify metadata satisfying the time-based criteria,

wherein the metadata contains at least categories associated with the data objects that relate to the manner in which storage operations are performed on the data objects;

determining data objects managed by the data storage system that are associated with the identified metadata;

receiving a tag or keyword from a user;

determining a subset of the determining data objects that are associated with the identified metadata; and

accessing at least one data object in the subset of the determined data objects that are associated with the identified metadata to perform the requested data management operation.

2. The computer-readable media of claim 1 wherein the received request comprises locating data objects accessed during a specified time range.

3. The computer-readable media of claim 1 wherein the received request comprises locating data objects changed at a particular frequency.

4. The computer-readable media of claim 1 wherein the received request comprises locating data objects accessed by a particular user after a specified time.

5. The computer-readable media of claim 1 wherein the received request comprises a request to access data containing one or more keywords.

6. The computer-readable media of claim 1 wherein the received request comprises a request to create a copy of data according to a specified schedule.

7. The computer-readable media of claim 1 wherein the received request comprises a request to locate and restore based on a restoration criterion.

8. The computer-readable media of claim 1 wherein the received request comprises a request to locate data having a user-specified data classification.

9. The computer-readable media of claim 1 further comprising:

storing a data object in primary storage;

copying the data object to secondary storage; and

restoring the data object from secondary storage to primary storage based on classifications associated with the data object.

10. The computer-readable media of claim 1, further comprising copying data in the metabase to another metabase that differs from the metabase.

11. The computer-readable media of claim 1 wherein the metabase includes one or more data classifications, wherein the classifications describe at least some characteristics of the data objects not stored with the data objects themselves.

12. The computer-readable media of claim 1 wherein the metabase identifies one or more logical locations of the data objects based on the searching.

13. In a data storage network, a system for storing information related to data accessible within a data storage network, comprising:

a means for identifying data within the data storage network managed by a data management system;

a means for obtaining time-based information about the data within the data storage network;

a means for creating metadata that describes the data within the data storage network and that contains the obtained time-based information;

a means for storing the created metadata;

a means for identifying a set of data objects selected from the data within the data storage network,

wherein the set of data objects are selected based on identified metadata, and

wherein the identified metadata represents a query of the created metadata;

a means for receiving a tag or keyword from a user;

a means for determining a subset of the set of data objects; and

a means for accessing at least one data object in the subset of the set of data objects to perform one or more requested data storage operations; and

,

a means for performing the one or more requested data storage operations on the at least one data object in the subset of data objects within the data storage network.

14. The system of claim 13 wherein the means for identifying data comprises a means for intercepting requests to store data.

15. The system of claim 13 wherein the means for obtaining time-based information comprises a means for obtaining a manner in which the identified data was created.

16. The system of claim 13 wherein the means for obtaining time-based information obtains a pattern of modification of the data.

17. The system of claim 13 wherein the means for obtaining time-based information comprises a means for obtaining a time that a particular user last accessed the data.

18. The system of claim 13 wherein the means for obtaining time-based information comprises a means for obtaining a time that a particular storage operation was last performed on the data.

19. The system of claim 13 wherein the means for obtaining time-based information comprises a means for obtaining a time the data was deleted.

20. The system of claim 13 wherein the means for obtaining time-based information comprises a means for obtaining a schedule for accessing the data.

21. A method of perform data management operations, the method comprising:

receiving a request to perform a data management operation specifying a time-based criteria;

searching a metabase containing metadata that describes data objects managed by the data storage system to identify metadata satisfying the time-based criteria,

wherein the metadata contains at least one category associated with the data objects that relate to the manner in which storage operations are performed on the data objects;

determining data objects managed by the data storage system that are associated with the identified metadata;

receiving a tag or keyword from a user;

determining a subset of the determining data objects that are associated with the identified metadata; and

accessing at least one data object in the subset of the determined data objects that are associated with the identified metadata to perform the requested data management operation.

22. The method of claim 21 wherein the received request comprises locating data objects accessed during a specified time range.

23. The method of claim 21 wherein the received request comprises locating data objects changed at a particular frequency.

24. The method of claim 21 wherein the received request comprises locating data objects accessed by a particular user after a specified time.

25. The method of claim 21 wherein the received request comprises a request to access data containing one or more keywords.

26. The method of claim 21 wherein the received request comprises a request to create a copy of data according to a specified schedule.

27. The method of claim 21 wherein the received request comprises a request to locate and restore based on a restoration criterion.

28. The method of claim 21 wherein the received request comprises a request to locate data having a user-specified data classification.

29. The method of claim 21 further comprising:

storing a data object in primary storage;

copying the data object to secondary storage; and

restoring the data object from secondary storage to primary storage based on classifications associated with the data object.

30. The method of claim 21, further comprising copying data in the metabase to another metabase that differs from the metabase.

31. The method of claim 21 wherein the metabase includes one or more data classifications, wherein the classifications describe at least some characteristics of the data objects not stored with the data objects themselves.

32. The method of claim 21 wherein the metabase identifies one or more logical locations of the data objects based on the searching.

33. A system for perform data management operations, the system comprising:

means for receiving a request to perform a data management operation specifying a time-based criteria;

means for searching a metabase containing metadata,

wherein the metadata describes data objects managed by the data storage system to identify metadata satisfying the time-based criteria, and

wherein the metadata contains at least one category associated with the data objects that relate to the manner in which storage operations are performed on the data objects;

means for determining data objects managed by the data storage system that are associated with the identified metadata;

means for receiving a tag or keyword from a user;

means for determining a subset of the determining data objects that are associated with the identified metadata; and

means for accessing at least one data object in the subset of the determined data objects that are associated with the identified metadata to perform the requested data management operation.

34. The system of claim 33 wherein the received request comprises locating data objects accessed during a specified time range.

35. The system of claim 33 wherein the received request comprises locating data objects changed at a particular frequency.

36. The system of claim 33 wherein the received request comprises locating data objects accessed by a particular user after a specified time.

37. The system of claim 33 wherein the received request comprises a request to access data containing one or more keywords.

38. The system of claim 33 wherein the received request comprises a request to create a copy of data according to a specified schedule.

39. The system of claim 33 wherein the received request comprises a request to locate and restore based on a restoration criterion.

40. The system of claim 33 wherein the received request comprises a request to locate data having a user-specified data classification.

41. The system of claim 33 further comprising:

means for storing a data object in primary storage;

means for copying the data object to secondary storage; and

means for restoring the data object from secondary storage to primary storage based on classifications associated with the data object.

42. The system of claim 33, further comprising means for copying data in the metabase to another metabase that differs from the metabase.

43. The system of claim 33 wherein the metabase includes one or more data classifications, wherein the classifications describe at least some characteristics of the data objects not stored with the data objects themselves.

44. The system of claim 33 wherein the metabase identifies one or more logical locations of the data objects based on the searching.