Systems and methods for classifying and transferring information in a storage network

• US 7,831,795 B2
• Filed: 11/28/2006
• Issued: 11/09/2010
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Schwartz, Jeremy A., Ngo, David, Prahlad, Anand, Muller, Marcus S.
• Primary Examiner(s): Nguyen; Hiep T
• Application Number:
  US11/564,170
• Publication Number:
  US 20070203937A1
• Time in Patent Office: 1,442 Days
• Field of Search: None
• US Class Current: 711/170
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A method of locating data objects on which to perform a data management operation within a data storage management system, comprising:

receiving a request to perform a data management operation that includes at least one criterion for identifying data objects managed by the storage management system;

accessing a metabase containing metadata describing data objects managed by the storage management system and finding specific metadata that identifies data objects managed by the storage management system satisfying the at least one criterion;

resolving references in the specific metadata to data objects managed by the storage management system that satisfy the at least one criterion;

providing results that contain the resolved references to the data objects managed by the storage management system that satisfy the at least one criterion on which to perform the data management operation; and

wherein resolving references comprises locating data objects within an auxiliary copy and specifying a path for accessing the data objects using the auxiliary copy.

2. The method of claim 1 wherein the at least one criterion identifies like data objects based on similarities among the data objects.

3. The method of claim 1 wherein the at least one criterion identifies data objects based on the results of past searches for data objects.

4. The method of claim 1 wherein the at least one criterion identifies data objects that were previously stored within the data management system and have been deleted.

5. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects accessed by a specified user.

6. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects accessed according to a particular pattern of behavior by one or more users.

7. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects associated with a group of users.

8. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects related to users assigned to a particular project.

9. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects based on user access control information.

10. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects made unavailable by a particular user.

11. The method of claim 1 wherein the at least one criterion identifies a pattern of access of one or more data objects.

12. The method of claim 1 wherein accessing the metabase comprises locating metadata identifying a particular user.

21. The method of claim 1 wherein the at least one criterion comprises a request to identify data objects made unavailable by a particular user.

22. The method of claim 1 wherein accessing the metabase comprises locating metadata identifying a particular user.

23. The method of claim 1 wherein the at least one criterion identifies like data objects based on similarities among the data objects.

24. The method of claim 1 wherein the at least one criterion identifies a pattern of access of one or more data objects.

13. A method of locating data objects on which to perform a data management operation within a data storage management system, comprising:

receiving a request to perform a data management operation that includes at least one criterion for identifying data objects managed by the storage management system;

accessing a metabase containing metadata describing data objects managed by the storage management system and finding specific metadata that identifies data objects managed by the storage management system satisfying the at least one criterion;

resolving references in the specific metadata to data objects managed by the storage management system that satisfy the at least one criterion;

providing results that contain the resolved references to the data objects managed by the storage management system that satisfy the at least one criterion on which to perform the data management operation; and

wherein resolving references comprises removing metadata describing data objects to which a user making the request does not have access.

14. The method of claim 13 wherein the at least one criterion identifies data objects based on the results of past searches for data objects.

15. The method of claim 13 wherein the at least one criterion identifies data objects that were previously stored within the data management system and have been deleted.

16. The method of claim 13 wherein the at least one criterion comprises a request to identify data objects accessed by a specified user.

17. The method of claim 13 wherein the at least one criterion comprises a request to identify data objects accessed according to a particular pattern of behavior by one or more users.

18. The method of claim 13 wherein the at least one criterion comprises a request to identify data objects associated with a group of users.

19. The method of claim 13 wherein the at least one criterion comprises a request to identify data objects related to users assigned to a particular project.

20. The method of claim 13 wherein the at least one criterion comprises a request to identify data objects based on user access control information.

25. At least one tangible computer-readable medium storing instructions, which when executed by at least one computer, performs a method of locating data objects on which to perform a data management operation within a data storage management system, the method comprising:

receiving a request to perform a data management operation that includes at least one criterion for identifying data objects managed by the storage management system;

accessing a metabase containing metadata describing data objects managed by the storage management system and finding specific metadata that identifies data objects managed by the storage management system satisfying the at least one criterion;

resolving references in the specific metadata to data objects managed by the storage management system that satisfy the at least one criterion;

providing results that contain the resolved references to the data objects managed by the storage management system that satisfy the at least one criterion on which to perform the data management operation; and

wherein resolving references comprises locating data objects within an auxiliary copy and specifying a path for accessing the data objects using the auxiliary copy.

26. The computer-readable medium of claim 25 wherein the at least one criterion identifies data objects that were previously stored within the data management system and have been deleted.

27. The computer-readable medium of claim 25 wherein the at least one criterion comprises a request to identify data objects accessed by a specified user.

28. The computer-readable medium of claim 25 wherein the at least one criterion comprises a request to identify data objects associated with a group of users.

29. The computer-readable medium of claim 25 wherein the at least one criterion comprises a request to identify data objects based on user access control information.

30. The computer-readable medium of claim 25 wherein the at least one criterion comprises a request to identify data objects made unavailable by a particular user.

31. The computer-readable medium of claim 25 wherein the at least one criterion identifies a pattern of access of one or more data objects.

32. At least one tangible computer-readable medium storing instructions, which when executed by at least one computer, performs a method of locating data objects on which to perform a data management operation within a data storage management system, the method comprising:

receiving a request to perform a data management operation that includes at least one criterion for identifying data objects managed by the storage management system;

accessing a metabase containing metadata describing data objects managed by the storage management system and finding specific metadata that identifies data objects managed by the storage management system satisfying the at least one criterion;

resolving references in the specific metadata to data objects managed by the storage management system that satisfy the at least one criterion;

providing results that contain the resolved references to the data objects managed by the storage management system that satisfy the at least one criterion on which to perform the data management operation; and

wherein resolving references comprises removing metadata describing data objects to which a user making the request does not have access.

33. The computer-readable medium of claim 32 wherein the at least one criterion identifies data objects that were previously stored within the data management system and have been deleted.

34. The computer-readable medium of claim 32 wherein the at least one criterion comprises a request to identify data objects accessed by a specified user.

35. The computer-readable medium of claim 32 wherein the at least one criterion comprises a request to identify data objects associated with a group of users.

36. The computer-readable medium of claim 32 wherein the at least one criterion comprises a request to identify data objects based on user access control information.

37. The computer-readable medium of claim 32 wherein the at least one criterion comprises a request to identify data objects made unavailable by a particular user.

38. The computer-readable medium of claim 32 wherein the at least one criterion identifies a pattern of access of one or more data objects.