Systems and methods for classifying and transferring information in a storage network

• US 7,831,622 B2
• Filed: 04/27/2010
• Issued: 11/09/2010
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Schwartz, Jeremy A., Ngo, David, Prahlad, Anand, Muller, Marcus S.
• Primary Examiner(s): Woo; Isaac M
• Application Number:
  US12/767,939
• Publication Number:
  US 20100211571A1
• Time in Patent Office: 196 Days
• Field of Search: 707600-831
• US Class Current: 707/791
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A method for extending metadata related to stored data objects within a data storage management system based on user-specified classifications, the method comprising:

automatically obtaining metadata related to one or more data objects, wherein the data objects are stored within the storage management system;

automatically storing the obtained metadata in a database of metadata;

receiving a search from a user, wherein the search includes certain criteria related to the metadata;

querying the database of metadata based on the received certain criteria;

providing to the user a list of a subset of the data objects based on the query of the database of metadata;

receiving data classifications from the user for associating with the subset of data objects,

wherein the classifications are not stored at least in part with the data objects themselves; and

associating the classifications received from the user with at least some of the subset of the data objects in a searchable classification index,

wherein the received classifications categorize at least some of the data objects in the subset of the data objects within the storage management system.

2. The method of claim 1 wherein receiving the search includes receiving two or more criteria connected via Boolean connectors.

3. The method of claim 1, further comprising displaying a graphical user interface for receiving user input selecting a data object and for displaying a list of available classifications for user selection.

4. The method of claim 1 further comprising providing an interface for the user to create new classifications based on a user'"'"'s purpose for interacting with the selected data object.

5. The method of claim 1 wherein the classifications comprise classifications related to a source of the data object or classifications related to a purpose of the data object.

6. The method of claim 1 wherein the classifications comprise classifications related to intended consumers of the data object or comprise classifications related to content of the data object or to classifications related to a pattern of interaction with the data object.

7. A non-transitory computer-readable medium storing instructions that, when executed by a computer, perform a method for extending metadata related to stored data objects within a storage management system based on user-specified classifications, the method comprising:

automatically obtaining metadata related to one or more data objects, wherein the data objects are stored within the storage management system;

automatically storing the obtained metadata in a database of metadata;

receiving a search from a user, wherein the search includes certain criteria related to the metadata;

querying the database of metadata based on the certain criteria;

providing to the user a list of a subset of the data objects based on the query of the database of metadata;

receiving data classifications from the user for associating with at least some of the data objects in the subset of data objects; and

associating the classifications received from the user with at least some of the data objects in a searchable data structure,

wherein the received classifications categorize at least some of the data objects within the storage management system.

8. The computer-readable medium of claim 7 wherein receiving the search includes receiving two or more criteria connected via Boolean connectors.

9. The computer-readable medium of claim 7, further comprising displaying a graphical user interface for receiving user input selecting a data object and for displaying a list of available classifications for user selection.

10. A system for extending metadata related to stored data objects within a storage management system based on user-specified classifications, the system comprising:

a metadata storage component configured to automatically store metadata obtained from multiple data objects, wherein the data objects are stored within the storage management system;

a metadata querying component configured to query metadata related to one or more data objects,

wherein query criteria are selected by a user, and

wherein the query criteria relate to identifying a subset of the data objects stored within the storage management system;

a data classification component configured to create or receive data classifications from a user for associating with at least some of the data objects in the identified subset of the data objects stored within the storage management system; and

,

an update component configured to associate classifications, received from a user, with the identified subset of data objects, in a classification index,

wherein the received classifications categorize at least the subset of data objects within the storage management system.

11. The system of claim 10 wherein the update component stores the classifications as tags associated with the metadata, and wherein the query criteria include two or more criteria connected via Boolean connectors.

12. A non-transitory computer-readable media encoded with instructions for controlling a computer system to locate data objects within a data management system based on user-defined attributes, by a method comprising:

receiving a search query specifying one or more user-defined attributes;

locating metadata within the data management system matching the specified one or more user-defined attributes;

providing search results based on the located metadata within the data management system, wherein the search results identify a subset of the data objects stored by the data management system;

receiving one or more user-selected data classifications; and

associating the one or more user-selected data classifications with at least some of the data objects in the subset of data objects,

wherein the user-selectable data classifications are in a searchable index

wherein the user-selected data classifications classify the data object within the data management system and facilitate the manner in which a storage operation is to be performed on one or more data objects associated with the metadata.

13. The computer-readable media of claim 12 wherein receiving the search query comprises receiving two or more criteria connected via Boolean connectors.

14. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying a user responsible for at least one data object.

15. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying a group with access to at least one data object.

16. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying a purpose associated with at least one data object.

17. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying a pattern of interaction with at least one data object.

18. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying access control information associated with at least one data object.

19. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying an event associated with at least one data object.

20. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying keywords associated with at least one data object.

21. The computer-readable media of claim 12 wherein receiving one or more user-selected data classifications comprises receiving at least one user-defined attribute identifying a project associated with at least one data object.