Systems and methods for classifying and transferring information in a storage network

• US 8,832,406 B2
• Filed: 12/11/2013
• Issued: 09/09/2014
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Prahlad, Anand, Schwartz, Jeremy A., Ngo, David, Brockway, Brian, Muller, Marcus S.
• Primary Examiner(s): NGUYEN, HIEP T
• Application Number:
  US14/102,780
• Publication Number:
  US 20140101160A1
• Time in Patent Office: 272 Days
• Field of Search: None
• US Class Current: 711/170
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. At least one tangible computer-readable data storage storing instructions for controlling at least one data processing system to identify data files complying with a query for certain data files, comprising:

receiving a query for data files, wherein the query relates to satisfying a compliance criteria;

based on the received query, searching at least one metabase to locate metadata describing data files satisfying the compliance criteria,

wherein the metabase is a database comprising metadata associated with the data files,

wherein the metadata includes data classifications that describe characteristics of the data files, and

wherein the metadata is not stored with the data files; and

,

providing responding data, wherein the responding data relates to data files satisfying the compliance criteria based on the located metadata, and

wherein the responding data identifies both primary and secondary storage locations associated with at least some of the data files satisfying the compliance criteria.

2. The computer-readable media of claim 1 wherein the compliance criteria is a legal discovery request, wherein the data files include electronic documents, and wherein the responding data includes a report.

3. The computer-readable media of claim 1 wherein the metadata identifies an availability associated with the data files stored at each of multiple data storage locations.

4. The computer-readable media of claim 1 wherein the metadata identifies a retention policy associated with the data files.

5. The computer-readable media of claim 1 wherein the metadata identifies one or more keywords associated with the data files.

6. The computer-readable media of claim 1 wherein the metadata identifies one or more users associated with to the data files, and further comprising:

retrieving at least some of the data files satisfying the compliance criteria based on the located metadata, wherein the retrieving is associated with the secondary storage location.

7. A system for recovering data from data storage locations in an enterprise, the system comprising:

a data object identification component for receiving criteria identifying one or more data objects to recover,

wherein the data object identification component is further configured to receive terms associated with user-provided tags;

a metabase component containing classifications associated with data objects,

wherein the classifications include information associated with searching for the data objects;

a search component for identifying user-provided tags, and metadata within the metabase, that satisfies the received criteria; and

,

a data recovery component for recovering data described by both the metadata and user-provided tags identified by the search component.

8. The system of claim 7 wherein the data object identification component comprises an application selection component that receives an application selection from the user that identifies a type of data the user wants to recover.

9. The system of claim 7 wherein the data object identification component receives a selection from the user of a time range of the data objects that the criteria identifies.

10. The system of claim 7 wherein the data recovery component recovers email deleted by the user based on the received criteria.

11. The system of claim 7 wherein the metabase component comprises metadata describing objects that have been archived.

12. The system of claim 7 wherein the received criteria contains user-defined data classifications.

13. One or more tangible computer memories collectively storing a data structure for describing data stored within a data storage system, wherein the data structure facilitates retrieval data objects stored in secondary data storage devices within the data storage system, comprising:

a data identification field that distinguishes a data object from other data objects stored within the storage system;

a device field that identifies a computing device or data storage device associated with the data object;

a data classification field that specifies one or more classifications that describe the data object and a manner in which storage operations are performed on the data object; and

,

a tag field associated with a tag provided by a user for the data object;

wherein the storage system is configured to perform data storage operations using the data structure.

14. The tangible computer memories of claim 13 further comprising a data object field that contains at least some of the contents of the data object.

15. The tangible computer memories of claim 13 further comprising a reference count field that counts a number of instances of the data object stored within the storage system, and wherein data storage operations access the data at a location based on the reference count field.

16. The tangible computer memories of claim 13 further comprising a storage policy field that specifies a storage policy for the data object.

17. The tangible computer memories of claim 13 further comprising a data availability field that specifies an estimate of an amount of time required to access the data.

18. The tangible computer memories of claim 13 further comprising a hierarchy information field that describes a relationship of the data object to other data objects in a hierarchy, and wherein the hierarchy is based on a network topography.

19. The tangible computer memories of claim 13 further comprising a hierarchy information field that describes a relationship of the data object to other data objects in a hierarchy, and wherein the hierarchy is based on geographic information.

20. The tangible computer memories of claim 13 further comprising a hierarchy information field that describes a relationship of the data object to other data objects in a hierarchy.

21. The tangible computer memories of claim 13 further comprising an operation status field that describes a progress of an ongoing storage operation.