Systems and methods for classifying and transferring information in a storage network

• US 7,937,393 B2
• Filed: 11/28/2006
• Issued: 05/03/2011
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Brockway, Brian, Schwartz, Jeremy A., Ngo, David, Prahlad, Anand, Muller, Marcus S.
• Primary Examiner(s): Trujillo; James
• Assistant Examiner(s): Moser; Bruce M
• Application Number:
  US11/564,136
• Publication Number:
  US 20070185915A1
• Time in Patent Office: 1,617 Days
• Field of Search: 707/200, 707/10, 707/2, 707/202, 707/204, 707/999.002, 707/999.01, 707/999.2, 707/999.202, 707/4, 707/705, 707/713, 707/741, 711/100, 711/161, 711/162
• US Class Current: 707/741
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/285 : Clustering or classification
• CPC Class Codes: G06F 2201/80 : Database-specific techniques
• CPC Class Codes: G06F 3/0604 : Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 : by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0649 : Lifecycle management
• CPC Class Codes: G06F 3/0685 : Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99948 : Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99955 : Archiving or backup

Abstract

Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.

Claims

1. A method for accessing data associated with a first computing device using a second computing device, comprising:

accessing data associated with a first computing device;

receiving metadata associated with the accessed data, wherein the received metadata includes metadata other than file system metadata and other than metadata identifying logical locations of the data;

storing the received metadata at a second computing device that is distinct from the first computing device;

analyzing the metadata stored at the second computing device to identify a set of the accessed data, wherein the set of the accessed data is less than the accessed data;

based on the analysis of the metadata, associating one or more data classifications with a subset of the accessed data, wherein—

the subset of accessed data is less than the set of accessed data, and

the one or more data classifications describe characteristics of the accessed data,

receiving a data management request, wherein the data management request includes one or more criteria and comprises a request to—

identify the subset of the accessed data based on the one or more data classifications, and

perform a data storage operation on the identified subset of the accessed data; and

,

performing the data storage operation requested by the data management request on the identified subset of the accessed data.

2. The method of claim 1 wherein accessing data comprises determining if a copy of the data associated with the first computing device is accessible at a computing device other than the first computing device, and when the data is accessible at a computing device other than the first computing device, accessing the data at the computing device other than the first computing device, and wherein the one or more data classifications are provided or identified by a user.

3. The method of claim 1 wherein performing the data storage operation comprises determining if a copy of the data associated with the first computing device is accessible at a computing device other than the first computing device, and when the data is accessible at a computing device other than the first computing device, performing the data storage operation on the data at the computing device other than the first computing device.

4. The method of claim 1 wherein performing the data storage operation comprises identifying characteristics of the received data including a purpose for the received data indicated by a user that created the received data.

5. The method of claim 1 wherein classifying comprises identifying characteristics of the received data including characteristics for finding the received data in response to a legal discovery request.

6. The method of claim 1 wherein associating one or more data classifications with a subset of the data comprises identifying characteristics of the received data including characteristics related to a purpose for retrieving the received data.

7. The method of claim 1 wherein the data is application-specific data, and wherein the metadata includes information identifying an application associated with the data.

8. The method of claim 1, further comprising:

accessing other data stored at other computing devices;

classifying the accessed other data;

storing the classifications of the other data at the second computing device, wherein classifications that classify data stored at multiple computing devices is centrally accessible at the second computing device; and

performing a data storage operation based on the stored classifications stored at the second computing device.

9. The method of claim 1 wherein receiving data comprises intercepting an application request to store data at the first computing device.

10. The method of claim 1 wherein receiving data associated with a first computing device comprises determining if data stored at the first computing device is available at an additional computing device, and when it is determined that the data is available at the additional computing device, accessing the data at the additional computing device without accessing the first computing device.

11. The method of claim 1 wherein the metadata stored at the second computing device contains a reference to the data stored at the first computing device.

12. A system to perform a data management operation on data stored at a first computing device using a second computing device, comprising:

a processor;

a data discovery component configured to discover data stored on the first computing device, wherein metadata is associated with the discovered data;

a data classification component configured to classify the discovered data with one or more classifications that identify characteristics of the discovered data, wherein the classification component is further configured to—

analyze the metadata to identify a set of the discovered data, wherein the set of data includes less than the discovered data;

based on the analysis of the metadata, associate one or more data classifications with a subset of the discovered data, wherein—

the subset of data includes less than the set of data, and

the metadata includes metadata other then file system metadata and other than metadata identifying logical locations of the discovered data;

a metadata storing component configured to store the metadata and the classifications on the second computing device; and

a data management operation component configured to perform a data management operation that first identifies data, and then performs an action on the identified data,

wherein the data management operation component reduces a number of accesses of the first computing device by using the classifications stored within the second computing device to identify data related to the data management operation without accessing the first computing device.

13. The system of claim 12 wherein the data management operation component performs the data management operation at a computing device other than the first computing device, and wherein the one or more classifications are user-defined classifications.

14. The system of claim 12 wherein the data discovery component discovers data by traversing a file system of the first computing device.

15. The system of claim 12 wherein the data discovery component discovers data by intercepting requests to store data at the first computing device.

16. A computer-readable storage medium encoded with instructions for accessing data stored at a first data processing system using a second data processing system, wherein the instructions when executed by a processor cause the processor to perform a method comprising:

identifying data stored on the first data processing system;

categorizing the identified data to create one or more data categorizations that specify information about the identified data for finding the data in response to a data management request, wherein the one or more data categorizations include descriptive data other than file system metadata and other than metadata identifying logical locations of the identified data,

wherein the categorizing includes—

analyzing metadata associated with the identified data to identify a set of the identified data, wherein the set of data is less than the identified data, and,

based on the analysis of the metadata, associating the one or more data categorizations with a subset of the identified data, wherein the subset of data is less than the set of data;

storing the descriptive data on the second data processing system; and

analyzing the descriptive data at the second data processing system to find data in response to a data management request, wherein an analysis regarding the data at the first data processing system is performed without accessing the data at the first data processing system.

17. The computer-readable media of claim 16 wherein the data is application-specific data, and wherein the metadata includes information identifying an application associated with the data.

18. The computer-readable media of claim 16 wherein the one or more data categorizations are user-defined categorizations.