Data mining systems and methods for heterogeneous data sources

• US 9,910,738 B2
• Filed: 06/28/2016
• Issued: 03/06/2018
• Est. Priority Date: 03/31/2009
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Prahlad, Anand, Gokhale, Parag, Kottomtharayil, Rajiv, Lu, Jun, Pawar, Rahul S.
• Primary Examiner(s): Ruiz, Angelica
• Application Number:
  US15/195,710
• Publication Number:
  US 20170031773A1
• Time in Patent Office: 616 Days
• Field of Search: 707600-831, 707899, 707999001-999206
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 63/102 Entity profiles
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and methods integrate disparate backup devices with a unified interface. In certain examples, a management console manages data from various backup devices, while retaining such data in its native format. The management console can display a hierarchical view of the client devices and/or their data and can further provide utilities for processing the various data formats. A data structure including fields for storing both metadata common to the client device data and value-added metadata can be used to mine or process the data of the disparate client devices. The unified single platform and interface reduces the need for multiple data management products and/or customized data utilities for each individual client device and provides a single pane of glass view into data management operations. Integrating the various types of storage formats and media allows a user to retain existing storage infrastructures and further facilitates scaling to meet long-term management needs.

Claims

1. A method for processing data from a plurality of client devices, the method comprising:

providing a graphical user interface including on-screen graphics representing a plurality of client devices in a storage network system, wherein the plurality of client devices comprises one or more first client devices storing secondary copy data in different secondary copy formats and one or more second client devices storing primary copy data generated by one or more applications executing on the second client devices, wherein the graphical user interface is provided via a management console executing on a computing device in network communication with the client devices;

receiving a data operation request including (i) a first selection of at least one second client device of the second client devices, and (ii) a first data management operation, the first data of the at least one second client device generated by a first application of the one or more applications;

using a data connector that is in communication with the management console, obtaining the first data of the at least one second client device from storage associated with the at least one second client device, the data connector corresponding to a file format associated with the first native application;

emulating, using one or more processors and on the proxy device, the first application; and

with the emulated application, performing the first data management operation on the obtained first data.

2. The method of claim 1, wherein the first application comprises a database application.

3. The method of claim 1, wherein the first application comprises an electronic messaging application.

4. The method of claim 3, wherein the first data management operation comprises identifying a first mailbox within the first data of the at least one second client device.

5. The method of claim 1, further comprising, based on said processing, updating a catalog comprising metadata corresponding to the first data of the at least one second client device.

6. The method of claim 1, additionally comprising:

receiving a second data operation request including (i) a second selection of at least one first client device of the first client devices, and (ii) a second data management operation; and

performing the second data management operation on the backup data of the at least one first client device.

7. The method of claim 6, wherein the first and second data management operations comprise storing, respectively, the first data of the at least one second client device and the backup data of the at least one first client device in a common data format.

8. The method of claim 7, wherein the common data format comprises an archive format.

9. The method of claim 6, wherein at least one of the first and second data management operations is performed based on a migration storage policy.

10. The method of claim 9, wherein the migration storage policy evaluates a cost of storing the data on the at least one first client device and/or the at least one second client device.

11. A system for administering a storage network comprising heterogeneous client devices, the system comprising:

a plurality of first client devices configured to store backup data in different file formats;

a plurality of second client devices configured to store non-backup data in different file formats;

a proxy device comprising at least one emulated native application executing thereon;

a secondary storage device;

a management console executing on a computing device in network communication with the first and second client devices, the proxy device and the secondary storage device, wherein the management console is configured provide a single interface including on-screen graphics representing the first and second client devices,

and wherein the management console is configured to,

receive a first data operation request with respect to the non-backup data stored on at least one of the second client devices, and

copy the non-backup data of the at least one second client device to a staging location associated with the proxy device,

and wherein the proxy device is configured to process the non-backup data of the at least one second client device with the at least one emulated native application and copy the processed non-backup data to the secondary storage device.

12. The system of claim 11, wherein the management console is further configured to:

receive a second data operation request with respect to the backup data stored on at least one of the first client devices;

process the backup data of the at least one first client device; and

copy the processed backup data to the secondary storage device.

13. The system of claim 12, wherein the non-backup data of the at least one second client device and the backup data of the at least one first client device are stored on the secondary storage device in a common file.

14. The system of claim 12, wherein at least one of the first and second data operation requests is based on a storage policy to migrate data to a less expensive storage medium after a predetermined period of time.

15. The system of claim 11, further comprising:

a plurality of first data connectors in communication with the management console and corresponding to the different file formats of the backup data; and

a plurality of second data connectors in communication with the management console and corresponding to the different file formats of the non-backup data,

wherein the first and second data connectors are configured to obtain data from, respectively, the first and second client devices.

16. The system of claim 15, wherein at least one of the first data connectors is configured to obtain backup data in a first file format from multiple ones of the first client devices.

17. The system of claim 15, wherein multiple ones of the second data connectors are configured to access non-backup data on a single one of the second client devices.

18. The system of claim 11, further comprising a migration storage policy, and wherein the data operation request is based at least in part on the migration storage policy.