Data mining systems and methods for heterogeneous data sources

• US 10,725,868 B2
• Filed: 01/25/2018
• Issued: 07/28/2020
• Est. Priority Date: 03/31/2009
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Prahlad, Anand, Gokhale, Parag, Kottomtharayil, Rajiv, Lu, Jun, Pawar, Rahul S.
• Primary Examiner(s): Ruiz, Angelica
• Application Number:
  US15/879,847
• Publication Number:
  US 20180217900A1
• Time in Patent Office: 915 Days
• Field of Search: 707600-831, 707899, 707999001-999206
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: H04L 63/102 Entity profiles
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and methods integrate disparate backup devices with a unified interface. In certain examples, a management console manages data from various backup devices, while retaining such data in its native format. The management console can display a hierarchical view of the client devices and/or their data and can further provide utilities for processing the various data formats. A data structure including fields for storing both metadata common to the client device data and value-added metadata can be used to mine or process the data of the disparate client devices. The unified single platform and interface reduces the need for multiple data management products and/or customized data utilities for each individual client device and provides a single pane of glass view into data management operations. Integrating the various types of storage formats and media allows a user to retain existing storage infrastructures and further facilitates scaling to meet long-term management needs.

Claims

1. A method for administering a storage network comprising heterogeneous client devices, the method comprising:

with a first data connector executing in a first computing device, discovering first data associated with a first client device, wherein the first data is generated by a first data backup application;

processing the first data to generate first processed data;

with a second data connector executing in a second computing device, discovering second data associated with a second client device, wherein the second data is generated by a second data backup application different than the first data backup application, wherein the first data is stored in a first format and the second data is stored in a second format different than the first format;

processing the second data to generate second processed data; and

with a management console executing in computer hardware, using at least the first and second processed data to generate data for generating a graphical user interface for display, the graphical user interface including a representation of the first and second client devices.

2. The method of claim 1, wherein the first computing device is a first host computing device and the first client device is a virtual machine executing on the first computing device, and the second computing device is a second host computing device and the second client device is a virtual machine executing on the second computing device.

3. The method of claim 1, wherein the first and second data is stored in cloud storage.

4. The method of claim 1, wherein the graphical user interface depicts a physical configuration of the first and second client devices.

5. The method of claim 1, further comprising:

with a third data connector executing in a third computing device, discovering database data associated with a third client device;

processing the database data; and

wherein said using comprises using the first processed data, second processed data, and processed database data to generate data for generating a graphical user interface for display, the graphical user interface including a representation of the first, second, and third client devices.

6. The method of claim 5, wherein the database data is in a third format associated with a database application used to generate the database data.

7. The method of claim 6, wherein said processing the database data comprises breaking the database data into individual database elements.

8. The method of claim 1, wherein the graphical user interface further includes a representation of a logical configuration of the first and second client devices.

9. The method of claim 1, wherein said discovering first data comprises accessing metadata associated with the first client device.

10. The method of claim 9, wherein said accessing metadata comprises accessing one or more logs associated with the first client device.

11. A system for administering a storage network comprising heterogeneous client devices, the method comprising:

a first computing device comprising computer hardware;

a second computing device comprising computer hardware;

a first data connector executing in the first computing device, associated with a first client device, and configured to discover first data associated with the first client device;

a second data connector executing in the second computing device, associated with a second client device, and configured to discover second data associated with the second client device, the first data stored in a first backup format and the second data stored in a second backup format different than the first backup format; and

a management console executing in a third computing device in communication with the first and second computing devices, the management console configured to, based at least on the first and second data, generate a graphical user interface for display, the graphical user interface including a representation of the first and second client devices.

12. The system of claim 11, wherein the first computing device is a first host computing device and the first client device is a virtual machine executing on the first computing device, and the second host computing device is a second computing device and the second client device is a virtual machine executing on the second computing device.

13. The system of claim 11, wherein the first and second data is stored in cloud storage.

14. The system of claim 11, wherein the user interface depicts a physical configuration of the first and second client devices.

15. The system of claim 11, further comprising:

a third data connector executing in computer hardware and configured to discover database data associated with a third client device;

wherein the management console is configured, based on the first data, the second data, and the database data, to generate a graphical user interface for display, the graphical user interface including a representation of the first, second, and third client devices.

16. The system of claim 15, wherein the database data is stored in a format associated with a database application used to generate the database data.

17. The system of claim 11, wherein the user interface depicts a logical configuration of the first and second client devices.

18. The system of claim 11, wherein the first data connector is configured to access metadata associated with the first client device as part of the discovery of the first data.

19. The system of claim 18, wherein the first data connector is configured to access one or more logs associated with the first client device including the metadata associated with the first client device.