Systems and methods for performance monitoring

• US 10,379,988 B2
• Filed: 12/16/2013
• Issued: 08/13/2019
• Est. Priority Date: 12/21/2012
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kochunni, Jaidev Oppath, Kottomtharayil, Rajiv, Vijayan, Manoj Kumar
• Primary Examiner(s): Gebresilassie, Kibrom K
• Application Number:
  US14/107,102
• Publication Number:
  US 20140180664A1
• Time in Patent Office: 2,066 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/2056 by mirroring
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3442 for planning or managing the needed capacity
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 11/3457 Performance evaluation by simulation
• CPC Class Codes: G06F 11/3461 Trace driven simulation
• CPC Class Codes: G06F 11/3485 for I/O devices
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

Data storage systems monitor the performance of data storage operations on a granular level and compile the information for presenting to a user. The system measures the time of execution for individual granular stages of the storage operation and in response to the monitoring results, automatically adjust parameters to optimize performance. Further, the system performs a performance test by simulating the data storage operation, but may not actually write the data to the secondary storage medium.

Claims

1. A method to monitor performance of steps of a data storage operation in a data management system, the method comprising:

receiving, with at least one computing device comprising computer hardware, an instruction to simulate a data backup operation on a data set, the data backup operation comprising a plurality of steps including at least a scan step, a setup pipeline step, a send step, and a write step, wherein each of the scan step, the setup pipeline step, the send step, and the write step has at least one adjustable parameter;

for each of the scan step, the setup pipeline step, the send step, and the write step;

executing a plurality of iterative simulations with the computer hardware, adjusting the at least one adjustable parameter in each iterative simulation of the plurality of iterative simulations, and measuring the execution times of the plurality of iterative simulations;

wherein adjusting the at least one adjustable parameter is based at least in part on an execution time of a previous iterative simulation;

storing the execution times of the plurality of iterative simulations in a storage management database;

comparing, with the computer hardware, the execution times of the plurality of iterative simulations stored in the storage management database to determine a minimum execution time of the execution times; and

identifying, with the computer hardware, at least one adjusted parameter associated with the minimum execution time to provide identified parameters; and

saving, with the computer hardware, the identified parameters associated with each of the scan step, the setup pipeline step, the send step, and the write step as default parameters for the data backup operation.

2. The method of claim 1 wherein the default parameters minimize an overall execution time of the data backup operation.

3. The method of claim 1 wherein the default parameters are saved for later performance of a non-simulated data backup operation.

4. The method of claim 1 further comprising displaying, with the computer hardware, the execution times on a graphical user interface (GUI).

5. The method of claim 1 wherein the data backup operation comprises one or more of a full backup operation, a differential backup operation, an incremental backup operation, and a mirror backup operation.

6. The method of claim 1 wherein the data set comprises one or more of files, volumes, databases, and sub-clients.

7. The method of claim 1 wherein the setup pipeline step comprises setting up a pipeline and wherein the send step comprises sending the at least a portion of the data set through the pipeline to form the simulated backup data.

8. A system to monitor performance of steps of a data storage operation in a data management system, the system comprising:

a first computing device comprising computer hardware configured to receive an instruction to simulate a data backup operation on a data set, the data backup operation comprising a plurality of steps including at least a scan step, a setup pipeline step, a send step, and a write step, wherein each of the scan step, the setup pipeline step, the send step, and the write step has at least one adjustable parameter;

for each of the scan step, the setup pipeline step, the send step, and the write step;

the computer hardware configured to execute a plurality of iterative simulations,

the first computing device configured to adjust the at least one adjustable parameter in each iterative simulation of the plurality of iterative simulations, and measure execution times of plurality of iterative simulations;

the first computing device further configured to adjust the at least one adjustable parameter based at least in part on an execution time of a previous iterative simulation;

the first computing device further configured to store the execution times of the plurality of iterative simulations in the a storage management database;

the first computing device further configured to compare the execution times of the plurality of iterative simulations stored in the storage management database to determine a minimum execution time of the execution times; and

the first computing device further configured to identify at least one adjusted parameter associated with the minimum execution time to provide identified parameters; and

the first computing device further configured to save the identified parameters associated with each of the scan step, the setup pipeline step, the send step, and the write step as default parameters for the data backup operation.

9. The system of claim 8 wherein the default parameters minimize an overall execution time of the data backup operation.

10. The system of claim 8 wherein the default parameters are saved for later performance of a non-simulated data backup operation.

11. The system of claim 8 wherein the first computing device is further configured to display the execution times on a graphical user interface (GUI).

12. The system of claim 8 wherein the data backup operation comprises one or more of a full backup operation, a differential backup operation, an incremental backup operation, and a mirror backup operation.

13. The system of claim 8 wherein the data set comprises one or more of files, volumes, databases, and sub-clients.

14. The system of claim 8 wherein the setup pipeline step comprises setting up a pipeline and wherein the send step comprises sending the at least a portion of the data set through the pipeline to form the simulated backup data.