SYSTEMS AND METHODS OF HIERARCHICAL STORAGE MANAGEMENT, SUCH AS GLOBAL MANAGEMENT OF STORAGE OPERATIONS

• US 20110213755A1
• Filed: 03/16/2011
• Published: 09/01/2011
• Est. Priority Date: 12/22/2006
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kottomtharayil, Rajiv, Kavuri, Srinivas
• Granted Patent: US 8,832,031 B2
• Time in Patent Office: Days
• US Class Current: 707/654
• CPC Class Codes: G06F 16/10 File systems; File servers

Abstract

A system and method for setting global actions in a data storage system is described. In some examples, the system determines a policy based on information from the system, and implements that policy to the system. In some examples, the system adds or modifies global filters based on information from the system.

Claims

1. A system for performing data storage operations that transfer data from a source to a destination, the system comprising:

a server coupled to two or more storage cells actively transferring data from the source to the destination, wherein the server comprises a processor, and

wherein each of the two or more storage cells comprises;

a secondary storage database configured to store secondary copies of data generated by a data storage operation;

a media agent configured to convey data produced at a client computer in order to create a secondary copy of data during a data storage operation;

a storage manager configured to control the media agent during a data storage operation, wherein the storage manager controls the media agent in accordance with a filter or rule applicable to the storage cell; and

,

wherein the server;

generates a report related to performance of data storage operations within the two or more storage cells,

performs a quantitative comparison of performances between the two or more storage cells; and

determines a filter or rule, wherein the filter or rule modifies active transfer of data from the source to the destination based in part on the filter or rule.

2. The system of claim 1, wherein the report comprises results of a quantitative comparison of job usage between the two or more storage cells.

3. The system of claim 1, wherein the report comprises results of a quantitative comparison of job delay between the two or more storage cells.

4. The system of claim 1, wherein the quantitative comparison compares a mean or peak waiting time for a job at a storage resource to an average service time.

5. The system of claim 1, wherein the quantitative comparison compares the arrival and queuing of jobs at different storage resources and wherein the arrival and queuing is modeled using an M/M/1 model.

6. The system of claim 1, wherein the quantitative comparison of performances between the two or more storage cells compares a number of jobs at each storage cell with a number of storage cells.

7. A system for defining a filter policy for performing data storage operations in a data storage system, the system comprising:

a first storage cell;

a second storage cell, different from the first storage cell but connected to the first storage cell,

wherein first and second storage cells each comprise a secondary storage database configured to store secondary copies of data under a data storage operation;

a media agent configured to relay data produced at a client computer in order to create a secondary copy of data under a data storage operation;

a storage manager configured to control the media agent, wherein the storage manager controls the media agent in accordance with a filter or rule for the first or second storage cell; and

,

a server configured to;

generate a report of a performance of data storage operations of the first and second cells,

perform a quantitative comparison to filters or rules based at least in part on the report, and

modify active transfer of data from client computers to the first and second storage cells.

8. The system of claim 7, wherein the server is further configured to assign a global filter policy that applies to all storage cells within the data storage system.

9. The system of claim 7, wherein the server is further configured to assign a first filter policy that applies to the first storage cell and assigning a second filter policy at least partially different than the first filter policy to the second storage cell.

10. The system of claim 7, further comprising:

an interface component, wherein the interface component presents an assigned filter policy to an administrator of the hierarchical data storage system.

11. A method for performing data storage operations that transfer data from a source to a destination, the method comprising:

generating a report related to performance of data storage operations within two or more storage cells,

wherein each of the two or more storage cells comprises;

a secondary storage database configured to store secondary copies of data generated by a data storage operation, and

a media agent configured to convey data produced at a client computer in order to create a secondary copy of data during a data storage operation;

performing a quantitative comparison of performances between the two or more storage cells; and

determining a filter or rule, wherein the filter or rule modifies active transfer of data from client computers to at least one of the two or more storage cells based in part on the assigned filter or rule; and

,

wherein a storage manager controls the media agent during a data storage operation, wherein the storage manager controls the media agent in accordance with the filter or rule for to the storage cell.

12. The method of claim 11, wherein the report comprises results of a quantitative comparison of job usage between the two or more storage cells.

13. The method of claim 11, wherein the report comprises results of a quantitative comparison of job delay between the two or more storage cells.

14. The method of claim 11, wherein the quantitative comparison compares a mean or peak waiting time for a job at a storage resource to an average service time.

15. The method of claim 11, wherein the quantitative comparison compares the arrival and queuing of jobs at different storage resources and wherein the arrival and queuing is modeled using an M/M/1 model.

16. The method of claim 11, wherein the quantitative comparison of performances between the two or more storage cells compares a number of jobs at each storage cell with a number of storage cells.

17. A system for adjusting the transfer of data from a source to a destination, the system comprising:

a server connected to two or more storage modules actively transferring data under a first storage policy, wherein the server;

generates a report related to a quantitative comparison between two or more storage modules,

wherein the quantitative comparison reflects an excess number of storage jobs waiting for a resource, and

utilizes the report to identify a redistribution of active transfer of data across resources of the two or more storage modules,

a data transfer module modification component configured to modify the active transfer so that the transfer no longer performs under the first storage policy but instead performs under the identified redistribution.

wherein the storage policy defines at least two of the following;

when to perform storage operations,

how often to perform storage operations,

a storage location to use during a storage operation,

a relationship between components to use during a storage operation,

accessible datapipes usable during storage operation,

storage retention schemes,

compression or encryption requirements, and

a network pathway to use for a storage operation.

18. The system of claim 17, wherein the report comprises results of a quantitative comparison of job usage between the two or more storage modules.

19. The system of claim 17, wherein the report comprises results of a quantitative comparison of job delay between the two or more storage modules.

20. The system of claim 17, wherein the quantitative comparison relates to queuing theory.

21. The system of claim 17, wherein the quantitative comparison relates to a M/M/1 model of queuing theory.

22. The system of claim 17, wherein the quantitative comparison includes comparing a number of jobs at each storage module with a number of storage modules.