Systems and methods for granular resource management in a storage network

• US 8,572,330 B2
• Filed: 12/15/2006
• Issued: 10/29/2013
• Est. Priority Date: 12/19/2005
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kottomtharayil, Rajiv, Gokhale, Parag, Muller, Marcus
• Primary Examiner(s): TSAI, SHENG JEN
• Application Number:
  US11/640,144
• Publication Number:
  US 20070198722A1
• Time in Patent Office: 2,510 Days
• Field of Search: 711/154
• US Class Current: 711/154
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

In accordance with some aspects of the present invention, systems and methods are provided for dynamically and/or automatically selecting and/or modifying data path definitions that are used in performing storage operations on data. Alternate data paths may be specified or selected that use some or all resources that communicate with a particular destination to improve system reliability and performance. The system may also dynamically monitor and choose data path definitions to optimize system performance, conserve storage media and promote balanced load distribution.

Claims

1. A method for routing data to a plurality of storage operation paths in a data storage system, the method comprising:

accessing a first storage policy comprising at least a first storage operation path that associates at least a first media agent with a first storage device in a first static relationship, wherein the first media agent conducts data to the first storage device via the first storage operation path, and

wherein the first storage policy further comprises a second operation path that associates a second media agent with the first storage device in a second static relationship, wherein the second operation path is an alternate to the first storage operation path, and wherein the second media agent conducts data to the first storage device via the second storage operation path;

accessing a second storage policy comprising at least a third storage operation path that associates a third media agent with the first storage device in a third static relationship, wherein the third media agent conducts data to the first storage device via the third storage operation path, and

wherein the second storage policy further comprises a fourth operation path that associates a fourth media agent with the first storage device in a fourth static relationship, wherein the fourth operation path is an alternate to the third storage operation path, wherein the fourth media agent conducts data to the first storage device via the fourth storage operation path;

automatically evaluating with one or more computer hardware processors, the first and second storage polices and the first, second, third and fourth static relationships to determine that the first and second storage polices have the first storage device in common;

automatically reducing with one or more computer hardware processors, the number of storage policies by combining the first and second storage policies to create a third storage policy, wherein the third storage policy comprises at least the first, second, third, and fourth storage paths to the first storage device in a dynamic relationship wherein subsets of one or more of the first, second, third, and fourth storage operation paths are selectable;

evaluating network operation; and

automatically selecting with one or more computer hardware processors, a subset of the first, second, third and fourth storage operation paths in the third storage policy to conduct data to the first storage device based on network operating conditions, wherein the selected subset of the first, second, third and fourth media agents performs data transmission operations that conduct data to the first storage device based on the network operation conditions; and

dynamically allocating with one or more computer hardware processors, the data transmission operations among the selected subset of the first, second, third and fourth media agents to balance data loads on the first, second, third, and fourth media agents.

2. The method of claim 1 wherein the network operating conditions include anyone of the following characteristics:

data transfer rate, load balancing, resource exhaustion, transmission congestion, or performance optimization.

3. The method of claim 1 wherein the step of selecting at least one of the plurality of storage operation paths is substantially dynamic.

4. The method of claim 3 wherein the substantially dynamic selection comprises analyzing and automatically selecting the at least one of the plurality of storage operation paths with a management module.

5. The method of claim 1 wherein the step of selecting at least one of the plurality of storage operation paths is based on user preference.

6. A storage operation system comprising:

a management component executing in one or more computer hardware processors, the management component configured to initiate a storage operation to a destination;

an index cache in communication with the management component, the index cache comprising a plurality of table entries that store a plurality of storage policies;

a plurality of storage devices;

a first media agent executing in one or more computer hardware processors, the first media agent configured to manage the flow of data to at least a first storage device based on a first storage policy, wherein the first storage policy defines a first storage operation path that associates the first media agent and the first storage device in a first static relationship;

a second media agent executing in one or more computer hardware processors, the second media agent configured to manage the flow of data to the first storage device based on the first storage policy, wherein the first storage policy defines a second storage operation path that associates the second media agent and the first storage device in a second static relationship;

a third media agent executing in one or more computer hardware processors, the third media agent configured to manage the flow of data to at least the first storage device based on a second storage policy, wherein the second storage policy defines a third storage operation path that associates the third media agent and the first storage device in a third static relationship;

a fourth media agent executing in one or more computer hardware processors, the fourth media agent configured to manage the flow of data to the first storage device based on the second storage policy, wherein the second storage policy defines a fourth storage operation path that associates the fourth media agent and the first storage device in a fourth static relationship;

wherein the management component automatically evaluates the first and second storage policies and the first, second, third, and fourth static relationships to determine that the first and second storage polices have the first storage device in common;

wherein the management component automatically reduces the number of storage policies by combining the first and second storage policies to create a third storage policy, wherein the third storage policy comprises at least the first, second, third and fourth storage paths to the first storage device in a dynamic relationship wherein subsets of one or more of the first, second, third, and fourth storage operation paths are selectable; and

wherein the management component is further configured to evaluate network operation,

wherein the management component is further configured, prior to initiating a storage operation, to automatically select a subset of the first, second, third, and fourth storage paths in the third storage policy to conduct data to the first storage device based on network operating conditions, wherein the selected subset of the first, second, third, and fourth media agents performs data transmission operations that conduct data associated with the storage operation to the first storage device based on the network operation conditions,

and wherein the management component is further configured to dynamically allocate the data transmission operations among the selected subset of the first, second, third and fourth media agents to balance data loads on the first, second, third and fourth media agents.

7. The system of claim 6 wherein the first and second storage operation paths are specified for sub-clients.

8. The system of claim 6 further comprising a drive pool linked to at least one of the first and second media agents, the drive pool defined by a storage policy and identifying a set of storage drives within a library including the destination.

9. The system of claim 6 wherein the management component selectively reconfigures the first and second storage operation paths based upon anyone of following characteristics:

data transfer rate, load balancing, resource exhaustion, transmission congestion, or performance optimization.

10. The system of claim 9 wherein the management component reconfigures the first and second storage operation paths substantially dynamically.

11. The system of claim 10 wherein the substantially dynamic reconfiguring analyzes and automatically reconfigures the first and second storage operation paths through based on the results of a predictive analysis.