Systems and methods for migrating components in a hierarchical storage network

• US 8,661,216 B2
• Filed: 12/15/2006
• Issued: 02/25/2014
• Est. Priority Date: 12/19/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kavuri, Srinivas, Muller, Marcus
• Primary Examiner(s): TSAI, SHENG JEN
• Application Number:
  US11/639,808
• Publication Number:
  US 20070198797A1
• Time in Patent Office: 2,629 Days
• Field of Search: 711/165, 711/170
• US Class Current: 711/165
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/1787 Details of non-transparently synchronising file systems
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

System and methods for selectively or automatically migrating resources between storage operation cells are provided. In accordance with one aspect of the invention, a management component within the storage operation system may monitor system operation and migrate components from storage operation cell to another to facilitate failover recovery, promote load balancing within the system and improve overall system performance as further described herein. Another aspect of the invention may involve performing certain predictive analyses on system operation to reveal trends and tendencies within the system. Such information may be used as the basis for potentially migrating components from one storage operation cell to another to improve system performance and reduce or eliminate resource exhaustion or congestion conditions.

Claims

1. A method for automatically transferring a storage resource from a first storage operation cell to a second storage operation cell, the method comprising:

monitoring, with a first storage operation cell, primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;

directing the first media agent to backup at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;

monitoring, with a second storage operation cell, the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;

directing the second media agent to backup at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;

monitoring a first operational characteristic of the first media agent in the first storage operation cell wherein the first operational characteristic has an associated first threshold;

predicting future utilization of the first media agent based on monitoring the first operational characteristic of the first media agent;

identifying that the second storage operation cell comprises a second storage resource having a second operational characteristic that does not exceed a second threshold;

determining whether the first media agent may be transferred to the second storage operation cell such that the transfer is capable of causing the first operational characteristic to remain within the first threshold; and

automatically transferring the first media agent to the second storage operation cell if predicting future utilization of the first media agent is near or exceeds the first threshold,

reconstituting the first media agent and the first index in the second storage operation cell;

wherein the second storage operation cell directs the first media agent to backup the first portion of the primary data and update the first index.

2. The method of claim 1, wherein the first operational characteristic is representative of a distribution of storage operations within the first storage operation cell.

3. The method of claim 2, wherein the transfer of the first media agent to the second storage operation cell promotes a substantially uniform distribution of storage operations within the first storage operation cell.

4. The method of claim 3, wherein load balancing is accomplished, at least in part, by the substantially uniform distribution of data transmission tasks.

5. The method of claim 1, wherein the first operational characteristic is representative of storage media consumption.

6. The method of claim 5, wherein the transfer of the first media agent to the second storage operation cell reduces storage media consumption.

7. The method of claim 1, further comprising transferring a secondary storage device to the second storage operation cell to reduce the likelihood of storage media exhaustion.

8. The method of claim 1, wherein the first operational characteristic is representative of overall system performance.

9. The method of claim 8, wherein the transfer of the first media agent to the second storage operation cell improves system efficiency.

10. The method according to claim 1, further comprising automatically transferring management information associated with the first media agent from the first storage operation cell to the second storage operation cell when the first media agent is transferred.

11. The method of claim 1, further comprising monitoring at least one operational characteristic of the first storage operation cell after transferring the first media agent .

12. The method of claim 11, further comprising transferring the first media agent back to the first storage operation cell if the at least one operational characteristic of the first storage operation cell indicates an undesirable impact in the operation of the first storage operation cell after transferring the first media agent.

13. The method of claim 1, further comprising monitoring at least a second operational characteristic associated with the second storage operation cell after transferring the first media agent.

14. The method of claim 13, further comprising transferring the first media agent back to the first storage operation cell if the second operational characteristic of the second storage operation cell indicates an undesirable impact in the operation of the second storage operation cell after transferring the first media agent.

15. The method according to claim 1, further comprising quiescing the first media agent before transferring the first media agent to the second storage operation cell.

16. The method according to claim 1, further comprising verifying that the second storage operation cell can accept the first media agent prior to transferring the first media agent to the second storage operation cell.

17. The method according to claim 16, wherein the verifying further comprises simulating the performance of the first media agent in the second storage operation cell.

18. The method according to claim 1, wherein the verifying further comprises simulating the performance of the first storage operation cell without the first media agent in the second storage operation cell.

19. The method according to claim 1, wherein:

predicting future utilization is based on an operational trend; and

determining whether to transfer the first media agent to the second storage operation cell based on the operational trend.

20. The method according to claim 1, wherein the first and second operational characteristics are anyone of the following:

network bandwidth utilization, resource capacity used, resource capacity available, time periods between storage operations, scheduling conflicts, or transmission path loads.

21. The method according to claim 1, further comprising before transferring the first media agent to the second storage operation cell, analyzing and predicting at least one effect on operational characteristics of the first or second storage operation cell if the first media agent is transferred.

22. The method according to claim 1, further comprising sending an alert to a user that the first media agent has been transferred.

23. The method of claim 1, wherein the automatically transferring step is performed, independent of user input, in response to at least one of system operating policies or guidelines.

24. The method according to claim 1, further comprising permanently transferring the first media agent to the second storage operation cell.