Systems and methods for migrating components in a hierarchical storage network

• US 20070260834A1
• Filed: 07/05/2007
• Published: 11/08/2007
• Est. Priority Date: 12/19/2005
• Status: Abandoned Application

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kavuri, Srinivas, Muller, Marcus
• Application Number:
  US11/825,279
• Publication Number:
  US 20070260834A1
• Time in Patent Office: Days
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/1787 Details of non-transparently synchronising file systems
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

System and methods for selectively or automatically migrating resources between storage operation cells are provided. In accordance with one aspect of the invention, a management component within the storage operation system may monitor system operation and migrate components from storage operation cell to another to facilitate failover recovery, promote load balancing within the system and improve overall system performance as further described herein. Another aspect of the invention may involve performing certain predictive analyses on system operation to reveal trends and tendencies within the system. Such information may be used as the basis for potentially migrating components from one storage operation cell to another to improve system performance and reduce or eliminate resource exhaustion or congestion conditions.

Claims

1. A system for re-allocating a resource in a storage system, comprising:

a first storage operation cell in the storage system, the first storage operation cell including a first resource;

a second storage operation cell in the storage system, a storage manager that monitors an operational characteristic of the first resource in the first storage operation cell;

wherein in the event that the operational characteristic is near or exceeds a first threshold, the storage manager automatically locates a second storage operation cell, the second storage operation cell, determines whether the first resource may be transferred to the second storage operation cell such that the transfer is capable of causing the first operational characteristic to remain within the first threshold; and

transfers the first resource to the second storage operation cell to maintain the first operational characteristic to remain within the first threshold.

2. The system of claim 1, wherein the operational characteristic is representative of a distribution of storage operations within the first storage operation cell.

3. The system of claim 1, wherein the transfer of the first resource to the second storage operation cell promotes a substantially uniform distribution of storage operations within the first storage operation cell.

4. The system of claim 3, wherein load balancing is accomplished, at least in part, by the substantially uniform distribution of data transmission tasks.

5. The system of claim 1, wherein the first operational characteristic is representative of storage media consumption.

6. The system of claim 5, wherein the transfer of the first resource to the second storage operation cell reduces storage media consumption.

7. The system of claim 5, wherein the transfer of the first resource to the second storage operation cell reduces the likelihood of storage media exhaustion.

8. The system of claim 1, wherein the first operational characteristic is representative of overall system performance.

9. The system of claim 8, wherein the transfer of the first resource to the second storage operation cell improves system efficiency.

10. The system of claim 1, wherein management information associated with the first resource from the first storage operation cell is automatically transferred to the second storage operation cell when the first resource is transferred.

11. The system of claim 1, wherein the storage manager monitors at least one operational characteristic of the first storage operation cell after transferring the first resource.

12. The system of claim 11, wherein the storage manager transfers the first resource back to the first storage operation cell if the at least one operational characteristic of the first storage operation cell indicates an undesirable impact in the operation of the first storage operation cell after transferring the first resource.

13. The system of claim 1, wherein the storage manager monitors at least one operational characteristic of the second storage operation cell after transferring the first resource.

14. The system of claim 13, wherein the storage manager transfers the first resource back to the first storage operation cell if the at least one operational characteristic of the second storage operation cell indicates an undesirable impact in the operation of the second storage operation cell after transferring the first resource.

15. The system of claim 1, wherein the storage manager quiesces the resource before transferring the first resource to the second storage operation cell.

16. The system of claim 1, wherein the storage manager verifies that the second storage operation cell can accept the first resource prior to transferring the first resource to the second storage operation cell.

17. The system of claim 16, wherein the storage manager or other software module simulates the performance of the first resource in the second storage operation cell.

18. The system according to claim 1, wherein the storage manager or other software module simulates the performance of the first storage operation cell without the first resource in the second storage operation cell.

19. The system according to claim 1, wherein a storage manager or other software module performs a predictive analysis to determine an operational trend, and determines whether to transfer the first resource to the second storage operation cell based on the operational trend.

20. The system of claim 1, wherein the first and second operational characteristics are any one of the following:

network bandwidth utilization, resource capacity used, resource capacity available, time periods between storage operations, scheduling conflicts, or transmission path loads.

21. The system of claim 1 wherein a storage manager or other software module analyzes and predicts at least one effect on operational characteristics of the first or second storage operation cell if the first resource is transferred, prior to transferring the first resource to the second storage operation cell.

22. A method for re-allocating resources in a storage system, the method comprising:

monitoring an operational characteristic of at least one storage operation cell in the storage system;

identifying a resource in a first storage operation cell;

identifying a second storage operation cell to which the resource may be transferred;

determining a potential effect that a transfer of the resource would have on the operational characteristic of at least one storage operation cell in the storage system; and

in the event that the determined potential effect of a transfer of the resource satisfies a criteria for the storage system, transferring the resource to the second storage operation cell.

23. A system for optimizing performance of storage operations in a storage system including a plurality of storage operation cells and resources, the system comprising:

a storage manager that monitors an operational characteristic of a plurality of storage operation cells in the storage system;

wherein the storage manager identifies a group first resources in a first storage operation cell and identifies a plurality of second storage operation cells to which the group of first resources may be transferred; and

wherein the storage manager determines a potential effect that a transfer of the group of first resources to the plurality of second storage operation cells would have on the performance storage operations, and if the determined potential effect of a transfer of the group of first resources improves the performance of storage operations, the storage manager transfers the group of first resources to the plurality of second storage operation cells.

24. A computer-readable medium having stored thereon a plurality of sequences of instructions including sequences of instructions which, when executed by one or more processors cause an electronic device to:

monitor an operational characteristic of at least one storage operation cell in a storage system;

identify a first resource in a first storage operation cell;

identify a second storage operation cell to which the resource may be transferred;

determine a potential effect that a transfer of the resource would have on the operational characteristic of at least one storage operation cell in the storage system; and

in the event that the determined potential effect of a transfer of the resource satisfies a an operational condition for the storage system, then transfer the resource to the second storage operation cell.