Systems and methods for migrating components in a hierarchical storage network

• US 9,448,892 B2
• Filed: 07/31/2015
• Issued: 09/20/2016
• Est. Priority Date: 12/19/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kavuri, Srinivas, Muller, Marcus S.
• Primary Examiner(s): TSAI, SHENG JEN
• Application Number:
  US14/815,081
• Publication Number:
  US 20150339197A1
• Time in Patent Office: 417 Days
• Field of Search: 711/165
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/1787 Details of non-transparently synchronising file systems
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]

Abstract

System and methods for selectively or automatically migrating resources between storage operation cells are provided. In accordance with one aspect of the invention, a management component within the storage operation system may monitor system operation and migrate components from storage operation cell to another to facilitate failover recovery, promote load balancing within the system and improve overall system performance as further described herein. Another aspect of the invention may involve performing certain predictive analyzes on system operation to reveal trends and tendencies within the system. Such information may be used as the basis for potentially migrating components from one storage operation cell to another to improve system performance and reduce or eliminate resource exhaustion or congestion conditions.

Claims

1. A storage system that automatically transfers a storage resource from a first storage operation cell to a second storage operation cell, the storage system comprising:

a first storage operation cell comprising computer hardware, the first storage operation cell monitors primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;

wherein the first storage operation cell directs the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;

a second storage operation cell comprising computer hardware, the second storage operation cell monitors the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;

wherein the second storage operation cell directs the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;

a third storage manager comprising computer hardware, the third storage manager automatically directs transfer of the first media agent to the second storage operation;

wherein the second storage operation cell reconstitutes the first media agent in association with the second storage operation cell;

wherein the third storage manager directs the transfer of management information associated with the first media agent from the first storage operation cell to the second storage operation cell to create a copy of the management information on the second storage operation cell;

wherein when the second storage operation cell determines that the copy of the first management is incomplete, the second storage operation cell performs a restore operation from at least a portion of the management information stored in the one or more secondary storage devices to restore the copy of the management information stored in association with the second storage operation cell; and

wherein the copy of the first media agent and the copy of the management information are stored in association with the second storage operation cell and the second storage operation cell directs the first media agent to copy a second portion of the primary data to the one or more secondary storage devices.

2. The storage system of claim 1 wherein the management information is at least one of metadata associated with the group of first resources, media records, archive records, application records, job history, source and target network pathway information, and storage policy criteria.

3. The storage system of claim 1 wherein the second storage operation cell verifies the management information transferred from the first storage operation cell.

4. The storage system of claim 1 wherein a copy of the management information remains in the first storage operation cell after the management information is transferred to the second storage operation cell.

5. The storage system of claim 4 wherein the management information in both the first storage operation cell and the second storage information cell are updated when changes occur.

6. The storage system of claim 1 wherein the transfer of the management information migrates the management information from the first storage operation cell to the second storage operation cell.

7. The storage system of claim 1 wherein the third storage manager directs transfer of the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of a distribution of storage operations within the first storage operation cell.

8. The storage system of claim 1 wherein the third storage manager directs transfer of the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of storage media consumption.

9. The storage system of claim 1 wherein the third storage manager directs transfer of the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of overall system performance.

10. The storage system of claim 1 wherein the first media agent is transferred to the second storage operation cell after the transfer of the management information.

11. A method of automatically transferring a storage resource from a first storage operation cell to a second storage operation cell, the method comprising:

monitoring with a first storage operation cell comprising computer hardware, primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;

directing the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;

monitoring with a second storage operation cell comprising computer hardware, the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;

directing the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;

reconstituting the first media agent in the second storage operation cell;

automatically directing transfer of management information associated with the first media agent to the second storage operation cell to create a copy of the management information on the second storage operation cell;

determining that the copy of the management information in the second storage operation cell is incomplete and performing a restore operation from at least a portion of the secondary data stored in the one or more secondary storage devices to restore the copy of the management information stored in association with the second storage operation cell; and

after restoration of the copy of the management information stored in association with the second storage operation cell, directing the first media agent to copy a second portion of the primary data to the one or more secondary storage devices.

12. The method of claim 11 wherein the management information is at least one of metadata associated with the group of first resources, media records, archive records, application records, job history, source and target network pathway information, and storage policy criteria.

13. The method of claim 11 further comprising verifying the management information transferred from the first storage operation cell.

14. The method claim 11 wherein a copy of the management information remains in the first storage operation cell after the management information is transferred to the second storage operation cell.

15. The method of claim 14 further comprising updating the management information in both the first storage operation cell and the second storage information cell when changes occur.

16. The method of claim 11 wherein transferring the management information migrates the management information from the first storage operation cell to the second storage operation cell.

17. The method of claim 11 wherein the third storage manager directs transfer of the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of a distribution of storage operations within the first storage operation cell.

18. The method of claim 11 wherein the third storage manager directs transfer of the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of storage media consumption.

19. The method of claim 11 wherein the third storage manager directs transfer of the first media agent to the second storage operation cell based at least in part on a first operational characteristic that is representative of overall system performance.

20. The method of claim 11 wherein the first media agent is transferred to the second storage operation cell after the transfer of the management information.