SYSTEMS AND METHODS FOR MIGRATING COMPONENTS IN A HIERARCHICAL STORAGE NETWORK

• US 20160306589A1
• Filed: 06/28/2016
• Published: 10/20/2016
• Est. Priority Date: 12/19/2005
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: KAVURI, Srinivas, MULLER, Marcus S.
• Granted Patent: US 9,916,111 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/1787 Details of non-transparently synchronising file systems
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]

Abstract

System and methods for selectively or automatically migrating resources between storage operation cells are provided. In accordance with one aspect of the invention, a management component within the storage operation system may monitor system operation and migrate components from storage operation cell to another to facilitate failover recovery, promote load balancing within the system and improve overall system performance as further described herein. Another aspect of the invention may involve performing certain predictive analyses on system operation to reveal trends and tendencies within the system. Such information may be used as the basis for potentially migrating components from one storage operation cell to another to improve system performance and reduce or eliminate resource exhaustion or congestion conditions.

Claims

1. A storage system that automatically transfers a storage resource from a first storage operation cell to a second storage operation cell, the storage system comprising:

a first storage operation cell comprising computer hardware, the first storage operation cell monitors primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;

wherein the first storage operation cell directs the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data; and

wherein the first storage manager monitors an operational characteristic associated with a first storage resource of the first storage operation cell,

a second storage operation cell comprising computer hardware, the second storage operation cell monitors the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;

wherein the second storage operation cell directs the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;

in the event the operational characteristic exceeds a threshold, initiating transfer of the first storage resource to the second storage operation cell, wherein the transfer of the first storage resource to the second storage operation cell creates a copy of management information associated with the first storage resource in the second storage operation cell;

wherein when the second storage operation cell determines that the copy of the management information is incomplete, the second storage operation cell performs a restore operation from the one or more secondary storage devices to restore the copy of the management information to the second storage operation cell.

2. The storage system of claim 1 wherein the copy of the management information is at least one of metadata associated with at least one of the group consisting of:

media records, archive records, application records, job history, source and target network pathway information, and storage policy criteria.

3. The storage system of claim 1 wherein the second storage operation cell verifies the copy of the management information transferred from the first storage operation cell.

4. The storage system of claim 1 wherein the management information remains in the first storage operation cell after the copy of the management information is transferred to the second storage operation cell.

5. The storage system of claim 4 wherein the management information in both the first storage operation cell and the copy of the management information in the second storage information cell are updated when changes occur.

6. The storage system of claim 1 wherein the transfer of the first storage resource migrates the management information from the first storage operation cell to the second storage operation cell.

7. The storage system of claim 1 wherein the first storage manager directs transfer of the first storage resource to the second storage operation cell.

8. The storage system of claim 1 wherein the second storage manager directs transfer of the first storage resource to the second storage operation cell

9. The storage system of claim 1 wherein the operational characteristic is based at least in part on a first operational characteristic that is representative of overall system performance.

10. The storage system of claim 1 wherein the operational characteristic is based at least in part on storage media consumption.

11. A method of automatically transferring a storage resource from a first storage operation cell to a second storage operation cell, the method comprising:

monitoring with a first storage operation cell comprising computer hardware, primary data created by one or more client computers, the primary data stored on one or more primary storage devices, the first storage operation cell comprising at least a first storage manager and at least a first media agent;

directing the first media agent to copy at least a first portion of the primary data by copying the first portion of the primary data to one or more secondary storage devices to create secondary data of the primary data, and wherein the first media agent creates a first index of the secondary data;

monitors an operational characteristic associated with a first storage resource of the first storage operation cell;

monitoring with a second storage operation cell comprising computer hardware, the primary data created by the one or more client computers, the second storage operation cell comprising at least a second storage manager and a second media agent;

directing the second media agent to copy at least a second portion of the primary data by copying the second portion of the primary data to the one or more secondary storage devices to create the secondary data of the primary data, and wherein the second media agent creates a second index of the secondary data;

in the event the operational characteristic exceeds a threshold, initiating transfer of the first storage resource to the second storage operation cell, wherein the transfer of the first storage resource to the second storage operation cell creates a copy of management information associated with the first storage resource in the second storage operation cell; and

determining that the copy of the management information in the second storage operation cell is incomplete and performing a restore operation from the one or more secondary storage devices to restore the copy of the management information to the second storage operation cell.

12. The method of claim 11 wherein the copy of the management information is at least one of the group consisting of:

media records, archive records, application records, job history, source and target network pathway information, and storage policy criteria.

13. The method of claim 11 further comprising verifying the copy of the management information transferred from the first storage operation cell.

14. The method claim 11 wherein the management information remains in the first storage operation cell after the copy of the management information is transferred to the second storage operation cell.

15. The method of claim 14 further comprising updating the management information in the first storage operation cell and the copy of the management information in the second storage information cell when changes occur.

16. The method of claim 11 wherein transferring the first storage resource migrates the management information from the first storage operation cell to the second storage operation cell.

17. The method of claim 11 wherein the first storage manager directs transfer of the first storage resource to the second storage operation cell.

18. The method of claim 11 wherein the second storage manager directs transfer of the first storage resource to the second storage operation cell.

19. The method of claim 11 wherein the operational characteristic is based at least in part on a first operational characteristic that is representative of overall system performance.

20. The method of claim 11 wherein the operational characteristic is based at least in part on storage media consumption.