System for redirecting requests after a secondary storage computing device failure

• US 10,310,953 B2
• Filed: 10/20/2016
• Issued: 06/04/2019
• Est. Priority Date: 12/30/2015
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Vijayan, Manoj Kumar, Kochunni, Jaidev Oppath, Attarde, Deepak Raghunath, Ankireddypalle, Ramachandra Reddy
• Primary Examiner(s): Patel, Kamini B
• Application Number:
  US15/299,254
• Publication Number:
  US 20170192866A1
• Time in Patent Office: 957 Days
• Field of Search: 714 63
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1662 the resynchronized component or unit being a persistent storage device re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/2097 maintaining the standby controller/processing unit updated initialisation or re-synchronisation thereof G06F11/1658 and subgroups
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 : Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 : Plurality of storage devices
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and methods are provided herein for automatically configuring newly installed secondary storage computing devices and managing secondary storage computing devices when one or more become unavailable. For example, a storage manager can then detect the computing resources available to the newly installed secondary storage computing device, assign a role to the newly installed secondary storage computing device based on the detected computing resources, configure the newly installed secondary storage computing device with deduplication and storage policies used by the other secondary storage computing devices, re-partition secondary storage devices to allocate memory for the newly installed secondary storage computing device, and instruct other secondary storage computing devices to replicate their managed data such that the newly installed secondary storage computing device has access to the replicated data.

Claims

1. A networked information management system configured to automatically configure installed data storage computers, the networked information management system comprising:

a first data storage computer comprising computer hardware, wherein the first data storage computer is configured to process input/output (I/O) requests corresponding to first data, wherein the first data is stored in a first partition of a secondary storage device, wherein a replication of second data is stored in a second partition of the secondary storage device, and wherein the first data storage computer is further configured to access the first data stored in the first partition of the secondary storage device and the replication of the second data stored in the second partition of the secondary storage device;

a first deduplication database in communication with the first data storage computer, wherein deduplication information corresponding to the first data is stored in a first partition of the first deduplication database, and wherein a replication of deduplication information corresponding to the second data is stored in a second partition of the first deduplication database;

a second data storage computer comprising computer hardware, wherein the second data storage computer is configured to process I/O requests corresponding to the second data, wherein a replication of the first data is stored in a third partition of the secondary storage device, wherein the second data is stored in a fourth partition of the secondary storage device, and wherein the second data storage computer is further configured to access the replication of the first data stored in the third partition and the second data stored in the fourth partition;

a second deduplication database in communication with the second data storage computer, wherein the deduplication information corresponding to the second data is stored in a first partition of the second deduplication database; and

a storage manager comprising computer hardware configured to;

detect that the second data storage computer has failed,

receive a first I/O request corresponding to the second data, and

send the first I/O request to the first data storage computer in place of the second data storage computer in response to detecting that the second data storage computer has failed, wherein the first data storage computer is configured to process the first I/O request using the replication of the second data stored in the second partition of the secondary storage device and the replication of the deduplication information corresponding to the second data stored in the second partition of the first deduplication database.

2. The networked information management system of claim 1, wherein the first I/O request is a read request.

3. The networked information management system of claim 2, wherein the first data storage computer is further configured to retrieve a portion of the replication of the second data stored in the second partition of the secondary storage device corresponding to the read request.

4. The networked information management system of claim 1, wherein the first I/O request is a write request that comprises a first data block.

5. The networked information management system of claim 4, wherein the first data storage computer is further configured to write the first data block to the second partition of the secondary storage device for inclusion in the replication of the second data.

6. The networked information management system of claim 1, wherein the replication of the deduplication information corresponding to the second data stored in the second partition of the first deduplication database comprises at least one of a data block signature, a storage location of a data block, or a count of a number of times the data block is used.

7. The networked information management system of claim 1, wherein the first data storage computer is not configured to access the second data stored in the fourth partition.

8. A computer-implemented method for automatically configuring installed data storage computers, the computer-implemented method comprising:

determining a presence of a first data storage computer and a second data storage computer, wherein the first data storage computer is configured to process input/output (I/O) requests corresponding to first data, wherein the first data is stored in a first partition of a secondary storage device, wherein a replication of second data is stored in a second partition of the secondary storage device, wherein the first data storage computer is further configured to access the first data stored in the first partition of the secondary storage device and the replication of the second data stored in the second partition of the secondary storage device, wherein a first deduplication database is in communication with the first data storage computer, wherein deduplication information corresponding to the first data is stored in a first partition of the first deduplication database, and wherein a replication of deduplication information corresponding to the second data is stored in a second partition of the first deduplication database;

detecting that the second data storage computer has failed, wherein the second data storage computer is configured to process I/O requests corresponding to the second data, wherein a replication of the first data is stored in a third partition of the secondary storage device, wherein the second data is stored in a fourth partition of the secondary storage device, wherein the second data storage computer is further configured to access the replication of the first data stored in the third partition and the second data stored in the fourth partition, wherein a second deduplication database is in communication with the second data storage computer, wherein the deduplication information corresponding to the second data is stored in a first partition of the second deduplication database;

receiving a first I/O request corresponding to the second data; and

sending the first I/O request to the first data storage computer in place of the second data storage computer in response to detecting that the second data storage computer has failed in a manner that causes the first data storage computer to process the first I/O request using the replication of the second data stored in the second partition of the secondary storage device and the replication of the deduplication information corresponding to the second data stored in the second partition of the first deduplication database.

9. The computer-implemented method of claim 8, wherein the first I/O request is a read request.

10. The computer-implemented method of claim 9, wherein sending the first I/O request to the first data storage computer further comprises sending the first I/O request to the first data storage computer in a manner that causes the first data storage computer to access a portion of the replication of the second data stored in the second partition of the secondary storage device corresponding to the read request.

11. The computer-implemented method of claim 8, wherein the first I/O request is a write request that comprises a first data block.

12. The computer-implemented method of claim 11, wherein sending the first I/O request to the first data storage computer further comprises sending the first I/O request to the first data storage computer in a manner that causes the first data storage computer to write the first data block to the second partition of the secondary storage device for inclusion in the replication of the second data.

13. The computer-implemented method of claim 8, wherein the replication of the deduplication information corresponding to the second data stored in the second partition of the first deduplication database comprises at least one of a data block signature, a storage location of a data block, or a count of a number of times the data block is used.

14. The computer-implemented method of claim 8, wherein the first data storage computer is not configured to access the second data stored in the fourth partition.

15. A networked information management system configured to automatically configure installed data storage computers, the networked information management system comprising:

a first data storage computer comprising computer hardware, wherein the first data storage computer is configured to process input/output (I/O) requests corresponding to first data, wherein the first data is stored in a first partition of a secondary storage device, wherein a replication of second data is stored in a second partition of the secondary storage device, and wherein the first data storage computer is further configured to access the first partition of the secondary storage device and the second partition of the secondary storage device;

a first deduplication database in communication with the first data storage computer, wherein deduplication information corresponding to the first data is stored in a first partition of the first deduplication database, and wherein a replication of deduplication information corresponding to the second data is stored in a second partition of the first deduplication database;

a second data storage computer comprising computer hardware, wherein the second data storage computer is configured to process I/O requests corresponding to the second data, wherein a replication of the first data is stored in a third partition of the secondary storage device, wherein the second data is stored in a fourth partition of the secondary storage device, and wherein the second data storage computer is further configured to access the third partition and the fourth partition;

a second deduplication database in communication with the second data storage computer, wherein the deduplication information corresponding to the second data is stored in a first partition of the second deduplication database; and

a storage manager comprising computer hardware configured to;

detect that the second data storage computer has failed, and

send a first I/O request corresponding to the second data to the first data storage computer in place of the second data storage computer in response to detecting that the second data storage computer has failed, wherein the first data storage computer is configured to process the first I/O request using the replication of the second data stored in the second partition of the secondary storage device and the replication of the deduplication information corresponding to the second data stored in the second partition of the first deduplication database.

16. The networked information management system of claim 15, wherein the replication of the deduplication information corresponding to the second data stored in the second partition of the first deduplication database comprises at least one of a data block signature, a storage location of a data block, or a count of a number of times the data block is used.

17. The networked information management system of claim 15, wherein the first data storage computer is not configured to access the second data stored in the fourth partition.