Methods and system of pooling storage devices

• US 8,074,042 B2
• Filed: 10/01/2010
• Issued: 12/06/2011
• Est. Priority Date: 11/05/2004
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kottomtharayil, Rajiv, Chen, Ho-Chi
• Primary Examiner(s): Campos, Yaima
• Application Number:
  US12/896,563
• Publication Number:
  US 20110022814A1
• Time in Patent Office: 431 Days
• Field of Search: None
• US Class Current: 711/170
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 12/00 Accessing, addressing or allocating within memory systems or architectures digital input from, or digital output to record carriers, e.g. to disk storage units, G06F3/06
• CPC Class Codes: G06F 12/02 Addressing or allocation; Relocation program address sequencing G06F9/00; arrangements for selecting an address in a digital store G11C8/00
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0686 Libraries, e.g. tape libraries, jukebox
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A system and method are provided for pooling storage devices in a virtual library for performing a storage operation. A storage management device determines a storage characteristic of a plurality of storage devices with respect to performing a storage operation. Based on a storage characteristic relating to performing the storage operation, the storage management device associates at least two storage devices in a virtual library. The storage management device may continuously monitor the virtual library and detect a change in storage characteristics of the storage devices. When changes in storage characteristics are detected, the storage management device may change associations of the storage device in the virtual library.

Claims

1. A method for performing a storage operation comprising:

receiving a first storage policy that specifies a schedule of future storage operations;

automatically determining that the schedule of future storage operations associated with a first storage policy requires more storage than exists in a first virtual library, wherein the first virtual library comprises a first configuration with at least first and second physical storage devices;

automatically detecting with one or more computer processors, at least a third physical storage device associated with a second virtual library, wherein detection of the third physical storage device is based at least in part on a storage characteristic associated with the schedule of future storage operations;

automatically associating with one or more computer processors the third physical storage device with the first virtual library without the need of user intervention; and

storing a second configuration of the first virtual library that comprises at least the first physical storage device, the second physical storage device and the third physical storage device.

2. The method of claim 1, further comprising storing data indicating an association of the first and second physical storage device with the first virtual library in an index.

3. The method of claim 1, further comprising:

detecting a fourth physical storage device among a plurality of physical storage devices, the fourth physical storage device satisfying a second storage characteristic associated with the schedule of future storage operations;

disassociating the first physical storage device with the first virtual library; and

associating the fourth physical storage device with the first virtual library wherein the first virtual library comprises a third configuration with at least the second physical storage device, the third physical storage device and the fourth physical storage device.

4. The method of claim 3 wherein disassociating the first physical storage device from the first virtual library comprises updating an index with data indicating a disassociation of the first physical storage device with the first virtual library.

5. The method of claim 1, further comprising:

receiving a characteristic of the first physical storage device, the first physical storage device being associated in the first virtual library;

detecting a change in the characteristic of the first physical storage device, wherein the change in the characteristic of the first physical storage device causes the first physical storage device to not satisfy a storage characteristic threshold;

identifying that a fourth physical storage device has a storage characteristic satisfying the storage characteristic threshold;

disassociating the first physical storage device from the first virtual library; and

associating the fourth physical storage device with the first virtual library.

6. The method of claim 5 wherein detecting a change in the characteristic of the first physical storage device comprises examining the first physical storage device based on receiving the first storage policy.

7. The method of claim 1 further comprising receiving a first request for data and a second request for data stored on the first virtual library and automatically determining that the first request is associated with data stored on the first configuration of the first virtual library and the second request is associated with data stored on the second configuration of the first virtual library.

8. The method of claim 1 wherein detection of the third physical storage device is based at least in part on the likelihood of congestion associated with one or more of the future scheduled storage operations.

9. The method of claim 1 wherein the third physical storage device continues to be associated with the second virtual library.

10. A system for performing a storage operation comprising:

a first storage policy that specifies a schedule of future storage operations;

one or more modules executing in one or more computer processors that is configured to automatically determine that the schedule of future storage operations associated with a first storage policy require requires more storage than exists in a first virtual library, wherein the first virtual library comprises a first configuration with at least first and second physical storage devices;

wherein the one or more modules are further configured to automatically detect at least a third physical storage device associated with a second virtual library, wherein detection of the third physical storage device is based at least in part on a storage characteristic associated with the schedule of future storage operations;

wherein the one or more modules automatically associate the third physical storage device with the first virtual library without the need of user intervention; and

wherein the one or more modules are further configured to store a second configuration of the first virtual library that comprises at least the first physical storage device, the second physical storage device and the third physical storage device.

11. The system of claim 10, further comprising an index that stores data indicating an association of the first and second physical storage device with the first virtual library.

12. The system of claim 10, further comprising:

wherein the one or more modules further detect a fourth physical storage device among a plurality of physical storage devices, the fourth physical storage device satisfying a second storage characteristic associated with the schedule of future storage operations;

wherein the one or more modules disassociate the first physical storage device with the first virtual library; and

wherein the one or more modules associate the fourth physical storage device with the first virtual library wherein the first virtual library comprises a third configuration with at least the second physical storage device, the third physical storage device and the fourth physical storage device.

13. The system of claim 12 wherein the one or more modules updating an index with data indicating a disassociation of the first physical storage device with the first virtual library.

14. The system of claim 10, further comprising:

a characteristic associated with the first physical storage device, the first physical storage device being associated in the first virtual library;

wherein the one or more modules detect a change in the characteristic of the first physical storage device, wherein the change in the characteristic of the first physical storage device causes the first physical storage device to not satisfy a storage characteristic threshold;

a fourth physical storage device has a storage characteristic satisfying the storage characteristic threshold;

wherein the one or more modules disassociate the first physical storage device from the first virtual library, and associate the fourth physical storage device with the first virtual library.

15. The system of claim 14 wherein a determination of the change in the characteristic of the first physical storage device comprises examining the first physical storage device based on receiving the first storage policy.

16. The system of claim 10 further comprising a first request for data and a second request for data stored on the first virtual library and wherein the one or more modules are further configured to automatically determine that the first request is associated with data stored on the first configuration of the first virtual library and the second request is associated with data stored on the second configuration of the first virtual library.

17. The system of claim 10 wherein detection of the third physical storage device is based at least in part on the likelihood of congestion associated with one or more of the future scheduled storage operations.

18. The system of claim 10 wherein the third physical storage device continues to be associated with the second virtual library.