System and method for performing integrated storage operations

• US 8,285,671 B2
• Filed: 07/08/2011
• Issued: 10/09/2012
• Est. Priority Date: 11/13/2003
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Prahlad, Anand, Ngo, David, Zhou, Lixin, May, Andreas
• Primary Examiner(s): Mofiz, Apu
• Assistant Examiner(s): BIBBEE, JARED M
• Application Number:
  US13/179,033
• Publication Number:
  US 20110264620A1
• Time in Patent Office: 459 Days
• Field of Search: 707/609, 707/640, 707/649, 707/654, 707/705
• US Class Current: 707/609
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: Y10S 707/99931 Database or file accessing

Abstract

The present invention relates to a method for performing integrated storage operations on an information store. The present invention comprises identifying a plurality disparate types of storage operations stored in a policy option table. A first storage operation is performed according to a first set of storage criteria stored in the policy option table and a second operation, disparate from the first storage operation, is performed according to a second set of storage criteria stored in the policy option table.

Claims

1. A system for performing data storage operations on at least one information store, the system comprising:

a processor;

means for performing a first storage operation,

wherein performing the first storage operation includes copying at least a first portion of the information store to one or more storage devices and generating first metadata that describes at least the copied first portion stored on the one or more storage devices, wherein the first metadata has a first format;

means for performing a second storage operation, different from the first storage operation,

wherein performing the second storage operation includes copying at least a second portion of the information store to one or more storage devices and generating second metadata that describes at least the copied second portion stored on the one or more storage devices,

wherein the second metadata has a second format, and wherein the second format of metadata is different from the first format of metadata;

means for converting metadata, associated with storage operations from multiple information stores into a normalized format;

wherein the means for converting converts the first metadata having the first format and the second metadata having the second format into the normalized metadata format; and

,

wherein the means for performing the first and second storage operations include means for coordinating actions to perform at least one of;

fully copying data in the at least one information store,

performing snapshots of data in the at least one information store,

performing serverless copy of data in the at least one information store,

archiving data in the at least one information store,

migrating data in the at least one information store, and

recovering data in the at least one information store.

2. The system of claim 1, further comprising:

means for managing different types of storage operations according to incompatible formats associated with multiple information stores employing incompatible formats; and

means, communicating between the means for managing and the information store, for performing local, low-level read and write calls to the information store, at at least a cluster level, and under control of the means for managing.

3. The system of claim 1, further comprising:

means for managing different types of storage operations according to diverse and incompatible formats based at least in part on the normalized format.

4. The system of claim 1, wherein:

the means for performing the first and second types of storage operations implement, via a proxy host or intelligent network device, different types of storage operations according to diverse and incompatible formats associated with multiple information stores using the incompatible formats.

5. A system for operating within a network, wherein the network couples multiple information stores with at least one storage device, the system comprising:

a processor;

a first data agent, wherein the first data agent operates with a first information store under a first data storage operation, and

wherein first metadata is associated with the first data storage operation, and wherein the first metadata describes data copied from the first information store under the first data storage operation;

a second data agent, wherein the second data agent operates with a second information store under a second data storage operation;

wherein the first and second storage operations differ, and

wherein second metadata is associated with the second data storage operation, and wherein the second metadata describes data copied from the second information store under the second data storage operation; and

,

a third data agent communicating with the first and second data agents and with the at least one storage device, wherein the third data agent manages and controls different storage operations for data from the first and second information stores to the at least one storage device, via the first and second data agents, despite the first and second different storage operations,

wherein the third data agent employs a normalized metadata format,

wherein the normalized metadata format is derived from the first metadata and the second metadata, and,

wherein the first metadata and the second metadata employ a format that differs from the normalized metadata format.

6. The system of claim 5 wherein the third data agent is further configured to:

generating first metadata which describes at least a copied first data portion stored on the first information store, wherein the first metadata has a first format associated with the first storage operation;

generating second metadata which describes at least a copied second data portion stored on the second information store, wherein the second metadata has a second format associated with the second storage operation, and wherein the second format is incompatible with the first format; and

converting the first metadata having the first format associated with the first storage operation and the second metadata having the second format associated with the second storage operation into a common metadata format.

7. The system of claim 5 wherein first and second data agents are executed in association with a host computer, wherein the host computer is coupled to the first and second information stores and the network, and wherein the system further comprises a proxy host, employing the third data agent, to perform storage operations to relieve the host computer of processing functions required in storage operations.

8. The system of claim 5, further comprising multiple media agents coupled between the network and multiple storage devices, wherein each media agent is configured to transfer data from at least one of the first and second data agents, as directed by a storage manager associated with the third data agent.

9. The system of claim 5 wherein the third data agent is further configured to execute a copy or snapshot of at least one of the first and second information stores, and process the copy or snapshot on a proxy host computer or intelligent network device.

10. The system of claim 5 wherein the third data agent is further configured to employ a file allocation table (FAT) of a target volume associated with one of multiple storage devices to create a snapshot or full copy as an image level copy, wherein the image level copy permits user access to stored data at a file and folder level.

11. The system of claim 5 wherein the third data agent is further configured to perform local, low-level read and write calls at at least a cluster level, under control of the third data agent.

12. The system of claim 5 wherein the third data agent is further configured to generate metadata in a common format based on metadata received from the first and second data agents, wherein the common metadata format is configured to permit managing of different kinds of storage operations into a unified view of storage operations performed on the first and second information stores, and permit comparisons among the common metadata.

13. The system of claim 5, further comprising a storage manager, communicatively coupled with the third data agent, wherein the storage manager includes at least one of an index cache, a replication volume table, and a policy option table.

14. At least one non-transisitory computer-readable medium storing instructions that, when executed by at least one computer, performs a method comprising:

performing a first storage operation on an information store, wherein performing the first storage operation includes copying at least a first portion of the information store to one or more storage devices and generating first metadata,

wherein the first metadata describes at least the copied first portion stored on the one or more storage devices, and

wherein the first metadata has a first format associated with the first storage operation;

performing a second storage operation on the information store, wherein performing the second storage operation includes copying at least a second portion of the information store to one or more storage devices and generating second metadata which describes at least the copied second portion stored on the one or more storage devices,

wherein the second metadata has a second format associated with the second storage operation, and

wherein the second storage operation differs from the first storage operation; and

wherein the second format of metadata is different from the first format of metadata;

converting the first metadata having a first format associated with the first storage operation, and the second metadata having a second format associated with the second storage operation, into a normalized metadata format.

15. The non-transisitory computer-readable medium of claim 14, wherein the method includes identifying a plurality of disparate types of storage operations stored in a policy option table, wherein each type of storage operation copies at least a portion of the information store to one or more storage devices.

16. The non-transisitory computer-readable medium of claim 14, wherein the first storage operation is one of a full copy, snapshot, and serverless copy, and

wherein the second storage operation is a different one of a full copy, snapshot or serverless copy.

17. The non-transisitory computer-readable medium of claim 14 wherein the first metadata includes the location of at least the copied first portion on the one or more storage devices and the second metadata includes the location of at least the copied second portion stored on the one or more storage devices.

18. The non-transisitory computer-readable medium of claim 14 wherein the first storage operation is a full copy operation and the second storage operation is a snapshot operation.

19. At least one non-transisitory computer-readable medium storing or carrying instructions that when executed by at least one data processing device performs a method comprising:

in response to a first storage operation to copy at least a first portion of an information store to one or more storage devices, receiving first metadata which describes at least the copied first portion stored on one or more storage devices,

wherein the first metadata has a first format associated with the first storage operation;

in response to a second storage operation, disparate from the first storage operation, to copy at least a second portion of the information store to one or more storage devices, second metadata which describes at least the copied second portion stored on the one or more storage devices,

wherein the second metadata has a second format associated with the second storage operation, and,

wherein the second format differs from the first format; and

generating a normalized metadata format from the first metadata having a first format associated with the first storage operation, and the second metadata having the second format associated with the second storage operation.

20. The non-transisitory computer-readable medium of claim 19, further comprising:

receiving a request to restore a portion of the information store; and

utilizing the normalized metadata to restore the requested portion of the information store from the one or more storage devices.

21. The non-transisitory computer-readable medium of claim 19, further comprising:

receiving a request to restore a single file from the information store;

utilizing the normalized metadata to restore the requested single file the information store from the one or more storage devices.

22. The non-transisitory computer-readable medium of claim 19, wherein the first storage operation and the second storage operation are selected after reviewing a policy option table.