Systems and methods for transferring data in a block-level storage operation

• US 8,019,963 B2
• Filed: 08/24/2009
• Issued: 09/13/2011
• Est. Priority Date: 10/30/1997
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Ignatius, Paul, Prahlad, Anand, Kumar, Avinash, Tyagarajan, Mahesh
• Primary Examiner(s): CHOE, YONG J
• Application Number:
  US12/546,087
• Publication Number:
  US 20100042804A1
• Time in Patent Office: 750 Days
• Field of Search: 711/202, 711/153, 711/154, 711/203, 711/E12.058
• US Class Current: 711/202
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0656 Data buffering arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The invention provides a system and method for storing a copy of data stored in an information store. In one embodiment, a data agent reads one or more blocks containing the data from the information store. The data agent maps the one or more blocks to provide a mapping of the blocks, and transmits the one or more blocks and mapping to a media agent for a storage device. The media agent stores the one or more blocks in the storage device according to the mapping.

Claims

1. A system for copying data stored in an information store, the system comprising:

one or more data agent modules executing on a computing device, the one or more data agent modules being configured to,

read a plurality of first blocks of data stored in the information store,

generate a first mapping of the plurality of first blocks, and

transmit a copy of the plurality of first blocks and the first mapping to a storage device by arranging the copy of the plurality of first blocks into one or more chunks, each of the one or more chunks having a header for storing at least a portion of the first mapping, wherein the portion of the first mapping is associated with the copy of the plurality of first blocks in the corresponding chunk;

identify block level data changes in the information store and to arrange, in one or more second chunks, a plurality of second blocks that represent changed blocks and added blocks of the block level data changes; and

one or more media agent modules for storing the copy of the plurality of first blocks in the storage device according to the first mapping such that the copy of the plurality of first blocks stored in the storage device is in the same order as the plurality of first blocks stored in the information store.

2. The system of claim 1, wherein the one or more data agent modules are further configured to generate a second mapping for at least one second header of the one or more second chunks, wherein the second mapping comprises a block identifier for each of the plurality of second blocks.

3. The system of claim 2, wherein the one or more media agent modules are further configured to store the plurality of second blocks in the storage device, wherein said storing further comprises,

for each second block that represents one of the changed blocks, replacing a corresponding one of the copy of the plurality of first blocks on the storage device that has the block identifier of one of the plurality of second blocks, and

for each second block that represents one of the added blocks, adding the second block to the storage device according to the block identifier of the second block.

4. The system of claim 1, wherein the copy of the plurality of first blocks represents a copy of at least one full volume of the information store.

5. The system of claim 1, wherein the portion of the mapping stored in each header comprises an offset table.

6. The system of claim 1, wherein the portion of the mapping stored in each header comprises an index.

7. A method for copying data stored in an information store, the method comprising:

generating a first mapping indicative of an order of a plurality of first blocks in an information store;

transmitting a copy of the plurality of first blocks and the first mapping to a storage device, wherein said transmitting further comprises,

arranging the copy of the plurality of first blocks into one or more chunks, each of the one or more chunks having a header, and

storing at least a portion of the first mapping in each header, wherein the portion of the first mapping is associated with the copy of the plurality of first blocks in the corresponding chunk;

storing the copy of the plurality of first blocks in the storage device according to the first mapping in each header such that the copy of the plurality of first blocks stored in the storage device is arranged in the same order as the plurality of first blocks stored in the information store;

arranging, in one or more second chunks, a plurality of second blocks that represent changed blocks and added blocks of block level data changes in the information store;

generating a second mapping for at least one second header of the one or more second chunks, wherein the second mapping comprises a block identifier for each of the plurality of second blocks; and

storing the plurality of second blocks in the storage device, wherein said storing further comprises,

for each second block that represents one of the changed blocks, replacing a corresponding one of the copy of the plurality of first blocks on the storage device that has a like block identifier as the second block, and

for each second block that represents one of the added blocks, adding the second block to the storage device according to the block identifier of the second block.

8. The method of claim 7, wherein said transmitting occurs using a data pipeline.

9. The method of claim 7, wherein said transmitting occurs over a virtual private network.

10. The method of claim 7, additionally comprising periodically scanning the information store to identify the changed blocks and the added blocks.

11. The method of claim 7, additionally comprising generating the copy of the plurality of first blocks on the information store.

12. The method of claim 11, wherein the copy of the plurality of first blocks represents a copy of at least one full volume of the information store.

13. The method of claim 7, wherein the copy of the plurality of first blocks is not transmitted in the same order that the copy of the plurality of first blocks is stored in the storage device.

14. The method of claim 7, further comprising accessing a file allocation table of a client device associated with the information store to identify the block identifiers for each of the plurality of second blocks.

15. The method of claim 7, wherein said arranging further comprises:

storing the plurality of second blocks in a shared memory; and

encrypting the plurality of second blocks in the shared memory.

16. The method of claim 15, wherein said arranging further comprises compressing the plurality of second blocks in the shared memory.

17. A system for copying data stored in an information store, the system comprising:

means for copying data on a client computing device, said copying means executing on the client computing device and being configured to,

read a plurality of first blocks of data stored in an information store,

generate a first mapping of the plurality of first blocks, and

transmit a copy of the plurality of first blocks and the first mapping to a storage device by arranging the copy of the plurality of first blocks into one or more chunks, each of the one or more chunks having a header for storing at least a portion of the first mapping, wherein the portion of the first mapping is associated with the copy of the plurality of first blocks in the corresponding chunk;

identify block level data changes in the information store and to arrange, in one or more second chunks, a plurality of second blocks that represent changed blocks of the block level data changes in the information store; and

means for storing the copy of the plurality of first blocks in the storage device according to the first mapping such that the copy of the plurality of first blocks stored in the storage device is in the same order as the plurality of first blocks stored in the information store.

18. The system of claim 17, wherein said copying means is further configured to:

generate a second mapping for at least one second header of the one or more second chunks, wherein the second mapping comprises a block identifier for each of the plurality of second blocks.

19. The system of claim 18, wherein said storing means is further configured to store the plurality of second blocks in the storage device by:

for each second block that represents one of the changed blocks, replacing a corresponding one of the copy of the plurality of first blocks on the storage device that has a like block identifier as the second block, and

for each second block that represents one of the added blocks, adding the second block to the storage device according to the block identifier of the second block.