Systems and methods for transferring data in a block-level storage operation

• US 8,239,654 B2
• Filed: 08/18/2011
• Issued: 08/07/2012
• Est. Priority Date: 10/30/1997
• Status: Expired due to Fees

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Ignatius, Paul, Prahlad, Anand, Tyagarajan, Mahesh, Kumar, Avinash
• Primary Examiner(s): CHOE, YONG J
• Application Number:
  US13/212,534
• Publication Number:
  US 20110302383A1
• Time in Patent Office: 355 Days
• Field of Search: 711/202, 711/203, 711/153, 711/154, 711/E12.058
• US Class Current: 711/202
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0656 Data buffering arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The invention provides a system and method for storing a copy of data stored in an information store. In one embodiment, a data agent reads one or more blocks containing the data from the information store. The data agent maps the one or more blocks to provide a mapping of the blocks, and transmits the one or more blocks and mapping to a media agent for a storage device. The media agent stores the one or more blocks in the storage device according to the mapping.

Claims

1. A system for copying data stored in an information store, the system comprising:

one or more computing devices configured to generate a first mapping of a plurality of first blocks of data stored in an information store;

one or more computing devices configured to transmit a copy of the plurality of first blocks and the first mapping to a storage device;

one or more computing devices configured to store the copy of the plurality of first blocks in the storage device according to the first mapping;

one or more computing devices configured to identify block level data changes in the information store; and

one or more computing devices configured to generate a second mapping comprising a block identifier for each of a plurality of second blocks that represent changed blocks and added blocks of the block level data changes.

2. The system of claim 1 further comprising one or more computing devices configured to replace a corresponding one of the copy of the plurality of first blocks on the storage device that has the block identifier of one of the plurality of second blocks for each second block that represents one of the changed blocks.

3. The system of claim 2 further comprising one or more computing devices configured to add the second block to the storage device according to the block identifier of the second block for each second block that represents one of the added blocks.

4. The system of claim 1, wherein the copy of the plurality of first blocks is arranged into one or more chunks, each chunk associated with a header including at least a portion of the first mapping, the transmission comprising the one or more chunks and headers such that each chunk preceded by its associated header.

5. The system of claim 1, wherein the copy of the plurality of first blocks is arranged into one or more chunks, the one or more chunks associated with a header and a footer, the header including at least a portion of the first mapping and the footer indicating completion of the transmission, the transmission comprising the header, the one or more chunks, and the footer, the header followed by the one or more chunks, the one or more chunks followed by the footer.

6. The system of claim 1, wherein the copy of the plurality of first blocks is arranged into one or more chunks, each chunk of the one or more chunks associated with a header including at least a portion of the first mapping and a footer indicating completion of the associated chunk, the transmission comprising each chunk of the one or more chunks preceded by its associated header and followed by its associated footer.

7. The system of claim 1, wherein the first mapping comprises a block identifier for each of a plurality of first blocks.

8. The system of claim 1, wherein the copy of the plurality of first blocks includes at least one header, the at least one header comprising at least one of a version control, an in-line compression module, an in-line snooping module, a header transfer module, a compression algorithm selector, an offset and block tagging module, an in-line cyclic redundancy check (CRC) generator, a discard duplicate CRC module, a restart from point of failure module, and a group blocks module.

9. The system of claim 8, wherein the offset and block tagging module tags the block identifier.

10. A method for copying data stored in an information store, the method comprising:

generating a first mapping of a plurality of first blocks of data stored in an information store;

transmitting a copy of the plurality of first blocks and the first mapping to a storage device;

storing the copy of the plurality of first blocks in the storage device according to the first mapping;

identifying block level data changes in the information store; and

generating a second mapping comprising a block identifier for each of a plurality of second blocks that represent changed blocks and added blocks of the block level data changes.

11. The method of claim 10 further comprising replacing a corresponding one of the copy of the plurality of first blocks on the storage device that has the block identifier of one of the plurality of second blocks for each second block that represents one of the changed blocks.

12. The method of claim 11 further comprising adding the second block to the storage device according to the block identifier of the second block for each second block that represents one of the added blocks.

13. The method of claim 10, further comprising arranging the copy of the plurality of first blocks into one or more chunks, each chunk associated with a header including at least a portion of the first mapping, the transmission comprising the one or more chunks and the associated headers such that each chunk is preceded by its associated header.

14. The method of claim 10, further comprising arranging the copy of the plurality of first blocks into one or more chunks, the one or more chunks associated with a header and a footer, the header including at least a portion of the first mapping and the footer indicating completion of the transmission, the transmission comprising the one or more chunks preceded by the header and followed by the footer.

15. The method of claim 10, further comprising arranging the copy of the plurality of first blocks into one or more chunks, each chunk of the one or more chunks associated with a header including at least a portion of the first mapping and a footer indicating completion of the associated chunk, the transmission comprising each chunk of the one or more chunks preceded by its associated header and followed by its associated footer.

16. The method of claim 10, wherein the copy of the plurality of first blocks includes at least one header, the at least one header comprising at least one of a version control, an in-line compression module, an in-line snooping module, a header transfer module, a compression algorithm selector, an offset and block tagging module, an in-line cyclic redundancy check (CRC) generator, a discard duplicate CRC module, a restart from point of failure module, and a group blocks module.

17. The method of claim 16, wherein the offset and block tagging module tags the block identifier.

18. A system for copying data stored in an information store, the system comprising:

means for generating a first mapping of a plurality of first blocks of data stored in an information store;

means for transmitting a copy of the plurality of first blocks and the first mapping to a storage device;

means for storing the copy of the plurality of first blocks in the storage device according to the first mapping;

means for identifying block level data changes in the information store; and

means for generating a second mapping comprising a block identifier for each of a plurality of second blocks that represent changed blocks and added blocks of the block level data changes.

19. The system of claim 18 further comprising means for replacing a corresponding one of the copy of the plurality of first blocks on the storage device that has the block identifier of one of the plurality of second blocks for each second block that represents one of the changed blocks.

20. The system of claim 19 further comprising means for adding the second block to the storage device according to the block identifier of the second block for each second block that represents one of the added blocks.