Maintaining checkpoints during backup of live system

• US 7,900,006 B2
• Filed: 04/30/2008
• Issued: 03/01/2011
• Est. Priority Date: 04/30/2008
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Nagaraj, Prasad
• Primary Examiner(s): BATAILLE, PIERRE MICHE
• Application Number:
  US12/113,011
• Publication Number:
  US 20090276590A1
• Time in Patent Office: 1,035 Days
• Field of Search: 711/162, 711/202, 711/167, 714/4, 714/5, 714/6
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1443 Transmit or communication errors
• CPC Class Codes: G06F 11/1464 for networked environments

Abstract

Techniques introduced here support block level transmission of a logical container from a network storage controller to a backup system. In accordance with the techniques, transmission can be restarted using checkpoints created at the block level by allowing restarts from various points within a logical container, for example a point at which 10%, 50%, or 75% of the logical container had been transmitted. The transmission can be restarted while maintaining data consistency of the logical container data and included meta-data. Advantageously, changes made prior to a checkpoint restart to, for example, meta-data, do not lead to inconsistent logical container backups.

Claims

1. A method comprising:

transmitting a logical container to a backup system from a network storage controller one block of the logical container at a time to create a backup of the logical container while creating a checkpoint including a number of blocks of the logical container that have been transmitted until an interruption of transmission; and

restarting transmission of the logical container from the checkpoint including transmitting changed meta-data to the backup system to replace meta-data in the backup of the logical container to ensure consistency of the backup with changes to the meta-data of the logical container made prior to restarting transmission.

2. The method of claim 1 wherein the modified meta-data is transmitted from a snapshot including the logical container.

3. The method of claim 1 wherein the meta-data include an access control list that has been added since the beginning of transmission.

4. The method of claim 1 wherein the meta-data includes an access control list that has been modified prior to the interruption.

5. The method of claim 1 wherein all blocks of the logical container were previously transferred and only a header of the logical container including modified meta-data is transmitted.

6. The method of claim 1 wherein a checkpoint includes a number of blocks of a logical container that have been transmitted.

7. The method of claim 1 further comprising restarting transmission of blocks from a beginning of the logical container;

wherein a configuration of the backup system has changed during transmission of the blocks.

8. A method comprising:

transmitting a block of a logical container to a backup system;

determining that the transmission of the logical container is not complete;

creating a checkpoint including a number of blocks of the logical container that have been transmitted;

determining that an interruption has caused the transmission to stop;

identifying changes to meta-data of a logical container;

recording an entry in a logical container meta-data database identifying changed meta-data of the logical container; and

restarting transmission of the logical container from the checkpoint including transmitting the changed meta-data to the backup system to replace meta-data in the backup of the logical container to ensure consistency of the backup for changes to meta-data made prior to restarting transmission.

9. The method of claim 8 further comprising creating a snapshot including the logical container.

10. The method of claim 8 wherein the changed meta-data includes a modified attribute.

11. The method of claim 8 wherein the changed meta-data includes an extended attribute that has been deleted.

12. The method of claim 8 wherein the changed meta-data includes a new object ID.

13. A network storage controller comprising:

a block transmission module sending a logical container to a backup system one block at a time while creating checkpoints, each checkpoint including a number of blocks of the logical container that have been transmitted;

a logical container meta-data inspection unit identifying an attribute modified prior to restarting transmission of the logical container; and

an interruption recovery module instructing the block transmission module to restart transmission of the logical container from a checkpoint including transmitting the attribute to the backup system to store in the backup to ensure consistency of the backup with the logical container.

14. The network storage controller of claim 13 wherein the checkpoints each include a number of blocks of the logical container that have been transmitted and a time that the logical container was last modified in a system in use.

15. The network storage controller of claim 13 further comprising a transmission state monitor identifying an interruption of transmission in the transmission of blocks of the logical container.

16. The network storage controller of claim 13 further comprising a modified meta-data database to store records of logical containers indicating that logical container meta-data have changed.

17. The network storage controller of claim 13 wherein the logical container includes a modified object identifier and the network storage controller records an entry in a modified meta-data database indicating that the meta-data for the logical container have changed.

18. The network storage controller of claim 13 wherein the logical container includes a modified access control list, and the network storage controller records an entry in a modified meta-data database indicating that meta-data for the logical container have changed.

19. A computer readable medium storing instructions for execution by a processor of a network storage controller, the instructions comprising:

creating a snapshot including a logical container;

transmitting a copy of the logical container from the network storage controller to a backup system one block of the logical container at a time while creating checkpoints reflecting a number of blocks of the logical container that have been transmitted, until an interruption stops the network storage controller from transmitting; and

restarting transmission of the logical container from the checkpoint including transmitting changed meta-data to the backup system to replace meta-data in a backup of the logical container to ensure consistency of the backup with the logical container to reflect changes to the meta-data of the logical container made prior to restarting transmission.

20. The computer readable medium of claim 19 wherein the meta-data includes an access control list (ACL) that has been deleted since the snapshot has been created.

21. The computer readable medium of claim 19 wherein a configuration of the backup system has changed since the snapshot has been created, further comprising transmitting all user data from a beginning of the logical container.

22. The computer readable medium of claim 19 further comprising transmitting meta-data including an attribute that has been changed since the snapshot has been created.