Incremental restore of data between storage systems having dissimilar storage operating systems associated therewith

• US 8,688,645 B2
• Filed: 11/30/2010
• Issued: 04/01/2014
• Est. Priority Date: 11/30/2010
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Sadhwani, Dhiraj
• Primary Examiner(s): Pham, Hung Q
• Assistant Examiner(s): CHEUNG, HUBERT G
• Application Number:
  US12/956,116
• Publication Number:
  US 20120136832A1
• Time in Patent Office: 1,218 Days
• Field of Search: None
• US Class Current: 707/681
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A method includes quiescing a file system of source storage system through a backup engine associated with the source storage system and a destination storage system and capturing, at the source storage system, a point-in-time image of the file system thereof through the backup engine. The method also includes sharing the captured point-in-time image of the file system of the source storage system with the destination storage system to enable the storage systems to have a common base data and negotiating between the storage systems for the common base data. Further, the method includes applying, to the common base data at the source storage system, a differential change corresponding to a difference between the common base data and a point-in-time image of the file system of the source storage system backed up at the destination storage system.

Claims

1. A method of restoring data between a source storage system managing data for a plurality of host devices and a destination storage system, comprising:

quiescing a file system associated with the source storage system associated with a first storage operating system through a backup engine associated with the source storage system and the destination storage system associated with a second storage operating system, the source storage system being configured to have data associated with the source storage system backed up at the destination storage system, and the second storage operating system being configured to implement a file system different from the file system implemented through the first storage operating system;

capturing, at the source storage system, a point-in-time image, a snapshot of the file system associated with the source storage system through the backup engine;

sharing the captured point-in-time image of the file system associated with the first storage operating system of the source storage system with the destination storage system to enable the source storage system and the destination storage system to have a common base data;

negotiating between the source storage system and the destination storage system for the common base data, wherein during the negotiating, the destination storage system sends a list of point-in-time images to the source storage system and the source storage system uses the sent list to obtain the common base data; and

applying, to the common base data at the source storage system, a differential change corresponding to a difference between the common base data at the destination storage system and a point-in-time image of the file system of the source storage system backed up at the destination storage system, the point-in-time image of the file system of the source storage system backed up at the destination storage system being configured to be in an immediate temporal past relative to a backup of the data to be restored to the source storage system at the destination storage system and in a temporal past relative to the common base data at the destination storage system.

2. The method of claim 1, further comprising remotely triggering, through an appropriate interlace at the source storage system, an update associated with the backup engine through the destination storage system, the update being configured to enable the quiescing the file system associated with the source storage system.

3. The method of claim 1, wherein the capturing the point-in-time image of the file system associated with the source storage system includes at least one of a process comprising:

capturing a series of point-in-time images of the file system of the source storage system prior to the quiescing; and

selecting an immediate previous point-in-time image of the file system prior to the quiescing as the point-in-time image of the file system at the source storage system following the quiescing; and

momentarily holding on to the selected immediate previous point-in-time image of the file system at the source storage system.

4. The method of claim 1, wherein the negotiating between the source storage system and the destination storage system for the common base data includes:

transmitting, to the source storage system, a series of point-in-time images associated with temporal back up of the file system of the source storage system at the destination storage system; and

selecting the common base data from the transmitted series of point-in-time images.

5. The method of claim 1, further comprising copying, at the source storage system, data associated with the file system to another location to enable a backup.

6. The method of claim 1, further comprising obtaining, at the destination storage system, the difference between the common base data and the point-in-time image of the file system of the source storage system backed up at the destination storage system to configure one of a quota tree data, a volume data and a sub-directory data associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system to be in a same state as a corresponding one of a quota tree data, a volume data and a sub-directory data corresponding to the common base data at the destination storage system.

7. The method of claim 6, wherein the obtaining the difference between the common base data and the point-in-time image of the file system of the source storage system backed up at the destination storage system includes:

traversing an appropriate one of a quota tree, a volume and a sub-directory corresponding to the corresponding one of the quota tree data, the volume data and the sub-directory data associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system starting from a root inode in a tree order;

fetching an inode associated with the common base data at the destination storage system corresponding to an inode associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system based on an inode identifier; and

obtaining a differential data between the inode associated with the common base data at the destination storage system and the inode associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system.

8. The method of claim 7, further comprising transmitting an attribute incompatible with the destination storage system based on the associated second storage operating system as is to the source storage system, the attribute being associated with the data to be restored to the source storage system.

9. The method of claim 1, wherein the source storage system and the destination storage system are configured to communicate with each other through a network.

10. The method of claim 1, wherein the storage operating system associated with the destination storage system is configured to support a data set associated with at least one of a Network File System (NFS) protocol, a Common Internet File System (CIFS) protocol, an Internet Small Computer System Interface (iSCSI) protocol, a Hypertext Transfer Protocol (HTTP), a File Transfer Protocol (FTP), an FTP-Secure (FTPS) protocol, a Secure File Transfer Protocol (SFTP), and a Network Data Management Protocol (NDMP).

11. The method of claim 1, wherein the file system of the destination storage system is a “

write anywhere”

file system.

12. A method of incrementally restoring differential data between a source storage system managing data for a plurality of host devices and a destination storage system, comprising:

quiescing a file system associated with a the source storage system associated with a first storage operating system through a backup engine associated with the source storage system and the destination storage system associated with a second storage operating system, the source storage system being configured to have data associated with the source storage system backed up at the destination storage system, and the second storage operating system being configured to implement a file system different from the file system implemented through the first storage operating system;

capturing, at the source storage system, a point-in-time image, a snapshot of the file system associated with the source storage system through the backup engine;

sharing the captured point-in-time image of the file system associated with the first storage operating system of the source storage system with the destination storage system to enable the source storage system and the destination storage system to have a common base data;

negotiating between the source storage system and the destination storage system for the common base data;

wherein during the negotiating, the destination storage system sends a list of point-in-time images to the source storage system and the source storage system uses the sent list to obtain the common base data;

obtaining, at the destination storage system, a difference between the common base data and a point-in-time image of the file system of the source storage system backed up at the destination storage system to configure one of a quota tree data, a volume data and a sub-directory data associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system to be in a same state as a corresponding one of a quota tree data, a volume data and a sub-directory data corresponding to the common base data at the destination storage system, the point-in-time image of the file system of the source storage system backed up at the destination storage system being configured to be in an immediate temporal past relative to a backup of data to be restored to the source storage system at the destination storage system and in a temporal past relative to the common base data at the destination storage system;

traversing an appropriate one of a quota tree, a volume and a sub-directory corresponding to the corresponding one of the quota tree data, the volume data and the sub-directory data associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system starting from a root inode in a tree order;

fetching an inode associated with the common base data at the destination storage system corresponding to an inode associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system based on an inode identifier;

obtaining a difference between data associated with the inode associated with the common base data at the destination storage system and the inode associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system as a difference between the common base data at the destination storage system and the point-in-time image of the file system of the source storage system backed up at the destination storage system; and

applying, to the common base data at the source storage system, a differential change corresponding to the obtained difference between the common base data at the destination storage system and the point-in-time image of the file system of the source storage system backed up at the destination storage system.

13. The method of claim 12, further comprising remotely triggering, through an appropriate interface at the source storage system, an update associated with the backup engine through the destination storage system, the update being configured to enable the quiescing the file system associated with the source storage system.

14. The method of claim 12, wherein the capturing the point-in-time image of the file system associated with the source storage system includes at least one of:

a process including;

capturing a series of point-in-time images of the file system of the source storage system prior to the quiescing; and

selecting an immediate previous point-in-time image of the file system prior to the quiescing as the point-in-time image of the file system at the source storage system following the quiescing; and

momentarily holding on to the selected immediate previous point-in-time image of the file system at the source storage system.

15. The method of claim 12, wherein the negotiating between the source storage system and the destination storage system for the common base data includes:

transmitting, to the source storage system, a series of point-in-time images associated with temporal back up of the file system of the source storage system at the destination storage system; and

selecting the common base data from the transmitted series of point-in-time images.

16. The method of claim 12, further comprising copying, at the source storage system, data associated with the file system to another location to enable a backup.

17. The method of claim 12, wherein the source storage system and the destination storage system are configured to communicate with each other through a network.

18. The method of claim 12, wherein the storage operating system associated with the destination storage system is configured to support a data set associated with at least one of a Network File System (NFS) protocol, a Common Internet File System (CIFS) protocol, an Internet Small Computer System Interface (iSCSI) protocol, a Hypertext Transfer Protocol (HTTP), a File Transfer Protocol (FTP), an FTP-Secure (FTPS) protocol, a secure file transfer protocol (SFTP) and a Network Data Management Protocol (NDMP).

19. The method of claim 12, wherein the file system of the destination storage system is a “

write anywhere”

file system.

20. The method of claim 12, further comprising transmitting an attribute incompatible with the destination storage system based on the associated second storage operating system as is to the source storage system, the attribute being associated with the data to be restored to the source storage system.

21. A storage environment configured to enable an incremental data restore comprising:

a source storage system associated with a first storage operating system; and

a destination storage system configured to back up data associated with the source storage system, the destination storage system associated with a second storage operating system, the destination storage system comprising a processor and a memory, and the second storage operating system being configured to implement a file system different from a file system implemented through the first storage operating system, wherein the memory includes storage locations configured to be addressable by the processor, wherein the memory is configured to store instructions associated with a backup engine associated with the source storage system and the destination storage system, and wherein the backup engine is configured to enable;

quiescing the file system associated with the source storage system, capturing, at the source storage system, a point-in-time image, a snapshot, of the file system associated with the source storage system;

sharing the captured point-in-time image of the file system associated with the first storage operating system of the source storage system with the destination storage system to enable the source storage system and the destination storage system to have a common base data;

negotiating between the source storage system and the destination storage system for the common base data, wherein during the negotiating, the destination storage system sends a list of point-in-time images to the source storage system and the source storage system uses the sent list to obtain the common base data; and

applying, to the common base data at the source storage system, a differential change corresponding to a difference between the common base data at the destination storage system and a point-in-time image of the file system of the source storage system backed up at the destination storage system, the point-in-time image of the file system of the source storage system backed up at the destination storage system being configured to be in an immediate temporal past relative to a backup of the data to be restored to the source storage system at the destination storage system and in a temporal past relative to the common base data at the destination storage system.

22. The storage environment of claim 21, wherein the source storage system comprises an appropriate interface configured to remotely trigger an update associated with the backup engine through the destination storage system, the update being configured to enable the quiescing the file system associated with the source storage system.

23. The storage environment of claim 21, wherein the backup engine is configured to enable capturing the point-in-time image of the file system associated with the source storage system through at least one of a process including:

capturing a series of point-in-time images of the file system of the source storage system prior to the quiescing thereof; and

selecting an immediate previous point-in-time image of the file system prior to the quiescing as the point-in-time image of the file system at the source storage system following the quiescing; and

momentarily holding on to the selected immediate previous point-in-time image of the file system at the source storage system.

24. The storage environment of claim 21, wherein the backup engine is configured to enable negotiating between the source storage system and the destination storage system for the common base data through:

transmitting, to the source storage system, a series of point-in-time images associated with temporal back up of the file system of the source storage system at the destination storage system; and

selecting the common base data from the transmitted series of point-in-time images.

25. The storage environment of claim 21, wherein data associated with the file system of the source storage system is copied at the source storage system to another location to enable a backup.

26. The storage environment of claim 21, wherein the backup engine is further configured to enable:

obtaining, at the destination storage system, the difference between the common base data and the point-in-time image of the file system of the source storage system backed up at the destination storage system to configure one of a quota tree data, a volume data and a sub-directory data associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system to be in a same state as a corresponding one of a quota tree data, a volume data and a sub-directory data corresponding to the common base data at the destination storage system.

27. The storage environment of claim 26, wherein the backup engine is configured to enable obtaining the difference between the common base data and the point-in-time image of the file system of the source storage system backed up at the destination storage system through:

traversing an appropriate one of a quota tree, a volume and a sub-directory the corresponding to the corresponding one of the quota tree data, the volume data and the sub-directory data associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system starting from a root inode in a tree order;

fetching an inode associated with the common base data at the destination storage system corresponding to an inode associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system based on an inode identifier; and

obtaining a differential data between the inode associated with the common base data at the destination storage system and the inode associated with the point-in-time image of the file system of the source storage system backed up at the destination storage system.

28. The storage environment of claim 27, wherein an attribute incompatible with the destination storage system based on the associated second storage operating system is configured to be transmitted as is to the source storage system, the attribute being associated with the data to be restored to the source storage system.

29. The storage environment of claim 21, wherein the source storage system and the destination storage system are configured to communicate with each other through a network.

30. The storage environment of claim 29, wherein the network is at least one of a storage area network (SAN), a local area network (LAN), a wide area network (WAN), a virtual private network (VPN) and Internet.

31. The storage environment of claim 21, wherein the storage operating system associated with the destination storage system is configured to support a data set associated with at least one of a Network File System (NFS) protocol, a Common Internet File System (CIFS) protocol, an Internet Small Computer System Interface (iSCSI) protocol, a Hypertext Transfer Protocol (HTTP), a File Transfer Protocol (FTP), an FTP-Secure (FTPS) protocol, a secure file transfer protocol (SFTP) and a Network Data Management Protocol (NDMP).

32. The storage environment of claim 21, wherein the file system of the destination storage system is a “

write anywhere”

file system.

33. A method of restoring data between storage systems associated with different operating systems based on a commonality of point-in-time images, comprising:

generating a point-in-time image, a snapshot, of a file system at a source storage system associated with a first storage operating system, the source storage system being configured to have associated data backed up at a destination storage system associated with a second storage operating system, the first storage operating system being configured to implement the file system at the source storage system, and the second storage operating system being configured to implement a file system at the destination storage system different from that implemented through the first storage operating system;

providing, through a computer network, the generated point-in-time image to the destination storage system;

negotiating between the source storage system and the destination storage system for a common base data, wherein during the negotiating, the destination storage system sends a list of point-in-time images to the source storage system and the source storage system uses the sent list to obtain the common base data;

establishing the common base data between the source storage system and the destination storage system through sharing the generated point-in-time image with the destination storage system, the common base data being referenced by both the source storage system and the destination storage system based on identification data of common data between both using the sent list; and

incrementally restoring data associated with the source storage system through the destination storage system based on the established common base data.

34. The method of claim 33, further comprising:

quiescing the file system associated with the source storage system through a backup engine associated with the source storage system and the destination storage system prior to the generating the point-in-time image, the point-in-time image being captured through the backup engine.