Generating data set of the first file system by determining a set of changes between data stored in first snapshot of the first file system, and data stored in second snapshot of the first file system

• US 6,959,310 B2
• Filed: 02/15/2002
• Issued: 10/25/2005
• Est. Priority Date: 02/15/2002
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Sawdon, Wayne A., Schmuck, Frank B., Haskin, Roger L., Eshel, Marc M.
• Primary Examiner(s): Channavajjala, Srirama
• Application Number:
  US10/077,320
• Publication Number:
  US 20030158862A1
• Time in Patent Office: 1,348 Days
• Field of Search: 707 1- 8, 707100-1041, 707200-206, 709203-210, 709225-226, 711160-165, 715/500.1, 715510-513
• US Class Current: 1/1
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A system, method and computer readable medium for providing a standby file system with snapshot feature is disclosed. A first snapshot of a primary file system is generated. Next, a standby file system restores the first snapshot of the primary file system in the standby file system and a snapshot of the standby file system is taken. Then, a second snapshot of the primary file system is taken and a data set capturing the differences between the first snapshot of the primary file system and a previous data set of the primary file system is generated. Subsequently, the data set is applied to the standby file system. Upon unavailability of the primary file system, the standby file system is initialized as the new primary file system. Upon recovery of the old primary file system, the old primary file system is initialized as a new standby file system.

Claims

1. A method for providing a standby file system, comprising the steps of:

generating a first snapshot of a first file system at a first time, wherein the first file system is a primary file system;

restoring to a second file system the first snapshot of the first file system, wherein the second file system is a standby file system;

generating a second snapshot of the first file system at a second time;

generating a data set of the first file system by determining a set of changes between data stored in the first snapshot of the first file system and data stored in the second snapshot of the first file system and storing the set of changes into the data set; and

bringing the second file system to the state of the first file system at the second time by applying, after the restoring, the data set to the second file system.

2. The method of claim 1, further comprising the steps of:

generating, in response to bringing the second file system to the state of the first file system at the second time, a first snapshot of the second file system; and

initializing the second file system as the primary file system.

3. The method of claim 2, further comprising the steps of:

generating, at a third time, a second snapshot of the second file system;

generating a data set of the second file system by determining a set of changes between data stored in the first snapshot of the second file system and data stored in the second snapshot of the first file system and storing the set of changes into the data set;

restoring, in response to a recovery of the first file system, the first snapshot of the first file system to the first file system;

bringing the first file system to the state of the second file system at the third time by applying the data set of the second file system to the first file system; and

initializing the first file system as the standby file system.

4. The method of claim 3, further comprising the steps of:

initializing the second file system as the standby file system; and

initializing the first file system as the primary file system.

5. The method of claim 4, further comprising the step of:

generating a snapshot of the first file system, wherein the snapshot is not taken for the purpose of providing a standby file system.

6. The method of claim 5, further comprising the step of:

generating a snapshot of the second file system, wherein the snapshot is not taken for the purpose of providing a standby file system.

7. The method of claim 4, further comprising the steps of:

generating a snapshot of the first file system, wherein the snapshot is not taken for the purpose of providing a standby file system; and

providing the snapshot to a processor for creation of a tape backup comprising the snapshot.

8. The method of claim 4, wherein the second file system is a standby file system for a third file system.

9. The method of claim 4, wherein the first file system is a standby file system for a third file system.

10. The method of claim 1, wherein the bringing the second file system to the state of the first file system at the second time is performed in response to determining an unavailability of the first file system, the method further comprising the steps of:

initializing the second file system as the primary file system; and

generating, in response to bringing the second file system to the state of the first file system at the second time, a first snapshot of the second file system.

11. The method of claim 10, further comprising the steps of:

restoring to the first file system the first snapshot of the first file system;

bringing the first file system to the state of the first file system at the second time by applying, after the restoring to the first file system, the data set to the first file system;

generating, at a fourth time, a second snapshot of the second file system;

generating a data set of the second file system by determining a set of changes between the first snapshot of the first file system and the second snapshot of the second file system;

bringing the first file system to the state of the second file system at the fourth time by applying the data set of the second file system to the first file system; and

initializing the first file system as the standby file system.

12. The method of claim 11, further comprising the steps of:

initializing the second file system as the standby file system; and

initializing the first file system as the primary file system.

13. The method of claim 11, further comprising the step of:

storing, in response to bringing the first file system to the state of the first file sysrem at the fourth time, an identifier in the superblock of the first file system the identifier identifying the data set that was applied.

14. The method of claim 13, further comprising the step of:

storing, in response to the bringing the second file system to the state of the first file system at the second time, an identifier in the superblock of the second file system the identifier identifying the data set that was applied.

15. The method of claim 11, further comprising:

generating a third snapshot of the second file system at a fifth time;

generating a second data set of the second file system by determining a set of changes between data in the third snapshot of the second file system and the second snapshot of the second file system; and

bringing the first file system to the state of the second file system at the fifth time by applying the second data set to the second file system after applying the first snapshot of the second file system and the data set of the second file system to the first file system.

16. The method of claim 15, further comprising:

generating a third snapshot of the second file system at a sixth time;

generating a second data set of the second file system by determining a set of changes between data in the third snapshot of the second file system and the second snapshot of the second file system that was applied to the first file system; and

bringing the first file system to the state of the second file system at the sixth time by applying the second data set to the second file system after applying the first snapshot of the second file system and the data set of the second file system to the first file system.

17. The method of claim 1, further comprising:

generating a third snapshot of the first file system at a third time;

generating a second data set of the first file system by determining a set of changes between data in the third snapshot of the first file system and the second snapshot of the first file system; and

bringing the second file system to the state of the first file system at the third time by applying the second data set to the second file system after applying the first snapshot of the first file system and the data set of the first file system to the second file system.

18. The method of claim 17, further comprising:

generating a fourth snapshot of the first file system at a fourth time;

generating a third data set of the first file system by determining a set of changes between data in the fourth snapshot of the first file system and the second data set of the first file system that was applied to the second file system; and

bringing the second file system to the state of the first file system at the fourth time by applying the third data set to the second file system after applying the first snapshot of the first file system, the data set of the first file system and the second data set of the first file system to the second file system.

19. The method of claim 1, wherein at least one of the steps of generating a first snapshot of the first file system and generating a second snapshot of the first file system comprises:

generating a snapshot dataset for a source file in the first file system, wherein the source file comprises at least one of data and metadata, and wherein the snapshot dataset is substantially empty after being generated and comprises at least one shadow inode, wherein the at least one shadow inode, when the snapshot dataset is generated, each contain an invalid disk address and further comprises a corresponding shadow inode for each inode of the first file system; and

performing at least one of the following steps;

copying to the at least one shadow inode in the snapshot dataset an inode corresponding to the source file, when a data block corresponding to the source file is only appended, wherein a disk address of the data block corresponding to the source file is not copied to the at least one shadow inode;

copying to the at least one shadow inode in the snapshot dataset the inode corresponding to the source file and copying to the snapshot dataset the data block corresponding to the source file, when the data block corresponding to the source file is at least one of overwritten and deleted, wherein the at least one shadow inode includes a disk address of the data block which was written in the snapshot dataset; and

copying to the at least one shadow inode in the snapshot dataset the inode corresponding to the source file, when only metadata of the source file is modified, wherein a disk address of a data block corresponding to the source file is not copied to the at least one shadow inode.

20. A computer readable medium including computer instructions for providing a standby file system, the computer instructions comprising instructions for:

generating a first snapshot of a first file system at a first time, wherein the first file system is a primary file system;

restoring to a second file system the first snapshot of the first file system, wherein the second file system is a standby file system;

generating a second snapshot of the first file system at a second time;

generating a data set of the first file system by determining a set of changes between data stored in the first snapshot of the first file system and data stored in the second snapshot of the first file system and storing the set of changes into the data set; and

bringing the second file system to the state of the first file system at the second time by applying, after the restoring, the data set to the second file system.

21. The computer readable medium of claim 20, the computer instructions further comprising instructions for:

generating, in response to bringing the second file system to the state of the first file system at the second time, a first snapshot of the second file system; and

initializing the second file system as the primary file system.

22. The computer readable medium of claim 21, the computer instructions further comprising instructions for:

generating, at a third time, a second snapshot of the second file system;

generating a data set of the second file system by determining a set of changes between data stored in the first snapshot of the second file system and data stored in the second snapshot of the first file system and storing the set of changes into the data set;

restoring, in response to a recovery of the first file system, the first snapshot of the first file system to the first file system;

bringing the first file system to the state of the second file system at the third time by applying the data set of the second file system to the first file system; and

initializing the first file system as the standby file system.

23. The computer readable medium of claim 22, the computer instructions further comprising instructions for:

initializing the second file system as the standby file system; and

initializing the first file system as the primary file system.

24. The computer readable medium of claim 20, wherein the computer instructions for bringing the second file system to the state of the first file system at the second time operate in response to determining an unavailability of the first file system, the computer instructions further comprising instructions for:

initializing the second file system as the primary file system; and

generating, in response to bringing the second file system to the state of the first file system at the second time, a first snapshot of the second file system.

25. The computer readable medium of claim 24, the computer instructions further comprising instructions for:

restoring to the first file system the first snapshot of the first file system;

bringing the first file system to the state of the first file system at the second time by applying, after the restoring to the first file system, the data set to the first file system;

generating, at a fourth time, a second snapshot of the second file system;

generating a data set of the second file system by determining a set of changes between the first snapshot of the first file system and the second snapshot of the second file system;

bringing the first file system to the state of the second file system at the fourth time by applying the data set of the second file system to the first file system; and

initializing the first file system as the standby file system.

26. The computer readable medium of claim 25, the computer instructions further comprising instructions for:

initializing the second file system as the standby file system; and

initializing the first file system as the primary file system.

27. A system for providing a standby file system, comprising:

means for generating a first snapshot of a first file system at a first time, wherein the first file system is a primary file system;

means for restoring to a second file system the first snapshot of the first file system, wherein the second file system is a standby file system;

means for generating a second snapshot of the first file system at a second time;

means for generating a data set of the first file system by determining a set of changes between data stored in the first snapshot of the first file system and data stored in the second snapshot of the first file system and storing the set of changes into the data set; and

;

means for bringing the second file system to the state of the first file system at the second time by applying, after operation of the means for restoring, the data set to the second file system.

28. The system of claim 27, further comprising:

means for generating, in response to bringing the second file system to the state of the first file system at the second time, a first snapshot of the second file system; and

means for initializing the second file system as the primary file system.

29. The system of claim 28, further comprising:

means for generating, at a third time, a second snapshot of the second file system;

means for generating a data set of the second file system by determining a set of changes between data stored in the first snapshot of the second file system and data stored in the second snapshot of the first file system and storing the set of changes into the data set;

means for restoring, in response to a recovery of the first file system, the first snapshot of the first file system to the first file system;

means for bringing the first file system to the state of the second file system at the third time by applying the data set of the second file system to the first file system; and

means for initializing the first file system as the standby file system.

30. The system of claim 29, further comprising:

means for initializing the second file system as the standby file system; and

means for initializing the first file system as the primary file system.

31. The system of claim 27, wherein the means for bringing the second file system to the state of the first file system at the second time operates in response to determining an unavailability of the first file system, the system further comprising:

means for initializing the second file system as the primary file; and

means for generating, in response to bringing the second file system to the state of the first file system at the second time, a first snapshot of the second file system.

32. The system of claim 31, further comprising:

means for restoring to the first file system the first snapshot of the first file system;

means for bringing the first file system to the state of the first file system at the second time by applying, after the restoring to the first file system, the data set to the first file system;

means for generating, at a fourth time, a second snapshot of the second file system;

means for generating a data set of the second file system by determining a set of changes between the first snapshot of the first file system and the second snapshot of the second file system;

means for bringing the first file system to the state of the second file system at the fourth time by applying the data set of the second file system to the first file system; and

initializing the first file system as the standby file system.

33. A system for providing a standby file system, comprising:

a first snapshot generated at a first time of a first file system, wherein the first file system is a primary file system;

means for restoring to second file system the first snapshot of the first file system, wherein the second file system is a standby file system;

a second snapshot generated at a second time of the first file system;

a data set of the first file system, wherein the data set contains changes between data stored in the first snapshot of the first file system and data stored in the second snapshot of the first file system; and

means for bringing the second file system to the state of the first file system at the second time by applying, after the restoring, the data set to the second file system.

34. The system of claim 33, further comprising:

a third snapshot generated at a third time of the second file system, the third time corresponding to a time of operation of the means for bringing the second file system to the state of the first file system at the second time; and

means for initializing the second file system as the primary file system.

35. The system of claim 34, further comprising:

a fourth snapshot generated at a fourth time of the second file system;

a data set of the second file system, wherein the data set of the second file system contains changes between data stored in the first snapshot of the second file system and data stored in the second snapshot of the second file system;

means for restoring, in response to a recovery of the first file system, the first snapshot of the first file system to the first file system;

means for bringing the first file system to the state of the second file system at the third time by applying the data set of the second file system to the first file system; and

means for initializing the first file system as the standby file system.