Efficient hierarchical storage management of a file system with snapshots

• US 8,055,864 B2
• Filed: 08/06/2007
• Issued: 11/08/2011
• Est. Priority Date: 08/06/2007
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Sawdon, Wayne A., Schmuck, Frank B.
• Primary Examiner(s): Elmore; Reba I
• Application Number:
  US11/834,338
• Publication Number:
  US 20090043978A1
• Time in Patent Office: 1,555 Days
• Field of Search: 711/101, 711/162
• US Class Current: 711/162
• CPC Class Codes: G06F 16/174 Redundancy elimination performed by the file system management of the data involved in backup or backup restore using de-duplication of the data G06F11/14
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A method is provided for managing the storage of a file that has been selected for migration from a first storage level within a file system to a second storage level. The method comprises copying each of one or more data blocks of the selected file that are stored in the first storage level at a physical disk address maintained in a corresponding reference of an inode for the selected file from the first storage level to the second storage level; maintaining a logical ditto address in each reference of an inode for each snapshot file in the file system that refers to one of the one or more data blocks of the selected file that were copied to the second storage level; and updating the file system to include a managed region for controlling access to the one or more data blocks through the inode for the selected file.

Claims

1. A file storage management method, the method comprising:

providing an inode of a first file that includes at least one reference, where the at least one reference includes a physical disk address of a data block of the first file;

providing an inode of a snapshot file of the first file, where the inode includes at least one reference that includes the physical disk address of the data block of the first file;

copying the at least one data block of the first file from a first storage level to a second storage level;

updating the at least one reference of the inode of the snapshot file with a logical value, where the logical value includes a value indicating that additional processing is required to obtain the physical disk address of the data block of the first file; and

providing a managed region that controls access to the data block through the inode of the first file.

2. The method of claim 1, further comprising:

deallocating the data block of the first file.

3. The method of claim 2, further comprising:

copying at least one data block of the snapshot file from the first storage level to the second storage level.

4. The method of claim 3, wherein the deallocating comprises delaying the deallocating the data block of the first file until after the copying of the at least one data block of the snapshot file is complete.

5. The method of claim 1, wherein the updating the at least one reference occurs when the snapshot file is generated.

6. The method of claim 5, further comprising converting the logical value to a physical disk address when the data block is modified.

7. The method of claim 1, wherein the updating the at least one reference occurs once the copying is complete.

8. The method of claim 1, further comprising:

receiving a request to read or modify the first file;

using the managed region, restoring the at least one data block of the first file to the first file storage level; and

satisfying the request to read or modify the first file.

9. The method of claim 1, further comprising:

receiving a request to read or modify the snapshot file;

when the logical value is maintained in the reference of the inode of the snapshot file, restoring the data block of the first file to the first storage level using the managed region; and

satisfying the request to read or modify the snapshot file.

10. The method of claim 3, further comprising:

receiving a request to read or modify the snapshot file;

when the physical disk address is maintained in a reference of the inode of the snapshot file, restoring the data block of the snapshot file to the first storage level using the managed region;

when the logical value is maintained in the reference of the inode of the snapshot file, restoring the data block of the first file to the first storage level using the managed region; and

satisfying the request to read or modify the snapshot file.

11. The method of claim 10, further comprising:

updating the logical value of the reference of the inode of the snapshot file with a physical disk address.

12. The method of claim 1, further comprising:

receiving a request to delete or truncate the first file;

restoring the at least one data block of the first file to the first storage level; and

updating the logical value of the reference of the inode of the snapshot file with a physical disk address.

13. The method of claim 1, wherein the inode of the first file includes a disk address pointer to one or more indirect data blocks that contain at least one reference to a data block of the first file.

14. The method of claim 1, wherein the first storage level is an online memory device under the control of a processing unit upon which a file system is executed.

15. The method of claim 14, wherein the online memory device comprises a hard disk drive array.

16. The method of claim 1, wherein the second storage level comprises an offline memory device that communicates with a file system via a network.

17. The method of claim 16, wherein the offline memory device comprises storage medium selected from floppy disks, optical disks, and magnetic tape.

18. A data processing system, comprising:

a central processing unit;

a random access memory for storing data and programs for execution by the central processing unit;

a first storage level comprising a nonvolatile storage device; and

computer readable instructions stored in the random access memory for execution by the central processing unit to perform a program for managing the storage of a file that has been selected for migration from the first storage level within a file system to a second storage level, wherein the program causes operations to be performed, the operations comprising;

providing an inode of a first file that includes at least one reference, where the at least one reference includes a physical disk address of a data block of the first file;

providing an inode of a snapshot file of the first file, where the inode includes at least one reference that includes the physical disk address of the data block of the first file;

copying the at least one data block of the first file from the first storage level to the second storage level;

updating the at least one reference of the inode of the snapshot file with a logical value, where the logical value includes a value indicating that additional processing is required to obtain the physical disk address of the data block of the first file; and

providing a managed region that controls access to the data block through the inode of the first file.