PASS-THROUGH WRITE POLICIES OF FILES IN DISTRIBUTED STORAGE MANAGEMENT

• US 20070266056A1
• Filed: 05/09/2006
• Published: 11/15/2007
• Est. Priority Date: 05/09/2006
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Stacey, Christopher, Zimran, Eyal
• Granted Patent: US 7,546,432 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99954 Version management

Abstract

A hierarchical storage system includes file servers and a policy engine server. Offline attributes are added to file system inodes in a primary file server, file system parameters are added in the primary server, offline read and write access method fields are added to a connection database, and the primary file server uses these attributes and parameters for selecting a particular read method or write method for access to an offline file or section of an offline file. The write methods follow a “write recall full” policy, a “pass-through write” policy, a “pass-through multi-version” policy, or a “directory write pass-through” policy. The pass-through multi-version policy results in a new offline version of a file each time that a client opens and writes to a multi-version file. The directory write pass-through policy results in a new offline file when a file is created within a write pass-through directory.

Claims

1. A method of operation in a data network including a file server for access to file data that is migrated between primary storage and secondary storage, said method comprising:

the file server responding to a client request for write access to a specified file by checking whether file data of the specified file has been migrated from the primary storage to the secondary storage, and upon finding that file data of the specified file has been migrated from the primary storage to the secondary storage, performing a write pass-through in which data of the specified file is not recalled from the secondary storage to the primary storage in response to the client request for write access to the specified file and file data from the client is written to the secondary storage, wherein the file server follows a write pass-through multi-version policy resulting in a new offline version of a multi-version file each time that a client opens and writes to the multi-version file.

2. The method of operation as claimed in claim 1, wherein the file server follows the write pass-through multi-version policy by opening the multi-version file as a new offline version for pass-through write and preserving an original version of the multi-version file as a snapshot file in response to a first request from the client to write to the multi-version file following a request from the client to open the multi-version file.

3. The method of operation as claimed in claim 1, wherein the file server following the write pass-through multi-version policy further includes the file server updating offline content verifiers of the multi-version file upon closing the multi-version file.

4. The method of operation as claimed in claim 3, wherein the file server updates the offline content verifiers of the multi-version file in a corresponding stub file for the multi-version file, the stub file being stored in the primary storage.

5. The method of operation as claimed in claim 3, wherein the content verifiers include an offline file size and modification time.

6. The method of operation as claimed in claim 1, wherein the multi-version file has at least one attribute used for controlling selective retention of snapshots of the multi-version file by deleting an oldest one of the snapshots of the multi-version file upon inspecting said at least one attribute.

7. The method of operation as claimed in claim 1, which includes using at least three attributes of the multi-version file for controlling selective retention of snapshots of the multi-version file, the attributes specifying a maximum number of snapshots to keep, an expiration age of the snapshots, and a minimum number of expired snapshots to keep.

8. The method of operation as claimed in claim 1, which further includes the file server following a directory write pass-through policy resulting in a new offline file when a file is created within a write pass-through directory.

9. The method of operation as claimed in claim 8, wherein the file server following the directory write pass-through policy includes the primary file server writing new file data for the new offline file to a secondary storage location specified by a setting on the write pass-through directory.

10. The method of operation as claimed in claim 1, which further includes the file server following different write migration policies for different sections of a multi-section offline file, as specified by at least one write policy attribute of the multi-section offline file.

11. The method of operation as claimed in claim 10, which includes the file server accessing in primary storage a respective stub file for each section of the multi-section offline file in order to determine the write migration policy and offline attributes of said each section of the multi-section offline file.

12. A method of operation in a data network including a file server for access to file data that is migrated between primary storage and secondary storage, said method comprising:

the file server responding to a client request for write access to a specified file by checking whether file data of the specified file has been migrated from the primary storage to the secondary storage, and upon finding that file data of the specified file has been migrated from the primary storage to the secondary storage, performing a write pass-through in which data of the specified file is not recalled from the secondary storage to the primary storage in response to the client request for write access to the specified file and file data from the client is written to the secondary storage, wherein the file server follows a directory write pass-through policy resulting in a new offline file when a file is created within a write pass-through directory.

13. The method of operation as claimed in claim 12, wherein the file server following the directory write pass-through policy includes the primary file server writing new file data for the new offline file to a secondary storage location specified by a setting on the write pass-through directory.

14. The method of operation as claimed in claim 12, wherein the file server either creates a new directory on the secondary storage for the new offline file or does not create a new directory on the secondary storage as selected by a setting on the write pass-through directory.

15. The method of operation as claimed in claim 12, wherein the file server sets read and write migration policies for the new file as selected by settings on the write pass-through directory.

16. The method as claimed in claim 12, which includes the file server finding that the write pass-through directory is in a write pass-through directory tree, and the file server finding that the write pass-through directory does not have a pass-through override option set.

17. The method of operation as claimed in claim 12, which further includes the file server following different write migration policies for different sections of a multi-section offline file, as specified by at least one write policy attribute of the multi-section offline file.

18. The method of operation as claimed in claim 17, which includes the file server accessing in primary storage a respective stub file for each section of the multi-section offline file in order to determine the write migration policy and offline attributes of said each section of the multi-section offline file.

19. A method of operation in a data network including a file server for access to file data that is migrated between primary storage and secondary storage, said method comprising:

the file server responding to a client request for write access to a specified file by checking whether file data of the specified file has been migrated from the primary storage to the secondary storage, and upon finding that file data of the specified file has been migrated from the primary storage to the secondary storage, performing a write pass-through in which data of the specified file is not recalled from the secondary storage to the primary storage in response to the client request for write access to the specified file and file data from the client is written to the secondary storage, wherein the file server follows different write migration policies for different sections of a multi-section offline file, as specified by at least one write policy attribute of the multi-section offline file.

20. The method of operation as claimed in claim 19, which includes the file server accessing in primary storage a respective stub file for each section of the multi-section offline file in order to determine the write migration policy and offline attributes of said each section of the multi-section offline file.