Distributed open writable snapshot copy facility using file migration policies

• US 20060212481A1
• Filed: 03/21/2005
• Published: 09/21/2006
• Est. Priority Date: 03/21/2005
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Stacey, Christopher H., Zimran, Eyal
• Granted Patent: US 7,546,431 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A read-write snapshot copy facility is constructed from a hierarchical storage management facility. The read-write snapshot copy file system initially comprises stub files pointing to the files in a read-only snapshot copy file system. When an application writes to a file in the read-write snapshot copy, the read-write snapshot copy facility migrates a copy of the file to replace the stub file, and then writes to the migrated file. Because the read-write snapshot copy facility references the files in the read-only snapshot file system in a network namespace using standard protocols such as NFS or CIFS, the read-write snapshot copy facility permits referencing of distributed read-only snapshot file systems in an open (heterogeneous) network environment, and the read-write snapshot copy is scalable by linking the read-write snapshot copy facility to multiple file servers containing read-only snapshot file systems.

Claims

1. A method comprising:

a read-write snapshot copy facility creating a read-write snapshot copy of at least a portion of a production file system by creating stub files including pointers to data files in a read-only snapshot copy of at least the portion of the production file system; and

the read-write snapshot copy facility responding to a read request from an application program to read data from a read-write snapshot copy of at least a portion of one of the data files in the read-only snapshot copy of at least the portion of the production file system by accessing one of the stub files to obtain a pointer to said one of the data files, and using the pointer to said one of the data files to read data from said one of the data files and to return the data read from said one of the data files to the application program; and

the read-write snapshot copy facility responding to a write request from the application program to write data to a read-write snapshot copy of at least a portion of another of the data files in the read-only snapshot copy of at least the portion of the production file system by accessing another of the stub files to obtain a pointer to said another of the data files, and using the pointer to said another of the data files to read data from said another of the data files to produce a file that is written to by the application program and that replaces said another of the stub files.

2. The method as claimed in claim 1, wherein the read-write snapshot copy facility is in a first file server that stores the stub files, and a read-only snapshot copy facility is in a second file server that stores the production file system, and the read-write snapshot copy facility accesses the read-only snapshot copy of at least the portion of the production file system by accessing the read-only snapshot copy facility.

3. The method as claimed in claim 2, wherein the application program is in a client computer that sends the read request and the write request over a data network to the first file server.

4. The method as claimed in claim 1, wherein the read-write snapshot copy facility and the application program are replicated in each of a number of client computers, and the method includes using the client computers to execute the application programs upon different read-write snapshot copies by accessing a shared read-only file system that is stored in a file server.

5. The method as claimed in claim 1, which includes using the read-write snapshot copy facility to create a read-write file system that is comprised of at least respective portions of a plurality of read-only file systems residing in different file servers.

6. The method as claimed in claim 1, wherein the read-write snapshot copy facility accesses a hierarchical storage management facility for performing pass-through read access of said one of the data files in response to the read request, and for performing a full migration of a copy of said another of the data files in response to the write request.

7. The method as claimed in claim 1, which includes the read-write snapshot copy facility setting an initial value of a storage quota for stub files and new and changed files of the read-write snapshot copy of at least the portion of the production file system, the initial value of the storage quota being a fraction of the size of the production file system.

8. The method as claimed in claim 1, which includes read-write snapshot copy facility migrating directory files from the read-only snapshot copy of at least the portion of the production file system to the read-write snapshot copy of at least the portion of the production file system as a background process, and migrating a directory file from the read-only snapshot copy of at least the portion of the production file system to the read-write snapshot copy of at least the portion of the production file system as a priority process in response to a request from the application program for read access to the directory file.

9. The method as claimed in claim 1, which includes operating a read-only snapshot copy facility to create the read-only snapshot copy of at least the portion of the production file system and to provide the read-write snapshot copy facility with read access to the read-only snapshot copy of at least the portion of the production file system.

10. The method as claimed in claim 1, which includes promoting the read-write snapshot copy of at least the portion of the production file system by migrating read-only snapshot data referenced by the stub files in order to produce read-write data files that are used for replacing the stub files.

11. Apparatus comprising a data processing device including storage and a read-write snapshot copy facility, the read-write snapshot copy facility being programmed for creating, in the storage of the data processing device, stub files including pointers to data files in a read-only snapshot copy of at least a portion of a production file system;

the read-write snapshot copy facility being programmed for responding to a read request from an application program to read data from a read-write snapshot copy of at least a portion of one of the data files in the read-only snapshot copy of at least the portion of the production file system by accessing one of the stub files to obtain a pointer to said one of the data files, and using the pointer to said one of the data files to read data from said one of the data files and to return the data read from said one of the data files to the application program; and

the read-write snapshot copy facility being programmed for responding to a write request from the application program to write data to a read-write snapshot copy of at least a portion of another of the data files in the read-only snapshot copy of at least the portion of the production file system by accessing another of the stub files to obtain a pointer to said another of the data files, and using the pointer to said another of the data files to read data from said another of the data files to produce a file that is written to by the application program and that replaces said another of the stub files.

12. The apparatus as claimed in claim 11, wherein the data processing device is a first file server, and wherein the apparatus further comprise a second file server, and a data network linking the first file server to the second file server for transmission of data between the first file server and the second file server, and the read-only snapshot copy facility is in the second file server, and the second file server has storage for storing the production file system.

13. The apparatus as claimed in claim 12, which includes a client computer linked by the data network to the first file server for the transmission of data between the client computer and the first file server, wherein the application program is stored in the client computer for execution by the client computer.

14. The apparatus as claimed in claim 11, which includes a plurality of client computers, and wherein the read-write snapshot copy facility and the application program are replicated in each of the client computers so that the application programs are executable for accessing different read-write copies by the read-write snapshot copy facilities accessing a shared read-only file system.

15. The apparatus as claimed in claim 11, wherein the read-write snapshot copy facility is programmed to create a read-write file system that is comprised of a plurality of read-only copies of file systems residing in different file servers.

16. The apparatus as claimed in claim 11, wherein the read-write snapshot copy facility includes a hierarchical storage management facility for performing pass-through read access of said one of the data files in response to the read request, and for performing a full migration of a copy of said another of the data files in response to the write request.

17. The apparatus as claimed in claim 11, wherein the read-write snapshot copy facility is programmed for setting an initial value of a storage quota for stub files and new and changed files of a read-write snapshot copy of at least the portion of the production file system, the initial value of the storage quota being a fraction of the size of the production file system.

18. The apparatus as claimed in claim 11, wherein the read-write snapshot copy facility is programmed for migrating directory files from the read-only snapshot copy of at least the portion of the production file system to a read-write snapshot copy of at least the portion of the production file system as a background process, and migrating a directory file from the read-only snapshot copy of at least the portion of the production file system to the read-write snapshot copy of at least the portion of the production file system as a priority process in response to a request from the application program for read access to the directory file.

19. The apparatus as claimed in claim 11, which further includes a read-only snapshot copy facility for creating the read-only snapshot copy of at least the portion of the production file system, and a network linking the read-only snapshot copy facility to the read-write snapshot copy facility for providing the read-write snapshot copy facility with read access to the read-only snapshot copy of at least the portion of the production file system.

20. The apparatus as claimed in claim 11, wherein the data processing device is programmed for creating an independent production file system by migrating read-only snapshot data referenced by the stub files in order to produce read-write data files used for replacing the stub files.