Scalable global namespace through referral redirection at the mapping layer

• US 7,937,453 B1
• Filed: 09/24/2008
• Issued: 05/03/2011
• Est. Priority Date: 09/24/2008
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Hayden, John M., Jiang, Xiaoye
• Primary Examiner(s): Ismail; Shawki S
• Assistant Examiner(s): Korobov; Vitali
• Application Number:
  US12/236,997
• Time in Patent Office: 951 Days
• Field of Search: 707/607, 707/617, 707/625, 707/821, 707/899, 709/229, 709/219, 709/203, 709/217, 709/223
• US Class Current: 709/219
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097

Abstract

Client computers, a namespace server, and file servers are linked in a data network so that the namespace server provides the clients with NFS or CIFS access to a virtual file system including files stored in the file servers, and also provides migration of files between the file servers in a fashion transparent to the client access using NFS or CIFS. The client computers and storage arrays storing the file data are also linked in a storage area network so that the clients have high speed block access to the file data using a file mapping protocol. The namespace server redirects a metadata access request in the file mapping protocol from a client to the appropriate file server when the file is not being migrated, and otherwise denies the metadata access request when the file is being migrated so that the client reverts to NFS or CIFS access.

Claims

1. In a data processing system including client computers, file servers managing respective file systems, storage arrays storing file data of the file systems, and a namespace server providing the client computers with file access to a virtual file system in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol, the virtual file system containing files of the respective file systems managed by the file servers, a method of providing at least one of the client computers with read or write access to a specified file in the virtual file system, said method comprising:

said at least one of the client computers sending to the namespace server a first metadata access request in accordance with a file mapping protocol for metadata access to the specified file, and the namespace server responding to the first metadata request by determining that the specified file is not presently being migrated, and upon determining that the specified file is not presently being migrated, the namespace server returning to said at least one of the client computers a redirection reply redirecting said at least one of the client computers to one of the file servers managing a respective one of the file systems including the specified file, and said at least one of the client computers receiving the redirection reply and using the redirection reply to obtain file mapping metadata from said one of the file servers managing the respective one of the file systems including the specified file, and using the file mapping metadata to produce a block access request sent to one of the storage arrays storing file data of the specified file to read data from or write data to the specified file; and

said at least one of the client computers sending a second metadata access request in accordance with the file mapping protocol to the namespace server for metadata access to the specified file, and the namespace server responding to the second metadata request by determining that the specified file is now being migrated, and upon determining that the specified file is now being migrated, the namespace server returning to said at least one of the client computers a metadata access denied reply, and said at least one of the client computers receiving the metadata access denied reply and responding to the metadata access denied reply by sending to the namespace server a read or write request in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol to read data from or write data to the specified file as requested by said at least one client computer.

2. The method as claimed in claim 1, wherein said at least one client computer uses the file mapping metadata to produce the block access request sent to one of the storage arrays storing file data of the specified file to write data to the specified file.

3. The method as claimed in claim 1, wherein said at least one client computer responds to the metadata access denied reply by sending to the namespace server a write request in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol to write data to the specified file while the specified file is being migrated.

4. The method as claimed in claim 1, wherein the file mapping metadata includes a list of extents of file data of the specified file, and wherein the block address request sent to said one of the storage arrays storing data of the specified file is a Small Computer System Interface (SCSI) read or write command.

5. The method as claimed in claim 1, wherein the data processing system further includes a storage area network (SAN) linking the client computers to the storage arrays for block access to the file data of the file systems, and the method further includes said at least one of the client computers sending the block access request over the storage area network (SAN) to said one of the storage arrays storing the file data of the specified file to read data from or write data to the specified file, and the block access request sent over the storage area network (SAN) to said one of the storage arrays storing the file data of the specified file to read data from or write data to the specified file is a Small Computer System Interface (SCSI) read or write command.

6. The method as claimed in claim 1, wherein the data processing system further includes an Internet Protocol (IP) network linking the client computers to the namespace server, and wherein the method further includes said at least one of the client computers sending the first metadata request over the Internet Protocol (IP) network to the namespace server, and the namespace server returning the redirection reply to said at least one of the client computers over the Internet Protocol (IP) network, and said at least one of the client computers sending the second metadata access request to the namespace server over the Internet Protocol (IP) network, and the namespace server returning to said at least one of the client computers the metadata access denied reply over the Internet Protocol (IP) network, and said at least one of the client computers sending to the namespace server the read or write request in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol over the Internet Protocol (IP) network to read data from or write data to the specified file while the specified file is being migrated.

7. The method as claimed in claim 1, which further includes the namespace server migrating the specified file between the file servers by sending to the file servers read or write commands in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol to copy the specified file between the file servers, and the namespace server interrupting the copying of the specified file between the file servers so that the migration of the specified file is transparent to read or write access of the specified file in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol by said at least one of the client computers, and the namespace server renewing the copying of the specified file between the file servers once the read or write access of the specified file in accordance with the Network File System (NFS) protocol or the Common Internet File System (CIFS) protocol by said at least one of the client computers has been completed.

8. The method as claimed in claim 1, which further includes the namespace server migrating the specified file from a first one of the file servers to a second one of the file servers by setting an attribute of the specified file in the virtual file system to indicate that migration of the specified file is in progress, notifying the first one of the file servers that migration of the specified file is in progress, and copying the specified file from the first one of the file servers to the second one of the file servers, and the first one of the file servers responding to the notification that migration of the specified file is in progress by denying metadata access of the client computers to the specified file.

9. The method as claimed in claim 8, which further includes said at least one of the client computers responding to denial of metadata access to the specified file by the first one of the file servers by said at least one of the client computers sending the second metadata access request to the namespace server in accordance with the file mapping protocol for metadata access to the specified file.