TCP forwarding of client requests of high-level file and storage access protocols in a network file server system

• US 20060230148A1
• Filed: 04/06/2005
• Published: 10/12/2006
• Est. Priority Date: 04/06/2005
• Status: Abandoned Application

• Current Assignee: EMC Corporation (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Gupta, Uday K,, Faibish, Sorin, Jiang, Xiaoye, Fridella, Stephen A., Forecast, John
• Application Number:
  US11/099,912
• Publication Number:
  US 20060230148A1
• Time in Patent Office: Days
• US Class Current: 709/226
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/165 Combined use of TCP and UDP protocols; selection criteria therefor

Abstract

For each high-level protocol, a respective mesh of Transmission Control Protocol (TCP) connections is set up for a cluster of server computers for the forwarding of client requests. Each mesh has a respective pair of TCP connections in opposite directions between each pair of server computers in the cluster. The high-level protocols, for example, include the Network File System (NFS) protocol, and the Common Internet File System (CIFS) protocol. Each mesh can be shared among multiple clients because there is no need for maintenance of separate TCP connection state for each client. The server computers may use Remote Procedure Call (RPC) semantics for the forwarding of the client requests, and prior to the forwarding of a client request, a new unique transaction ID can substituted for an original transaction ID in the client request so that forwarded requests have unique transaction IDs.

Claims

1. A method of operation of multiple server computers connected by a data network to client computers for providing the client computers with access to file systems in accordance with a plurality of high-level protocols in which access requests indicate respective file systems to be accessed, access to each of the file systems being managed by a respective one of the server computers, said method comprising:

for each of the plurality of high-level protocols, setting up a respective mesh of Transmission Control Protocol (TCP) connections between the server computers for forwarding, between the server computers, access requests in accordance with said each of the plurality of high-level protocols;

each mesh having a respective pair of TCP connections in opposite directions between each pair of the server computers; and

each of the server computers responding to receipt of client requests for access in accordance with the high-level protocols by forwarding at least some of the client requests for access in accordance with the high-level protocols over the respective meshes to other ones of the server computers that manage access to the file systems indicated by said at least some of the client requests for access.

2. The method as claimed in claim 1, wherein the high-level protocols include the Network File System (NFS) protocol, the Common Internet File System (CIFS) protocol, the File Transfer Protocol (FTP), and the Internet Small Computer System Interface (iSCSI) protocol.

3. The method as claimed in claim 1, wherein each mesh is shared among multiple ones of the client computers and there is no maintenance of separate TCP connection state for each of the multiple ones of the client computers.

4. The method as claimed in claim 1, wherein at least one of the client computers uses the User Datagram Protocol (UDP) for transmission of at least one of the access requests in accordance with at least one of the high-level protocols over the data network to at least one of the server computers, and said at least one of the server computers forwards said at least one of the access requests over a TCP connection of the respective mesh for said at least one of the high-level protocols to another one of the server computers that manages one of the file systems that is indicated by said at least one of the access requests in accordance with said at least one of the high-level protocols, and said at least one of the server computers converts a TCP byte stream into a UDP-like message during servicing of said at least one of the access request.

5. The method as claimed in claim 1, wherein the server computers use Remote Procedure Call (RPC) semantics for the forwarding of said at least some of the client requests for access in accordance with the high-level protocols over the respective meshes to other ones of the server computers that manage access to the file systems indicated by said at least some of the client requests for access.

6. The method as claimed in claim 1, which includes adding additional TCP connections to at least one of the meshes to increase transmission bandwidth of said at least one of the meshes.

7. The method as claimed in claim 1, which includes at least one of the server computers creating a new mesh for use by a client application.

8. The method as claimed in claim 1, which includes at least one of the server computers accessing a forwarding policy parameter set for at least one of the high-level protocols to determine whether to forward to another one of the server computers either a data request or a metadata request in response to receipt of at least one client request for access in accordance with said at least one of the high-level protocols.

9. The method as claimed in claim 1, which includes at least one of the client computers having an IP address and sending from the IP address to at least one of the server computers at least one request for access including an original transaction ID, and said at least one of the server computers responding to receipt of said at least one request for access by assigning a new transaction ID to said at least one client request, caching a mapping of the new transaction ID with the original transaction ID and the IP address, substituting the new transaction ID for the original transaction ID in said at least one request for access, and forwarding said at least one request for access including the substituted new transaction ID to another one of the server computers that manages access to a file system that is indicated by said at least one request for access.

10. The method as claimed in claim 9, which includes said at least one of the server computers receiving a reply including the new transaction ID from said another one of the server computers that manages access to the file system that is indicated by said at least one request for access, and in response said at least one of the server computers obtaining the new transaction ID from the reply and using the new transaction ID from the reply to lookup the cached original transaction ID and the IP address, in order to replace the new transaction ID in the reply with the original transaction ID and return the reply to the IP address of said at least one of the client computers.

11. A method of operation of multiple server computers connected by a data network to client computers for providing access to file systems in accordance with a plurality of high-level protocols in which access requests indicate respective file systems to be accessed, access to each of the file systems being managed by a respective one of the server computers, said method comprising:

for each of the plurality of high-level protocols, setting up a respective mesh of Transmission Control Protocol (TCP) connections between the server computers for forwarding, between the server computers, access requests in accordance with said each of the plurality of high-level protocols;

each mesh having a respective pair of TCP connections in opposite directions between each pair of the server computers; and

each of the server computers responding to receipt of client requests for access in accordance with the high-level protocols by forwarding at least some of the client requests for access in accordance with the high-level protocols over the respective meshes to other ones of the server computers that manage access to the file systems indicated by said at least some of the client requests for access;

wherein the high-level protocols include the Network File System (NFS) protocol, and the Common Internet File System (CIFS) protocol;

wherein each mesh is shared among multiple ones of the client computers and there is no maintenance of separate TCP connection state for each of the multiple ones of the client computers;

wherein the server computers use Remote Procedure Call (RPC) semantics for the forwarding of said at least some of the client requests for access in accordance with the high-level protocols over the respective meshes to other ones of the server computers that manage access to the file systems indicated by said at least some of the client requests for access;

which includes at least one of the client computers having an IP address and sending from the IP address to at least one of the server computers at least one request for access including an original transaction ID, and said at least one of the server computers responding to receipt of said at least one request for access by assigning a new transaction ID to said at least one client request, caching a mapping of the new transaction ID with the original transaction ID and the IP address, substituting the new transaction ID for the original transaction ID in said at least one request for access, and forwarding said at least one request for access including the substituted new transaction ID to another one of the server computers that manages access to a file system that is indicated by said at least one request for access; and

which includes said at least one of the server computers receiving a reply including the new transaction ID from said another one of the server computers that manages access to the file system that is indicated by said at least one request for access, and in response said at least one of the server computers obtaining the new transaction ID from the reply and using the new transaction ID from the reply to lookup the cached original transaction ID and the IP address, in order to replace the new transaction ID in the reply with the original transaction ID and return the reply to the IP address of said at least one of the client computers.

12. A network file server system for connection via a data network to client computers for providing the client computers with access to file systems in accordance with a plurality of high-level protocols in which access requests indicate respective file systems to be accessed;

said network file server system comprising, in combination;

multiple server computers for connection via the data network to the client computers, the plurality of server computers being programmed so that access to each of the file systems is managed by a respective one of the server computers, said server computers being programmed for setting up a respective mesh of Transmission Control Protocol (TCP) connections between the server computers for forwarding, between the server computers, access requests in accordance with said each of the plurality of high-level protocols, each mesh having a respective pair of TCP connections in opposite directions between each pair of the server computers; and

each of the server computers being programmed for responding to receipt of client requests for access in accordance with the high-level protocols by forwarding at least some of the client requests for access in accordance with the high-level protocols over the respective meshes to other ones of the server computers that manage access to the file systems indicated by said at least some of the client requests for access.

13. The network file server system as claimed in claim 12, wherein the high-level protocols include the Network File System (NFS) protocol, the Common Internet File System (CIFS) protocol, the File Transfer Protocol (FTP), and the Internet Small Computer System Interface (iSCSI) protocol.

14. The network file server system as claimed in claim 12, which is programmed for detecting failure of a data mover, and upon substitution of a replacement data mover for the failed data mover, accessing a configuration database in order to obtain configuration information about each TCP connection with the failed data mover in each mesh and using the configuration information for re-establishing each TCP connection with the failed data mover in each mesh so that each TCP connection with the failed data mover in each mesh is re-established with the replacement data mover.

15. The network file server system as claimed in claim 12, wherein at least one of the server computers is programmed for receiving from at least one of the client computers at least one of the access requests in accordance with at least one of the high-level protocols transmitted over the data network using the User Datagram Protocol (UDP), and said at least one of the server computers is programmed for forwarding said at least one of the access requests over a TCP connection of the respective mesh for said at least one of the high-level protocols to another one of the server computers that manages one of the file systems that is indicated by said at least one of the access requests in accordance with said at least one of the high-level protocols, and said at least one of the server computers is programmed for converting a TCP byte stream into a UDP-like message for servicing of said at least one of the access requests.

16. The network file server system as claimed in claim 12, wherein the server computers are programmed for using Remote Procedure Call (RPC) semantics for the forwarding of said at least some of the client requests for access in accordance with the high-level protocols over the respective meshes to other ones of the server computers that manage access to the file systems indicated by said at least some of the client requests for access.

17. The network file server system as claimed in claim 12, wherein at least one of the server computers is programmed for creating a new mesh for use by a client application.

18. The network file server system as claimed in claim 12, wherein at least one of the server computers is programmed for accessing a forwarding policy parameter set for at least one of the high-level protocols to determine whether to forward to another one of the server computers either a data request or a metadata request in response to receipt of at least one client request for access in accordance with said at least one of the high-level protocols.

19. The network file server system as claimed in claim 12, wherein said at least one of the server computers is programmed for receiving from at least one of the client computers at least one request for access including an original transaction ID, and said at least one of the server computers is programmed for responding to receipt of said at least one request for access by assigning a new transaction ID to said at least one client request, caching a mapping of the new transaction ID with the original transaction ID, substituting the new transaction ID for the original transaction ID in said at least one request for access, and forwarding said at least one request for access including the substituted new transaction ID to another one of the server computers that manages access to a file system that is indicated by said at least one request for access.

20. The network file server system as claimed in claim 19, wherein said at least one of the server computers is programmed for receiving a reply including the new transaction ID from said another one of the server computers that manages access to the file system that is indicated by said at least one request for access, and for said at least one of the server computers obtaining the new transaction ID from the reply and using the new transaction ID from the reply to lookup the cached original transaction ID and the IP address, in order to replace the new transaction ID in the reply with the original transaction ID and return the reply to said at least one of the client computers.