Distributed file serving architecture system with metadata storage virtualization and data access at the data server connection speed
First Claim
1. A method for providing a distributed file serving architecture with metadata storage virtualization and direct data access, comprising:
- storing metadata associated with data on a data server in memory at a metadata server;
establishing a file-based remote direct memory access protocol session with a host and a data server;
receiving a data request at the metadata server from the host through an operations channel established between the host and the metadata server for providing asynchronous communication initiated only by the host;
controlling virtualization of the data server file system at the metadata server, wherein the controlling is performed by;
providing data structures containing information about block files represented by logical files on the data server that forms the directory structure; and
providing block data virtualization metadata comprising a mapping of the file system provided by the data server to a metafile system of the metadata server;
satisfying the data request under the control of the metadata server, said satisfying including;
providing from the metadata server to the data server, connection and host target buffer information through a back control channel between the metadata server and the data server using the remote direct memory access protocol;
processing the received connection and host target buffer information;
using, by said data server, the processed connection and host target buffer information to directly access memory allocated in the host for the data request to satisfy the data request; and
transferring the data requested by said data request from the data server to the host through said file-based remote direct memory access protocol session.
1 Assignment
0 Petitions
Accused Products
Abstract
Method, apparatus and program storage device that provides a distributed file serving architecture with metadata storage virtualization and data access at the data server connection speed is provided. A host issues a file access request including data target locations. The file access request including data target locations is processed. Remote direct memory access (RDMA) channel endpoint connection are issued in response to the processing of the file access request. An RDMA transfer of the file-block data associated with the file access request is made directly between a memory at the host and a data server.
111 Citations
27 Claims
-
1. A method for providing a distributed file serving architecture with metadata storage virtualization and direct data access, comprising:
-
storing metadata associated with data on a data server in memory at a metadata server; establishing a file-based remote direct memory access protocol session with a host and a data server; receiving a data request at the metadata server from the host through an operations channel established between the host and the metadata server for providing asynchronous communication initiated only by the host; controlling virtualization of the data server file system at the metadata server, wherein the controlling is performed by; providing data structures containing information about block files represented by logical files on the data server that forms the directory structure; and providing block data virtualization metadata comprising a mapping of the file system provided by the data server to a metafile system of the metadata server; satisfying the data request under the control of the metadata server, said satisfying including; providing from the metadata server to the data server, connection and host target buffer information through a back control channel between the metadata server and the data server using the remote direct memory access protocol; processing the received connection and host target buffer information; using, by said data server, the processed connection and host target buffer information to directly access memory allocated in the host for the data request to satisfy the data request; and transferring the data requested by said data request from the data server to the host through said file-based remote direct memory access protocol session. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A program storage readable by one or more computers, the program storage having media tangibly embodying one or more programs of instructions executable by a computer to perform a method for satisfying a request in a distributed file serving architecture with metadata storage virtualization and direct data access, comprising:
-
storing metadata associated with data on a data server in memory at a metadata server; establishing a file-based remote direct memory access protocol session with a host and a data server; receiving a data request at the metadata server from the host through an operations channel established between the host and the metadata server for providing asynchronous communication initiated only by the host; controlling virtualization of the data server file system at the metadata server, wherein the controlling is performed by; providing data structures containing information about block files represented by logical files on the data server that forms the directory structure; and providing block data virtualization metadata comprising a mapping of the file system provided by the data server to a metafile system of the metadata server; satisfying the data request under the control of the metadata server, said satisfying including; providing from the metadata server to the data server, connection and host target buffer information through a back control channel between the metadata server and the data server using the remote direct memory access protocol; processing the received connection and host target buffer information; using, by said data server, the processed connection and host target buffer information to directly access memory allocated in the host for the data request to satisfy the data request; and transferring the data requested by said data request from the data server to the host through said file-based remote direct memory access protocol session. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A system, comprising:
-
a data server that stores data; a host comprising; a first memory, and instructions, stored on said first memory, for establishing a file-based remote direct memory access protocol session between the host and the data server; a metadata server comprising a second memory storing metadata associated with data on the data server; wherein said metadata server controls virtualization of the data server file system, wherein the metadata server controls virtualization by; providing data structures containing information about block files represented by logical files on the data server that forms the directory structure; and providing block data virtualization metadata comprising a mapping of the file system provided by the data server to a metafile system of the metadata server; wherein said host comprises instructions, stored on said first memory, for establishing an operations channel between the host and the metadata server for providing asynchronous communication initiated only by the host and to provide a data request at the metadata server from the host through the operations channel; wherein said metadata server controls the satisfying of the data request, said satisfying including; establishing a back control channel between the metadata server and the data server using the remote direct memory access protocol; providing from the metadata server to the data server, connection and host target buffer information through the back control channel between the metadata server and the data server using the remote direct memory access protocol; processing the received connection and host target buffer information; and using, by said data server, the processed connection and host target buffer information to directly access memory allocated in the host for the data request to satisfy the data request. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27)
-
Specification