Distributed, unified file system operations
First Claim
1. A system, comprising:
- a data server to perform operations on a file of a unified file system;
a distributed table having lookup information for the file, the distributed table supporting the unified file system, the lookup information being separate from the unified file system, the lookup information describing the location of the data server;
a plurality of lookup nodes to store portions of the distributed table, no single portion being an entirety of the distributed table, and the portions being are distributed evenly among the plurality of lookup nodes,a lookup node in the plurality of lookup nodes, the lookup node comprising;
a memory to store policies that direct a lookup path through the plurality of lookup nodes; and
a processor to;
receive a request from a client node to access the file, the request including the file name and a path of the file;
generate a key for the file by hashing the file name and the path of the file received in the request;
determine that the lookup information for the file is not stored on the lookup node by looking up the key the portion of the distributed table resident on the lookup node; and
forward the request to another one of the plurality of lookup nodes according to the policies stored in the memory to chain the request to the plurality of lookup nodes to find a second lookup node, from the plurality of lookup nodes, with the lookup information so that the access that has been requested can be directly implemented by the data server.
8 Assignments
0 Petitions
Accused Products
Abstract
Apparatus, systems, and methods may operate to receive a request to access a file from a client node at one of a plurality of lookup nodes, the lookup nodes storing portions of a distributed table having lookup information associated with the file. The distributed table, which may comprise a distributed hash table, includes replicated references to virtualized and non-virtualized file elements of varied granularity in a unified file system. Additional activity may comprise forwarding the request to another one of the lookup nodes until the lookup information is located, or chaining the request to one of the plurality of lookup nodes and implementing activity that has been requested. Additional apparatus, systems, and methods are disclosed.
10 Citations
19 Claims
-
1. A system, comprising:
-
a data server to perform operations on a file of a unified file system; a distributed table having lookup information for the file, the distributed table supporting the unified file system, the lookup information being separate from the unified file system, the lookup information describing the location of the data server; a plurality of lookup nodes to store portions of the distributed table, no single portion being an entirety of the distributed table, and the portions being are distributed evenly among the plurality of lookup nodes, a lookup node in the plurality of lookup nodes, the lookup node comprising; a memory to store policies that direct a lookup path through the plurality of lookup nodes; and a processor to; receive a request from a client node to access the file, the request including the file name and a path of the file; generate a key for the file by hashing the file name and the path of the file received in the request; determine that the lookup information for the file is not stored on the lookup node by looking up the key the portion of the distributed table resident on the lookup node; and forward the request to another one of the plurality of lookup nodes according to the policies stored in the memory to chain the request to the plurality of lookup nodes to find a second lookup node, from the plurality of lookup nodes, with the lookup information so that the access that has been requested can be directly implemented by the data server. - View Dependent Claims (2, 3, 4)
-
-
5. A processor-implemented method to execute on one or more processors that perform the method, comprising:
-
receiving, at a lookup node from a plurality of lookup nodes, a request to access a file of a unified file system from a client node, the request including a file name and a path of the file, the lookup nodes storing portions of a distributed table, the distributed table having lookup information for the file, wherein the distributed table includes replicated references to virtualized and non-virtualized file elements of varied granularity in a unified file system, no single portion of the distributed table is an entirety of the distributed table, the portions of the distributed table being distributed evenly among the plurality of lookup nodes, the lookup information being separate from the unified file system and describing the location of a data server that can perform operations on the file; generate, by the lookup node, a key for the file by hashing the file name and the path of the file; determining, by the lookup node, that the lookup information for the file is not stored on the lookup node by looking up the key in a portion of the distributed table resident on the lookup node; accessing, by the lookup node, a policy to determine a second lookup node from the plurality of lookup nodes to which the request will be forwarded; and forwarding, by the lookup node, the request to the second lookup node to chain the request to the plurality of lookup nodes to find the lookup information and implement, by the data server, the access that has been requested. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. At least one non-transitory machine readable medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
-
receiving, at a lookup node from a plurality of lookup nodes, a request to access a file of a unified file system from a client node, the request including a file name and a path of the file, the lookup nodes storing portions of a distributed table, the distributed table having lookup information for the file, wherein the distributed table includes replicated references to virtualized and non-virtualized file elements of varied granularity in a unified file system, no single portion of the distributed table is an entirety of the distributed table, the portions of the distributed table being distributed evenly among the plurality of lookup nodes, the lookup information being separate from the unified file system and describing the location of a data server that can perform operations on the file; generate, by the lookup node, a key for the file by hashing the file name and the path of the file; determining, by the lookup node, that the lookup information for the file is not stored on the lookup node by looking up the key in a portion of the distributed table resident on the lookup node; accessing, by the lookup node, a policy to determine a second lookup node from the plurality of lookup nodes to which the request will be forwarded; and forwarding, by the lookup node, the request to the second lookup node to chain the request to the plurality of lookup nodes to find the lookup information and implement, by the data server, the access that has been requested. - View Dependent Claims (15, 16, 17, 18, 19)
-
Specification