Transaction aggregation in a switched file system

• US RE43,346 E1
• Filed: 03/14/2007
• Issued: 05/01/2012
• Est. Priority Date: 01/11/2001
• Status: Expired due to Fees

• Current Assignee: RPX Corporation
• Original Assignee: F5 Networks, Inc. (F5 Incorporated)
• Inventors: Miloushev, Vladimir, Nickolov, Peter
• Primary Examiner(s): NGUYEN, HIEP T
• Application Number:
  US11/724,107
• Time in Patent Office: 1,875 Days
• Field of Search: None
• US Class Current: 709/213
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/2056 by mirroring
• CPC Class Codes: G06F 11/2058 using more than 2 mirrored copies
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H04L 2029/06054 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 29/06 characterised by a protocol
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1002 for accessing one among a plurality of replicated servers, e.g. load balancing arrangements or protocols for peer-to-peer networking H04L67/104; protocols for client-server architectures H04L67/42; allocation of processing resources to service requests in a distributed system G06F9/5027; rebalancing the processing load in a distributed system G06F9/5083; wireless network traffic load balancing H04W28/08; network load balancing, traffic engineering H04L47/125; video servers using load balancing strategies H04N21/23103; error detection or correction of the data by redundancy in hardware G06F11/16
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1017 based on a round robin mechanism
• CPC Class Codes: H04L 67/1019 Random or heuristic server selection
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/28 for the provision of proxy services, e.g. intermediate processing or storage in the network network management provisions H04L41/00; network monitoring provisions H04L43/00; proxies for network security H04L63/0281; media manipulation, adaptation or conversion in real-time communications H04L65/601; protocol conversion H04L69/08
• CPC Class Codes: H04L 67/2838 for integrating service provisioning from a plurality of service providers web site content organization and management G06F16/958
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/329 : in the application layer [OSI layer 7]

Abstract

Client computers are decoupled from file servers in a computer network, by placing a network node, also termed a file switch or file switch computer, between the client computers and the file servers. To the client computers, the file switch appears to be a file server having enormous storage capabilities and high throughput. To the file servers, the file switch appears to be a client as it delegates a single transaction received from a client computer to multiple file servers. The file switch aggregates the file servers'"'"' responses to the client computer'"'"'s request and presents a single response back to the client computer. The file switch performs this transaction aggregation function in a manner that is transparent to both the client computers and the file servers.

Claims

1. A method of processing a user request for performing a transaction on a user file that is stored, along with other user files, in a shared data computer network, where each user file of at least a plurality of the user files is divided into different portions stored separately on a plurality of file servers, among a group of file servers in a computer network, comprising:

receiving a user request, using a file switch, to perform a specified transaction on a specified user file;

identifying a subset of the file servers that separately store the different portions of the user file needed to perform the specified transaction;

sending commands, using the file switch, to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

aggregating the received replies, using the file switch, to produce an aggregated reply; and

sending the aggregated reply, using the file switch, to a sender of the user request;

wherein the method is performed in a manner that is transparent to both the sender and the file servers by using a respective network file protocol of the sender and a respective file network protocol of the file servers.

2. The method of claim 1 wherein the receiving, sending and aggregating steps are performed by a file switch and the accessing and determining steps are performed by a metadata server.

3. A method of processing a user request for performing a transaction on a user file that is stored, along with other user files, in a shared data computer network, where each user file of at least a plurality of the user files is divided into different portions stored separately on a plurality of file servers, among a group of file servers in a computer network, comprising:

receiving a user request to perform a specified transaction on a specified user file;

accessing metadata identifying a set of file servers for separately storing respective defined different portions of the specified user file;

determining, based on the metadata, a subset of the file servers that separately store different portions of the user file needed to perform the specified transaction;

sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

aggregating the received replies to produce an aggregated reply; and

sending the aggregated reply to a sender of the user request;

wherein the method is performed in a manner that is transparent to both the sender and the file servers by using a respective network file protocol of the sender and a respective network file protocol of the file servers.

4. The method of claim 3, wherein

the specified user file has an aggregated size and a corresponding number of defined portions;

and

the method includes updating the metadata when the specified transaction changes the number of defined portions of the specified user file.

5. The method of claim 3, the method including updating the metadata.

6. The method of claim 3, wherein the accessing metadata step includes accessing a metadata file that stores the metadata.

7. The method of claim 3, wherein the accessing metadata step includes accessing cached metadata corresponding to metadata stored in a metadata file.

8. A file switch for use in a computer network having a group of file servers and a plurality of client computers, the file switch comprising:

at least one processing unit for executing computer programs;

at least one port for exchanging information with the file servers and client computers, the information exchanged including information concerning a specified user file;

a file aggregation module including one or more computer programs, the computer programs including instructions for;

receiving a user request to perform a specified transaction on a specified user file;

determining a subset of the file servers that separately store different portions of the user file needed to perform the specified transaction;

sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

aggregating the received replies to produce an aggregated reply; and

sending the aggregated reply to a sender of the user request;

wherein the file aggregation module is configured to operate, when executed by the file switch, in a manner that is transparent to both the client computers and the file servers by using a respective network file protocol of the client computers and a respective network file protocol of the file servers.

9. A file switch for use in a computer network having a group of file servers and a plurality of client computers, the file switch comprising:

at least one processing unit for executing computer programs;

at least one port for exchanging information with the file servers and client computers, the information exchanged including information concerning a specified user file;

a file aggregation module including one or more computer programs, the computer programs including instructions for;

receiving a user request to perform a specified transaction on a specified user file;

accessing metadata identifying a set of file servers for separately storing respective defined different portions of the specified user file;

determining, based on the metadata, a subset of the file servers that separately store the different portions of the user file needed to perform the specified transaction;

sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

aggregating the received replies to produce an aggregated reply; and

endingsending the aggregated reply to a sender of the user request;

wherein the file aggregation module is configured to operate, when executed by the file switch, in a manner that is transparent to both the client computers and the file servers by using a respective network file protocol of the client computers and a respective network file protocol of the file servers.

10. The file switch of claim 9, wherein

the specified user file has an aggregated size and a corresponding number of defined portions, and

the one or more computer programs of the file aggregation module include instructions for updating the metadata when the specified transaction changes the number of defined portions of the specified user file.

11. The file switch of claim 9, wherein the one or more computer programs of the file aggregation module include instructions for updating the metadata.

12. The file switch of claim 9, wherein the one or more computer programs of the file aggregation module include instructions for accessing a metadata file that stores the metadata.

13. The file switch of claim 9, wherein the one or more computer programs of the file aggregation module include instructions for accessing cached metadata corresponding to metadata stored in a metadata file.

14. A system for use in a computer network having a plurality of client computers, the system comprising:

a group of file servers;

a file switch, the file switch including;

at least one port for exchanging information with the file servers and client computers, the information exchanged including information concerning a specified user file;

means for receiving a user request to perform a specified transaction on a specified user file;

means for identifying a subset of the file servers that separately store different portions of the user file needed to perform the specified transaction;

means for sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

means for aggregating the received replies to produce an aggregated reply; and

means for sending the aggregated reply to a sender of the user request;

wherein the receiving, identifying, sending, aggregating and sending means are configured to operate in a manner that is transparent to both the client computers and the file servers by using a respective network file protocol of the client computers and a respective network file protocol of the file servers.

15. A system for use in a computer network having a plurality of client computers, the system comprising:

a group of file servers;

a file switch, the file switch including;

at least one port for exchanging information with the file servers and client computers, the information exchanged including information concerning a specified user file;

means for receiving a user request to perform a specified transaction on a specified user file;

means for accessing metadata identifying a set of file servers for separately storing respective defined different portions of the specified user file;

means for determining, based on the metadata, a subset of the file servers that separately store different portions of the user file needed to perform the specified transaction;

means for sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

means for aggregating the received replies to produce an aggregated reply; and

means for sending the aggregated reply to a sender of the user request;

wherein the receiving, accessing, determining, command sending, aggregating and aggregated reply sending means are configured to operate in a manner that is transparent to both the client computers and the file servers by using a respective network file protocol of the client computers and a respective network file protocol of the file servers.

16. The system of claim 15, wherein the specified user file has an aggregated size and a corresponding number of defined portions;

the system including means for updating the metadata when the specified transaction changes the number of defined portions of the specified user file.

17. The system of claim 15, including means for updating the metadata.

18. The system of claim 15, the means for accessing metadata including means for accessing a metadata file that stores the metadata.

19. The system of claim 15, the means for accessing metadata including means for accessing cached metadata corresponding to metadata stored in a metadata file.

20. A system for use in a computer network having a plurality of client computers, the system comprising:

a group of file servers;

a file switch, the file switch including;

at least one port for exchanging information with the file servers and client computers, the information exchanged including information concerning a specified user file;

at least one processing unit for executing computer programs;

a file aggregation module including one or more computer programs, the computer programs including instructions for;

receiving a user request to perform a specified transaction on a specified user file;

identifying a subset of the file servers that separately store different portions of the user file needed to perform the specified transaction;

sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

aggregating the received replies to produce an aggregated reply; and

sending the aggregated reply to a sender of the user request;

wherein the file aggregation module is configured to operate, when executed by the file switch, in a manner that is transparent to both the client computers and the file servers by using a respective network file protocol of the client computers and a respective network file protocol of the file servers.

21. A system for use in a computer network having a plurality of client computers, the system comprising:

a group of file servers;

a file switch, the file switch including;

at least one port for exchanging information with the file servers and client computers, the information exchanged including information concerning a specified user file;

at least one processing unit for executing computer programs;

a file aggregation module including one or more computer programs, the computer programs including instructions for;

receiving a user request to perform a specified transaction on a specified user file;

accessing metadata identifying a set of file servers for separately storing respective defined different portions of the specified user file;

determining, based on the metadata, a subset of the file servers that separately store different portions of the user file needed to perform the specified transaction;

sending commands to each respective file server in the subset of file servers to perform the transaction on a respective separately stored different portion of the user file, and receiving replies from the subset of file servers;

aggregating the received replies to produce an aggregated reply; and

sending the aggregated reply to a sender of the user request,

wherein the file aggregation module is configured to operate, when executed by the file switch, in a manner that is transparent to both the client computers and the file servers by using a respective network file protocol of the client computers and a respective network file protocol of the file servers.

22. The system of claim 21, wherein

the specified user file has an aggregated size and a corresponding number of defined portions, and

the one or more computer programs of the file aggregation module include instructions for updating the metadata when the specified transaction changes the number of defined portions of the specified user file.

23. The system of claim 21, wherein the one or more computer programs of the file aggregation module include instructions for updating the metadata.

24. The system of claim 21, wherein the one or more computer programs of the file aggregation module include instructions for accessing a metadata file that stores the metadata.

25. The system of claim 21, wherein the one or more computer programs of the file aggregation module include instructions for accessing cached metadata corresponding to metadata stored in a metadata file.