Switching systems and methods for storage management in digital networks

• US 7,958,199 B2
• Filed: 11/02/2001
• Issued: 06/07/2011
• Est. Priority Date: 11/02/2001
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Oracle America, Inc. (Oracle Corporation)
• Inventors: Stronge, William, Merhar, Milan, Ferrari, Stephen, Cochrane, Christopher, Hall, Howard
• Primary Examiner(s): Serrao; Ranodhi N
• Assistant Examiner(s): Cloud; Joiya M
• Application Number:
  US10/415,328
• Publication Number:
  US 20040078419A1
• Time in Patent Office: 3,504 Days
• Field of Search: 709/211, 709/219
• US Class Current: 709/211
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1017 based on a round robin mechanism
• CPC Class Codes: H04L 67/1019 Random or heuristic server selection
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/10 Streamlined, light-weight or high-speed protocols, e.g. express transfer protocol [XTP] or byte stream
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/161 Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/164 Adaptation or special uses of UDP protocol
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/32 Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Disclosed are improved methods, devices and systems for storage management in digital networks.

Claims

1. In a digital processing system comprising at least two NAS servers, a workload distribution method comprising:

configuring the NAS servers as a single, virtual, server using a configurable switch fabric,

replicating at least a subset of data on an NAS server on at least one other NAS server to create a replicated storage domain;

receiving file system requests from at least one client;

directing a read request from the at least one client to a server in the replicated storage domain, the server being selected in accordance with a workload distribution function that;

(1) initially directs requests for a given file to a single server;

(2) when the rate at which the file is being requested exceeds a threshold limit, designates an additional server to serve the file; and

(3) distributes successive requests for the file in round robin fashion between the servers designated to serve the file;

multicasting a write request from the at least one client to each of the individual servers included in the replicated storage domain, maintaining data synchronization across the replicated storage domain; and

receiving, from at least one of the servers in the replicated storage domain, a response to the received file system request.

2. In a digital processing system comprising a plurality of servers, a first set of processor elements, a second set of processor elements, and a configurable switch fabric, a workload distribution method comprising:

configuring the servers as a single, virtual, server using the first set of processor elements, the second set of processor elements and the configurable switch fabric interconnected between the first set of processor elements and the second set of processor elements, the first set of processor elements connected to at least one client to receive file system requests and provide IP processing, the second set of processor elements connected to the servers and capable of receiving file system requests from the first set of processor elements and routing file system requests to the servers, the second set of processor elements providing storage processing;

designating a workload distribution group including at least two servers;

receiving a file system request from a client;

directing a read request to a selected server in the workload distribution group, via the switching system, the server being selected in accordance with a workload distribution function, the workload distribution function including;

(1) examining the contents of the read request and selecting a subset of the servers that is pre-allocated to handle the contents of the read request;

(2) first directing the request to the selected subset of the servers, via the configurable switch fabric; and

(3) then directing the request to one or more selected servers within the selected subset of the servers, the one or more selected servers being selected in accordance with a load balancing function; and

multicasting a write request to each of the servers in the workload distribution group, via the configurable switch fabric.

3. The method of claim 2 wherein selecting the subset of the servers further comprises directing requests for a first file system subdirectory to a first subset of servers, and directing requests for a second file system subdirectory to a second subset of servers.

4. The method of claim 2 wherein the workload distribution function comprises referencing a hash table, wherein entries in the hash table can have more than one server address so that a file can exist in more than one server cache and be served up by more than one the servers.

5. The method of claim 4 further comprising using a selection algorithm to determine which of the servers in the workload distribution group to direct the read request to.

6. The method of claim 5 wherein the selection algorithm is round robin.

7. The method of claim 5 wherein frequently accessed files are served by more than one server.

8. The method of claim 5 wherein file handle entries can be placed on multiply linked lists, wherein each of the lists contains file handle entries for files served by a specific number of the servers.

9. The method of claim 8 wherein the multiply linked lists include a list for file handle entries of files having only one of the servers serving them;

a list for file handle entries of files having two of the servers serving them; and

a list for file handle entries of files having four of the servers serving them.

10. The method of claim 9 further comprising promoting and demoting file handle entries, the promoting and demoting comprising moving file handle entries from list to list as frequency of access requests for the corresponding files increases or decreases.

11. The method of claim 10, wherein the file handle entries initially are present on a single server list denoting files served by one of the servers, wherein the file handle in a read request is used to access the hash table, wherein when there is no entry for the file handle, a free entry is taken from an entry free list and a single one of the servers is designated to serve the file, based on a selected criterion, wherein when no entries are free, a server is selected and the read request directed to the selected server without creating an entry, and wherein when a new entry is created, it is added to the hash table and placed at the top of the single server list.

12. The method of claim 11 wherein the criterion is any of least loaded, fastest responding or round robin.

13. The method of claim 11 wherein the entries are promoted to a next higher-order list when frequency of access requests for the corresponding file exceeds a threshold.

14. The method of claim 13 wherein the entries are demoted to a next lower-order list when frequency of access requests for the corresponding file falls below a threshold.

15. The method of claim 2 further comprising dynamically modifying the contents of the servers by creating additional copies of frequently requested files.