Extended storage capacity for a network file server

• US 7,072,917 B2
• Filed: 04/26/2004
• Issued: 07/04/2006
• Est. Priority Date: 04/24/2003
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: NeoPath Networks, Inc. (Cisco Systems, Inc.)
• Inventors: Wong, Thomas K., Chawla, Rajeev, Tsirigotis, Panagiotis, Iyengar, Anand
• Primary Examiner(s): Robinson, Greta
• Assistant Examiner(s): Lu, Kuen S.
• Application Number:
  US10/832,927
• Publication Number:
  US 20040267832A1
• Time in Patent Office: 799 Days
• Field of Search: 707/200, 707/205, 707/1, 707/100, 707/204, 707/101, 709/200, 709/217, 709/201, 709/218
• US Class Current: 707/693
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: Y10S 707/955 Object-oriented
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99956 File allocation

Abstract

A NAS switch provides extended storage capacity to a file server in a decentralized storage network such as a NAS (Network Attached Storage) storage network. The NAS switch sits in the data path of a client on the front end and a directory file server and shadow file servers on the back end. A segregation module in the NAS switch replicates data from the directory file server to a shadow file server, and then replaces the data in the directory file server with holey files. Holey files, which store a range of consecutive values such as zero with negligible storage space, retain the attributes of the data without retaining its storage consumption. Thus, the directory file server can server as a single directory hierarchy for several shadow file servers containing data beyond a capacity of the directory file server. When the NAS switch receives operations from the client, an association module forwards directory operations to the directory file server and data operations to the shadow file server. The NAS switch also provides services to several shadow file servers from a single directory file server.

Claims

1. A method for extending the storage capacity of a file server in a decentralized storage network, comprising:

storing data for an object on a shadow file server;

generating a range of consecutive data values commensurate with a first size of the object;

compressing the range of consecutive data values to generate a holey file;

storing the holey file as size metadata for the object on a directory file server; and

adding an entry to a directory server table to associate the data and the size metadata for reconstruction of the object.

2. The method of claim 1, further comprising:

modifying the stored data for the object to a second size; and

changing the range of consecutive data values based on the second size.

3. The method of claim 1, further comprising:

receiving the object from a client for storage on the storage network.

4. The method of claim 1, further comprising:

converting an existing file server to the directory file server by moving data to the shadow file server and replacing files with holey files.

5. The method of claim 1, further comprising:

naming a shadow file containing the data with a hash function.

6. The method of claim 1, wherein the directory server table associates one or more directories of the directory file server with the shadow file server.

7. The method of claim 1, further comprising:

adding an entry to a file location cache to associate a switch file handle used by a client to access the object from a network attached storage switch with a shadow file handle used by the network attached storage switch to access a shadow file from the shadow file server.

8. The method of claim 7, further comprising:

receiving a request to access the object with the switch file handle;

looking-up the shadow file handle in the file location cache; and

submitting the access request using the shadow file handle.

9. The method of claim 8, further comprising:

removing entries from the file location cache responsive to surpassing a capacity;

responsive to not finding the shadow file handle in the file location cache, looking-up a directory associated with the object in the directory server table to obtain the associated shadow file server; and

submitting the request to the shadow file server.

10. The method of claim 1, further comprising:

receiving a request to access the object that affects a directory; and

submitting the request to the directory file server.

11. The method of claim 10, wherein the request comprises one from the group consisting of:

create directory, delete directory, and move directory.

12. The method of claim 1, further comprising:

receiving a request to access the object that affects a shadow file; and

submitting the request to the shadow file server.

13. The method of claim 12, wherein the request comprises one from the group consisting of:

create file, delete file, move file, copy file, read file, and write file.

14. The method of claim 1, further comprising:

receiving a request to access the object that affects a directory and a shadow file; and

submitting the request to the directory file server and the shadow file server.

15. The method of claim 14, wherein the request comprises one from the group consisting of:

create file, delete file, move file, copy file, and truncate file.

16. The method of claim 1, further comprising:

providing a file service to a shadow file location on the shadow file server from the directory file server.

17. The method of claim 16, wherein the file service comprises file locking to preserve data integrity of the shadow file during multiple accesses.

18. The method of claim 1, wherein the object comprises a directory hierarchy having objects representative of sub-directories and files.

19. The method of claim 1, wherein the object comprises a file.

20. The method of claim 1, further comprising:

mapping a switch file handle that is independent of a location of the object to a first network attached storage file handle that is indicative of a first location of the metadata.

21. The method of claim 20, further comprising:

storing the data at a second location; and

mapping the switch file handle to a second network attached storage file handle that is indicative of the second location.

22. A network attached storage (NAS) switch to extend the storage capacity of a file server in a NAS storage network, comprising:

a segregation module to segregate an object by storing data for the object on a shadow file server, and storing size metadata for the object on a directory file server as size metadata in the form of a holey file generated from compressing a range of consecutive data values commensurate with a first size of the object, the segregation module associating the data and the size metadata in a directory server table; and

an association module to retrieve the object from the data and the metadata in the directory server table.

23. The NAS switch of claim 22, wherein the segregation module modifies the stored data for the object to a second size and changes the offset of data values based on the second size.

24. The NAS switch of claim 22, further comprising:

a client module to receive the object from a client for storage on the storage network.

25. The NAS switch of claim 22, wherein the segregation module converts an existing file server to the directory file server by moving data to the shadow file server and replacing files with holey files.

26. The NAS switch of claim 22, further comprising:

a file naming module to name a shadow file containing the data with a hash function.

27. The NAS switch of claim 22, wherein the directory server table associates one or more directories of the directory file server with the shadow file server.

28. The NAS switch of claim 22, further comprising:

a file location cache,

wherein the segregation module adds an entry to the file location cache, the entry comprising a switch file handle used by a client to access the object from a NAS switch in association with a shadow file handle from the shadow file server.

29. The NAS switch of claim 28, further comprising:

a client module to receive a request to access the object with the switch file handle; and

a file server interface to submit the request to the shadow file server,

wherein the association module looks-up the shadow file handle in the file location cache.

30. The NAS switch of claim 29, wherein the file location cache removes entries responsive to surpassing a capacity, and the association module looks-up the object in the directory server table to obtain the associated shadow file server responsive to not finding the shadow file handle in the file location cache, and the file server interface submits the request to the shadow file server.

31. The NAS switch of claim 22, wherein the segregation module receives a request to access the object that affects a directory, and a file server interface submits the request to the directory file server.

32. The NAS switch of claim 31, wherein the request comprises one from the group consisting of:

create directory, delete directory, and move directory.

33. The NAS switch of claim 22, wherein the segregation module, responsive to receiving a request to access the object that affects a shadow file, submits the request to the shadow file server.

34. The NAS switch of claim 33, wherein the request comprises one from the group consisting of:

create file, delete file, move file, copy file, read file, and write file.

35. The NAS switch of claim 22, wherein the segregation module, responsive to receiving a request to access the object that affects a directory and a shadow file, submits the request to the directory file server and the shadow file server.

36. The NAS switch of claim 35, wherein the request comprises one from the group consisting of:

create file, delete file, move file, copy file, and truncate file.

37. The NAS switch of claim 22, wherein the directory file server provides a file service to a shadow file located on the shadow file server.

38. The NAS switch of claim 37, wherein the file service comprises file locking to preserve data integrity of the shadow file during multiple accesses.

39. The NAS switch of claim 22, wherein the object comprises a directory hierarchy having objects representative of sub-directories and files.

40. The NAS switch of claim 22, wherein the object comprises a file.

41. A computer program product, comprising a computer-readable medium having computer program instructions for a method of extending the storage capacity of a file server in a decentralized storage network, the method comprising the steps of:

storing data for an object on a shadow file server;

generating a range of consecutive data values commensurate with a first size of the object;

compressing the range of consecutive data values to generate a holey file;

storing the holey file as size metadata for the object on a directory file server; and

adding an entry to a directory server table to associate the data and the size metadata for reconstruction of the object.

42. A network attached storage (NAS) switch to access an object in a storage network, comprising:

a means for segregating data of an object, for storage on a shadow file server, from metadata of the object, for storage on a directory file server as size metadata in the form of a holey file generated from compressing a range of consecutive data values commensurate with a first size of the object; and

a means for associating the data and the metadata in a directory server table.

43. A method for extending the storage capacity of a file server in a decentralized storage network, comprising:

receiving an object in a switch device;

storing file data for the object on a shadow file server;

generating size metadata for the object with a holey file, the holey file representative of a range of consecutive data values that is commensurate with a first size of the object; and

storing the holey file in a file system on a directory file server, the directory file server configured to provide a directory of files with file sizes.

44. The method of claim 43, further comprising:

receiving a request in the switch device;

if the request comprises a request for access to the directory, forwarding the directory file server; and

if the request comprises a request for access to the object, forwarding the request to the shadow file server.