File-based hybrid file storage scheme supporting multiple file switches

• US 20060167838A1
• Filed: 01/21/2005
• Published: 07/27/2006
• Est. Priority Date: 01/21/2005
• Status: Abandoned Application

• Current Assignee: F5 Networks, Inc. (F5 Incorporated)
• Original Assignee: Z-Force Communications, Inc. (F5 Incorporated)
• Inventors: Lacapra, Francesco
• Application Number:
  US11/041,147
• Publication Number:
  US 20060167838A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097

Abstract

In an aggregated file system, a file may begin with a set of stripe fragments all in the RAID-5 scheme in order to take advantage of the RAID-5 scheme'"'"'s storage efficiency. After that, when one of the fragments is accessed by a file switch, it will be duplicated into the data mirroring scheme. The file'"'"'s corresponding metadata server maintains a data structure, e.g., a bitmap, indicating which fragments have been duplicated into the data mirroring scheme. In other words, the file, at this moment, exists in a hybrid scheme. A file consolidator running on the metadata server is triggered at a predefined time to copy the fragments from the data mirroring scheme back to the RAID-5 scheme, This file consolidator also updates the bitmap to reflect the changes to the file'"'"'s scheme change. This hybrid scheme is expected to increase the I/O capacity of the conventional RAID-5 scheme and the storage usage of the conventional mirroring scheme.

Claims

1. A method of managing user files in an aggregated file system, comprising:

receiving from a client a file operating request with respect to a user file, the request including a name of the user file and an operating instruction;

identifying a first set of file segments of the user file stored in the aggregated file system according to a first scheme;

identifying a second set of file segments of the user file stored in the aggregated file system according to a second scheme; and

applying the operating instruction to the first and second sets of file segments, respectively.

2. The method of claim 1, wherein the user file is associated with a metadata file and the metadata file includes a data structure identifying addresses of the first and second sets of file segments in the aggregated file system.

3. The method of claim 2, wherein the data structure includes a first table identifying a first array of file servers hosting the first set of file segments and a second table identifying a second array of file servers hosting the second set of file segments.

4. The method of claim 1, wherein the first scheme is a data mirroring scheme and the second scheme is a RAID-5 scheme.

5. The method of claim 4, wherein a file segment in the first set has at least two identical copies of mirrored stripe fragments on at least two different file servers and a file segment in the second set is a RAID-5 stripe comprising at least three stripe fragments, each stored in a separate file server of the aggregated file system.

6. The method of claim 5, wherein the at least three stripe fragments include a parity fragment and at least two data fragments, and the parity fragment comprises the exclusive-or of the at least two data fragments.

7. The method of claim 6, wherein the parity fragments associated with the second set of file segments are distributed across the second array of file servers in a round-robin fashion.

8. The method of claim 5, wherein, in the case that the file operating request is a file read request, the applying the operating instruction includes:

extracting each of the mirrored stripe fragments from one of the first array of file servers;

extracting each of the RAID-5 stripe fragments from one of the second array of file servers;

merging the mirrored and RAID-5 stripe fragments to produce a response; and

returning the response to the requesting client.

9. The method of claim 5, wherein, in the case that the file operating request is a file write request associated with a new version of the user file, the applying the operating instruction includes:

updating each mirrored stripe fragment stored in one of the first array of file servers if its content is modified in the new version of the user file;

generating at least two identical copies of mirrored stripe fragments in at least two of the first array of file servers, the mirrored stripe fragments corresponding to a RAID-5 stripe fragment in the second array of file servers whose content is modified in the new version of the user file; and

changing the first and second tables in the metadata file to reflect the content changes in the new version of the user file.

10. The method of claim 5, wherein, in the case that the file operating request is a file consolidate request triggered by a timeout of the user file, the applying the operating instruction includes:

updating a RAID-5 stripe fragment stored in one of the second array of file servers with its corresponding mirrored stripe fragment stored in one of the first array of file servers;

updating a parity fragment associated with the RAID-5 stripe fragment;

repeating said two updates until all mirrored stripe fragments of the user file are stored in the second array of file servers; and

changing the first and second tables in the metadata file to release space occupied by the mirrored stripe fragments of the user file.

11. The method of claim 5, wherein, in the case that the file operating request is a file consolidate request, the applying the operating instruction includes:

selecting a user file from a set of user files in accordance with predefined selection criteria, the user file having a set of mirrored stripe fragments in the first array of file servers and an associated metadata file;

moving the mirrored stripe fragments from the first array of file servers into the second array of file servers;

updating the metadata file to reflect said moving; and

repeating said selecting, moving and updating until a stop condition is reached.

12. The method of claim 11, wherein said moving includes:

updating a RAID-5 stripe fragment stored in one of the second array of file servers with a corresponding mirrored stripe fragment stored in one of the first array of file servers;

updating a parity fragment associated with the RAID-5 stripe fragment; and

repeating said two updates until all mirrored stripe fragments of the user file are stored in the second array of file servers.

13. The method of claim 5, wherein, in the case that the file operating request is a file consolidate request triggered when free space in the first array of file servers falls below a predefined threshold level, the applying the operating instruction includes:

selecting a user file from a set of user files in accordance with its timestamp, the user file having a set of mirrored stripe fragments in the first array of file servers and an associated metadata file;

releasing space occupied by the mirrored stripe fragments by moving the mirrored stripe fragments from the first array of file servers into the second array of file servers;

updating the metadata file to reflect said releasing; and

repeating said selecting, releasing and updating until the free space in the first array of file servers is above the predefined threshold level.

14. The method of claim 13, wherein said releasing includes:

updating a RAID-5 stripe fragment stored in one of the second array of file servers with a corresponding mirrored stripe fragment stored in one of the first array of file servers;

updating a parity fragment associated with the RAID-5 stripe fragment; and

repeating said two updates until all mirrored stripe fragments of the user file are stored in the second array of file servers.

15. An aggregated file system, comprising:

a plurality of file servers;

a file switch, including;

a processor for executing instructions for storing, maintaining and providing access to a set of user files, the instructions including;

instructions for receiving from a client a file operating request with respect to a user file, the request including a name of the user file and an operating instruction;

instructions for identifying a first set of file segments of the user file stored in the aggregated file system according to a first scheme;

instructions for identifying a second set of file segments of the user file stored in the aggregated file system according to a second scheme; and

instructions for applying the operating instruction to the first and second sets of file segments, respectively;

wherein the plurality of file servers include a first array of file servers hosting the first set of file segments and a second array of file servers hosting the second set of file segments.

16. The system of claim 15, wherein the user file is associated with a metadata file and the metadata file is stored in a metadata server including a data structure identifying addresses of the first and second sets of file segments in the aggregated file system.

17. The system of claim 16, wherein the data structure includes a first table identifying the first array of file servers hosting the first set of file segments and a second table identifying the second array of file servers hosting the second set of file segments.

18. The system of claim 17, wherein the first scheme is a data mirroring scheme and the second scheme is a RAID-5 scheme.

19. The system of claim 18, wherein a file segment in the first set has at least two identical copies of mirrored stripe fragments on at least two different file servers and a file segment in the second set is a RAID-5 stripe comprising at least three stripe fragments, each stored in a separate file server of the aggregated file system.

20. The system of claim 19, wherein the at least three stripe fragments include a parity fragment and at least two data fragments, and the parity fragment comprises the exclusive-or of the at least two data fragments.

21. The system of claim 20, wherein the parity fragments associated with the second set of file segments are distributed across the second array of file servers in a round-robin fashion.

22. The system of claim 19, wherein, in the case that the file operating request is a file read request, the instructions for applying the operating instruction include:

instructions for extracting each of the mirrored stripe fragments from one of the first array of file servers;

instructions for extracting each of the RAID-5 stripe fragments from one of the second array of file servers;

instructions for merging the mirrored and RAID-5 stripe fragments to produce a response; and

instructions for returning the response to the requesting client.

23. The system of claim 19, wherein, in the case that the file operating request is a file write request associated with a new version of the user file, the instructions for applying the operating instruction include:

instructions for updating each mirrored stripe fragment stored in one of the first array of file servers if its content is modified in the new version of the user file;

instructions for generating at least two identical copies of mirrored stripe fragments in at least two of the first array of file servers, the mirrored stripe fragments corresponding to a RAID-5 stripe fragment in the second array of file servers whose content is modified in the new version of the user file; and

instructions for changing the first and second tables in the metadata file to reflect the content changes in the new version of the user file.

24. The system of claim 19, wherein, in the case that the file operating request is a file consolidate request triggered by a timeout of the user file, the instructions for applying the operating instruction include:

instructions for updating a RAID-5 stripe fragment stored in one of the second array of file servers with its corresponding mirrored stripe fragment stored in one of the first array of file servers;

instructions for updating a parity fragment associated with the RAID-5 stripe fragment;

instructions for repeating said two updates until all mirrored stripe fragments of the user file are stored in the second array of file servers; and

instructions for changing the first and second tables in the metadata file to release space occupied by the mirrored stripe fragments of the user file.

25. The system of claim 19, wherein, in the case that the file operating request is a file consolidate request, the instructions for applying the operating instruction include:

instructions for selecting a user file from a set of user files in accordance with predefined selection criteria, the user file having a set of mirrored stripe fragments in the first array of file servers and an associated metadata file;

instructions for moving the mirrored stripe fragments from the first array of file servers into the second array of file servers;

instructions for updating the metadata file to reflect said moving; and

instructions for repeating said selecting, moving and updating until a stop condition is reached.

26. The system of claim 25, wherein said moving instructions include:

instructions for updating a RAID-5 stripe fragment stored in one of the second array of file servers with a corresponding mirrored stripe fragment stored in one of the first array of file servers;

instructions for updating a parity fragment associated with the RAID-5 stripe fragment; and

instructions for repeating said two updates until all mirrored stripe fragments of the user file are stored in the second array of file servers.

27. The system of claim 19, wherein, in the case that the file operating request is a file consolidate request triggered when free space in the first array of file servers falls below a predefined threshold level, the instructions for applying the operating instruction include:

instructions for selecting a user file from a set of user files in accordance with its timestamp, the user file having a set of mirrored stripe fragments in the first array of file servers and an associated metadata file;

instructions for releasing space occupied by the mirrored stripe fragments by moving the mirrored stripe fragments from the first array of file servers into the second array of file servers;

instructions for updating the metadata file to reflect said releasing; and

instructions for repeating said selecting, releasing and updating until the free space in the first array of file servers is above the predefined threshold level.

28. The system of claim 27, wherein said releasing instructions include:

instructions for updating a RAID-5 stripe fragment stored in one of the second array of file servers with a corresponding mirrored stripe fragment stored in one of the first array of file servers;

instructions for updating a parity fragment associated with the RAID-5 stripe fragment; and

instructions for repeating said two updates until all mirrored stripe fragments of the user file are stored in the second array of file servers.

29. A file switch for use in a computer network having a plurality of file servers, a metadata server and a plurality of client computers, the file switch comprising:

at least one processing unit for executing computer programs;

at least one interface for exchanging information with the file servers, metadata server and client computers, the information exchanged including information concerning a specified user file;

a set of user files that have been updated by the file switch during a predefined time period;

instructions for receiving a file operating request with respect to a user file, the request including a name of the user file and an operating instruction;

file read instructions for extracting a plurality of file segments of a user file from the file servers and returning them to a requesting client;

file write instructions for updating a plurality of file segments of a user file in the file servers in accordance with a new version of the user file; and

file consolidate instructions for removing one or more user files from the set of updated user files in accordance with a predefined condition.

30. The file switch of claim 29, wherein each of the file read instructions, file write instructions and file consolidate instructions includes:

instructions for identifying a first set of file segments of a user file stored in a first array of file servers of the aggregated file system according to a first scheme; and

instruction for identifying a second set of file segments of a user file stored in a second array of file servers of the aggregated file system according to a second scheme.

31. The file switch of claim 30, wherein the user file is associated with a metadata file stored in the metadata server and the metadata file includes first and second tables identifying addresses of the first and second sets of file segments in the first and second arrays of file servers.

32. The file switch of claim 31, wherein the first scheme is a data mirroring scheme and the second scheme is a RAID-5 scheme.

33. The file switch of claim 32, wherein the file read module includes:

instructions for extracting a plurality of mirrored stripe fragments from the first array of file servers;

instructions for extracting a plurality of RAID-5 stripe fragments from the second array of file servers;

instructions for merging the mirrored and RAID-5 stripe fragments to produce a response; and

instructions for returning the response to the requesting client.

34. The file switch of claim 32, wherein the file write module includes, upon receipt of a new version of the user file:

instructions for updating a mirrored stripe fragment in one of the first array of file servers in accordance with the new version of the user file;

instructions for generating at least two copies of a RAID-5 stripe fragment in at least two file servers in the first array of file servers in accordance with the new version of the user file; and

instructions for changing the first and second tables in the metadata file to reflect the content changes in the new version of the user file.

35. The file switch of claim 32, wherein, if the predefined condition is a timeout of a user file, the file consolidate module includes:

instructions for updating a RAID-5 stripe fragment stored in the second array of file servers with its corresponding mirrored stripe fragment in the first array of file servers;

instructions for updating a parity stripe fragment associated with the RAID-5 stripe fragment stored in the second array of file servers; and

instructions for changing the first. and second tables in the metadata file to reflect the consolidation of the user file.

36. The file switch of claim 32, wherein, if the predefined condition is that free space in the first array for hosting mirrored stripe fragments is below a predefined threshold level, the file consolidate module includes:

instructions for selecting a user file from the set of updated user files in accordance with its updating timestamp, the user file having a set of mirrored stripe fragments in the first array of file servers;

instructions for releasing the space occupied by the mirrored stripe fragments by moving them from the first array into the second array;

instructions for updating the user file'"'"'s metadata file to reflect said moving; and

instructions for repeating said selecting, releasing and updating instructions until the free space in the first array is above the predefined threshold level.

37. The file switch of claim 36, wherein said releasing instructions include:

instructions for updating a RAID-5 stripe fragment stored in one of the second array of file servers with a corresponding mirrored stripe fragment stored in one of the first array of file servers; and

instructions for updating a parity fragment associated with the RAID-5 stripe fragment; and

instructions for repeating said two updates until all mirrored stripe fragments are stored in the second array of file servers.

38. A hybrid file storage scheme for managing user files in an aggregated file system, comprising:

splitting a user file into first and second sets of file segments;

storing the first set of file segments in a first array of file servers according to a first scheme; and

storing the second set of file segments in a second array of file servers according to a second scheme.

39. The scheme of claim 38, wherein the first scheme is a data mirroring scheme and the second scheme is a RAID-5 scheme.

40. The scheme of claim 39, wherein a file segment in the first set includes at least two identical copies of a mirrored stripe fragment stored in at least two different file servers in the first array and a file segment in the second set comprises at least three stripe fragments including at least two data fragments and one associated parity fragment, each stored in a separate file server in the second array, and wherein the associated parity fragment is equal to the exclusive-or of the at least two data fragments and a mirrored stripe fragment in the first set is associated with a data fragment in the second set.