Filesystem storing file data in larger units than used for metadata

• US 10,127,236 B1
• Filed: 06/27/2013
• Issued: 11/13/2018
• Est. Priority Date: 06/27/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Zhou, Yingchao, Davenport, William C., Seibel, Christopher A., Guo, Jun, Zhai, Jia, Wang, Wengang, Armangau, Philippe
• Primary Examiner(s): Alam, Hosain
• Assistant Examiner(s): Allen, Nicholas
• Application Number:
  US13/928,972
• Time in Patent Office: 1,965 Days
• Field of Search: 707822
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06

Abstract

A method is provided for storing files in a filesystem of a data storage system. The method includes (a) storing data of each file of a set of files of the filesystem in a set of data allocation units (AUs) of the filesystem on the data storage system, each data AU of the set of data AUs having a common data AU size, and (b) storing metadata pertaining to each file of the set of files in a set of metadata AUs of the filesystem on the data storage system, each metadata AU of the set of metadata AUs having a common metadata AU size, the common data AU size being larger than the common metadata AU size. A computerized apparatus and a computer program product are also provided for performing a method similar to that described above.

Claims

1. A method of storing files in a filesystem of a data storage system, the method comprising:

storing data of each file of a set of files of the filesystem in a set of data blocks of the filesystem on the data storage system, each data block of the set of data blocks having a shared data block size;

storing metadata pertaining to each file of the set of files in a set of metadata blocks of the filesystem on the data storage system, each metadata block of the set of metadata blocks having a shared metadata block size, the shared data block size being larger than the shared metadata block size by an integer factor, the integer being greater than one, the shared metadata block size being equal to a memory page size of the data storage system;

storing an indication of a default data block size within filesystem-descriptive metadata pertaining to the filesystem;

at a formatting time of the filesystem, setting the shared data block size as the stored default data block size for all files of the filesystem;

at a creation time of a new file of the filesystem outside the set of files, setting a new data block size of the new file, the new data block size being different than the default data block size;

storing an indication of the new data block size within metadata pertaining to the new file;

storing data of the new file in another set of data blocks of the filesystem on the data storage system, each data block of the other set of data blocks having the new data block size; and

storing metadata pertaining to the new file in another set of metadata blocks of the filesystem on the data storage system, each metadata block of the other set of metadata blocks having the shared metadata block size, the new data block size being larger than the shared metadata block size.

2. The method of claim 1, further comprising, at the formatting time of the filesystem, receiving an indication from a user as to what type(s) of use is to be made of the filesystem;

wherein setting the default data block size for all files includes selecting a size based on the indication from the user as to what type(s) of use is to be made of the filesystem.

3. The method of claim 2,

wherein receiving the indication from the user as to what type(s) of use is to be made of the filesystem includes interacting with the user via a wizard that prompts the user for the types(s) of applications that are to be used with the filesystem;

and

wherein selecting the size based on the indication from the user includes selecting the size based on the interaction between the wizard and the user.

4. The method of claim 1, further comprising:

at the creation time of the new file, receiving an indication from a user as to as to what type(s) of use is to be made of the new file; and

setting the new data block size of the new file includes;

selecting the default data block size when the user provides a null indication; and

otherwise, selecting a size based on the indication from the user as to what type(s) of use is to be made of the new file.

5. The method of claim 4,

wherein receiving the indication from the user as to what type(s) of use is to be made of the new file includes interacting with the user via a wizard that prompts the user for the types(s) of applications that are to be used with the new file;

and

wherein selecting the size based on the indication from the user includes selecting the size based on the interaction between the wizard and the user.

6. The method of claim 1, wherein storing the indication of the default data block size within filesystem-descriptive metadata pertaining to the filesystem includes storing the integer within the filesystem-descriptive metadata pertaining to the filesystem.

7. The method of claim 1,

wherein each data block of the set of data blocks includes a number of sequential blocks of the data storage system equal to the integer;

and

wherein the metadata pertaining to each file of the set of files includes a block pointer to a first block of each data block of the set of data blocks for that file.

8. The method of claim 1 wherein the memory page size of the data storage system is 8 kilobytes.

9. The method of claim 8 wherein the integer is an integral power of two.

10. The method of claim 9 wherein the integer is equal to 4.

11. The method of claim 9 wherein the integer is equal to 8.

12. The method of claim 9 wherein the integer is equal to 16.

13. The method of claim 1, wherein:

the metadata blocks of the set of metadata blocks include inode blocks and indirect blocks, the inode blocks storing a plurality of inodes, the inodes and the indirect blocks storing pointers that point to indirect blocks and pointers that point to data blocks; and

the data blocks are each a collection of a plurality of contiguous storage blocks.

14. The method of claim 1, wherein the set of metadata blocks includes a set of indirect blocks, each of the set of indirect blocks storing pointers that point to at least one of other indirect blocks and data blocks.

15. The method of claim 1, wherein:

the shared metadata block size is the smallest unit of metadata storage that can be allocated by the filesystem; and

the shared data block size is the smallest unit of data storage that can be allocated by the filesystem.

16. An apparatus comprising:

data storage; and

a controller, the controller being configured to;

store data of each file of a set of files of a filesystem in a set of data blocks of the filesystem on the data storage, each data block of the set of data blocks having a shared data block size;

store metadata pertaining to each file of the set of files in a set of metadata blocks of the filesystem on the data storage, each metadata block of the set of metadata blocks having a shared metadata block size, the shared data block size being larger than the shared metadata block size by an integer factor, the integer being greater than one, the shared metadata block size being equal to a memory page size of the apparatus;

store an indication of a default data block size within filesystem-descriptive metadata pertaining to the filesystem;

at a formatting time of the filesystem, setting the shared data block size as the stored default data block size for all files of the filesystem;

at a creation time of a new file of the filesystem outside the set of files, setting a new data block size of the new file, the new data block size being different than the default data block size;

storing an indication of the new data block size within metadata pertaining to the new file;

storing data of the new file in another set of data blocks of the filesystem on the data storage, each data block of the other set of data blocks having the new data block size; and

storing metadata pertaining to the new file in another set of metadata blocks of the filesystem on the data storage, each metadata block of the other set of metadata blocks having the shared metadata block size, the new data block size being larger than the shared metadata block size.

17. The apparatus of claim 16 further comprising memory, the memory having the memory page size, the memory being accessible in increments of the memory page size.

18. A computer program product comprising a non-transitory computer-readable storage medium storing a set of instructions, which, when executed by a data storage computer, causes the data storage computer to perform the operations of:

storing data of each file of a set of files of a filesystem in a set of data blocks of the filesystem on persistent storage connected to the data storage computer, each data block of the set of data blocks having a shared data block size;

storing metadata pertaining to each file of the set of files in a set of metadata blocks of the filesystem on the persistent storage connected to the data storage computer, each metadata block of the set of metadata blocks having a shared metadata block size, the shared data block size being larger than the shared metadata block size by an integer factor, the integer being greater than one, the shared metadata block size being equal to a memory page size of the data storage computer;

storing an indication of a default data block size within filesystem-descriptive metadata pertaining to the filesystem;

at a formatting time of the filesystem, setting the shared data block size as the stored default data block size for all files of the filesystem;

at a creation time of a new file of the filesystem outside the set of files, setting a new data block size of the new file, the new data block size being different than the default data block size;

storing an indication of the new data block size within metadata pertaining to the new file;

storing data of the new file in another set of data blocks of the filesystem on the persistent storage, each data block of the other set of data blocks having the new data block size; and

storing metadata pertaining to the new file in another set of metadata blocks of the filesystem on the persistent storage, each metadata block of the other set of metadata blocks having the shared metadata block size, the new data block size being larger than the shared metadata block size.