Multi-tiered filesystem

• US 8,843,459 B1
• Filed: 03/09/2011
• Issued: 09/23/2014
• Est. Priority Date: 03/09/2010
• Status: Active Grant

• Current Assignee: Hitachi Vantara, LLC (Hitachi, Ltd.)
• Original Assignee: Hitachi Data Systems Engineering Uk Limited (Hitachi, Ltd.)
• Inventors: Aston, Christopher J., Laker, Mark Stephen, Berrington, Neil, Garbagnati, Carlo F., Shottan, Shmuel, Willis, Trevor E., Dorey, Martin A.
• Primary Examiner(s): Ly, Anh
• Application Number:
  US13/043,837
• Time in Patent Office: 1,294 Days
• Field of Search: 707/694, 707/821, 707/822, 707/823, 707/828, 707/831, 707/E17.007, 707/E17.01, 711/114, 711/115, 711/165, 711/170, 714/746, 709/223, 709/224
• US Class Current: 707/694
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A multi-tiered filesystem integrates multiple types of storage devices into a contiguous filesystem storage space having regions associated with two or more tiers of storage.

Claims

1. In a storage system having a plurality of storage devices, wherein different storage devices may be associated with different storage characteristics, a multi-tiered filesystem method comprising:

aggregating storage from the plurality of storage devices into a storage pool having a plurality of storage tiers, the storage tiers having different storage characteristics;

allocating storage from a plurality of the storage tiers for a multi-tiered filesystem;

aggregating the allocated storage into a contiguous filesystem storage space such that at least two regions of the contiguous filesystem storage space are associated with different storage tiers; and

for storing a particular quantum of data;

selecting a storage tier for the quantum of data;

allocating, from the contiguous filesystem storage space, at least one block of storage from at least one region associated with the selected storage tier; and

storing the quantum of data in the at least one allocated storage block, wherein the storage system is operable to store user data associated with a user file into at least one storage device forming a lower storage tier in the storage pool and to store user metadata for managing the user file into at least one storage device forming a higher storage tier in the storage pool based on the types of the storage devices and the type of the user data and the user metadata;

the user metadata stored in the higher storage tier separately from the user data stored in the lower storage tier.

2. A method according to claim 1, wherein the storage tiers are based on at least one of different storage device media, different storage device speeds, or different storage device reliabilities.

3. A method according to claim 2, wherein the different storage device media include solid state storage and at least one type of disk storage.

4. A method according to claim 1, wherein the storage tiers include a high-speed storage tier and at least one lower-speed storage tier.

5. A method according to claim 1, wherein the storage tiers include a high-reliability storage tier and at least one lower-reliability storage tier.

6. A method according to claim 1, wherein the at least two regions of the contiguous filesystem storage space include at least one metadata region predominantly used for storing metadata and at least one user data region predominantly used for storing user data.

7. A method according to claim 6, wherein the at least one metadata region is associated with solid state storage devices and wherein the at least one user data region is associated with disk storage devices.

8. A method according to claim 6, wherein the at least one metadata region is associated with high-reliability disk storage devices and wherein the at least one user data region is associated with lower-reliability disk storage devices.

9. A method according to claim 6, further comprising:

storing system metadata associated with the multi-tiered filesystem in blocks of storage associated with the at least one metadata region; and

for each of a first number of user files having user metadata and user data, storing the user metadata for the user file in blocks of storage associated with the at least one metadata region and storing the user data for the user file in blocks of storage associated with the at least one user data region.

10. A method according to claim 9, further comprising:

selectively storing a portion of system metadata in blocks of data associated with the at least one user data region when there is insufficient storage space in the at least one metadata region for storing the portion of system metadata.

11. A method according to claim 9, further comprising, for each of a second number of user files, storing both the user metadata and the user data for the user file in storage blocks associated with the at least one metadata region.

12. A method according to claim 9, wherein the at least one user data region includes a plurality of user data regions associated with different user data tiers, and wherein storing the user data for the user file comprises:

selecting a user data tier for the user data from among the plurality of user data tiers based on a predetermined storage policy; and

storing the user data for the user file in blocks of storage associated with the selected user data tier.

13. A method according to claim 12, further comprising, for each of a third number of user files, storing the user metadata and the user data for the user file in blocks of storage associated with different user data tiers, wherein the user data tier in which the user metadata is stored is associated with a hierarchically higher storage tier than the user data tier in which the user data is stored.

14. A method according to claim 12, further comprising, for each of a fourth number of user files, storing the user metadata and the user data for the user file in blocks of storage associated with the same user data tier.

15. A method according to claim 1, further comprising:

migrating data between storage tiers based on a predetermined migration policy.

16. A method according to claim 1, wherein the multi-tiered filesystem is managed using a hierarchy of virtual storage constructs including system drives, ranges composed of one or more system drives, stripesets composed of one or more ranges, and spans composed of one or more stripesets, and wherein the storage tiers are managed at the stripeset level such that each stripeset is associated with a storage tier and the multi-tiered filesystem integrates storage from stripesets associated with multiple storage tiers.

17. A file storage system comprising:

a plurality of storage devices including storage devices associated with different storage characteristics; and

a file server operably coupled to the plurality of storage devices, the file server configured to aggregate storage from the plurality of storage devices into a storage pool having a plurality of storage tiers, the storage tiers having different storage characteristics;

allocate storage from a plurality of the storage tiers for a multi-tiered filesystem;

aggregate the allocated storage into a contiguous filesystem storage space such that at least two regions of the contiguous filesystem storage space are associated with different storage tiers; and

for storing a particular quantum of data;

select a storage tier for the quantum of data;

allocate, from the contiguous filesystem storage space, at least one storage block of storage from at least one region associated with the selected storage tier; and

store the quantum of data in the at least one allocated storage block, wherein the file server is operable to store user data associated with a user file into at least one storage device forming a lower storage tier in the storage pool and to store user metadata for managing the user file into at least one storage device forming a higher storage tier in the storage pool based on the types of the storage devices and the type of the user data and the user metadata the user metadata stored in the higher storage tier separately from the user data stored in the lower storage tier.

18. A system according to claim 17, wherein the storage tiers are based on at least one of different storage device media, different storage device speeds, or different storage device reliabilities.

19. A system according to claim 18, wherein the different storage device media include solid state storage and at least one type of disk storage.

20. A system according to claim 17, wherein the storage tiers include a high-speed storage tier and at least one lower-speed storage tier.

21. A system according to claim 17, wherein the storage tiers include a high-reliability storage tier and at least one lower-reliability storage tier.

22. A system according to claim 17, wherein the at least two regions of the contiguous filesystem storage space include at least one metadata region predominantly used for storing metadata and at least one user data region predominantly used for storing user data.

23. A system according to claim 22, wherein the at least one metadata region is associated with solid state storage devices and wherein the at least one user data region is associated with disk storage devices.

24. A system according to claim 22, wherein the at least one metadata region is associated with high-reliability disk storage devices and wherein the at least one user data region is associated with lower-reliability disk storage devices.

25. A system according to claim 22, wherein the file server is further configured to store system metadata associated with the multi-tiered filesystem in blocks of storage associated with the at least one metadata region;

and

for each of a first number of user files having user metadata and user data, store the user metadata for the user file in blocks of storage associated with the at least one metadata region and store the user data for the user file in blocks of storage associated with the at least one user data region.

26. A system according to claim 25, wherein the file server is further configured to selectively store a portion of system metadata in blocks of data associated with the at least one user data region when there is insufficient storage space in the at least one metadata region for storing the portion of system metadata.

27. A system according to claim 25, wherein the file server is further configured to store, for each of a second number of user files, both the user metadata and the user data for the user file in storage blocks associated with the at least one metadata region.

28. A system according to claim 25, wherein the at least one user data region includes a plurality of user data regions associated with different user data tiers, and wherein the file server is configured to store the user data for the user file by selecting a user data tier for the user data from among the plurality of user data tiers based on a predetermined storage policy and storing the user data for the user file in blocks of storage associated with the selected user data tier.

29. A system according to claim 28, wherein the file server is further configured to store, for each of a third number of user files, the user metadata and the user data for the user file in blocks of storage associated with different user data tiers, wherein the user data tier in which the user metadata is stored is associated with a hierarchically higher storage tier than the user data tier in which the user data is stored.

30. A system according to claim 28, wherein the file server is further configured to store, for each of a fourth number of user files, the user metadata and the user data for the user file in blocks of storage associated with the same user data tier.

31. A system according to claim 17, wherein the file server is further configured to migrate data between storage tiers based on a predetermined migration policy.

32. A system according to claim 17, wherein the file server is configured to manage the multi-tiered filesystem using a hierarchy of virtual storage constructs including system drives, ranges composed of one or more system drives, stripesets composed of one or more ranges, and spans composed of one or more stripesets, and wherein the file server is configured to manage storage tiers at the stripeset level such that each stripeset is associated with a storage tier and the multi-tiered filesystem integrates storage from stripesets associated with multiple storage tiers.

33. In a storage system having a storage pool including disk storage representing a lower storage tier and solid state storage device representing a higher storage tier, a method for converting a single-tiered filesystem into a multi-tiered filesystem, the single-tiered filesystem storing filesystem metadata and user files in disk storage, the method comprising:

allocating solid state storage for the filesystem from the storage pool;

aggregating the allocated solid state storage and the disk storage into a contiguous filesystem storage space such that at least two regions of the contiguous filesystem storage space are associated with different storage tiers; and

upon creation of a new user file by the filesystem;

storing user metadata associated with the new user file in the solid state storage; and

storing user data associated with the new user file in the disk storage, wherein at least one user file remains stored entirely in disk storage and wherein the storage system is operable to store the user data associated with the new user file into the disk storage forming the lower storage tier in the storage pool and to store the user metadata for managing the new user file into the solid state storage forming the higher storage tier in the storage pool based on the types of the storage devices and the type of the user data and the user metadata, the user metadata stored in the higher storage tier separately from the user data stored in the lower storage tier.

34. A method according to claim 33, further comprising:

selectively migrating filesystem metadata from the disk storage to the solid state storage.

35. A method according to claim 33, further comprising:

selectively converting a user file stored entirely in disk storage to a user file associated with user metadata stored in the higher storage tier separately from user data stored in the lower storage tier, such converting including moving at least a portion of the user metadata associated with the user file to the solid state storage.

36. A method according to claim 35, wherein such converting is performed upon a write to the user file.

37. A method according to claim 35, wherein such converting is performed upon a user access to the user file.

38. A file server comprising:

a storage pool including storage from at least two tiers of storage devices, the storage tiers having different storage characteristics; and

a plurality of multi-tiered filesystems, each multi-tiered filesystem including storage from a plurality of the storage tiers aggregated into a contiguous filesystem storage space such that at least two regions of the contiguous filesystem storage space are associated with different storage tiers, wherein the file server is operable to store user data associated with a user file into at least one storage device forming a lower storage tier in the storage pool and to store user metadata for managing the user file into at least one storage device forming a higher storage tier in the storage pool based on the types of the storage devices and the type of the user data and the user metadata so that the user metadata can be stored in the higher storage tier separately from the user data stored in the lower storage tier.

39. A file server according to claim 38, wherein each multi-tiered filesystem is configured to selectively store filesystem metadata and user metadata in a first storage tier and to selectively store user data in a second storage tier.