Heterogenic volume generation and use system

• US 9,524,300 B2
• Filed: 03/14/2013
• Issued: 12/20/2016
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Rajpal, Shiv, Pang, Juan-Lee, Havewala, Sarosh Cyrus, Verma, Surendra, Mehra, Karan, Matthew, Bryan Stephen, Christiansen, Neal Robert, Herron, Andrew
• Primary Examiner(s): Mahmoudi, Tony
• Assistant Examiner(s): Wang, Dongming
• Application Number:
  US13/829,276
• Publication Number:
  US 20140280397A1
• Time in Patent Office: 1,377 Days
• Field of Search: 707/825
• US Class Current: 1/1
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

A system in which a file system may operate on a volume in which the logical address extent of the volume is divided into multiple tiers, each tier providing storage having a distinct trait set by mapping the logical addresses of the volume to appropriate underlying storage systems. A volume system exposes the volume to the file system in a manner that the file system itself has awareness of the tiers, and is aware of the trait sets of each tier. The file system may thus store file system namespaces (such as directories and files) into the tiers as appropriate for the file system namespace. A provisioning system may also be provided and be configured to provision the volume to include such tiers, and if desired, to extend the tiers.

Claims

1. A computing system comprising:

at least one processor; and

one or more hardware storage device having stored thereon computer-executable instructions that are executable by the at least one processor and that cause the computing system to implement a method of storing namespace items, the method comprising;

implementing a file system and a volume system, the volume system being configured to expose a volume to the file system in a manner that the volume is exposed with a plurality of tiers;

storing a file system namespace item in a particular tier of the plurality of tiers based on storage traits that are determined to apply to the file system namespace item, each storage trait being either a mandatory storage trait or an optional storage trait, wherein a determination as to which tier the file system namespace item is to be stored in is based at least partially on whether one or more of the storage traits of the file system namespace item are mandatory or optional, whereby mandatory storage traits take precedence over optional storage traits when determining which tier the file system namespace item will be stored in;

monitoring and detecting one or more changes to the storage traits that apply to the file system namespace item subsequent to storage of the file system namespace item, wherein at least one change of the one or more changes that is detectable by the computing system is a mandatory storage trait changing into an optional storage trait after a request for the at least one change is submitted; and

moving the file system namespace item from the particular tier of the plurality of tiers to a different tier in response to detecting the one or more changes to the one or more of the storage traits that apply to the file system namespace item subsequent to storage of the file system namespace item, wherein said one or more changes causes the storage traits of the file system namespace item to correspond more closely to the different tier than the particular tier.

2. The system in accordance with claim 1, further comprising:

a mapping system configured to map logical address locations of the volume to a plurality of underlying storage systems to support a traits set for each of the plurality of tiers of the volume.

3. The system in accordance with claim 2, wherein the mapping system maps the logical address locations of the volume to the plurality of underlying storage systems using a plurality of slabs, each of contiguous logical storage.

4. The system in accordance with claim 3, wherein most of the plurality of slabs are at least one Megabyte in size.

5. The system in accordance with claim 3, wherein a given tier of the plurality of tiers comprises a plurality of regions, at least most of the plurality of regions each comprising a plurality of slabs that are each contiguous in the logical address location of the volume.

6. The system in accordance with claim 2, wherein the plurality of underlying storage systems support the traits set for each of the plurality of tiers of the volume.

7. The system in accordance with claim 2, wherein at least one of the plurality of underlying storage systems comprises flash memory.

8. The system in accordance with claim 2, wherein at least one of the plurality of underlying storage systems comprises a mechanical disk.

9. The system in accordance with claim 2, wherein at least one of the plurality of underlying storage systems comprises a consolidated storage system that offers up a plurality of addresses that are mapped to a further plurality of underlying storage systems.

10. The system in accordance with claim 1, further comprising:

a provisioning system configured to provision the volume to include the plurality of tiers.

11. The system in accordance with claim 10, wherein the provisioning system is further configured to extend a given one of the plurality of tiers in response to a determination that the given tier should be extended.

12. The system in accordance with claim 1, further comprising:

a tiering engine that causes files or fragments thereof to be moved from one tier to a target tier in response to monitoring dynamic conditions.

13. The system in accordance with claim 12, wherein the tiering engine honors a storage trait set to be applied to a corresponding file when moving the file or a file fragment to a target tier, wherein the target tier also provides storage having a trait set consistent with the trait set to be applied to the corresponding file or file fragment.

14. The system in accordance with claim 1, wherein a first set of traits comprises an identity of an underlying storage system.

15. The system in accordance with claim 1, wherein a distinct trait set for at least one of the plurality of tiers comprises a performant trait.

16. The system in accordance with claim 1, wherein a distinct trait set for at least one of the plurality of tiers comprises a resiliency trait.

17. The system in accordance with claim 1, wherein a distinct trait set for at least one of the plurality of tiers comprises an encryption trait.

18. The system in accordance with claim 1, wherein a distinct trait set for at least one of the plurality of tiers comprises a compression trait.

19. A computer program product comprising one or more computer-readable hardware storage devices having thereon one or more computer-executable instructions that are executable by one or more processors of a computing system to cause the computing system to operate the following:

a file system; and

a volume system configured to expose a volume to the file system in a manner that the volume is exposed with a plurality of tiers, each tier of the volume comprising a region of contiguous slabs in a logical addressing scheme of the volume that are all associated with a distinct trait set, the volume having at least some thickly provisioned slabs that are mapped to the one or more storage device and at least one or more thinly provisioned slabs that are not mapped to any storage device,

wherein the file system is configured to store a file system namespace item or a file fragment in a particular tier of the plurality of tiers based on storage traits to be applied to the file system namespace item, each storage trait being either a mandatory storage trait or an optional storage trait, and wherein a determination as to which tier the file system namespace item is to be stored in is based at least partially on whether one or more of the storage traits of the file system namespace item are mandatory or optional, whereby mandatory storage traits take precedence over optional storage traits when determining which tier the file system namespace item will be stored in,

wherein the computing system monitors and detects one or more changes with the storage traits that apply to the file system namespace item subsequent to storage of the file system namespace item, wherein at least one change of the one or more changes that is detectable by the computing system is a mandatory storage trait changing into an optional storage trait after a request for the at least one change is submitted, and

wherein the computing system further moves the file system namespace item from the particular tier of the plurality of tiers to a different tier in response to detecting the one or more changes in the one or more of the storage traits that apply to the file system namespace item subsequent to storage of the file system namespace item, wherein said one or more changes causes the storage traits of the file system namespace item to correspond more closely to the different tier than the particular tier.

20. A computing system comprising:

at least one processor;

a file system;

a volume system configured to expose a volume to the file system in a manner that the volume is exposed with a plurality of tiers, each tier comprising storage having of a distinct trait set, wherein the file system is configured to cause a file system namespace item to be stored in at least a particular tier of the plurality of tiers based on storage traits associated with the file system namespace item, each storage trait being either a mandatory storage trait or an optional storage trait, and wherein a determination as to which tier the file system namespace item is to be stored in is based at least partially on whether one or more of the storage traits of the file system namespace item are mandatory or optional, whereby mandatory storage traits take precedence over optional storage traits when determining which tier the file system namespace item will be stored in,

a plurality of underlying storage systems, including hardware storage systems;

a mapping system configured to map logical address locations of the volume to the plurality of underlying storage systems to support the trait set for each of the plurality of tiers of the volume, wherein the mapping system maps the logical address locations of the volume to a plurality of underlying storage systems in such a manner that each tier of the volume comprises a region of contiguous slabs in a logical addressing scheme; and

a provisioning system configured to provision the volume to include the plurality of tiers, including the particular tier that is a match for the storage traits that are associated with the file system namespace item and to responsively store the file system namespace item in the particular tier,

the provisioning system being further configured to monitor and detect a change in the storage traits associated with the stored file system namespace item subsequent to storage of the file system namespace item, wherein at least one change of the one or more changes that is detectable by the computing system is a mandatory storage trait changing into an optional storage trait after a request for the at least one change is submitted, and

the provisioning system being further configured to determine that a new tier of the plurality of tiers becomes a better match for the file system namespace item than the particular tier due to the change in the storage traits associated with the stored file system namespace item and, in response, to move the file system namespace item to the new tier.

21. The computing system of claim 20, wherein detecting the change in the storage traits includes, subsequent to storing the file system namespace item, the provisioning system detecting that the new tier has a higher number of storage traits than the particular tier that match the storage traits that are to be applied to the file system namespace item.

22. The computing system of claim 20, wherein the storage traits includes at least a compression storage trait, and the change in the storage traits includes a change in the compression storage trait.

23. The computing system of claim 20, wherein the storage traits includes at least a compression storage trait, and the change in the storage traits includes a change in the encryption storage trait.

24. The computing system of claim 20, wherein at least some traits included within a first trait set that corresponds to a first tier are also included within a second trait set that corresponds to a second tier, such that the first tier and the second tier share some, but not all, traits.

25. The computing system of claim 20, wherein the file system is further configured to do the following:

upon a condition in which the file system detects that a mandatory storage trait of the file system namespace item cannot be satisfied by any of the plurality of tiers, the file system performs the following;

first saves the file system namespace item in a best matched tier;

after saving the file system namespace item, notifies a user regarding the save to a suboptimal storage location; and

asks the user whether the save should be cancelled.

26. The computing system of claim 20, wherein the file system is further configured to, for at least some tiers in the plurality of tiers, request a user to specify primary or secondary goals for each of the at least some tiers.