Opportunistic performance allocations in data storage systems

• US 8,954,393 B1
• Filed: 11/24/2004
• Issued: 02/10/2015
• Est. Priority Date: 11/24/2004
• Status: Expired due to Fees

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Operating Corporation (Gen Digital Inc.)
• Inventors: Botes, Par
• Primary Examiner(s): Ahn, Sangwoo
• Application Number:
  US10/997,724
• Time in Patent Office: 3,730 Days
• Field of Search: 707 1- 10, 707100-1041
• US Class Current: 707/651
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11

Abstract

System and method for the opportunistic allocation of copies of data across data storage resources in file systems. Embodiments may opportunistically and transparently trade storage space in a file system for performance. In embodiments, when data is stored to the file system, copies of the data may be opportunistically stored to two or more data storage resources. The data may then be opportunistically accessed from a less active resource if the resource storing a primary copy of the data is busy. The opportunistically stored copies of data remain online in the file system. In hierarchical file systems or tiered storage hierarchies, embodiments may allow higher-level storage tiers to “borrow” performance from lower-level tiers by opportunistically allocating copies of data from a higher-level tier within a lower-level tier. Copies of data stored on a data storage resource may be deleted if storage space is needed on that data storage resource.

Claims

1. A system, comprising:

at least one processor; and

a memory storing file system software that when executed by the at least one processor performs;

managing access of a file system implemented on a plurality of storage resources;

storing data to a storage resource of the plurality of storage resources, wherein the storage resource is in one class of storage resource of a plurality of classes of storage resources;

determining whether to make a copy of the data available based at least in part on determining whether storage space is available in another class of storage resource having a lower performance characteristic than the one class of storage resource;

in response to determining to make the copy of the data available, opportunistically allocating the copy of the data to another storage resource of a plurality of storage resources in the other class of storage resource, wherein opportunistically allocating comprises storing the copy of the data on the other storage resource such that the data and the copy of the data are both online in the file system and available for retrieval;

redirecting an access request for the data to a less active one of the storage resources storing the data and the copy of the data, even if said redirecting results in the access request being redirected to the other storage resource; and

in response to determining that storage space is needed in the other class of storage resource or in response to determining that the data stored in the storage resource is modified, deleting, overwriting or marking for reuse the copy of the data from the other storage resource, wherein the data remains online in the file system for retrieval from the storage resource.

2. The system as recited in claim 1, wherein each class of the plurality of classes of storage resources is distinguished from every other class of the plurality of classes of storage resources based on performance characteristics.

3. The system as recited in claim 1, wherein the data is a file or a portion of a file.

4. The system as recited in claim 1, wherein, to store the data to the storage resource and the copy of the data to the other storage resource, the file system software further performs the storage to each of the respective storage resources according to a policy, wherein the policy specifies particular ones of the plurality of storage resources available for the storage.

5. The system as recited in claim 1, wherein the file system software further performs modifying metadata for the data to indicate a location of each of the copies of the data stored in the file system.

6. The system as recited in claim 1, wherein said storage of the data to the storage resource and the copy of the data to the other storage resource and said redirection of the access request for the data to the less active one of the storage resources storing the data and the copy of the data is transparent to an application configured to access the file system.

7. A system, comprising:

a plurality of storage devices storing a file system implemented as a tiered storage hierarchy comprising a plurality of storage tiers; and

a host system configured to couple to the file system, wherein the host system comprises a computer-accessible storage medium storing file system software comprising;

a data allocation component that, when executed on the host system, is configured to;

store data to a storage tier of the plurality of storage tiers, wherein the storage tier is one class of storage tier of a plurality of classes of storage tiers;

determine whether to make a copy of the data available based at least in part on a determination whether storage space is available in another class of storage tier having a lower performance characteristic than the one class of storage tier; and

in response to a determination to make the copy of the data available, opportunistically allocate the copy of the data to another storage tier of a plurality of storage tiers in the other class of storage tiers such that the data and the copy of the data are both online in the file system and available for retrieval, wherein the opportunistic allocation comprises storage of the copy of the data on the other storage tier; and

a file system functionality component that, when executed on the host system, is configured to;

redirect an access request for the data to a less active one of the storage tiers storing the data and the copy of the data even if said redirection results in the access request being redirected to the other storage tier; and

in response to a determination that storage space is needed in the other storage tier or in response to a determination that the data stored in the storage tier is modified, delete, overwrite or mark for reuse the copy of the data from the other storage tier, wherein the data remains online in the file system for retrieval from the storage tier.

8. The system as recited in claim 7, wherein the file system software, when executed on the host system, is further configured to modify metadata for the data to indicate a location of each of the copies of the data stored in the file system.

9. A method comprising:

storing, by file system software on one or more devices, data to a storage resource of a plurality of storage resources in a file system implemented on the plurality of storage resources, wherein the data stored remains online within the file system, and wherein the storage resource is in one class of storage resource of a plurality of classes of storage resources;

determining whether to make a copy of the data available based at least in part on determining whether storage space is available in another class of storage resource having a lower performance characteristics than the one class of storage resource;

in response to determining to make the copy of the data available, opportunistically allocating the copy of the data to another storage resource of a plurality of storage resources in the other class of storage resource, wherein opportunistically allocating comprises storing, by the file system software, the copy of the data on the other storage resource such that the data and the copy of the data are both online in the file system and available for retrieval;

receiving, by the file system software, one or more access requests for the data;

redirecting, by the file system software, the access requests for the data to a less active one of the storage resource and the other storage resource even if said redirecting results in the access requests being redirected to the data storage resource; and

in response to determining that storage space is needed in the other class of storage resource or in response to determining that the data stored in the storage resource is modified, deleting, overwriting or marking for reuse the copy of the data from the other class of storage resource, wherein the data remains online in the file system for retrieval from the storage resource.

10. The method as recited in claim 9, wherein each class of the plurality of classes of storage resources is distinguished from every other class of the plurality of classes of storage resources based on performance characteristics.

11. The method as recited in claim 9, wherein said storing the data to the storage resource and the copy of the data to the other storage resource comprise storing to the respective storage resources according to a policy, wherein the policy specifies particular ones of the plurality of storage resources available for storing the data and the copies of the data.

12. The method as recited in claim 9, further comprising modifying, by the file system software, metadata for the data to indicate a location of each of the copies of the data stored in the file system.

13. The method as recited in claim 9, wherein said storing the data to the storage resource and the copy of the data to the other storage resource and said redirecting the access requests for the data to the less active one of the storage resource and the other storage resource is transparent to an application configured to access the file system.

14. A non-transitory computer-accessible storage medium storing file system software that, when executed on one or more devices, performs:

storing data to a storage resource of a plurality of storage resources in a file system implemented on the plurality of storage resources, wherein the data stored remains online within the file system, and wherein the storage resource is in one class of storage resource of a plurality of classes of storage resources;

determining whether to make a copy of the data available based at least in part on determining whether storage space is available in another class of storage resource having a lower performance characteristics than the one class of storage resource;

in response to determining to make the copy of the data available, opportunistically allocating the copy of the data to another storage resource of a plurality of storage resources in the other class of storage resource, wherein opportunistically allocating comprises storing, by the file system software, the copy of the data on the other storage resource such that the data and the copy of the data are both online in the file system and available for retrieval;

receiving one or more access requests for the data;

redirecting the one or more access requests for the data to a less active one of the storage resource storing the data and the other storage resource storing the copy of the data even if said redirecting results in the access requests being redirected to the other storage resource; and

in response to determining that storage space is needed in the other class of storage resource or in response to determining that the data stored in the storage resource is modified, deleting, overwriting or marking for reuse the copy of the data from the other class of storage resource, wherein the data remains online in the file system for retrieval from the storage resource.

15. The non-transitory computer-accessible storage medium as recited in claim 14, wherein the file system is implemented as a tiered storage hierarchy comprising a plurality of storage tiers, wherein each storage tier comprises one or more of the plurality of storage resources.

16. The non-transitory computer-accessible storage medium as recited in claim 14, wherein each class of the plurality of classes of storage resources is distinguished from every other class of the plurality of classes of storage resources based on performance characteristics.

17. The non-transitory computer-accessible storage medium as recited in claim 14, wherein the file system software further performs modifying metadata for the data to indicate a location of each of the copies of the data stored in the file system.

18. The non-transitory computer-accessible storage medium as recited in claim 14, wherein said storage of the data to the storage resource and the copy of the data to the other storage resource and said redirection of the access requests for the data to the less active one of the storage resource and the other storage resource is transparent to an application configured to access the file system.

19. The non-transitory computer-accessible storage medium as recited in claim 14, wherein said storing the data to the storage resource and the copy of the data to the other storage resource comprise storing to the respective storage resources according to a policy, wherein the policy specifies particular ones of the plurality of storage resources available for storing the data and the copies of the data.