Restoring a file to its proper storage tier in an information lifecycle management environment

• US 8,229,897 B2
• Filed: 02/03/2006
• Issued: 07/24/2012
• Est. Priority Date: 02/03/2006
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: International Business Machines Corporation
• Inventors: Cannon, David M., Clark, Thomas K., Correl, Stephen F., Marek, Toby L., Seeger, James J. Jr., Young, Jason C., Wolf, David M., Young, Michael W.
• Primary Examiner(s): Breene, John
• Assistant Examiner(s): Wong, Huen
• Application Number:
  US11/347,515
• Publication Number:
  US 20070185934A1
• Time in Patent Office: 2,363 Days
• Field of Search: 707/644, 707/645, 707/646, 707/649, 707/680, 707/681, 711/162
• US Class Current: 707/679
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques

Abstract

A technique for implementing policy-aware backup and restore capability in a tiered storage system. If a data set'"'"'s contents are backed up from the tiered storage system to a backup storage system, metadata for the data set may also be backed up. Prior to the data set being restored from the backup storage system to the tiered storage system, the backed up metadata is restored and processed to determine a tier among the tiered storage pools to which the data set will be restored.

Claims

1. A method for implementing policy-aware backup and restore capability in a tiered storage file system, comprising:

said tiered storage file system managing hierarchical data storage tiers of a tiered storage system wherein the storage tiers represent different classes of storage based on device cost and associated capabilities and include at least one high value storage tier and one low value storage tier, said high value storage tier having higher cost and associated capabilities than said low value storage tier, said high value storage tier storing data of higher data value than said low value storage tier;

said tiered storage file system maintaining Information Lifecycle Management (ILM) metadata for data sets stored in said tiered storage system, said ILM metadata identifying a data set'"'"'s storage tier assignment;

said storage tier assignment being determined by an ILM policy rule that determines a storage tier where a data set should be placed in said tiered storage system according to a value associated with said data set;

performing a data set backup that backs up a data set independently of said ILM metadata for said data set from said tiered storage file system to a backup storage system to create a backed up data set;

said data set backup including a backup/restore application storing said backed up data set on said backup storage system without use of said ILM metadata for said backed up data set, said backup/restore application acting as a client of said tiered storage file system;

independently performing an ILM metadata backup that backs up said ILM metadata for said backed up data set to create backed up ILM metadata;

said metadata backup including said tiered storage file system providing said ILM metadata for said backed up data set to said backup/restore application as a data object that is opaque to said backup/restore application and said backup/restore application storing said data object as said backed up ILM metadata;

prior to said backed up data set being restored from said backup storage system to said tiered storage file system, said backup/restore application performing an ILM metadata restore that restores said backed up ILM metadata to said tiered storage file system;

said tiered storage file system processing said backed up ILM metadata to determine, based on said data value of data in said backed up data set, a storage tier in said tiered storage system to which said backed up data set will be restored, said storage tier being one of said at least one high value storage tier and one low value storage tier; and

said backup/restore application performing a data set restore that restores said backed up data set from said backup storage system to said tiered storage file system, said data set restore being performed in cooperation with said tiered storage file system to place said backed up data set in said storage tier determined by said ILM metadata processing.

2. A method in accordance with claim 1 wherein said ILM metadata comprises standard file metadata.

3. A method in accordance with claim 1 wherein said ILM metadata back up comprises storing said ILM metadata in persistent storage outside of said tiered storage system.

4. A method in accordance with claim 1 wherein said ILM metadata backup comprises storing said ILM metadata as a Binary Large Object (BLOB).

5. A method in accordance with claim 1 wherein said ILM metadata restore includes said backup/restore application transferring said backed up ILM metadata to a memory buffer and issuing a file system call to said tiered storage file system specifying said memory buffer and a file name for restoring said backed up data set to which said backed up ILM metadata corresponds.

6. A method in accordance with claim 5 wherein said data set restore includes said tiered storage file system opening a file having said file name in said storage tier determined by said ILM metadata processing and returning a file descriptor for said file to said backup/restore application.

7. A method in accordance with claim 6 wherein said data set restore further includes said backup/restore application writing data blocks of said backed up data set to said open file and closing said file.

8. A method in accordance with claim 1 wherein said ILM metadata processing comprises applying said ILM policy rule to said ILM metadata to determine said tier for said data set.

9. A method for implementing policy-aware restore operations for backing up and restoring a data set between backup storage and a tiered storage system managed by a tiered storage file system;

comprising;

said tiered storage file system managing hierarchical data storage tiers that represent different classes of storage based on device cost and associated capabilities and include at least one high value storage tier and one low value storage tier, said high value storage tier having higher cost and associated capabilities than said low value storage tier, said high value storage tier storing data of higher data value than said low value storage tier;

said tiered storage file system maintaining Information Lifecycle Management (ILM) metadata for data sets stored in said tiered storage system, said ILM metadata identifying a data set'"'"'s storage tier assignment;

said storage tier assignment being determined by an ILM policy rule that determines a storage tier where a data set should be placed in said tiered storage system according to a value associated with said data set;

performing a data set backup that backs up a data set independently of said ILM metadata for said data set from said tiered storage file system to a backup storage system to create a backed up data set;

said data set backup including a backup/restore application storing said backed up data set on said backup storage system without use of said ILM metadata for said backed up data set, said backup/restore application acting as a client of said tiered storage file system;

independently performing an ILM metadata backup that backs up said ILM metadata for said backed up data set to create backed up ILM metadata;

said ILM metadata backup including said tiered storage file system providing said ILM metadata for said backed up data set to said backup/restore application as a data object that is opaque to said backup/restore application and said backup/restore application storing said data object as said backed up ILM metadata;

prior to said backed up data set being restored from said backup storage system to said tiered storage file system, said backup/restore application performing an ILM metadata restore that restores said backed up ILM metadata to said tiered storage file system; and

said tiered storage file system processing said backed up ILM metadata to determine a storage tier in said tiered storage system to which said backed up data set will be restored;

said backup/restore application performing a data set restore that restores said backed up data set from said backup storage system to said tiered storage file system, said data set restore being performed in cooperation with said tiered storage file system to place said backed up data set in said storage tier determined by said ILM metadata processing;

said ILM metadata processing comprising said tiered storage file system evaluating conditions in said tiered storage system and assigning said data set to a storage tier, as by;

performing a first storage tier assignment upon determination that a version of said data set exists on said data set'"'"'s pre-backup storage tier;

said first storage tier assignment comprising assigning said data set to said pre-backup storage tier;

performing a second storage tier assignment upon determination that a version of said data set exists on a storage tier that is different from said data set'"'"'s pre-backup storage tier;

said second storage tier assignment comprising assigning said data set to said different storage tier;

performing a third storage tier assignment upon determination that said data set does not exist in said tiered storage system but said data set'"'"'s pre-backup storage tier exists;

said third storage tier assignment comprising assigning said data set to said data set'"'"'s pre-backup storage tier unless said pre-backup storage tier has a changed file system identifier, in which case said third storage tier assignment comprises applying policy placement rules to determine a new storage tier target and assigning said data set to said new storage tier target; and

performing a fourth storage tier assignment upon determination that said data set and said data set'"'"'s pre-backup storage tier do not exist in said tiered storage system; and

said fourth storage tier assignment comprising applying policy placement rules to determine a new storage tier target and assigning said data set to said new storage tier target.

10. A system, comprising:

one or more processors;

memory coupled to one or more said processors, said memory including one or more computer useable media tangibly embodying one or more programs of instructions executable by said one or more processors to perform operations for implementing policy-aware backup and restore capability in a tiered storage file system, comprising;

said tiered storage system managing hierarchical data storage tiers of a tiered storage system wherein the storage tiers represent different classes of storage based on device cost and associated capabilities and include at least one high value storage tier and one low value storage tier, said high value storage tier having higher cost and associated capabilities than said low value storage tier, said high value storage tier storing data of higher data value than said low value storage tier;

said tiered storage file system maintaining Information Lifecycle Management (ILM) metadata for data sets stored in said tiered storage system, said ILM metadata identifying a data set'"'"'s storage tier assignment;

said storage tier assignment being determined by an ILM policy rule that determines a storage tier where a data set should be placed in said tiered storage system;

performing a data set backup that backs up a data set independently of said ILM metadata for said data set from said tiered storage file system to a backup storage system to create a backed up data set;

said data set backup including a backup/restore application storing said backed up data set on said backup storage system without use of said ILM metadata for said backed up data set, said backup/restore application acting as a client of said tiered storage file system;

independently performing an ILM metadata backup that backs up said ILM metadata for said backed up data set to create backed up ILM metadata;

said ILM metadata backup including said tiered storage file system providing said ILM metadata for said backed up data set to said backup/restore application as a data object that is opaque to said backup/restore application and said backup/restore application storing said data object as said backed up ILM metadata;

prior to said backed up data set being restored from said backup storage system to said tiered storage file system, said backup/restore application performing an ILM metadata restore that restores said backed up ILM metadata to said tiered storage file system;

said tiered storage file system processing said backed up ILM metadata to determine, based on said data value of data in said backed up data set, a storage tier in said tiered storage system to which said data set will be restored, said storage tier being one of said at least one high value storage tier and one low value storage tier; and

said backup/restore application performing a data set restore that restores said backed up data set from said backup storage system to said tiered storage file system, said data set restore being performed in cooperation with said tiered storage file system to place said backed up data set in said storage tier determined by said ILM metadata processing.

11. A system in accordance with claim 10 wherein said ILM metadata restore includes said backup/restore application transferring said backed up ILM metadata to a memory buffer and issuing a file system call to said tiered storage file system specifying said memory buffer and a file name for restoring said backed up data set to which said backed up ILM metadata corresponds.

12. A system in accordance with claim 11 wherein said data set restore includes said tiered storage file system opening a file having said file name in said storage tier determined by said ILM metadata processing and returning a file descriptor for said file to said backup/restore application.

13. A system in accordance with claim 12 wherein said data set restore further includes said backup/restore application writing data blocks of said backed up data set to said open file and closing said file.

14. A system in accordance with claim 10 wherein said ILM metadata processing comprises applying said ILM policy rule to said ILM metadata to determine said tier for said data set.

15. A computer program product, comprising:

one or more machine useable storage media;

logic provided by said one or more storage media for programming one or more processors perform operations for implementing policy-aware backup and restore capability in a tiered storage file system, comprising;

said tiered storage file system managing hierarchical data storage tiers of a tiered storage system wherein the storage tiers represent different classes of storage based on device cost and associated capabilities and include at least one high value storage tier and one low value storage tier, said high value storage tier having higher cost and associated capabilities than said low value storage tier, said high value storage tier storing higher data of higher data value than said low value storage tier, comprising;

said tiered storage file system maintaining Information Lifecycle Management (ILM) metadata for data sets stored in said tiered storage system, said ILM metadata identifying a data set'"'"'s storage tier assignment;

said storage tier assignment being determined by an ILM policy rule that determines a storage tier where a data set should be placed in said tiered storage system;

performing a data set backup that backs up a data set independently of said ILM metadata for said data set from said tiered storage file system to a backup storage system to create a backed up data set;

said data set backup including a backup/restore application storing said backed up data set on said backup storage system without use of said ILM metadata for said backed up data set, said backup/restore application acting as a client of said tiered storage file system;

independently performing an ILM metadata backup that backs up said ILM metadata for said backed up data set to create backed up ILM metadata;

said ILM metadata backup including said tiered storage file system providing said ILM metadata for said backed up data set to said backup/restore application as a data object that is opaque to said backup/restore application and said backup/restore application storing said data object as said backed up ILM metadata;

prior to said backed up data set being restored from said backup storage system to said tiered storage file system, said backup/restore application performing an ILM metadata restore that restores said backed up ILM metadata to said tiered storage file system;

said tiered storage file system processing said backed up ILM metadata to determine, based on said data value of data in said backed up data set, a storage tier in said tiered storage system to which said backed up data set will be restored, said storage tier being one of said at least one high value storage tier and one low value storage tier; and

said storage tier being one of said at least one high value storage tier and one low value storage tier; and

said backup/restore application performing a data set restore that restores said backed up data set from said backup storage system to said tiered storage file system, said data set restore being performed in cooperation with said tiered storage file system to place said backed up data set in said storage tier determined by said ILM metadata processing.

16. A computer program product in accordance with claim 15 wherein said ILM metadata restore includes said backup/restore application transferring said backed up ILM metadata to a memory buffer and issuing a file system call to said tiered storage file system specifying said memory buffer and a file name for restoring said backed up data set to which said backed up ILM metadata corresponds.

17. A computer program product in accordance with claim 16 wherein said data set restore includes said tiered storage file system opening a file having said file name in said storage tier determined by said ILM metadata processing and returning a file descriptor for said file to said backup/restore application.

18. A computer program product in accordance with claim 17 wherein said data set restoring further includes said backup/restore application writing data blocks of said backed up data set to said open file and closing said file.

19. A computer program product in accordance with claim 15 wherein said ILM metadata processing comprises applying said ILM policy rule to said ILM metadata to determine said tier for said data set.