Systems and methods for managing portions of files in multi-tier storage systems

• US 8,352,429 B1
• Filed: 08/31/2009
• Issued: 01/08/2013
• Est. Priority Date: 08/31/2009
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Corporation (NortonLifeLock Inc.)
• Inventors: Mamidi, Murthy V., Malige, Raghupathi, Ravi, Gautham
• Primary Examiner(s): Wu, Yicun
• Application Number:
  US12/551,221
• Time in Patent Office: 1,226 Days
• Field of Search: 707640-642, 711/5, 710/5, 710/15
• US Class Current: 707/640
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof

Abstract

The present disclosure presents a method for managing portions of files in multi-tier storage systems. The method may include identifying a file that is managed by an application and stored in a multi-tier storage system. The method may also include determining how the application stores data in the file by identifying data-management information associated with the application. The method may further include using the data-management information to identify a first portion of the file, identifying a data-placement policy, and implementing the data-placement policy by moving the first portion of the file from a first tier of the multi-tier storage system to a second tier of the multi-tier storage system. Various other methods, systems, and computer-readable media are also disclosed.

Claims

1. A computer-implemented method for managing portions of files in multi-tier storage systems, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:

identifying a file that is managed by an application and stored in a multi-tier storage system, wherein the application comprises a database application and a first portion of the file comprises a database extent of the file;

determining how the application stores data in the file by analyzing the file to determine how the file is sub-divided and how the database application writes to the file to identify data-management information associated with the application;

using the data-management information to identify the first portion of the file;

identifying a data-placement policy;

implementing the data-placement policy by moving the first portion of the file from a first tier of the multi-tier storage system to a second tier of the multi-tier storage system, wherein moving the first portion of the file comprises translating the database extent to file system blocks offset and length pairs and using the file system blocks offset and length pairs to move file system blocks of the database extent.

2. The method of claim 1, wherein:

analyzing the file to determine how the file is sub-divided and how the database application writes to the file comprises analyzing the file to determine that the database application breaks data up within the file into database extents.

3. The method of claim 1, wherein:

the database extent comprises data of a database table space;

database extents of the database table space are stored in a plurality of files.

4. The method of claim 1, wherein the database extent comprises a contiguous area of storage within the multi-tier storage system.

5. The method of claim 1, wherein:

the data-placement policy indicates that the first portion of the file has higher priority than a second portion of the file;

the second tier of the multi-tier storage system provides a higher quality of service than the first tier of the multi-tier storage system.

6. The method of claim 5, further comprising:

determining that the first portion of the file has higher priority than the second portion of the file by;

tracking input-output activity of the first portion of the file;

tracking input-output activity of the second portion of the file;

determining that the input-output activity of the first portion of the file is higher than the input-output activity of the second portion of the file.

7. The method of claim 1, wherein:

the data-management information indicates a manner in which the application stores data within the file.

8. The method of claim 1, further comprising tracking input-output activity of the first portion of the file, wherein:

the data-placement policy comprises an input-output threshold;

implementing the data-placement policy comprises;

determining that the input-output activity of the first portion of the file exceeds the input-output threshold;

moving the first portion of the file in response to the determination that the input-output activity of the first portion of the file exceeds the input-output threshold.

9. The method of claim 8, further comprising:

providing a report of the input-output activity of the first portion of the file;

using the report of the input-output activity to set the input-output threshold.

10. The method of claim 1, further comprising tracking input-output activity of the first portion of the file, wherein:

the first portion of the file comprises the database extent of the file;

the input-output activity of the first portion of the file is associated with start and offset information that identify the first portion of the file.

11. The method of claim 1, wherein:

the file comprises data of a call detail record table;

the call detail record table is partitioned;

moving the first portion of the file comprises moving a partition of the call detail record table from the first tier of the multi-tier storage system to the second tier of the multi-tier storage system.

12. The method of claim 1, wherein:

the first portion of the file comprises a database extent of a call detail record table;

moving the first portion of the file comprises;

using database extent and segment dictionary tables to generate file, offset, and length information of the database extent of the call detail record table;

using the file, offset, and length information to move the first portion of the file from the first tier of the multi-tier storage system to the second tier of the multi-tier storage system.

13. The method of claim 1, wherein:

the multi-tier storage system comprises a multi-device file system;

the multi-device file system abstracts a set of volumes as a single device;

the first tier of the multi-tier storage system comprises a first subset of volumes from the set of volumes;

the second tier of the multi-tier storage system comprises a second subset of volumes from the set of volumes.

14. A system for managing portions of files in multi-tier storage systems, the system comprising:

at least one processor;

a multi-tier storage system;

an identification module programmed to;

direct the processor to identify a file that is managed by an application and stored in the multi-tier storage system, wherein the application comprises a database application and a first portion of the file comprises a database extent of the file;

direct the processor to determine how the application stores data in the file by analyzing the file to determine how the file is sub-divided and how the database application writes to the file to identify data-management information associated with the application;

use the data-management information to identify the first portion of the file;

a relocation module programmed to;

identify a data-placement policy;

implement the data-placement policy by moving the first portion of the file from a first tier of the multi-tier storage system to a second tier of the multi-tier storage system, wherein moving the first portion of the file comprises translating the database extent to file system blocks offset and length pairs and using the file system blocks offset and length pairs to move file system blocks of the database extent.

15. The system of claim 14, wherein:

the database extent comprises data of a database table space;

database extents of the database table space are stored in a plurality of files.

16. The system of claim 14, wherein:

the data-placement policy indicates that the first portion of the file has higher priority than a second portion of the file;

the second tier of the multi-tier storage system provides a higher quality of service than the first tier of the multi-tier storage system.

17. The system of claim 14, further comprising:

a tracking module programmed to track input-output activity of the first portion of the file.

18. The system of claim 17, wherein:

the data-placement policy comprises an input-output threshold;

implementing the data-placement policy comprises;

determining that the input-output activity of the first portion of the file exceeds the input-output threshold;

moving the first portion of the file in response to the determination that the input-output activity of the first portion of the file exceeds the input-output threshold.

19. The system of claim 14, wherein:

the identification module is programmed to determine how the application stores data in the file by

identifying, among a plurality of different applications, which application manages the file.

20. A computer-readable-storage medium comprising one or more computer-executable instructions that, when executed by a computing device, cause the computing device to:

identify a file that is managed by an application and stored in a multi-tier storage system, wherein the application comprises a database application and a first portion of the file comprises a database extent of the file;

determine how the application stores data in the file by analyzing the file to determine how the file is sub-divided and how the database application writes to the file to identify data-management information associated with the application;

use the data-management information to identify the first portion of the file;

identify a data-placement policy;

implement the data-placement policy by moving the first portion of the file from a first tier of the multi-tier storage system to a second tier of the multi-tier storage system, wherein moving the first portion of the file comprises translating the database extent to file system blocks offset and length pairs and using the file system blocks offset and length pairs to move file system blocks of the database extent.