Transparent migration of files among various types of storage volumes based on file access properties

• US 7,533,230 B2
• Filed: 10/13/2004
• Issued: 05/12/2009
• Est. Priority Date: 10/13/2004
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Williams, Doug, Glover, Frederick S., Mark, Timothy
• Primary Examiner(s): Bragdon; Reginald G.
• Assistant Examiner(s): Namazi; Mehdi
• Application Number:
  US10/964,835
• Publication Number:
  US 20060080365A1
• Time in Patent Office: 1,672 Days
• Field of Search: 711/165, 707/6
• US Class Current: 711/165
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2201/885 Monitoring specific for caches
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

In one embodiment, a method and system for storing a file in a storage domain is provided. The method includes monitoring access to a file to determine a file access pattern, tagging the file to indicate the identified access pattern and using the tag to identify an appropriate storage medium in a storage domain for the file, when available, based on the access pattern.

Claims

1. A method for dynamically migrating files in a storage domain transparent to any applications currently using the file, the method comprising:

periodically checking a tag in a file stored on one of a plurality of storage volumes in the storage domain, wherein the tag identifies a pattern of prior access to the file;

determining whether the access pattern matches a storage classification for the one of the plurality of storage volumes on which the file is stored; and

when the access pattern does not match the storage classification for the one of the plurality of storage volumes on which the file is stored, moving the file to another one of the plurality of storage volumes with a storage classification that matches the access pattern of the file when available.

2. The method of claim 1, and further comprising:

maintaining the tag with the file until a storage volume is added to the storage domain with a storage classification that matches the file access pattern; and

migrating the file to the matched storage volume.

3. The method of claim 1, and further determining whether a pattern of access has been identified for the file.

4. The method of claim 3, wherein determining whether the pattern of access has been identified comprises determining whether the file has a valid tag.

5. The method of claim 1, and further comprising periodically balancing the load of files across the storage domain for files without a tag.

6. The method of claim 5, and wherein periodically balancing the load of files includes balancing the load of files that have a tag but do not have a matching storage volume.

7. The method of claim 1, wherein determining whether the access pattern matches the storage classification for the one of the plurality of storage volumes comprises consulting a look-up table.

8. The method of claim 1, wherein moving the file to another one of the plurality of storage volumes comprises:

identifying a storage volume with a storage classification that is appropriate to the access pattern for the file;

deleting the file from the one of the plurality of storage volumes;

saving the file to the another one of the plurality of storage volumes with the storage classification that matches the access pattern for the file; and

wherein deleting and saving the file are done transactionally to prevent loss of data.

9. The method of claim 8, wherein if a storage volume with a storage classification that is appropriate to the access pattern for the file is not identified, the method further comprises:

maintaining the tag with the file until a storage volume is added to the storage domain with a storage classification that matches the file access pattern; and

migrating the file to the matched storage volume.

10. A computer readable medium having a data structure stored thereon, the data structure comprising:

a plurality of types of storage volumes, each type of storage volume having an associated storage classification based on functional properties of the storage volume;

a plurality of file access patterns; and

wherein each of the plurality of file access patterns is associated with at least one of the plurality of types of storage volumes to enable moving a file to an appropriate storage volume when a current file access pattern does not match the associated storage classification for the type of storage volume on which the file is stored, wherein the moving of the file is based on the current access pattern associated with the file by a tag stored in the file.

11. The computer readable medium of claim 10, wherein the data structure comprises a table that cross references the plurality of types of storage devices with the plurality of file access patterns.

12. A method for storing a file in a storage domain, the method comprising:

monitoring access to a file to determine a file access pattern;

tagging the file to indicate the identified access pattern; and

using the tag to identify an appropriate storage medium in a storage domain for the file, when available, wherein each storage volume is associated with a storage classification based on functional properties of the storage volume, and wherein the appropriate storage medium is the storage medium having the associated storage classification that matches the identified access pattern.

13. The method of claim 12, and further comprising:

if the appropriate storage medium is not available in the storage domain when the file access pattern is determined, maintaining the tag with the file until a storage volume is added to the storage domain with an associated storage classification that matches the file access pattern; and

migrating the file to the matched storage volume.

14. The method of claim 12, wherein tagging the file comprises tagging the file when an access pattern is determined at a time the file is closed.

15. The method of claim 12, wherein monitoring access to the file comprises recording information each time data is read from or written to the file.

16. The method of claim 12, wherein using the tag to identify an appropriate storage medium comprises periodically comparing the pattern of usage for the file with the storage classification associated with the storage volume for the file based on the tag of the file.

17. A method for matching a file with a storage volume in an array of a plurality of storage volumes, the method comprising:

storing information on each access to a file;

monitoring the information on each access to the file over time to determine an access pattern;

when a pattern emerges from the information, selecting a tag that identifies the access pattern;

tagging the file with the selected tag; and

when the access pattern does not match the storage classification for the one of the plurality of storage volumes on which the file is stored, migrating the file to a storage volume that matches the characteristics of the identified access pattern wherein each storage volume includes a storage classification based on functional properties of the storage volume.

18. The method of claim 17, wherein storing information on each access comprises storing information each time data is written to the file and each time data is read from the file.

19. The method of claim 17, wherein monitoring the information on each access comprises determining a value that represents the strength of the pattern.

20. The method of claim 17, wherein migrating the file comprises moving the file to a storage volume that has an associated storage classification that matches the identified access pattern.

21. A data storage system with dynamic and transparent file migration, the data storage system comprising:

a plurality of storage volumes, each of the storage volumes having an associated storage classification based on functional properties of the storage volumes;

a pattern recognition function that monitors access to files stored on the plurality of storage volumes to determine a pattern of access for each of the files;

a look-up table associating the storage classification for each of the storage volumes with at least one of the file access patterns; and

a file management function that periodically uses a tag in one of the files that indicates the access pattern of the file stored on the plurality of storage volumes, wherein if the indicated access pattern does not match the storage classification for the one of the plurality of storage volumes on which the file is currently stored, the file management function migrates the file from one of the storage volumes to another of the storage volumes such that the storage classification associated with the storage volume matches the access pattern identified by the pattern recognition function for the file, wherein the migration is based on the look-up table.

22. The system of claim 21, wherein the plurality of storage volumes comprises at least two different types of storage volumes.

23. The system of claim 21, wherein the file management function tags the files with a tag that represents the file access pattern based on the pattern recognition function.

24. The system of claim 21, and further including an input/output device that is adapted to receive the storage classification for a storage device when it is added to the plurality of storage devices.

25. A machine readable medium comprising instructions stored thereon for implementing a method for matching a file with a storage volume in an array of a plurality of storage volumes, the method comprising:

storing information on each access to a file;

monitoring the information on each access to the file over time to determine an access pattern;

when a pattern emerges from the information, selecting a tag that identifies the access pattern;

tagging the file with the selected tag; and

when the access pattern does not match the associated storage classification of the storage volume currently storing the file, migrating the file to a storage volume having an associated storage classification that matches the characteristics of the identified access pattern, when available, without any interruption of access to the file by applications.

26. The machine readable medium of claim 25, wherein storing information on each access comprises storing information each time data is written to the file and each time data is read from the file.

27. The machine readable medium of claim 25, wherein monitoring the information on each access comprises determining a value that represents the strength of the pattern.