Data management system and data management method

• US 8,364,645 B2
• Filed: 05/07/2010
• Issued: 01/29/2013
• Est. Priority Date: 09/13/2006
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Iwasaki, Masaaki, Kumazawa, Kiyotake
• Primary Examiner(s): Le, Debbie
• Assistant Examiner(s): TRAN, ANHTAI V
• Application Number:
  US12/775,549
• Publication Number:
  US 20100241656A1
• Time in Patent Office: 998 Days
• Field of Search: None
• US Class Current: 707/652
• CPC Class Codes: G06F 11/1662 the resynchronized component or unit being a persistent storage device re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A file system transfer designation section for transferring the file system matching with file system transfer rules from the first volume of the first storage apparatus to the second volume of the second storage apparatus based on the first file system transfer rules, a file system storage information manager for updating storage information of the file system in accordance with transfer of the file system by the file system transfer designation section, and transmitting the updated file system storage information, and a search information manager for updating search information for searching the files based on a file search request from the client apparatus using the file system storage information sent by the file system storage information manager are provided.

Claims

1. A data management system comprising:

a host apparatus receiving requests from a client apparatus;

a first storage apparatus having a first volume for storing a file system composed of a set of files;

a second storage apparatus having a second volume; and

a file system transfer apparatus for transferring the file system from the first volume of the first storage apparatus to the second volume of the second storage apparatus, when the set of files in the file system has not been accessed for a predetermined period of time,

wherein the host apparatus has location information and file system transfer information, the location information is managed in file units and includes an identifier of each file and an identifier of the file system to which the file belongs, and the file system transfer information is managed in file system units and indicates the transfer before and after transfer for the file system and storage location of the file system,

wherein when the file system transfer apparatus migrates the file system, the file system transfer apparatus sends a notice of the transfer to the host apparatus, the host apparatus updates the file system transfer information in response to receiving the notice of the transfer, the host apparatus accesses the file in the file system using the location information and the updated file system transfer information.

2. The data management system according to claim 1, further comprising:

a mount determination apparatus for determining whether or not a file system for a file corresponding to a file read request from the client apparatus is capable of being directly mounted from the second storage apparatus to the host apparatus,

wherein a file system transfer apparatus transfers the file system from the second volume of the second storage apparatus to the first volume of the first storage apparatus that is capable of mounting the file system on the host apparatus in the event that the mount determination apparatus determines that the file system can not be directly mounted.

3. The data management system according to claim 2, wherein the host apparatus includes a mount management apparatus for managing mounting and un-mounting of the file system, the mount management apparatus directly mounting the file system for the file corresponding to the file read request from the client apparatus from the second storage apparatus in the event that the mount determination apparatus determines that direct mounting of the file system is possible.

4. The data management system according to claim 3, wherein the file system transfer apparatus duplicates the file system from the second volume of the second storage apparatus onto the first volume of the first storage apparatus that is capable of mounting the file system on the host apparatus in the event that the mount determination apparatus determines that the file system cannot be directly mounted.

5. The data management system according to claim 2, further comprising:

a file system storage information manager for updating storage information of the file system in accordance with transfer of the file system by the file system transfer apparatus, and transmitting the updated file system storage information; and

a search information manager for updating search information for searching for a file based on a file search request from the client apparatus using the file system storage information sent from the file system storage information manager.

6. The data management system according to claim 5, wherein the search information includes information indicating a host apparatus, a file system, attributes and a keyword list for each file;

information indicating a file and attributes for each keyword; and

information indicating a host apparatus, a storage apparatus and a volume as of the time before transfer, a host apparatus, a storage apparatus and a volume as of the time after transfer, and the storage state of the file system, for each file system.

7. The data management system according to claim 5, wherein the storage information further includes information indicating a host apparatus, a storage apparatus and a volume as of the time before transfer, a host apparatus, a storage apparatus and a volume as of the time after transfer, and the storage state of the file system, for each file system.

8. The data management system according to claim 5, wherein the file system storage information manager is provided in the file system transfer apparatus and a search information manager is provided in each of a plurality of the host apparatuses.

9. The data management system according to claim 8, wherein the search information manager is provided in an index server and the file system transfer apparatus and the file system storage information manager are provided in the first storage apparatus.

10. The data management system according to claim 1, wherein the file system transfer apparatus employs file system migration rules that include fixed rules for transferring a file system, related at least to one of (1) a period of reading or writing processing, (2) transfer of the file system and (3) frequency of read/write processing during a given period of time.

11. A data management method for a system including a host apparatus operative to receive requests from a client apparatus, a first storage apparatus having a first volume for storing a file system composed of a set of files, and a second storage apparatus having a second volume for storing the file system sent from the first storage apparatus, comprising:

transferring the file system matching with file system migration rules from the first volume of the first storage apparatus to the second volume of the second storage apparatus when the set of files in the file system has not been accessed for a predetermined period of time; and

managing the system such that,

when the host apparatus has location information and file system transfer information, the location information is managed in file units and includes an identifier of each file and an identifier of the file system to which the file belongs, and the file system transfer information is managed in file system units and indicates the transfer before and after transfer for the file system and storage location of the file system, and

when the file system is migrated, a notice of transfer is sent to the host apparatus, the host apparatus updates the file system transfer information in response to receiving the notice of transfer, and the host apparatus accesses the file in the file system that was transferred using the location information and the updated file system transfer information.

12. The data management method according to claim 11, further comprising:

determining whether or not a file system for a file corresponding to a file read request from the client apparatus is capable of being directly mounted from the second storage apparatus to the host apparatus,

and transferring the file system from the second volume of the second storage apparatus to the first volume of the first storage apparatus that is capable of mounting the file system on the host apparatus in the event that the determining step determines that the file system can not be directly mounted.

13. The data management method according to claim 12, further comprising managing mounting and un-mounting of the file system in the host system, the mounting and un-mounting managing step involving directly mounting the file system for the file corresponding to the file read request from the client apparatus from the second storage apparatus in the event that the determining step determines that direct mounting of the file system is possible.

14. The data management method according to claim 13, wherein the transferring step comprises duplicating the file system from the second volume of the second storage apparatus onto the first volume of the first storage apparatus that is capable of mounting the file system on the host apparatus in the event that the determining step determines that the file system can not be directly mounted.

15. The data management method according to claim 11, further comprising:

updating storage information of the file system by a file system storage information manager in accordance with transfer of the file system by the file system transfer apparatus, and transmitting the updated file system storage information; and

updating by a search information manager search information for searching for a file based on a file search request from the client apparatus using the file system storage information sent from the file system storage information manager.

16. The data management method according to claim 15, wherein the search information includes information indicating a host apparatus, a file system, attributes and a keyword list for each file;

information indicating a file and attributes for each keyword; and

information indicating a host apparatus, a storage apparatus and a volume as of the time before transfer, a host apparatus, a storage apparatus and a volume as of the time after transfer, and the storage state of the file system, for each file system.

17. The data management method according to claim 15, wherein the storage information further includes information indicating a host apparatus, a storage apparatus and a volume as of the time before transfer, a host apparatus, a storage apparatus and a volume as of the time after transfer, and the storage state of the file system, for each file system.

18. The data management system according to claim 11, wherein the transferring step is executed according to file system migration rules that include fixed rules for transferring a file system that are related at least to one of (1) a period of reading or writing processing, (2) transfer of the file system and (3) frequency of read/write processing during a given period of time.