Data management system and data management method

• US 7,730,071 B2
• Filed: 11/28/2006
• Issued: 06/01/2010
• Est. Priority Date: 09/13/2006
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Iwasaki, Masaaki, Kumazawa, Kiyotake
• Primary Examiner(s): Ly; Cheyne D
• Assistant Examiner(s): TRAN, ANHTAI V
• Application Number:
  US11/604,684
• Publication Number:
  US 20080065707A1
• Time in Patent Office: 1,281 Days
• Field of Search: 707/205
• US Class Current: 707/742
• CPC Class Codes: G06F 11/1662 the resynchronized component or unit being a persistent storage device re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008
• CPC Class Codes: G06F 16/119 Details of migration of file systems migration mechanisms in storage systems G06F3/0647
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A file system transfer designation section for transferring the file system matching with file system transfer rules from the first volume of the first storage apparatus to the second volume of the second storage apparatus based on the first file system transfer rules, a file system storage information manager for updating storage information of the file system in accordance with transfer of the file system by the file system transfer designation section, and transmitting the updated file system storage information, and a search information manager for updating search information for searching the files based on a file search request from the client apparatus using the file system storage information sent by the file system storage information manager are provided.

Claims

1. A data management system for managing information arranged as plural files in a plurality of file systems, comprising:

at least one client apparatus;

at least one host apparatus operative for receiving requests from said at least one client apparatus, said at least one host apparatus comprising an index table for storing location information for said files based on keywords, said index table being managed in file units and the location information in each file including an identifier of the file and an identifier of the file system to which the file belongs, a reverse index table for storing file information containing keywords, said reverse index table being managed in file units, and a file system transfer management table for storing information for before and after transfer for file systems, said file system transfer management table storing storage locations of the file systems and being managed in file units, said at least one host being operative to select a file system and a file in the selected file system, check whether the selected filed is a newly added file or an updated file and, if so, readout and analyze the content of the file, and produce at least one of location information, attributes and key word list based on the analysis, and update therewith at least one of the index table and the reverse index table;

a first storage apparatus having a first volume for storing a file system, and a second storage apparatus having a second volume for storing the file system sent from the first storage apparatus;

a file system transfer apparatus storing file system migration rules, said file system transfer apparatus executing migration in units of file systems and, when the file system transfer apparatus migrates a file system, the host apparatus receives a notice and updates the file system transfer management table, said file system transfer apparatus being operative for transferring the file system matching with first file system migration rules from the first volume of the first storage apparatus to the second volume of the second storage apparatus based on the first file system migration rules, wherein the file system transfer management table is operative for updating storage information of the file system in accordance with transfer of the file system by file system transfer apparatus, and transmitting the updated file system storage information; and

a search information manager for updating search information for searching the files based on a file search request from the client apparatus using file system storage information sent by a file system storage information manager;

wherein, when a file corresponding to a file read request is stored in said second storage apparatus, the host apparatus sends a mount request for the file system of the file corresponding to the file read request to the file system transfer apparatus;

subsequently the file system transfer apparatus determines whether or not the file system for the file is capable of being directly mounted from the second storage apparatus to the host apparatus; and

as the result of the determination, if the file system for the file is capable of being directly mounted, the file system transfer apparatus directly mounts the file system for the file corresponding to the file read request from the second storage apparatus to the host apparatus and if the file system for the file is not capable of being directly mounted, the file system transfer apparatus migrates the file system for the file corresponding to the file read request from the second storage apparatus to the first storage apparatus.

2. The data management system according to claim 1, wherein the file system transfer apparatus further comprises a mount determination section for determining whether or not a file system for a file corresponding to a file read request from the client apparatus is capable of being directly mounted from the second storage apparatus to the host apparatus, and

wherein the file system transfer apparatus transfers the file system from the second volume of the second storage apparatus to the first volume of the first storage apparatus that is capable of mounting the file system at the host apparatus in the event that the mount determination section determines that the file system can not be directly mounted.

3. The data management system according to claim 1, wherein the search information comprises:

information containing host apparatus, file system, attributes and a keyword list every file, information containing file and attributes every keyword, and information containing the host apparatus, storage apparatus and volume for before transfer, the host apparatus, storage apparatus and volume for after transfer, and the storage state of the file system, every file system.

4. The data management system according to claim 1, the storage information further comprising:

information containing the host apparatus, storage apparatus and volume for before transfer, the host apparatus, storage apparatus and volume for after transfer, and the storage state of the file system, every file system.

5. The data management system according to claim 1, wherein the file system transfer designation section and the file system storage information manager

are provided at the file system transfer apparatus,

and the search information manager comprises:

a plurality of the host apparatus.

6. The data management system according to claim 1, wherein the search information manager is provided at

an index server, and

the file system transfer designation section and the file system storage information manager

are provided at the first storage apparatus.

7. The data management system according to claim 2, the host apparatus further comprising:

a mount management section for managing mounting and un-mounting of the file system;

and the mount management section;

directly mounting the file system for the file corresponding to the file read request from the client apparatus from the second storage apparatus in the event that the mount determination section determines that direct mounting of the file system is possible.

8. The data management system according to claim 2, wherein the file system transfer apparatus:

duplicates the file system from the second volume of the second storage apparatus to the first volume of the first storage apparatus that is capable of mounting the file system at the host apparatus in the event that the mount determination section determines that the file system can not be directly mounted.

9. A data management method for a data management system for managing information arranged as plural files in a plurality of file systems and having:

at least one a host apparatus receiving requests from at least one client apparatus, said at least one host apparatus comprising an index table for storing location information for said files based on keywords said index table being managed in file units and the location information in each file including an identifier of the file and an identifier of the file system to which the file belongs, a reverse index table for storing file information containing keywords, said reverse index table being managed in file units, and a file system transfer management table for storing information for before and after transfer for file systems, said file system transfer management table storing the storage locations of the file systems and being managed in file units, said at least one host being operative to select a file system and a file in the selected file system, check whether the selected filed is a newly added file or an updated file and, if so, readout and analyze the content of the file, and produce at least one of location information, attributes and key word list based on the analysis, and update therewith at least one of the index table and the reverse index table;

a file system transfer apparatus storing file system migration rules;

said file system transfer apparatus executing migration in units of file systems and, when the file system transfer apparatus migrates a file system, the host apparatus receives a notice and updates the file system transfer management table, first storage apparatus having a first volume for storing a file system, and a second storage apparatus having a second volume for storing the file system sent from the first storage apparatus, comprising;

a first step of transferring the file system matching with file system migration rules from the first volume of the first storage apparatus to the second volume of the second storage apparatus based on the first file system migration rules;

a second step of updating storage information for the file system in accordance with transfer of the file system of the first step, and transmitting the updated storage information of the file system; and

a third step of updating the search information for searching the files based on file search requests from the client apparatus using file system storage information sent in the second step;

wherein, when a file corresponding to a file read request is stored in said second storage apparatus, the host apparatus sends a mount request for the file system of the file corresponding to the file read request to the file system transfer apparatus; and

the file system transfer apparatus is operative to conduct;

a fourth step of determining whether or not a file system for a file corresponding to a file read request from the client apparatus is capable of being directly mounted from the second storage apparatus to the host apparatus;

a fifth step of transferring the file system from the second volume of the second storage apparatus to the first volume of the first storage apparatus that is capable of mounting the file system at the host apparatus, in the event that it is determined in the fourth step that the file system cannot be directly mounted; and

a sixth step of managing mounting and un-mounting of the file system;

wherein, in the sixth step,

a file system for a file corresponding to a file read request from the client apparatus is directly mounted from the second storage apparatus in the event that it is determined that the file system can be directly mounted in the fourth step.

10. The data management method according to claim 9, wherein the search information comprises:

information containing host apparatus, file system, attributes and a keyword list every file, information containing file and attributes every keyword, and information containing the host apparatus, storage apparatus and volume for before transfer, the host apparatus, storage apparatus and volume for after transfer, and the storage state of the file system, every file system.

11. The data management method according to claim 9, the storage information further comprising:

information containing the host apparatus, storage apparatus and volume for before transfer, the host apparatus, storage apparatus and volume for after transfer, and the storage state of the file system, every file system.

12. The data management method according to claim 9, wherein the first step and the second step:

are carried out at the file system transfer apparatus,

and the third step;

is carried out at the corresponding host apparatus of the plurality of host apparatus.

13. The data management method according to claim 9, wherein the first step and the second step:

are carried out at the first storage apparatus,

and the third step;

is carried out focusing on the index server.