Data management apparatus

• US 20050080810A1
• Filed: 08/04/2004
• Published: 04/14/2005
• Est. Priority Date: 10/03/2003
• Status: Abandoned Application

• Current Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Matsuura, Yohei
• Application Number:
  US10/910,304
• Publication Number:
  US 20050080810A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The present invention aims to improve the performance, reliability, and availability in a distributed file system environment. A load observing unit of a distributed file system management server observes load status of each disk, and when the load of a specific disk exceeds a predetermined level, a data controlling unit moves data stored in that disk to another disk, and updates directory information of a directory information database by reflecting this data migration. When a client makes an inquiry for the directory information, a directory notifying unit sends the updated directory information to that client, and a cache of a directory information database of the client side is updated.

Claims

1. A data management apparatus connected to a plurality of data storage devices and a plurality of data obtainment devices being capable to obtain data by accessing any one of the data storage devices, the data management apparatus comprising:

a directory information database storing directory information showing which data is stored in which of the data storage devices;

a load observing unit observing load status of the plurality of data storage devices;

a data controlling unit analyzing an observation result by the load observing unit, when the load status of a specific data storage device matches a predetermined condition, moving at least a part of data stored in the specific data storage device to any one of the data storage devices, and updating the directory information by reflecting the data migration; and

a directory notifying unit, when an inquiry of directory information related to the data which has been moved by the data controlling unit is received from a specific data obtainment device, sending at least the directory information related to the moved data among the directory information after updating to the specific data obtainment device.

2. The data management apparatus of claim 1, wherein

the data management apparatus is connected to a plurality of data obtainment devices having a cache of directory information;

and

the directory notifying unit, when an inquiry of directory information related to the data which has been moved by the data controlling unit is received from a specific data obtainment device, sends at least the directory information related to the moved data among the directory information after updating to the specific data obtainment device so as to update the cache of directory information held by the specific data obtainment device.

3. The data management apparatus of claim 1,

wherein the data controlling unit analyzes the observation result of the load observing unit, when a load of a specific data storage device exceeds a predetermined level, moves at least a part of data stored in the specific storage device to any one of the data storage devices, and updates the directory information by reflecting the data migration.

4. The data management apparatus of claim 1,

wherein the load observing unit observes the load status of each data stored in each of the data storage devices, and

wherein the data controlling unit analyzes the observation result of the load observing unit, when the load of the specific data exceeds a predetermined level, divides the specific data into an arbitrary number of pieces, moves at least a part of divided data which has been divided from the specific data to any one of the data storage devices, and updates the directory information by reflecting the data migration.

5. The data management apparatus of claim 1,

wherein the load observing unit observes the load status of each data area of the data stored in each of the data storage devices, and

wherein the data controlling unit analyzes the observation result of the load observing unit, when the load of a specific data area exceeds a predetermined level, divides the specific data area into an arbitrary number of pieces, moves at least a part of divided data divided from the specific data area to any one of the data storage devices, and updates the directory information by reflecting the data migration.

6. The data management apparatus of claim 1,

wherein the load observing unit observes the load status of each data stored in each of the data storage devices, and

wherein the data controlling unit analyzes the observation result of the load observing unit, when the load of a plurality pieces of mutually consecutive data is under a predetermined level, unites the plurality pieces of mutually consecutive data into united data, moves the united data to any one of the data storage devices, and updates the directory information by reflecting the data migration.

7. The data management apparatus of claim 4,

wherein the directory information database stores service level information for each data showing service level of each of the data stored in each of the data storage devices, and

wherein the data controlling unit, when the load of a plurality pieces of data exceeds a predetermined level, divides each of the plurality pieces of data into an arbitrary number of pieces, by referring to the service level information for each data stored in the directory information database, determines an order to move the plurality pieces of data based on the service level of each data, moves divided data of each of the plurality pieces of data according to the order determined, and updates the directory information by reflecting each data migration.

8. The data management apparatus of claim 1,

wherein the data controlling unit selects a data storage device for a destination of data migration from the plurality of data storage devices based on characteristics of each of the plurality of data storage devices and moves data to the data storage device selected.

9. The data management apparatus of claim 1,

wherein the data controlling unit selects a data storage device for a destination of data migration from the plurality of data storage devices based on spare capacity of each of the plurality of data storage devices and moves data to the data storage device selected.

10. The data management apparatus of claim 1,

wherein the directory information database stores service level information for each obtainment device showing service level set for each of the plurality of data obtainment devices, and

wherein the data controlling unit refers to the service level information for each obtainment device stored in the directory information database, based on the service level set for a specific data obtainment device, selects a data storage device for a destination of data migration from the plurality of data storage devices, and moves data to the data storage device selected.

11. The data management apparatus of claim 1,

wherein the data controlling unit, selects a data storage device for a destination of the data migration from the plurality of data storage devices based on characteristics and spare capacity of each of the plurality of data storage device, and moves data to the data storage device selected.

12. The data management apparatus of claim 1,

wherein the data controlling unit, when a service level of specific data is under a predetermined level, generates copy data of the specific data, moves the copy data to a data storage device in which a service level of the copy data generated exceeds the predetermined level, and updates the directory information by reflecting the data migration.

13. The data management apparatus of claim 1,

wherein the data controlling unit sometimes generates a plurality of pieces of copy data of specific data, and makes service levels of the plurality of pieces of copy data different by moving the plurality of pieces of copy data to different data storage devices, and

wherein the directory notifying unit, upon receiving an inquiry of the directory information related to original data of the copy data as well as a notice of the service level requested by a specific data obtainment device from the specific data obtainment device, selects one of the plurality of pieces of copy data which matches the service level requested by the specific data obtainment device, and sends at least directory information related to the one of the plurality of pieces of copy data selected to the specific data obtainment device.

14. The data management apparatus of claim 1,

wherein the data controlling unit, upon receiving a notice showing a service level of specific data does not match a service level required by a specific data obtainment device from the specific data obtainment device, generates copy data of the specific data, moves the copy data generated to a data storage device in which the service level requested by the specific data obtainment device can be obtained, and updates the directory information by reflecting the data migration.

15. The data management apparatus of claim 1,

wherein the data controlling unit sometimes generates a plurality of pieces of copy data of specific data, and makes service levels of the plurality of pieces of copy data different by moving the plurality of pieces of copy data to different data storage devices, and

wherein the directory notifying unit, after the data controlling unit performs data migration of the plurality of pieces of copy data and updates the directory information, selects one of the plurality of pieces of copy data which matches a service level requested by a specific data obtainment device, and sends the directory information related to the one of the plurality of pieces of copy data to the specific data obtainment device.

16. The data management apparatus of claim 1,

wherein the load observing unit observes load status of each data stored in each of the plurality of data storage devices, and

wherein the data controlling unit analyzes an observation result, when a load of specific data exceeds a predetermined level, divides at least a part of the specific data into an arbitrary number of pieces, moves at least a part of divided data which has been divided from the specific data to any one of the plurality of data storage devices, as a result of the data migration of the divided data, when reliability of a data storage device which is a destination of the divided data migration is under reliability of a data storage device which has originally stored the specific data, generates copy data of the divided data moved, and moves the copy data generated to another one of the plurality of data storage devices.

17. The data management apparatus of claim 16,

wherein the data controlling unit, as a result of the data migration of the copy data, when reliability of a data storage device which is a destination of the copy data migration is under reliability of a data storage device which has originally stored the divided data, generates new copy data of the copy data moved, and moves the new copy data generated to another one of the plurality of data storage devices.

18. The data management apparatus of claim 1,

wherein the load observing unit observes load status of each data stored in each of the plurality of data storage devices, and

wherein the data controlling unit analyzes an observation result, when a load of specific data exceeds a predetermined level, divides at least a part of the specific data into an arbitrary number of pieces, moves at least a part of divided data which has been divided from the specific data to any one of the plurality of data storage devices, as a result of data migration of the divided data, when reliability of a data storage device which is a destination of the divided data migration exceeds reliability of a data storage device which has originally stored the specific data and also when copy data of the divided data moved is stored in another one of the plurality of data storage devices, deletes the copy data stored in the another one of the plurality of data storage devices.

19. The data management apparatus of claim 1,

wherein the data management apparatus is capable to communicate with another data management apparatus having directory information, and

wherein the data controlling unit, when updating the directory information of the data management apparatus, updates the directory information of the another data management apparatus.

20. The data management apparatus of claim 19,

wherein the load observing unit notifies the another data management apparatus of the observation result of the load status of each of the plurality of data storage devices.

21. The data management apparatus of claim 1,

wherein the data management apparatus sets a common directory information database which can be shared with another data management apparatus on a common network to be shared with the another data management apparatus, and

wherein the data controlling unit, when performing data migration of any data, updates common directory information stored in the common directory information database.

22. The data management apparatus of claim 21, wherein

the data management apparatus manages specific directory subtree information among directory subtree information included in the common directory information database, and

the data management apparatus, upon receiving an inquiry for the directory information related to specific data from a specific data obtainment device, when the specific data for which the inquiry has been made is not included in the specific directory subtree information which is managed by the data management apparatus itself, transfers the inquiry from the specific data obtainment device to another one of the data management apparatus, makes the another one of the data management apparatus send the directory information related to the specific data for which the inquiry has been made to the specific data obtainment device.

23. The data management apparatus of claim 22,

wherein the data management apparatus sends at least a part of the directory subtree information which is managed by the data management apparatus itself to any one of the plurality of data obtainment devices and makes the data obtainment device to which at least a part of the directory subtree information is sent manage at least the part of the directory subtree information which is managed by the data management apparatus itself.

24. The data management apparatus of claim 23,

wherein the data management apparatus, when at least a part of the directory subtree information which is supposed to be managed by the data management apparatus is managed by one of the plurality of data obtainment devices, and when the directory subtree information managed by the one of the plurality of data obtainment devices needs to be returned, receives the directory subtree information managed by the one of the plurality of data obtainment devices from the one of the plurality of data obtainment devices, and manages again the directory subtree information received.

25. The data management apparatus of claim 1, wherein

the data management apparatus is connected to a storage network which connects the plurality of data storage devices and the plurality of data obtainment devices, and

the data management apparatus communicates with the plurality of data storage devices and the plurality of data obtainment devices via the storage network.

26. The data management apparatus of claim 1, wherein

the data management apparatus is connected to the plurality of data obtainment devices via other network besides a storage network which connects the plurality of data storage devices and the plurality of data obtainment devices, and

the data management apparatus communicates with the plurality of data obtainment devices via the other network.

27. The data management apparatus of claim 1, wherein

the data management apparatus is connected to the plurality of data storage devices via other network besides a storage network which connects the plurality of data storage devices and the plurality of data obtainment devices, and

the data management apparatus observes the load status of the plurality of data storage devices via the other network.