DATA STORAGE METHOD, DEVICE AND SYSTEM AND MANAGEMENT SERVER

• US 20100268908A1
• Filed: 09/28/2008
• Published: 10/21/2010
• Est. Priority Date: 11/22/2007
• Status: Abandoned Application

• Current Assignee: China Mobile Communications Corporation (China Mobile Communications Group Co., Ltd.)
• Original Assignee: China Mobile Communications Corporation (China Mobile Communications Group Co., Ltd.)
• Inventors: Xue, Haiqiang, Wei, Bing, Wang, Xiaoyun, Ouyang, Congxing, Zhao, Min
• Application Number:
  US12/741,406
• Publication Number:
  US 20100268908A1
• Time in Patent Office: Days
• US Class Current: 711/170
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/40 for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection management of faults, events, alarms or notifications in data switching networks H04L41/06

Abstract

The present invention relates to a data storage method, device and system and a management server. The data storage method includes: constituting a data pool from all of n data storage devices; when there is data for storage, polling all the devices in the data pool to select a group of m devices, and storing the data onto each of the selected group of m devices, where m is larger than one and smaller than n. The embodiments of the invention can address the problems of an existing data storage approach that a failing node causes an increased load on and instability of another node and that each node in the existing data storage approach has a low utilization ratio and poor predictability, so as to achieve uniform loads on the devices and high reliability of the nodes despite any failing node and improve the resource utilization ratio and predictability of the nodes.

Claims

1. A data storage method, comprising:

constituting a data pool by all of n data storage devices;

when there is data for storage, polling all the devices in the data pool to select a group of m devices, and storing the data into each of the selected group of m devices, where m is larger than one and smaller than n.

3. The method according to claim 1, wherein, polling all the devices in the data pool to select the group of m devices comprises:

polling in the data pool under the principal of C_n^m to select the group of m storage devices.

4. The method according to claim 1, further comprising:

detecting the loads of all the data storage devices in the original data pool when a new device joins the data pool;

upon detection of at least one of the devices in the original data pool with a load exceeding a preset value, transferring part of data stored on the device with a load exceeding the preset value to the new device.

5. The method according to claim 1, wherein, polling all the devices in the data pool to select the group of m devices and storing the data into each of the selected group of m devices comprise:

when the device in receipt of a data insertion request corresponding to the data detects that the data insertion request is from the outside of the data pool, storing the data, polling the other devices in the data pool to select a number m−

1 of devices, and storing the data into each of the selected m−

1 devices.

6. The method according to claim 5, wherein, polling the other devices in the data pool to select a number m−

1 of devices comprises;

polling the other devices in the data pool under the principal of C_n-1^m-1 to select a number m−

1 of devices.

7. The method according to claim 5, further comprising:

detecting the loads of all the data storage devices in the original data pool when a new device joins the data pool;

upon detection of at least one of the devices in the original data pool with a load exceeding a preset value, transferring part of data stored on the device with a load exceeding the preset value to the new device.

2. (canceled)

8. A management server, comprising:

a determination module configured to determine whether there is data for storage;

a resource allocation module connected with the determination module, and configured to poll, when there is data for storage, in a data pool composed of all of n data storage devices to select a group of m devices and transmit the data to each of the m devices, where m is larger than one and smaller than n; and

a management module connected with the resource allocation module and configured to manage both all the devices and device resources in the data pool.

9. The management server according to claim 8, wherein, the management module comprises:

a data insertion sub-module configured to trigger the resource allocation module upon receipt of a data insertion request message; and

a reception sub-module connected with the data insertion sub-module and configured to receive the data insertion request and corresponding data for storage.

10. The management server according to claim 8, wherein, the resource allocation module comprises:

a storage sub-module configured to store the total number n of all the devices in the data pool and the number m of selected devices;

a poll calculation sub-module connected with the storage sub-module and configured to select a group of m devices via polling under the principal of C_n^m; and

a transmission sub-module connected with the poll calculation sub-module and configured to transmit the data for storage to each of the m devices.

11. The management server according to claim 10, wherein, the management server comprises:

a monitoring sub-module configured to monitor all the devices in the data pool, and upon receipt of a quit request from one of the devices in the data pool and/or a join request from a new device to join the data pool, update devices resources in the data pool under management and transmit the total number of all the updated devices to the storage sub-module in the resource allocation module;

an analysis sub-module connected with the monitoring sub-module, and configured to transmit, upon receipt of a join request to join the data pool from a new device, load query request to all the devices in the original data pool, and analyze load information returned from all the devices; and

an execution sub-module connected with the analysis sub-module, and configured to transfer, when there is at least one of the devices in the original data pool with a load exceeding a preset value, part of data stored on the device with a load exceeding the preset value onto the new device.

12. A data storage system comprising a management server according to claim 8, further comprising a plurality of data storage devices all of which are connected with and managed centrally by the management server.

13. The data storage system according to claim 12, wherein, each of the data storage devices comprises:

a data insertion module configured to receive data for insertion transmitted from the management server;

a storage module connected with the data insertion module and configured to store the data for insertion and to calculate the load on the device; and

a detection module connected with the storage module, and configured to transmit, when the device quits or joins the data pool, a quit or join request to the management server;

the detection module is in mutual status communication with the management server after joining the data pool, and returns current load information of the device upon receipt of a device load query request from the management server.

14. A storage device, comprising:

an analysis module configured to analyze a data insertion request;

a resource allocation module connected with the analysis module, and when it is the first time for a data pool to which the device belongs to receive the data insertion request, the resource allocation module stores data corresponding to the data insertion request, polls the other devices in the data pool to select a number m−

1 of devices, and transmits the data to each of the selected m−

1 devices, where m is a natural number larger than one and smaller than the total number of all the devices in the data pool; and

when the data for insertion is forwarded from another device in the data pool, the resource allocation module merely stores the data corresponding to the data insertion request; and

a management module connected with the resource allocation module and configured to manage both the devices in the data pool composed of all the storage devices and resources information throughout the data pool.

15. The storage device according to claim 14, wherein, the analysis module comprises:

a data insertion analysis sub-module configured to determine, upon receipt of the data insertion request message, whether the data insertion request is received at the data pool for the first time or forwarded from another device in the data pool and trigger the resource allocation module; and

a reception sub-module connected with the data insertion sub-module and configured to receive the data insertion request.

16. The storage device according to claim 14, wherein, the resource allocation module comprises:

a storage sub-module configured to store the total number n of all the devices in the data pool and the number m of selected devices, and to store the data for insertion;

a poll calculation sub-module connected with the storage sub-module, and when the data insertion request is from the outside of the data pool, the poll calculation sub-module selects a number m−

1 of other devices in the data pool via polling under the principal of C_n-1^m-1; and

a transmission sub-module connected with the poll calculation sub-module and configured to transmit the data to each of the m−

1 devices.

17. The storage device according to claim 16, wherein, the management module comprises:

a monitoring sub-module configured to monitor all the other devices in the data pool, and upon receipt of a quit request from another device in the data pool and/or a join request from a new device to join the data pool, update resources under management and send the total number of the devices in the updated data pool to the storage sub-module;

an analysis sub-module connected with the monitoring sub-module, and configured to forward, upon receipt of the join request from a new device outside the data pool, the join request of the new device to the other devices, and to analyze the loads of all the devices in the original data pool; and

an execution sub-module connected with the analysis sub-module, and configured to transfer, when at least one of the devices in the original data pool has a load exceeding a preset value, part of data stored on the device with a load exceeding the preset value to the new device.

18. The storage device according to claim 17, wherein, the monitoring sub-module comprises:

a distributed hash table query sub-module connected with the analysis sub-module and configured to query data of the other devices in the data pool;

a distributed hash table insertion sub-module connected with the analysis sub-module and configured to insert data to the other devices in the data pool; and

a distributed hash table deletion sub-module connected with the analysis sub-module and configured to delete data from the other devices in the data pool.

19. A data storage system comprising a plurality of storage devices according to claim 14, the plurality of storage devices constituting a data pool.

20. The data storage system to claim 19, wherein, any one of the storage devices has both the resource allocation module connected with the analysis modules of the other storage devices and the management module connected with the management modules of the other storage devices.