DATA MANAGEMENT METHOD FOR NETWORK STORAGE SYSTEM AND THE NETWORK STORAGE SYSTEM BUILT THEREOF

• US 20090177860A1
• Filed: 02/23/2006
• Published: 07/09/2009
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: Hangzhou Hikvision Digital Technology Company Limited
• Original Assignee: Hui Xiong, Jie Yan, Yaolong Zhu
• Inventors: Yan, Jie, Zhu, Yaolong, Xiong, Hui
• Granted Patent: US 8,145,873 B2
• Time in Patent Office: Days
• US Class Current: 711/173
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A data management method for network storage system that said network storage system includes a storage network, a cluster of storage servers that provide data storage services for application servers connecting to the storage network and storage space corresponding to each storage server, setting a core manager in storage server, said core manager centralizing the metadata of all storage servers in a common storage space; separating the metadata from said storage servers to make a storage server become a storage manager and the storage spaces corresponding to each storage server form the common storage space, allocating the storage space of metadata in said common storage space, and managing the corresponding relationship between metadata and said storage manager.

Claims

1. A data management method for network storage system that said network storage system includes storage network, clusters of storage servers that provide data storage services to the application servers connecting, to said storage network and storage space corresponding to each storage server, which said data includes the raw data that accessed by the application servers and metadata corresponding to the storage servers, setting a core manager in storage server, said core manager centralizing the metadata of all storage servers in a common storage space, separating the metadata from said storage servers to make a storage server become a storage manager and the storage spaces corresponding to each storage server form the common storage space, allocating the storage space of metadata in said common storage space, and managing the corresponding relationship between metadata and said storage manager.

2. The method as claimed in claim 1, wherein said common storage space is divided into partitions, said storage managers and said partitions having one to one and/or one to more mapping relationship.

3. The method as claimed in claim 2, wherein said core manager consisting of allocation controller that distributes data into the partitions of common storage space, mapping controller that manages the mapping relationship between the partitions of common storage space and storage managers by a mapping table, and partition controller that manages the partitions of common storage space.

4. The method as claimed in claim 3, an operation of data accessing including:

(1) an application server sending a data accessing request;

(2) said allocation controller allocating a partition for said data;

(3) said mapping controller allocating a corresponding storage manager by said mapping table;

(4) transmitting the request and/or written date to the storage manager by the storage network;

(5) the storage manager completing the data accessing operation on the partition;

(6) returning the results of data accessing to the application server.

5. The method as claimed in claim 3, an operation of adding more storage manager including:

(1) a new storage manager connecting to the system;

(2) the system finding a new storage manager;

(3) the mapping controller adjusting the existing mapping table, adding the mapping relationship between the new storage manager and some partitions;

(4) the partition controller locking the accessing request queue to the partitions needed to be transferred to the new storage manager;

(5) the partition controller unloading the partitions needed to be transferred from the storage manager that manages the current partitions;

(6) the partition controller loading the current partitions in the new storage manager;

(7) unlocking the accessing request queue to the current partitions.

6. The method as claimed in claim 3, the rebuilding process of the cluster of storage manager including:

(1) adding new partitions to the common storage space;

(2) sending a rebuild instruction;

(3) the allocation controller keeping the original allocation arithmetic, and generating a new allocation arithmetic;

(4) the mapping controller generating a new mapping table that includes all partitions;

(5) the partition controller transferring and/or loading all partitions according to the new mapping table;

(6) entering the rebuild process and returning the completion of operation.

7. The method as claimed in claim 3, the failure handing process of storage manager including follows:

(1) the system finding the error information of a storage manager;

(2) the partition controller locking the accessing request queue to the partitions managed by the failed storage manager;

(3) the mapping manager adjusting the mapping table,

(4) transferring the partitions managed by the failed storage manager to other storage managers according to the new mapping table;

(5) recovering the data of partitions managed by the failed storage manager;

(6) unlocking the accessing request queue to partitions managed by the failed storage manager;

8. The method as claimed in claim 3, an operation of load balancing of the storage managers including:

(1) an overloading warning of a storage manager,

(2) the mapping controller adjusting the mapping table.

(3) the partition controller locking the request queue of the partitions needed to be transferred;

(4) the partition controller unloading the partitions needed to be transferred from the current storage manager managing the current partition;

(5) the partition controller loading the partitions needed to be transferred on the storage manager appointed by the new mapping table;

(6) unlocking the request queue to the partitions needed to be transferred;

9. A network storage system built within said data management method as claimed in claim 1 to claim 8, including storage network, clusters of storage managers that provide data storage services, and the common storage space storing the metadata, further including a core manager in storage server, said core manager centralizing the metadata of all storage servers in the common storage space to make a storage server become said storage manager and the storage spaces corresponding to each storage server form said common storage space, allocating the storage space of metadata in said common storage space, and managing the corresponding relationship between metadata and said storage manager.

10. The network storage system as claimed in claim 9, wherein said common storage space is divided into partitions, said storage managers and said partitions have one to one and/or one to more mapping relationship, wherein said core manager consisting of allocation controller that distributes data into the partitions of said common storage space, mapping controller that manages the mapping relationship between the partitions of said common storage space and storage managers by a mapping table, and partition controller that manages the partitions of said common storage space.