Distributed storage system and method for storing objects based on locations

• US 8,495,013 B2
• Filed: 12/23/2011
• Issued: 07/23/2013
• Est. Priority Date: 12/24/2010
• Status: Active Grant

• Current Assignee: KT Corporation
• Original Assignee: KT Corporation
• Inventors: Kim, Mi-Jeom, Park, Chang-Sik, Lee, Eo-Hyung, Hwang, Jin-Kyung
• Primary Examiner(s): Ehichioya, Fred I
• Assistant Examiner(s): Mobin, Hasanul
• Application Number:
  US13/336,074
• Publication Number:
  US 20120166394A1
• Time in Patent Office: 578 Days
• Field of Search: None
• US Class Current: 707/610
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

A distributed storage system and a method for storing objects based on locations. The distributed storage system may include a plurality of data nodes, at least one selection agent, a client, and a proxy server. The plurality of data nodes may be configured to be grouped into a plurality of zone groups based on locations of the plurality of data nodes and configured to store a target object and replicas of the target object. The at least one selection agent may be configured to select multiple target zone groups and select one target data node for each one of the selected multiple target zone groups.

Claims

1. A distributed storage system comprising:

non-transitory computer-readable recording media configured to store data in one or more locations;

a plurality of data nodes configured to be grouped into a plurality of zone groups based on locations of the plurality of data nodes and configured to store a target object and replicas of the target object;

at least one selection agent configured to select multiple target zone groups based on locations of the plurality of zone groups and the client in response to an inquiry from a proxy server and select one target data node for each one of the selected multiple target zone groups;

assign priorities to the selected multiple target zone groups and data nodes belonging to the selected multiple target zone groups, wherein the priorities are determined based on user preferences and locations of the zone groups and the data nodes;

a client configured to access the distributed storage system through a network, store the target object in one of the selected target data nodes which has a highest priority among the selected multiple zone groups and perform a replication process using a replication agent to store the replicas of the target object in other target data nodes; and

a metadata database that holds the location information associated with the proxy server is updated based on a data node list that includes information on the target zone groups and the target data nodes storing the target object and the replicas.

2. The distributed storage system of claim 1, wherein:

the at least one selection agent is the client; and

the client is configured to;

select the multiple target zone groups from the plurality of zone groups;

select the target data nodes by selecting one data node for each one of the selected multiple target zone groups based on the assigned priorities;

store the target object in one of the target data nodes;

store the replicas of the target object by performing the replication process using the replication agent; and

transmit the data node list to the proxy server.

3. The distributed storage system of claim 1, wherein:

the at least one selection agent are the client and the proxy server;

the client is configured to;

select the multiple target zone groups from the plurality of zone groups based on locations of the plurality of zone groups in response to an inquiry from the proxy server;

assign priorities to the selected multiple zone groups;

receive a data node list from the proxy server;

store the target object in one of the target data nodes included in the received list;

store the replicas of the target object in other target data nodes included in the received data node list by performing the replication process using the replication agent; and

transmit the data node list including information on the target data nodes and corresponding target zone groups that store the target object and the replicas of the target object to the proxy server, and

the proxy server is configured to;

select the target data nodes by selecting one data node for each one of the selected multiple target zone groups which are selected by the client;

transmit the data node list including information on the selected data nodes to the client; and

update the metadata database based on the data node list.

4. The distributed storage system of claim 3, wherein the proxy server selects one data node for each one of the selected multiple zone groups, as the target data nodes, based on an available storage capacity and an object storage history of data nodes belonging to the target zone groups.

5. The distributed storage system of claim 1, wherein:

the selection agent is the proxy server; and

the proxy server is configured to;

select multiple target zone groups from the plurality of zone groups based on locations of the plurality of zone groups and the client;

assign priorities to the selected multiple target zone groups based on distances from the selected multiple target zone groups to the client;

select the target data nodes by selecting one data node for each one of the selected multiple target zone groups;

update the metadata database based on a data node list including information on the selected data nodes; and

transmit the data node list to the client, and

the client is configured to;

receive the data node list from the proxy server;

store the target object in one of the target data nodes included in the data node list and store the replicas of the target object in other target data nodes included in the data node list by performing the replication process through the replication agent.

6. The distributed storage system of claim 5, wherein the proxy server uses a location-aware server to select the multiple target zone groups from the plurality of zone groups based on locations of the plurality of zone groups and the client and determine the priorities of the selected multiple zone groups based on distances from the selected multiple zone groups to the client.

7. The distributed storage system of claim 1, wherein:

the replication agent is a client; and

the client is configured to create the replicas of the target object and transmit the replicas into the other target data nodes.

8. The distributed storage system of claim 1, wherein:

the replication agent is the target data node; and

the target data node is configured to;

receive the target object and store the received target object;

determine whether a priority of a corresponding target zone group is a lowest priority; and

create a replica of the stored target object and transmit the replica to a target data node of a target zone group having a next highest priority when the priority is not the lowest priority.

9. The distributed storage system of claim 1, wherein:

the replication agent is a server;

the server is configured to create the replicas of the target object and transmit the replicas into the other target data nodes; and

the server is one of the proxy server and a replicator server.

10. A method for distributively storing a target object and replicas of the target object in a plurality of data nodes, the method comprising:

grouping a plurality of data nodes into a plurality of zone groups based on locations of the plurality of data nodes;

selecting multiple target zone groups and selecting target data nodes by selecting one data node for each one of the selected multiple target zone groups through at least one selection agent based on locations of the plurality of zone groups and the client in response to an inquiry from a proxy server;

storing a target object in one of the selected target data nodes;

storing the replicas of the target object in other target data nodes which has a highest priority among the selected multiple zone groups through performing a replication process using a replication agent; and

a metadata database that holds the location information associated with the proxy server is updated based on a data node list that includes information on the target zone group and the target data nodes storing the target object and the replicas.

11. The method of claim 10, wherein:

the at least one selection agent is a client; and

the client is configured to;

select the multiple target zone groups from the plurality of zone groups;

select the target data nodes by selecting one data node for each one of the selected multiple target zone groups based on the assigned priorities;

store the target object in one of the target data nodes;

store the replicas of the target object by performing the replication process using the replication agent; and

transmit the data node list to the proxy server.

12. The method of claim 11, wherein:

the at least one selection agent are a client and a proxy server;

the client is configured to;

select the multiple target zone groups from the plurality of zone groups based on locations of the plurality of zone groups in response to an inquiry from the proxy server;

assign priorities to the selected multiple zone groups;

receive a data node list from the proxy server;

store the target object in one of the target data nodes included in the received list;

store the replicas of the target object in other target data nodes included in the received data node list by performing the replication process using the replication agent; and

transmit the data node list including information on the target data nodes and corresponding target zone groups that store the target object and the replicas of the target object to the proxy server, and

the proxy server is configured to;

select the target data nodes by selecting one data node for each one of the selected multiple target zone groups which are selected by the client;

transmit the data node list including information on the selected data nodes to the client; and

update the metadata database based on the data node list.

13. The distributed storage system of claim 12, wherein the proxy server selects one data node for each one of the selected multiple zone groups, as the target data nodes, based on an available storage capacity and an object storage history of data nodes.

14. The distributed storage system of claim 10, wherein:

the selection agent is a proxy server; and

the proxy server is configured to;

select multiple target zone groups from the plurality of zone groups based on locations of the plurality of zone groups and the client;

assign priorities to the selected multiple target zone groups based on distances from the selected multiple target zone groups to the client;

select the target data nodes by selecting one data node for each one of the selected multiple target zone groups;

update the metadata database based on a data node list including information on the selected data nodes; and

transmit the data node list to the client, and

the client is configured to;

receive the data node list from the proxy server;

store the target object in one of the target data nodes included in the data node list and store the replicas of the target object in other target data nodes included in the data node list by performing the replication process through the replication agent.

15. The distributed storage system of claim 14, wherein the proxy server uses a location-aware server to select the multiple target zone groups from the plurality of zone groups based on locations of the plurality of zone groups and the client and determine the priorities of the selected multiple zone groups based on distances from the selected multiple zone groups to the client.

16. The distributed storage system of claim 11, wherein:

the replication agent is a client; and

the client is configured to create the replicas of the target object and transmit the replicas into the other target data nodes.

17. The distributed storage system of claim 11, wherein:

the replication agent is the target data node; and

the target data node is configured to;

receive the target object and store the received target object;

determine whether a priority of a corresponding target zone group is a lowest priority; and

create a replica of the stored target object and transmit the replica to a target data node belonging to a target zone group having a next highest priority than the own target zone group when the own target zone group has the lowest priority.

18. The method of claim 10, wherein:

the replication agent is a server;

the server is configured to create the replicas of the target object and transmit the replicas into the other target data nodes; and

the server is one of a proxy server and a replicator server.