ENABLING PLACEMENT CONTROL FOR CONSISTENT HASHING-BASED OBJECT STORES

• US 20170060865A1
• Filed: 08/25/2015
• Published: 03/02/2017
• Est. Priority Date: 08/25/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: RUPPRECHT, Lukas L., HILDEBRAND, Dean, OWEN, William W., ZHANG, Rui
• Granted Patent: US 10,248,678 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2255 Hash tables

Abstract

Techniques are disclosed herein for controlling object placement in object storage. A placement component of a storage application receives a request to store a first object in an object store having multiple nodes. The object store determines a placement of the first object to one of the nodes based on an object namespace including a numerical namespace and a lexicographical namespace. Each node is assigned a corresponding subspace of the object namespace for storing objects. The first object includes a numerical namespace value and a lexicographical namespace value. A second object (a replica of the first object) is generated. The first object is stored to a first node based on the lexicographical namespace value. The second object is stored to a second node based on the numerical namespace value.

Claims

1. A method for controlling object placement, comprising:

receiving a first request to store a first object in an object store which includes a plurality of nodes, wherein the object store determines a placement of the first object in one of the plurality based on an object namespace including a numerical namespace and a lexicographical namespace, wherein each node is assigned a corresponding subspace of the object namespace for storing objects, and wherein the first object includes a numerical namespace value and a lexicographical namespace value;

generating a second object, wherein the second object is a replica of the first object;

storing the first object in a first node of the plurality of nodes based on the lexicographical namespace value; and

storing the second object in a second node of the plurality of nodes based on the numerical namespace value.

2. The method of claim 1, further comprising:

receiving a second request to retrieve the first object;

identifying a node storing the first object based on the lexicographical namespace value; and

retrieving the first object from the identified node.

3. The method of claim 2, wherein identifying the node storing the first object is further based on a result of a query of (i) a metadata container associated with the first object and (ii) a name of at least a replica of the first object.

4. The method of claim 1, further comprising:

receiving a second request to delete the first object;

identifying a node storing the first object based on the lexicographical namespace value; and

removing the first object from the identified node.

5. The method of claim 1, further comprising, prior to generating the second object:

validating the request using role-based authentication.

6. The method of claim 1, wherein storing the first object to the first node in the plurality based on the lexicographical namespace value comprises:

upon determining that a metadata container associated with the first object includes metadata associated with a third object having a numerical namespace value that is identical to the numerical namespace value of the first object, replacing the third object with the first object.

7. The method of claim 1, wherein the numerical namespace value is generated by performing a hash function on the object.

8. A computer program product, comprising:

a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to perform an operation for controlling object placement, comprising;

receiving a first request to store a first object in an object store which includes a plurality of nodes, wherein the object store determines a placement of the first object in one of the plurality based on an object namespace including a numerical namespace and a lexicographical namespace, wherein each node is assigned a corresponding subspace of the object namespace for storing objects, and wherein the first object includes a numerical namespace value and a lexicographical namespace value,

generating a second object, wherein the second object is a replica of the first object,

storing the first object in a first node of the plurality of nodes based on the lexicographical namespace value, and

storing the second object in a second node of the plurality of nodes based on the numerical namespace value.

9. The computer program product of claim 8, wherein the operation further comprises:

receiving a second request to retrieve the first object;

identifying a node storing the first object based on the lexicographical namespace value; and

retrieving the first object from the identified node.

10. The computer program product of claim 9, wherein identifying the node storing the first object is further based on a result of a query of (i) a metadata container associated with the first object and (ii) a name of at least a replica of the first object.

11. The computer program product of claim 8, wherein the operation further comprises:

receiving a second request to delete the first object;

identifying a node storing the first object based on the lexicographical namespace value; and

removing the first object from the identified node.

12. The computer program product of claim 8, wherein the operation further comprises, prior to generating the second object:

validating the request using role-based authentication.

13. The computer program product of claim 8, wherein storing the first object to the first node in the plurality based on the lexicographical namespace value comprises:

upon determining that a metadata container associated with the first object includes metadata associated with a third object having a numerical namespace value that is identical to the numerical namespace value of the first object, replacing the third object with the first object.

14. The computer program product of claim 8, wherein the numerical namespace value is generated by performing a hash function on the object.

15. A system, comprising:

a processor; and

a memory storing a program, which, when executed on the processor, performs an operation for controlling object placement, the operation comprising;

receiving a first request to store a first object in an object store which includes a plurality of nodes, wherein the object store determines a placement of the first object in one of the plurality based on an object namespace including a numerical namespace and a lexicographical namespace, wherein each node is assigned a corresponding subspace of the object namespace for storing objects, and wherein the first object includes a numerical namespace value and a lexicographical namespace value,

generating a second object, wherein the second object is a replica of the first object,

storing the first object in a first node of the plurality of nodes based on the lexicographical namespace value, and

storing the second object in a second node of the plurality of nodes based on the numerical namespace value.

16. The system of claim 15, wherein the operation further comprises:

receiving a second request to retrieve the first object;

identifying a node storing the first object based on the lexicographical namespace value; and

retrieving the first object from the identified node.

17. The system of claim 16, wherein identifying the node storing the first object is further based on a result of a query of (i) a metadata container associated with the first object and (ii) a name of at least a replica of the first object.

18. The system of claim 15, wherein the operation further comprises:

receiving a second request to delete the first object;

identifying a node storing the first object based on the lexicographical namespace value; and

removing the first object from the identified node.

19. The system of claim 15, wherein the operation further comprises, prior to generating the second object:

validating the request using role-based authentication.

20. The system of claim 15, wherein storing the first object to the first node in the plurality based on the lexicographical namespace value comprises:

upon determining that a metadata container associated with the first object includes metadata associated with a third object having a numerical namespace value that is identical to the numerical namespace value of the first object, replacing the third object with the first object.