TENANT-LEVEL SHARDING OF DISKS WITH TENANT-SPECIFIC STORAGE MODULES TO ENABLE POLICIES PER TENANT IN A DISTRIBUTED STORAGE SYSTEM

• US 20160334998A1
• Filed: 05/15/2015
• Published: 11/17/2016
• Est. Priority Date: 05/15/2015
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: George, Johnu, Zhang, Kai, Udupi, Yathiraj B., Dutta, Debojyoti
• Granted Patent: US 10,222,986 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/84 Mapping; Conversion
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Embodiments include receiving an indication of a data storage module to be associated with a tenant of a distributed storage system, allocating a partition of a disk for data of the tenant, creating a first association between the data storage module and the disk partition, creating a second association between the data storage module and the tenant, and creating rules for the data storage module based on one or more policies configured for the tenant. Embodiments further include receiving an indication of a type of subscription model selected for the tenant, and selecting the disk partition to be allocated based, at least in part, on the subscription model selected for the tenant. More specific embodiments include generating a storage map indicating the first association between the data storage module and the disk partition and indicating the second association between the data storage module and the tenant.

Claims

1. A method comprising:

receiving an indication of a data storage module to be associated with a tenant of a distributed storage system;

allocating a partition of a disk for data of the tenant;

creating a first association between the data storage module and the disk partition;

creating a second association between the data storage module and the tenant; and

creating rules for the data storage module based on one or more policies configured for the tenant.

2. The method of claim 1, further comprising:

receiving an indication of a type of subscription model selected for the tenant.

3. The method of claim 2, further comprising:

selecting the disk partition to be allocated based, at least in part, on the subscription model selected for the tenant.

4. The method of claim 1, wherein the data storage module stores at least some data of the tenant in the disk partition based, at least in part, on the rules.

5. The method of claim 1, further comprising:

generating a storage map indicating the first association between the data storage module and the disk partition and indicating the second association between the data storage module and the tenant.

6. The method of claim 5, further comprising:

generating a unique identifier of the data storage module, wherein the unique identifier of the data storage module is mapped to the tenant in the storage map, and wherein the unique identifier is not mapped to any other tenants in the storage map.

7. The method of claim 5, wherein the storage map includes:

a mapping of a unique identifier of the data storage module to the tenant; and

a mapping of the unique identifier of the data storage module to the disk partition.

8. The method of claim 1, wherein one or more other partitions of the disk are associated with one or more other data storage modules, respectively, and wherein the one or more other data storage modules are associated with one or more other tenants, respectively, of the distributed storage system.

9. The method of claim 1, wherein the one or more policies are related to at least one of a performance requirement of disks that store the data, a distribution requirement for the data, and a replication requirement for the data.

10. The method claim 1, further comprising:

receiving an indication of a second data storage module to be associated with the tenant of the distributed storage system;

allocating a second disk partition for other data of the tenant;

creating a third association between the second data storage module and the second disk partition;

creating a fourth association between the second data storage module and the tenant; and

creating other rules for the second data storage module based on one or more other policies configured for storing other data of the tenant.

11. At least one machine readable storage medium comprising instructions that, when executed by at least one processor, cause the at least one processor to:

receive an indication of a data storage module to be associated with a tenant of a distributed storage system;

allocate a partition of a disk for data of the tenant;

create a first association between the data storage module and the disk partition;

create a second association between the data storage module and the tenant; and

create rules for the data storage module based on one or more policies configured for the tenant.

12. The at least one machine readable storage medium of claim 11, wherein the instructions when executed by the at least one processor cause the at least one processor to:

receive an indication of a type of subscription model selected for the tenant.

13. The at least one machine readable storage medium of claim 12, wherein the instructions when executed by the at least one processor cause the at least one processor to:

select the disk partition to be allocated based, at least in part, on the subscription model selected for the tenant.

14. The at least one machine readable storage medium of claim 11, wherein the data storage module stores at least some data of the tenant in the disk partition based, at least in part, on the rules.

15. The at least one machine readable storage medium of claim 11, wherein the instructions when executed by the at least one processor cause the at least one processor to:

generate a storage map indicating the first association between the data storage module and the disk partition and indicating the second association between the data storage module and the tenant.

16. An apparatus comprising:

at least one processor; and

at least one memory element comprising instructions that when executed by the at least one processor perform operations comprising;

receiving an indication of a data storage module to be associated with a tenant of a distributed storage system;

allocating a partition of a disk for data of the tenant;

creating a first association between the data storage module and the disk partition;

creating a second association between the data storage module and the tenant; and

creating rules for the data storage module based on one or more policies configured for the tenant.

17. The apparatus of claim 16, wherein the instructions when executed by the at least one processor cause the apparatus to:

generating a unique identifier of the data storage module, wherein the unique identifier of the data storage module is mapped to the tenant in a storage map, and wherein the unique identifier is not mapped to any other tenants in the storage map.

18. The apparatus of claim 16, wherein the data includes one of objects, files or blocks.

19. The apparatus of claim 16, wherein one or more other partitions of the disk are associated with one or more other data storage modules, respectively, and wherein the one or more other data storage modules are associated with one or more other tenants, respectively, of the distributed storage system.

20. The apparatus of claim 16, wherein the distributed storage system is a Ceph storage system.