Techniques for data storage array virtualization

• US 8,904,146 B1
• Filed: 11/26/2013
• Issued: 12/02/2014
• Est. Priority Date: 09/22/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Lazar, Gregory W.
• Primary Examiner(s): Gu, Shawn X
• Application Number:
  US14/089,931
• Time in Patent Office: 371 Days
• US Class Current: 711/173
• CPC Class Codes: G06F 12/0223 User address space allocation, e.g. contiguous or non contiguous base addressing
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Described are techniques for performing data storage system management. The data storage system is divided into a plurality of virtual partitions. A plurality of policy sets are specified where each of the policy sets includes one or more policies. One of the plurality of policy sets is assigned to each of the plurality of virtual partitions. Each of the plurality of policy sets includes an access control policy that assigns a portion of data storage of the data storage system as a resource for exclusive use in one of the plurality of virtual partitions that is assigned said each policy set.

Claims

1. A non-transitory computer readable medium comprising code stored thereon for performing data storage system management, the non-transitory computer readable medium comprising code for:

dividing a data storage system into a plurality of virtual partitions;

specifying a plurality of policy sets, each of said policy sets including one or more policies; and

assigning one of said plurality of policy sets to each of said plurality of virtual partitions, wherein each of said plurality of policy sets includes an access control policy that assigns a portion of data storage of the data storage system as a resource for exclusive use in one of the plurality of virtual partitions that is assigned said each policy set, and

wherein each of said plurality of policy sets includes a performance policy that assigns one or more performance limits for controlling use of data storage system resources by consumers of one of the plurality of virtual partitions that is assigned said each policy set.

2. The non-transitory computer readable medium of claim 1, wherein each performance policy specifies a quantity for a performance-based metric, said quantity representing a performance limit for the performance-based metric that is any of bandwidth, I/O throughput, and response time.

3. The non-transitory computer readable medium of claim 2, wherein response time is an average time for an input/output (I/O) request to be serviced by the data storage system including any wait time, bandwidth is an average amount of data in connection with read and/or write I/O requests processed by the data storage system per unit of time, and throughput is an average number of I/O requests serviced by the data storage system per unit of time.

4. The non-transitory computer readable medium of claim 1, wherein each performance policy includes one or more thresholds of a first resource, each of said one or more thresholds specifying a resource limit for the first resource which is any of processor utilization, memory, and cache.

5. The non-transitory computer readable medium of claim 1, wherein the data storage system includes a plurality of storage tiers, wherein each of said plurality of storage tiers includes physical storage devices of the data storage system having different physical storage performance characteristics, and wherein each of the plurality of policy sets includes a storage allocation policy that specifies one or more threshold amounts for each of the plurality of storage tiers for use by a virtual partition assigned said storage allocation policy.

6. The non-transitory computer readable medium of claim 5, wherein the plurality of storage tiers includes a first tier of flash drives, and one or more tiers of disk drives.

7. The non-transitory computer readable medium of claim 1, wherein each performance policy is assigned a predetermined quality of service level, and wherein each performance policy specifies one or more threshold amounts that are used as said one or more performance limits and are determined in accordance with the predetermined quality of service level.

8. A method of performing data storage system management comprising:

dividing a data storage system into a plurality of virtual partitions;

specifying a plurality of policy sets, each of said policy sets including one or more policies; and

assigning one of said plurality of policy sets to each of said plurality of virtual partitions, wherein each of said plurality of policy sets includes an access control policy that assigns a portion of data storage of the data storage system as a resource for exclusive use in one of the plurality of virtual partitions that is assigned said each policy set, and

wherein each of the plurality of virtual partitions has one of a plurality of partition administrators that performs data storage management only for resources assigned to said each virtual partition, wherein each of the plurality of partition administrators is assigned a role including any of a manager, a monitor, and a replicator, and

wherein the role of a monitor of a particular one of the plurality of virtual partitions is only allowed to view information regarding assigned objects of the particular one virtual partition and is not allowed to perform other operations on assigned objects of the particular one virtual partition.

9. The method of claim 8, wherein the role of a replicator of a specific one of the plurality of virtual partitions is only allowed to perform replication operations on assigned data storage of the specific one virtual partition.

10. The method of claim 8, wherein each access control policy identifies one or more objects representing storage devices of the data storage system for exclusive use in said one of the plurality of virtual partitions.

11. The method of claim 10, wherein each of the one or more objects represents any of a logical storage device, a physical storage device, a storage pool of one or more physical devices, and a storage group of one or more logical storage devices.

12. The method of claim 8, wherein a global data storage administrator having access to all data storage of the data storage system performs said dividing, said specifying and said assigning.

13. The method of claim 8, wherein the data storage system is a single physical data storage array.

14. The method of claim 8, wherein the data storage system includes a plurality of data storage arrays.

15. The method of claim 8, wherein the role of a manager of a first of the plurality of virtual partitions is allowed to perform any one or more of provision storage from a storage pool assigned to the first virtual partition in order to create logical devices for the first virtual partition, create storage groups for the first virtual partition from logical devices of the first virtual partition, and assign a data storage client of the first virtual partition to a first storage group of logical devices thereby allowing the data storage client to perform data storage operations to store and retrieve data from the first storage group.

16. A non-transitory computer readable medium comprising code stored thereon for performing data storage system management, the non-transitory computer readable medium comprising code for:

dividing a data storage system into a plurality of virtual partitions;

specifying a plurality of policy sets, each of said policy sets including one or more policies; and

assigning one of said plurality of policy sets to each of said plurality of virtual partitions, wherein each of said plurality of policy sets includes an access control policy that assigns a portion of data storage of the data storage system as a resource for exclusive use in one of the plurality of virtual partitions that is assigned said each policy set, and

wherein each of the plurality of virtual partitions has one of a plurality of partition administrators that performs data storage management only for resources assigned to said each virtual partition, wherein each of the plurality of partition administrators is assigned a role including any of a manager, a monitor, and a replicator, and

wherein the role of a replicator of a particular one of the plurality of virtual partitions is only allowed to perform replication operations on assigned data storage of the particular one virtual partition.

17. The non-transitory computer readable medium of claim 16, wherein the role of a monitor of a specific one of the plurality of virtual partitions is only allowed to view information regarding assigned objects of the specific one virtual partition and is not allowed to perform other operations on assigned objects of the specific one virtual partition.

18. The non-transitory computer readable medium of claim 16, wherein each access control policy identifies one or more objects representing storage devices of the data storage system for exclusive use in said one of the plurality of virtual partitions.

19. The non-transitory computer readable medium of claim 18, wherein each of the one or more objects represents any of a logical storage device, a physical storage device, a storage pool of one or more physical devices, and a storage group of one or more logical storage devices.

20. The non-transitory computer readable medium of claim 16, wherein the role of a manager of a first of the plurality of virtual partitions is allowed to perform any one or more of provision storage from a storage pool assigned to the first virtual partition in order to create logical devices for the first virtual partition, create storage groups for the first virtual partition from logical devices of the first virtual partition, and assign a data storage client of the first virtual partition to a first storage group of logical devices thereby allowing the data storage client to perform data storage operations to store and retrieve data from the first storage group.