Methods and apparatus for array agnostic automated storage tiering

• US 10,225,162 B1
• Filed: 09/26/2013
• Issued: 03/05/2019
• Est. Priority Date: 09/26/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Jain, Anurag, Biddappa, Sukesh Kumar, Mendes, Stephen A., Tahaliyani, Seema, Santoli, Douglas J., Tzanakis, Barbara S
• Primary Examiner(s): Wasel, Mohamed A
• Assistant Examiner(s): Kunwar, Binod J
• Application Number:
  US14/037,480
• Time in Patent Office: 1,986 Days
• Field of Search: 709223, 711117
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: H04L 41/5058 Service discovery by the service manager
• CPC Class Codes: H04L 41/5096 wherein the managed service relates to distributed or central networked applications
• CPC Class Codes: H04L 49/356 for storage area networks
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Methods and apparatus to provide, in a cloud infrastructure environment, an array agnostic automated storage tiering mechanism, wherein storage array types may be different. A user can select storage with an automated storage tiering policy while details of the storage are abstracted for the user. In embodiments, tiering policies determine a location for data based upon activity associated with the data.

Claims

1. A method, comprising:

using a computer processor to display information for user fields, the user fields comprising first one or more user fields relating to choosing a desired converged hardware system from a plurality of converged hardware systems and comprising second one or more user fields related to choosing a desired automated storage tiering policy from a plurality of available automated storage tiering policies to be used with the plurality of converged hardware systems,

the automated storage tiering policies controlling location of data to be stored in a storage array based on relative activity level of the data, wherein the plurality of converged hardware systems each comprise at least one or more respective storage arrays, each respective storage array associated with a respective set of array characteristics;

configuring, the user fields to abstract, from a user, details concerning the respective set of array characteristics and details concerning whether, based on the respective set of array characteristics, any of the available automated storage tiering policies are usable with a given storage array of a given converged hardware system;

wherein;

the respective set of array characteristics comprise at least one or more characteristics selected from the group consisting of;

a storage type, a vendor, a location, a switch type, a server type, a drive type, a redundant array of independent disk (RAID) level, a capacity, a speed, a cost, a reliability, an availability, a performance level, a pool, a volume property, a quota, a tiering policy, and a memory technology type;

the plurality of converged hardware systems comprise at least a first converged hardware system having a first storage array with a first respective set of array characteristics and a second converged hardware system having a second storage array with a second respective set of array characteristics,

wherein the first set of array characteristics and the second set of array characteristics are different; and

the displayed user fields for selecting the desired storage tiering policy and for selecting the desired converged hardware system are configured to permit a first user selection of the desired storage tiering policy and a second user selection of the desired converged hardware system to which the desired storage tiering policy is to be applied, wherein the user fields are configured to accept user selections independent of whether or not the selected desired automated storage tiering policy is applicable to the respective storage array associated with the selected desired converged hardware system;

receiving, from the user, the first user selection for the desired automated storage tiering policies for storage and the second user selection for the desired convergent hardware system to which the selected desired automated tiering policy is to be applied, wherein, responsive to the first and second user selections, the selected automated storage tiering policy is automatically configured to cover the one or more storage arrays associated with the selected desired converged hardware system;

providing a model of physical information stored within a management layer of the selected at least one converged hardware system;

providing a model of service and offering information stored within the management layer;

creating automatically, based at least in part on the first and second user selections, a first service to run on the selected at least one converged hardware system, the first service configured in accordance with the selected respective first one of the automated storage tiering policies; and

adopting the first service into the management layer, and splitting storage discovery of storage in first storage resources of the converged hardware systems into discovery of block storage in SAN fabrics and discovery of file storage paths;

wherein the automated storage tiering policies cover a plurality of storage types.

2. The method according to claim 1, wherein the displayed information for the user fields is configured so that information relating to the respective set of array characteristics is not displayed to or available to the user.

3. The method according to claim 1, wherein the automated storage tiering policies are associated with a service level.

4. The method according to claim 1, wherein the automated storage tiering policies that determine a location for data based upon the relative activity level of the data are configured to assess quantity and timing of input/output operations to the data.

5. The method according to claim 1, further including using at least one of an array specific command, an array specific model, and an array specific driver, to automatically apply the automated storage tiering policies to the storage array.

6. The method according to claim 1, further including adding further storage to the converged hardware system selected by the user and selecting a tiering policy for the further storage.

7. A method, comprising:

in a cloud infrastructure environment having a compute layer, a network layer, a storage layer, and management layer,

displaying information for user fields, the user field comprising first one or more user fields relating to choosing a desired converged hardware system from a plurality of converged hardware systems and comprising second one or more user fields related to choosing a desired automated storage tiering policy from a plurality of available automated storage tiering policies to be used with the plurality of converged hardware systems, the automated storage tiering policies controlling location of data to be stored in a storage array based on relative activity level of the data, wherein the plurality of converged hardware systems each comprise at least one or more respective storage arrays, each respective storage array associated with a respective set of array characteristics;

configuring the user fields to abstract, from a user, details concerning the respective set of array characteristics and details concerning whether, based on the respective set of array characteristics, any of the available automated storage tiering policies are usable with a given storage array of a given converged hardware system wherein;

the respective set of array characteristics comprise at least one or more characteristics selected from the group consisting of;

a storage type, a vendor, a location, a switch type, a server type, a drive type, a redundant array of independent disk (RAID) level, a capacity, a speed, a cost, a reliability, an availability, a performance level, a pool, a volume property, a quota, a tiering policy, and a memory technology type;

the plurality of converged hardware systems comprise at least a first converged hardware system having a first storage array with a first respective set of array characteristics and a second converged hardware system having a second storage array with a second respective set of array characteristics, wherein the first set of array characteristics and the second set of array characteristics are different; and

the displayed user fields for selecting the desired storage tiering policy and for selecting the desired converged hardware system are configured to permit a first user selection of the desired storage tiering policy and a second user selection of the desired converged hardware system to which the desired storage tiering policy is to be applied,

wherein the first user fields are configured to accept first and second user selections to be made so that such first and second user selections are made independent of whether or not the selected desired automated storage tiering policy is applicable to the respective storage array associated with the selected desired converged hardware system;

receiving, from the user, the first user selection for a first one of the available automated storage tiering policies for storage and the second user selection for at least one respective convergent hardware system to which the selected first tiering policy is to be applied,

wherein, responsive to the first and second user selections, the selected automated storage tiering policy is automatically configured to cover the one or more storage arrays associated with the selected desired converged hardware system;

providing, using a computer processor, a first service having first network resources, first compute resources, and first storage resources;

providing a model of physical information stored within a management layer of the selected at least one converged hardware system;

providing a model of service and offering information stored within the management layer;

creating automatically, based at least in part on the first and second user selections, a first service to run on the selected at least one converged hardware system, the first service configured in accordance with the selected respective first one of the automated storage tiering policies;

adopting the first service into the management layer;

splitting storage discovery of storage in the first storage resources into discovery of block storage in SAN fabrics and discovery of file storage paths;

providing a second service having second network resources, second compute resources, and second storage resources;

providing a management module coupled to the first and second services;

providing the first storage resources with a first LUN having a first automated storage tiering policy with a first tier associated with the first automated storage tiering policy and the first LUN; and

providing the second storage resources with a second LUN having a second automated storage tiering policy with a first tier associated with the second automated storage tiering policy and the second LUN;

wherein the first and second LUNs are of different types.

8. The method according to claim 7, further including discovering the first and second automated storage policies for the first and second storage resources.

9. The method according to claim 7, wherein the displayed information for the first and second user fields is configured so that information relating to the respective set of array characteristics of and the different types of the first and second LUNs is not displayed to the user.

10. The method according to claim 7, further including creating the first service from a service offering.

11. The method according to claim 7, further including loading or using at least one of an array specific model, an array specific driver, and an array specific command, for the first LUN.

12. The method according to claim 11, further including using one or more array specific commands specific to the first LUN to apply the first automated storage tiering policy to the first LUN.

13. An article comprising:

at least one non-transitory computer readable medium having stored instructions that enable a machine to perform at least the following in a cloud infrastructure environment having a compute layer, a network layer, a storage layer, and management layer;

displaying information for user fields, the user fields comprising first one or more user fields relating to choosing a desired converged hardware system from a plurality of converged hardware systems and comprising second one or more user fields related to choosing a desired automated storage tiering policy from a plurality of available automated storage tiering policies to be used with the plurality of converged hardware systems,

the automated storage tiering policies controlling location of data to be stored in a storage array based on relative activity level of the data, wherein the plurality of converged hardware systems each comprise at least one or more respective storage arrays, each respective storage array associated with a respective set of array characteristics;

configuring the user fields to abstract, from a user, details concerning the respective set of array characteristics and details concerning whether, based on the respective set of array characteristics, any of the available automated storage tiering policies are usable with a given storage array of a given converged hardware system wherein;

the respective set of array characteristics comprise at least one or more characteristics selected from the group consisting of;

a storage type, a vendor, a location, a switch type, a server type, a drive type, a redundant array of independent disk (RAID) level, a capacity, a speed, a cost, a reliability, an availability, a performance level, a pool, a volume property, a quota, a tiering policy, and a memory technology type;

the plurality of converged hardware systems comprise at least a first converged hardware system having a first storage array with a first respective set of array characteristics and a second converged hardware system having a second storage array with a second respective set of array characteristics, wherein the first set of array characteristics and the second set of array characteristics are different; and

the displayed user fields for selecting the desired storage tiering policy and for selecting the desired converged hardware system are configured to permit a first user selection of the desired storage tiering policy and a second user selection of the desired converged hardware system to which the desired storage tiering policy is to be applied, wherein the user fields are configured to accept user selections independent of whether or not the selected desired automated storage tiering policy is applicable to the respective storage array associated with the selected desired converged hardware system;

receiving, from the user, the first user selection for a first one of the available automated storage tiering policies for storage and the second user selection for at least one respective convergent hardware system to which the selected first automated storage tiering policy is to be applied, wherein, responsive to the first and second user selections, the selected first automated storage tiering policy is automatically configured to cover the one or more storage arrays associated with the selected desired converged hardware system;

providing, using a computer processor, a first service having first network resources, first compute resources, and first storage resources;

providing a model of physical information stored within a management layer of the selected at least one converged hardware system;

providing a model of service and offering information stored within the management layer;

creating automatically, based at least in part on the first and second user selections, a first service to run on the selected desired converged hardware system, the first service configured in accordance with the selected first automated storage tiering policy;

adopting the first service into the management layer;

splitting storage discovery of storage in the first storage resources into discovery of block storage in SAN fabrics and discovery of file storage paths;

providing a second service having second network resources, second compute resources, and second storage resources;

providing a management module coupled to the first and second services;

providing the first storage resources with a first LUN having the first automated storage tiering policy with a first tier associated with the first automated storage tiering policy and the first LUN; and

providing the second storage resources with a second LUN having a second automated storage tiering policy with a first tier associated with the second automated storage tiering policy and the second LUN, wherein the first and second LUNs are of different types.

14. The article according to claim 13, further including instructions for discovering the first and second automated storage policies for the first and second storage resources.

15. The article according to claim 13, wherein the displayed information for the user fields is configured so that information relating to the respective set of array characteristics of and the different types of the first and second LUNs is not displayed to the user.

16. The article according to claim 13, further including instructions for creating the first service from service offering.

17. The article according to claim 13, further including instructions for loading or using at least one of an array specific model, an array specific driver, and an array specific command for the first LUN.

18. The article according to claim 17, further including instructions for using one or more array specific commands specific to the first LUN to apply the first automated storage tiering policy to the first LUN.

19. A method operable in a cloud infrastructure environment having a compute layer, a network layer, a storage layer, and a management layer, the method comprising:

providing access to user fields, the user fields comprising first one or more user fields configured for user selection of a desired converged hardware system from a plurality converged hardware systems and second one or more user fields configured for user selection of a desired automated storage tiering policy from a plurality of available automated storage tiering policies to be used with the plurality of converged hardware systems,

the plurality of automated storage tiering policies controlling location of data to be stored in a storage array based on relative activity level of the data, wherein the plurality of converged hardware systems each comprises respective compute and network resources and one or more respective storage arrays, each respective storage array having a respective predetermined type from a plurality of predetermined types and an associated respective sets of array characteristics, wherein;

each respective predetermined type of storage array is associated with a respective set of array characteristics, the respective set of array characteristics comprising at least one or more elements selected from the group consisting of;

a storage type, a vendor, a location, a switch type, a server type, a drive type, a redundant array of independent disk (RAID) type, a capacity, a speed, a cost, a reliability, a performance level, a pool, a volume property, a quota, a tiering policy, and a memory technology type; and

the plurality of predetermined types comprises at least first and second predetermined types associated with first and second respective sets of characteristics, wherein the first set of characteristics and the second set of characteristics are different;

configuring the user fields to abstract, from a user, details concerning the respective set of array characteristics and details concerning whether, based on the respective set of array characteristics, any of the available automated storage tiering policies are usable with a given storage array of a given converged hardware system;

receiving, from the user, user selections, for the desired tiering policy and the desired converged hardware system, wherein, responsive to the selections, the selected automated storage tiering policy is automatically configured to cover the predetermined type of storage associated with the selected converged hardware system, and;

deploying automatically, based at least in part on the user selections of the desired tiering policy and the desired converged hardware system, a first service to run on the selected at least one converged hardware system, the first service configured in accordance with the selected respective first one of the automated storage tiering policies;

adopting the first service into the management layer; and

configuring, based on the respective storage array associated with the selected convergent hardware system, an array-specific model and a set of array-specific drivers, to apply the selected tiering policy to the respective storage array.

20. The method of claim 19 wherein the automated storage tiering policies that determine a location for data based upon the relative activity level of the data are configured to assess quantity and timing of input/output operations to the data.

21. The method of claim 19 further comprising adding further storage to the converged hardware system selected by the user and selecting a tiering policy for the further storage.