Techniques for binding resources for use by a consumer tier

• US 8,117,235 B1
• Filed: 09/29/2008
• Issued: 02/14/2012
• Est. Priority Date: 09/29/2008
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Barta, David
• Primary Examiner(s): Ly, Cheyne
• Application Number:
  US12/286,226
• Time in Patent Office: 1,233 Days
• Field of Search: 707/635, 707/692, 707/802, 707/827, 711/114, 711/153, 711/161
• US Class Current: 707/802
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

Described are techniques for configuring resources of a data storage system. A definition for each of one or more tiers is provided. Each of the tiers corresponds to a different class of consumer of data storage system resources and has a different corresponding definition including a set of one or more clauses and a priority of each clause in said set relative to other clauses in said set. Each of the clauses in the set is one of a plurality of predefined types of clauses. One or more data storage consumers are associated with each tier. A first set of data storage system resources is associated with a first of said one or more tiers in accordance with a corresponding first definition for said first tier. The first set is used when processing storage provisioning requests and I/O requests for data storage consumers associated with the first tier.

Claims

1. A method of configuring resources of a data storage system comprising:

providing a definition for each of one or more tiers, each of said one or more tiers corresponding to a different class of consumer of data storage system resources, each of said one or more tiers having a different corresponding definition including a set of one or more clauses and a priority of each clause in said set relative to other clauses in said set, each of said clauses in said set being one of a plurality of predefined types of clauses specifying expected criteria, said plurality of predefined types of clauses including at least one goal clause specifying an objective for said each tier and including at least one configuration clause specifying a data storage system configuration characteristic dependent on a data storage system resource used in connection with data storage for consumers of said each tier;

associating one or more data storage consumers with each of said one or more tiers;

associating a first set of data storage system resources with a first of said one or more tiers in accordance with a corresponding first definition for said first tier, said first so used when processing storage provisioning requests and I/O requests for data storage consumers associated with said first tier, wherein said first set of data storage system resources is selected in accordance with first expected criteria that is included in clauses of the first definition and that is prioritized based on first relative priorities associated with the clauses of the first definition, said first set of data storage system resources having actual characteristics in accordance with the first relative priorities and the first expected criteria;

periodically determining whether the first expected criteria are met; and

automatically adjusting the first set of data storage system resources in accordance with the first expected criteria and the first relative priorities if the first expected criteria are not met.

2. The method of claim 1, wherein said at least one goal clause includes at least one of a performance goal clause specifying an I/O performance goal, an availability goal clause specifying a level of availability, a protection clause specifying a recovery time objective, a protection clause specifying a recovery point objective, a cost clause specifying a data storage cost per unit of storage, and a power clause.

3. The method of claim 1, wherein said at least one configuration clause includes at least one of a utilization clause specifying a level of utilization of a data storage system component, a device type clause indicating a type of data storage device, a RAID type clause indicating a RAID level, and a replication clause indicating a data replication facility used to provide data replication.

4. The method of claim 1, wherein one of said data storage system consumers is an application, and said first definition is used in determining an amount of cache in the data storage system which is included in said first set for use in connection with processing I/O requests for the application.

7. The method of claim 2, wherein said at least one goal clause includes criteria specified using an absolute value or a term which represents one or more values.

8. The method of claim 7, wherein said criteria of said at least one goal clause includes a first term selected from a plurality of terms, each of said plurality of terms being associated with one or more numeric values.

5. A method of configuring resources of a data storage system comprising:

providing a definition for each of one or more tiers, each of said one or more tiers corresponding to a different class of consumer of data storage system resources, each of said one or more tiers having a different corresponding definition including a set of one or more clauses and a priority of each clause in said set relative to other clauses in said set, each of said clauses in said set being one of a plurality of predefined types of clauses, said plurality of predefined types of clauses including at least one goal clause specifying an objective for said each tier and including at least one configuration clause specifying a data storage system configuration characteristic dependent on a data storage system resource used in connection with data storage for consumers of said each tier;

associating one or more data storage consumers with each of said one or more tiers; and

associating a first set of data storage system resources with a first of said one or more tiers in accordance with a corresponding first definition for said first tier, said first set used when processing storage provisioning requests and I/O requests for data storage consumers associated with said first tier, and wherein, for each of said one or more tiers having a corresponding definition including a second set of one or more of said plurality of predefined types of clauses specifying expected criteria, periodically performing first processing for each consumer associated with said each tier, said, first processing including;

a) determining a relative priority of clauses in said second set; and

b) performing second processing for each of at least a portion of clauses in said second set, said second processing including;

b1) determining whether observed data associated with storage for said each consumer is in accordance with expected criteria of said each clause; and

b2) if said observed data is not in accordance with said expected criteria, determining one or more remediation actions.

6. The method of claim 5, wherein said determining one or more remediation actions further includes performing:

determining whether each of said remediation actions adversely impacts other clauses in the second set by violating expected criteria for said other clauses for said each consumer; and

selecting a best one of said remediation actions in accordance with selection criteria, said selection criteria including selecting a remediation action which is expected to cause said observed data for said each consumer to be in accordance with said expected criteria of said each clause, does not violate expected criteria of other clauses in said second set for said each consumer having a higher priority than said each clause, and has a minimum adverse impact on expected criteria of other clauses in said second set for said each consumer having a lower priority than said each clause.

9. The method of claim 6, wherein said second set of clauses includes a first clause specifying first criterion and a second clause specifying second criterion, and said remediation actions include a first option which violates the first criterion and does not violate the second criterion, and a second option which violates the second criterion and does not violate the first criterion.

10. The method of claim 9, wherein if said first clause has a higher priority than said second clause, said selecting one of said remediation actions selects said second option.

11. The method of claim 9, wherein if said first clause has a lower priority than said second clause, said selecting one of said remediation actions selects said first option.

12. The method of claim 6, wherein said second set includes a performance goal clause specifying an expected rate of I/O performance, a cost clause specifying a cost objective and a device clause specifying a physical device characteristic, said performance goal clause having a first priority, said cost clause having a second priority lower than said first priority, and said device clause having a third priority lower than said second priority, and wherein data for said each consumer is stored on a first device set of one or more devices, and said data storage system includes a second device set of one or more devices and a third device set of one or more devices, said second device set and said third device set having actual rates of I/O performance better than the expected rate of I/O performance, said second device set not violating said cost clause and violating said device clause, said third device set violating said cost clause and violating said device clause.

13. The method of claim 12, wherein remediation actions to increase the actual rate of I/O performance for said each consumer to meet the expected rate of I/O performance include:

increasing an amount of cache available for use by said each consumer, migrating a portion of data for said each consumer from said first device set to said second device set, and migrating a portion of data for said each consumer from said first device set to said third device set, and wherein, if it is determined that a portion of data for said each consumer should be migrated rather than increasing an amount of cache, said selecting one of said remediation actions causes a migration of a portion of data for said each consumer front said first device set to said second device set in accordance with said second set of clauses and associated relative priority of clauses in said second set.

18. The method of claim 6, wherein said selection criteria includes assessing, based on modeling implementation of a particular remediation action, whether implementation of the particular remediation action adversely impacts at least one of:

other clauses for said each consumer, oilier consumers in said each tier, and another tier of said one or more tiers.

14. A method of configuring resources of a data storage system comprising:

providing a definition for each of one or more tiers, each of said one or more tiers corresponding to a different class of consumer of data storage system resources, each of said one or more tiers having a different corresponding definition including a set of one or more clauses and a priority of each clause in said set relative to other clauses in said set, each of said clauses in said set being one of a plurality of predefined types of clauses, said plurality of predefined types of clauses including at least one goal clause specifying an objective for said each tier and including at least one configuration clause specifying a data storage system configuration characteristic dependent on a data storage system resource used in connection with data storage for consumers of said each tier;

associating one or more data storage consumers with each of said one or more tiers; and

associating a first set of data storage system resources with a first of said one or more tiers in accordance with a corresponding first definition for said first tier, said first set used when processing storage provisioning requests and I/O requests for data storage consumers associated with said first tier, and wherein said first set of data storage system resources is selected in accordance with clauses of said first definition and a relative priority of clauses of said first definition, said first set having actual characteristics in accordance with a prioritized set of expected characteristics and expected objectives, said expected characteristics specified in configuration clauses of said first definition to attain said expected objectives specified in goal clauses of said first definition, said expected characteristics and said expected objectives being prioritized in said prioritized set in accordance with the relative priority of clauses for said first definition.

15. The method of claim 14, wherein processing is automatically performed to adjust data storage system resources in said first set if observed data is not in accordance with said prioritized set for said first definition.

16. The method of claim 15, wherein at least one goal clause for said first definition identifies an expected objective dependent on one or more dynamic characteristics of the data storage system.

17. A method of configuring resources of a data storage system comprising:

providing a definition for each of one or more tiers, each of said one or more tiers corresponding to a different class of consumer of data storage system resources, each of said one or more tiers having a different corresponding definition including a set of one or more clauses and a priority of each clause in said set relative to other clauses in said set, each of said clauses in said set being one of a plurality of predefined types of clauses, said plurality of predefined types of clauses including at least one goal clause specifying an objective for said each tier and including at least one configuration clause specifying a data storage system configuration characteristic dependent on a data storage system resource used in connection with data storage for consumers of said each tier;

associating one or more data storage consumers with each of said one or more tiers; and

associating a first set of data storage system resources with a first of said one or more tiers in accordance with a corresponding first definition for said first tier, said first set used when processing storage provisioning requests and I/O requests for data storage consumers associated with said first tier, and wherein, for said first tier having said first definition including a second set of one or more of said plurality of predefined types of clauses specifying expected criteria, periodically performing first processing for each consumer associated with said first tier, said first processing including;

determining whether said expected criteria for each clause in the second set is met; and

if said expected criteria for each clause in the second set is not met, adjusting said first set of data storage system resources in accordance with said second set and a relative priority of clauses in said second set.

19. A computer readable medium comprising executable code stored thereon for configuring resources of a data storage system, the computer readable medium comprising executable code stored thereon for:

providing a definition for each of one or more tiers, each of said one or more tiers corresponding to a different class of consumer of data storage system resources, each of said one or more tiers having a different corresponding definition including a set of one or more clauses and a priority of each clause in said set relative to other clauses in said set, each of said clauses in said set being one of a plurality of predefined types of clauses specifying expected criteria, said plurality of predefined types of clauses including at least one goal clause specifying an objective for said each tier and including at least one configuration clause specifying a data storage system configuration characteristic dependent on a data storage system resource used in connection with data storage for consumers of said each tier;

associating one or more data storage consumers with each of said one or more tiers;

associating a first set of data storage system resources with a first of said one or more tiers in accordance with a corresponding first definition for said first tier, said first set used when processing storage provisioning requests and I/O requests for data storage consumers associated with said first tier, wherein said first set of data storage system resources is selected in accordance with first expected criteria that is included in clauses of the first definition and that is prioritized based on first relative priorities associated with the clauses of the first definition, said first set of data storage system resources having actual characteristics in accordance with the first relative priorities and the first expected criteria;

periodically determining whether the first expected criteria are met; and

automatically adjusting the first set of data storage system resources in accordance with the first expected criteria and the first relative priorities if the first expected criteria are not met.

20. The computer readable medium of claim 19, wherein said at least one goal clause includes at least one of a performance goal clause specifying an I/O performance goal, an availability goal clause specifying a level of availability, a protection clause specifying a recovery time objective, a protection clause specifying a recovery point objective, a cost clause specifying a data storage cost per unit of storage, and a power clause, and wherein said at least one configuration clause includes at least one of a utilization clause specifying a level of utilization of a data storage system component, a device type clause indicating a type of data storage device, a RAID type clause indicating a RAID level, and a replication clause indicating a data replication facility used to provide data replication.