Modular service level objective (SLO) subsystem for a network storage system

• US 8,700,806 B1
• Filed: 02/23/2011
• Issued: 04/15/2014
• Est. Priority Date: 02/23/2011
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Slik, David
• Primary Examiner(s): COULTER, KENNETH R
• Application Number:
  US13/033,531
• Time in Patent Office: 1,147 Days
• Field of Search: 709/249, 709220-223
• US Class Current: 709/249
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0646 Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 41/0813 characterised by the conditions triggering a change of settings
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A service level objective (SLO) subsystem that includes an SLO engine in a network storage system that allows new degrees of freedom to be added to the SLO subsystem, without requiring any modification of an associated SLO engine or the system'"'"'s existing SLOs, and without requiring the SLO engine to have any a priori knowledge of the new degrees of freedom. In certain embodiments, the system has a modular design which includes the SLO engine and one or more SLO modules that interface with the SLO engine. Each SLO module corresponds to a different degree of freedom. Each SLO module evaluates SLO compliance and determines what specific action(s) within its corresponding degree of freedom should be taken to comply with an SLO.

Claims

1. A service level objective (SLO) engine comprising:

an interface by which the SLO engine can communicate with a plurality of modules that are functionally distinct from each other and the SLO engine, each of the modules designed to evaluate a different one of a plurality of degrees of freedom of a data storage system in relation to any specified SLO and to produce a corresponding result; and

a compliance unit to determine, based on the results produced by the modules, one or more operations to perform on the data storage system in one or more of the plurality of degrees of freedom to increase a degree to which a specified SLO is satisfied;

wherein the compliance unit is configured to determine the one or more operations to perform on the data storage system by executing a process that includes;

ranking the results from the modules; and

selecting a proposed layout in one of the ranked results to apply to the data storage system.

2. An SLO engine as recited in claim 1, wherein the interface enables the SLO engine to communicate with an arbitrary number of said modules, where each of the modules is designed to evaluate a different degree of freedom in relation to an arbitrary SLO.

3. An SLO engine as recited in claim 2, wherein the result produced by each of the modules includes a proposed layout.

4. An SLO engine as recited in claim 3, wherein the result produced by each of the modules includes an indication of a degree to which the proposed layout will satisfy the specified SLO.

5. An SLO engine as recited in claim 4, wherein the indication comprises an SLO value associated with the proposed layout.

6. An SLO engine as recited in claim 3, wherein the result produced by each of the modules further includes a steady-state cost and a transition cost associated with the proposed layout.

7. An SLO engine as recited in claim 1, wherein the compliance unit causes a plurality of proposed layouts received from the modules to be processed iteratively by the plurality of modules to converge towards an optimal layout and ranking.

8. An SLO engine as recited in claim 1, wherein the interface is configured to provide to each of the modules SLO data indicative of the specified SLO and a current layout of the data storage system.

9. An SLO engine as recited in claim 1, wherein at least one module of the plurality of modules is from the group consisting of:

a data mirroring module to control data mirroring in relation to a specified SLO;

a data placement module to control data placement in relation to a specified SLO;

a namespace placement module to control data access in relation to a specified SLO;

a data replication module to control data replication in relation to a specified SLO;

a data caching module to control data caching in relation to a specified SLO;

a data transformation module to control data transformation, including encryption or compression or both, in relation to a specified SLO; and

a data dispersion module to control geographic dispersion of data in relation to a specified SLO.

10. A service level objective (SLO) subsystem for use in a data storage system, the SLO subsystem comprising:

a database to store SLO data defining an SLO; and

an SLO engine to implement a first degree of freedom according to the SLO by performing a first defined operation in the data storage system responsive to the SLO data, the SLO subsystem being configurable to implement, without requiring modification of the SLO engine or the SLO, a new degree of freedom associated with a second operation that is performable in the data storage system responsive to the SLO, wherein the SLO engine has no knowledge of the new degree of freedom or the new operation before the SLO subsystem is configured to provide the new degree of freedom, the SLO engine including an interface capable of communicating with an arbitrary number of external modules, each of which is designed to evaluate a different degree of freedom in relation to any arbitrary SLO.

11. An SLO subsystem as recited in claim 10, wherein each said module is designed independently of the arbitrary SLO.

12. An SLO subsystem as recited in claim 10, wherein each said module is configured to:

input data indicative of a specified SLO and a current layout of the data storage system;

apply the data to a function that represents a relationship between an SLO characteristic and a degree of freedom represented by the module, to determine an output set that indicates a proposed layout and an SLO value for the proposed layout; and

provide the output set to the SLO engine.

13. An SLO subsystem as recited in claim 12, wherein the output set further includes a steady-state cost and a transition cost associated with the proposed layout.

14. An SLO subsystem as recited in claim 13, wherein the SLO engine is configured to receive the output set from each of a plurality of said modules, and to determine, based on the output sets from the plurality of said modules, an action designed to increase the overall degree to which the SLO is satisfied.

15. An SLO subsystem as recited in claim 10, wherein the new degree of freedom is from the group consisting of:

data mirroring;

data placement;

data access control;

data replication;

data caching;

data transformation; and

data geographic dispersion.

16. A processing system comprising:

a processor;

a memory coupled to the processor;

a plurality of modules, each representing a different degree of freedom of a data storage system; and

an SLO engine, operatively coupled to but functionally distinct from each of the modules, to provide to each of the modules SLO data indicating a desired SLO for the data storage system and state data representing a current state of data stored in the data storage system, to receive from each of the modules a separate output array that includes a proposed layout and an SLO value associated with the proposed layout, the SLO engine including an interface capable of communicating with an arbitrary number of external modules, each of which is designed to evaluate a different degree of freedom in relation to any arbitrary SLO.

17. A processing system as recited in claim 16, wherein the SLO value received from each of the modules represents a degree to which the proposed layout will satisfy an SLO characteristic in a degree of freedom represented by the corresponding module.

18. A processing system as recited in claim 17, wherein the SLO engine further is to select, based on the output values, a proposed layout to apply to the data storage system to increase the degree to which the desired SLO is satisfied.

19. A processing system as recited in claim 16, wherein each of the plurality of modules is designed to evaluate a particular degree of freedom in relation to an arbitrary SLO.

20. A processing system as recited in claim 16, wherein at least one module of the plurality of modules is from the group consisting of:

a data mirroring module to control data mirroring in relation to a specified SLO;

a namespace placement module to control data access in relation to a specified SLO;

a data placement module to control data placement in relation to a specified SLO;

a data replication module to control data replication in relation to a specified SLO;

a data caching module to control data caching in relation to a specified SLO;

a data transformation module to control data transformation, including compression or encryption or both, in relation to a specified SLO; and

a data dispersion module to control geographic dispersion of data in relation to a specified SLO.

21. A method comprising:

operating a service level objective (SLO) engine in a data storage system to implement a first degree of freedom, by performing an operation of a first type in the data storage system responsive to a defined SLO; and

enabling the SLO engine to implement a new degree of freedom associated with an operation of a second type performable in the data storage system responsive to the defined SLO, by operatively coupling a functional module to the SLO engine, the functional module corresponding to the second degree of freedom and the operation of the second type, wherein the functional module is designed with specific knowledge of the second degree of freedom but with no knowledge of the SLO and is designed to evaluate the second degree of freedom in relation to any arbitrary SLO, wherein the SLO engine has no knowledge of the second degree of freedom or the operation of the second type prior to when the functional module is operatively coupled to the SLO engine.

22. A method as recited in claim 21, wherein the second degree of freedom is from the group consisting of:

data mirroring;

data placement;

data access control;

data replication;

data caching;

data transformation; and

data geographic dispersion.

23. A method comprising:

providing, to each of a plurality of functional modules, service level objective (SLO) data indicative of a specified SLO for a data storage system and state data indicative of a current state of the data storage system, each of the functional modules corresponding to a different one of a plurality of degrees of freedom, each of the functional modules configured to apply the SLO data and the state data to a function that represents a particular relationship between an SLO characteristic and the corresponding degree of freedom, wherein each of the functional modules is designed with specific knowledge of the degree of freedom but with no knowledge of the SLO and is designed to evaluate the degree of freedom in relation to any arbitrary SLO;

receiving from each said functional module an output set that includes a layout for the data storage system and an indication of a degree to which the layout will satisfy the specified SLO; and

selecting a layout to apply to the data storage system based on the output sets from the plurality of functional modules.

24. A method as recited in claim 23, wherein the indication received from each said functional module represents a degree to which the corresponding layout will satisfy an SLO characteristic in a degree of freedom represented by the corresponding functional module.

25. A method as recited in claim 24, wherein selecting a layout to apply to the data storage system comprises:

ranking the layouts received from the plurality of functional modules; and

selecting one of the ranked layouts to apply to the data storage system.

26. A method as recited in claim 24, wherein the layouts received from the plurality of functional modules are iteratively processed multiple times by the plurality of functionality modules to converge towards an optimal layout and ranking.

27. A method as recited in claim 23, wherein each of the plurality of functional modules is designed independently of the specified SLO.

28. A method as recited in claim 23, wherein at least one degree of freedom from the plurality of degrees of freedom is from the group consisting of:

data mirroring;

data placement;

data access control;

data replication;

data caching;

data transformation; and

data geographic dispersion.