TECHNIQUES FOR DYNAMICALLY ALLOCATING RESOURCES IN A STORAGE CLUSTER SYSTEM

• US 20180109467A1
• Filed: 11/22/2017
• Published: 04/19/2018
• Est. Priority Date: 02/27/2015
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Miller, Evan
• Granted Patent: US 10,536,396 B2
• Time in Patent Office: Days
• CPC Class Codes: H04L 47/225 Determination of shaping rate, e.g. using a moving window
• CPC Class Codes: H04L 47/805 QOS or priority aware
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

Various embodiments are directed to techniques for dynamically adjusting a maximum rate of throughput for accessing data stored within a volume of storage space of a storage cluster system based on the amount of that data that is stored within that volume. An apparatus includes an access component to monitor an amount of client data stored within a volume defined within a storage device coupled to a first node, and to perform a data access command received from a client device via a network to alter the client data stored within the volume; and a policy component to limit a rate of throughput at which at least the client data within the volume is exchanged as part of performance of the data access command to a maximum rate of throughput, and to calculate the maximum rate of throughput based on the stored amount.

Claims

1. A computing device comprising:

a memory containing a storage medium comprising instructions for performing a method; and

a processor coupled to the memory, the processor configured to execute the instructions to cause the processor to;

translate a request for storage services received from a client device into a data access command associated client data;

translate between a first protocol employed in a first exchange of the client data between a first node and the client device and a second protocol employed in a second exchange of the client data between the first node and a first storage device to implement the data access command upon a first volume of the first storage device; and

limit a rate of throughput of the first exchange.

2. The computing device of claim 1, wherein the instructions cause the processor to:

limit a rate of throughput of the second exchange.

3. The computing device of claim 1, wherein the instructions cause the processor to:

calculate a first maximum rate of throughput based on a first amount of client data stored within the first volume of the first storage device coupled to the first node of a storage cluster system.

4. The computing device of claim 3, wherein the instructions cause the processor to:

limit the rate of throughput of the first exchange based upon the first maximum rate of throughput.

5. The computing device of claim 1, wherein the instructions cause the processor to:

transmit a replica of the data access command to a second node to enable performance of the replica by the second node to alter client data stored within a second volume within a second storage device coupled to the second node at least partially in parallel with the performance of the data access command, the performances of the data access command and the replica to cause the client data stored within the second volume to mirror the client data stored within the first volume.

6. The computing device of claim 1, wherein the instructions cause the processor to:

reduce duplicate portions of the client data stored within the first volume to enable an increase in a first amount of client data stored within the first volume beyond a limit imposed by a storage capacity specified for the first volume.

7. The computing device of claim 6, wherein the instructions cause the processor to:

calculate a first maximum rate of throughput based on the first amount of client data stored within the first volume of the first storage device coupled to the first node of a storage cluster system;

compare the first maximum rate of throughput to an upper limit rate of throughput specified for the first volume;

determine that the first maximum rate of throughput exceeds the upper limit rate of throughput; and

determine whether to reduce the first maximum rate of throughput to the upper limit rate of throughput based on whether the first maximum rate of throughput combined with at least a second maximum rate of throughput exceeds an overall limit on rate of throughput imposed by at least one component of the first node, the second maximum rate of throughput based on at least a second amount of client data stored within a second volume defined within the first storage device.

8. The computing device of claim 3, wherein the instructions cause the processor to:

limit a rate of throughput of the second exchange based upon the first maximum rate of throughput.

9. A computer-implemented method comprising:

translating a request for storage services received from a client device into a data access command associated client data;

translating between a first protocol employed in a first exchange of the client data between a first node and the client device and a second protocol employed in a second exchange of the client data between the first node and a first storage device to implement the data access command upon a first volume of the first storage device; and

limiting a rate of throughput of the first exchange.

10. The computer-implemented method of claim 9, comprising:

limiting a rate of throughput of the second exchange.

11. The computer-implemented method of claim 9, comprising:

calculating a first maximum rate of throughput based on a first amount of client data stored within the first volume of the first storage device coupled to the first node of a storage cluster system.

12. The computer-implemented method of claim 11, comprising:

limiting the rate of throughput of the first exchange based upon the first maximum rate of throughput.

13. The computer-implemented method of claim 11, comprising:

recurringly calculating the first maximum rate of throughput in response to passage of a recurring interval of time.

14. The computer-implemented method of claim 12, comprising:

transmitting a replica of the data access command to a second node to enable performance of the replica by the second node to alter client data stored within a second volume within a second storage device coupled to the second node at least partially in parallel with the performance of the data access command, the performances of the data access command and the replica to cause the client data stored within the second volume to mirror the client data stored within the first volume.

15. The computer-implemented method of claim 9, comprising:

reducing duplicate portions of the client data stored within the first volume to enable an increase in a first amount of client data stored within the first volume beyond a limit imposed by a storage capacity specified for the first volume.

16. A non-transitory machine-readable storage medium comprising instructions that when executed by a machine, cause the machine to:

translate a request for storage services received from a client device into a data access command associated client data;

translate between a first protocol employed in a first exchange of the client data between a first node and the client device and a second protocol employed in a second exchange of the client data between the first node and a first storage device to implement the data access command upon a first volume of the first storage device; and

limit a rate of throughput of the first exchange.

17. The non-transitory machine-readable storage medium of claim 16, wherein the instructions cause the machine to:

calculate a first maximum rate of throughput based on a first amount of client data stored within the first volume of the first storage device coupled to the first node of a storage cluster system.

18. The non-transitory machine-readable storage medium of claim 17, wherein the instructions cause the machine to:

limit the rate of throughput of the first exchange based upon the first maximum rate of throughput.

19. The non-transitory machine-readable storage medium of claim 16, wherein the instructions cause the machine to:

limit a rate of throughput of the second exchange.

20. The non-transitory machine-readable storage medium of claim 16, wherein the instructions cause the machine to:

transmit a replica of the data access command to a second node to enable performance of the replica by the second node to alter client data stored within a second volume within a second storage device coupled to the second node at least partially in parallel with the performance of the data access command, the performances of the data access command and the replica to cause the client data stored within the second volume to mirror the client data stored within the first volume.