WORKLOAD MANAGEMENT IN A GLOBAL RECYCLE QUEUE INFRASTRUCTURE

• US 20170060753A1
• Filed: 08/28/2015
• Published: 03/02/2017
• Est. Priority Date: 08/28/2015
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: DENZ, Peter, Wyckoff, Peter, Curtis-Maury, Matthew
• Granted Patent: US 9,996,470 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 12/0871 Allocation or management of cache space
• CPC Class Codes: G06F 12/0875 with dedicated cache, e.g. instruction or stack
• CPC Class Codes: G06F 12/0893 Caches characterised by their organisation or structure
• CPC Class Codes: G06F 2212/314 In storage network, e.g. network attached cache
• CPC Class Codes: G06F 2212/452 Instruction code
• CPC Class Codes: G06F 2212/604 Details relating to cache allocation

Abstract

Presented herein are methods, non-transitory computer readable media, and devices for integrating a workload management scheme for a file system buffer cache with a global recycle queue infrastructure. Methods for allocating a certain portion of the buffer cache without physically partitioning the buffer resources are disclosed which include: identifying a workload from a plurality of workloads; allocating the buffer cache in the data storage network for usage by the identified workload; tagging a buffer from within the buffer cache with a workload identifier and track each buffer; determining if the workload is exceeding its allocated buffer cache; and wherein determining the workload is exceeding its allocated percentage of buffer cache, enabling the workload'"'"'s exceeded buffer to be available to scavenge; determining if the workload is exceeding a soft-limit on the allowable usage of the buffer cache, and wherein determining the workload is exceeding its soft-limit, degrading the prioritization of subsequent buffers, preventing the workload from thrashing out buffers of other workloads.

Claims

1. A method for integrating a workload management scheme for a buffer cache in a data storage system with a recycle queue infrastructure, the method comprising:

identifying, by a storage server, a workload from a plurality of workloads;

allocating at least a portion of the buffer cache in the data storage system to the identified workload;

establishing a soft-limit on allowable usage above which additional usage is degraded;

determining if the identified workload is exceeding its allocated buffer cache; and

if the identified workload is exceeding its allocated buffer cache, by an excess, making at least a portion of the excess amount available for scavenging.

2. The method of claim 1, further comprising storing the workload identifier within data of each buffer.

3. The method of claim 1, further comprising tagging a buffer from within the buffer cache with a workload identifier and track each buffer.

4. The method of claim 1, wherein the identifying the workload from a plurality of workloads comprises identifying the workload based on at least one parameter that includes:

a stored policy;

a set of rules; and

a corresponding client device.

5. The method of claim 1, wherein allocating at least a portion of the buffer cache in the data storage network comprises allocating at least one parameter that includes:

a specific data size, and a percentage of buffer cache in the data storage system.

6. The method of claim 1, wherein allocating at least a portion of the buffer cache in the data storage system comprises allocating the buffer cache either based on at least one parameter that includes:

a subscription;

prior use; and

prior performance.

7. A non-transitory machine-readable medium having stored thereon instructions for performing a method comprising machine executable code which when executed by at least one machine, causes the machine to:

identify a workload from a plurality of workloads;

allocate at least a portion of the buffer cache in the data storage system to the identified workload;

establishing a soft-limit on allowable usage above which additional usage is degraded;

determine if the identified workload is exceeding its allocated buffer cache; and

if the identified workload is exceeding its allocated buffer cache, by an excess, make at least a portion of the excess amount available for scavenging.

8. The non-transitory computer readable medium of claim 7, wherein the machine is further configured to store the workload identifier within data of each buffer.

9. The non-transitory computer readable medium of claim 7, wherein the machine is further configured to tag a buffer from within the buffer cache with a workload identifier and track each buffer.

10. The non-transitory computer readable medium of claim 7, wherein the machine is configured to identify the workload based on at least one parameter that includes:

a stored policy;

a set of rules; and

a corresponding client device.

11. The non-transitory computer readable medium of claim 7, wherein the machine is configured to allocate at least a portion of the buffer cache in the data storage network based on at least one parameter that includes:

a specific data size, and a percentage of buffer cache in the data storage system.

12. The non-transitory computer readable medium of claim 7, wherein the machine is configured to allocate at least a portion of the buffer cache in the data storage network based on at least one parameter that includes:

a subscription;

prior use; and

prior performance.

13. A computing device, comprising:

a memory containing machine readable medium comprising machine executable code having stored thereon instructions for performing a method of integrating a workload management scheme for a buffer cache in a data storage system with a recycle queue infrastructure;

a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to;

identify a workload from a plurality of workloads;

allocate at least a portion of the buffer cache in the data storage system to the identified workload;

establishing a soft-limit on allowable usage above which additional usage is degraded;

determine if the identified workload is exceeding its allocated buffer cache; and

if the identified workload is exceeding its allocated buffer cache, by an excess, make at least a portion of the excess amount available for scavenging.

14. The computing device of claim 13, wherein the processor is further configured to store the workload identifier within data of each buffer.

15. The computing device of claim 13, wherein the processor is further configured to tag a buffer from within the buffer cache with a workload identifier and track each buffer.

16. The computing device of claim 13, wherein the processor is configured to identify the workload based on at least one parameter that includes:

a stored policy;

a set of rules; and

a corresponding client device.

17. The computing device of claim 13, wherein the processor is configured to allocate at least a portion of the buffer cache in the data storage network based on at least one parameter that includes:

a specific data size, and a percentage of buffer cache in the data storage system.

18. The computing device of claim 13, wherein the processor is configured to allocate at least a portion of the buffer cache in the data storage network based on at least one parameter that includes:

a subscription;

prior use; and

prior performance.