Dynamic throttling of scan requests for multiple scanners a cluster of nodes

• US 9,832,224 B2
• Filed: 06/02/2015
• Issued: 11/28/2017
• Est. Priority Date: 03/30/2015
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Murugesan, Kumar, Singh, Mankawal Deep, Muhlestein, Mark
• Primary Examiner(s): Lemma, Samson
• Application Number:
  US14/728,564
• Publication Number:
  US 20160294853A1
• Time in Patent Office: 910 Days
• Field of Search: 726 24
• CPC Class Codes: H04L 63/1425 Traffic logging, e.g. anomaly detection
• CPC Class Codes: H04L 63/1458 Denial of Service

Abstract

Techniques for dynamic throttling of scan requests for multiple scanners in a cluster of nodes are described. An apparatus may comprise a dynamic throttling service component for executing the dynamic throttling of scan requests for the multiple scanners in the cluster of nodes. The dynamic throttling service component operative to estimate, by the scanner proxy, a resource limit count value representative of resource capacity for servicing scan requests for each one of the multiple scanners in the cluster of nodes; detect a first scan request exceeds the resource limit count value for a first scanner; dynamically throttle each subsequent scan request for the first scanner in response to the first scan request exceeding the resource limit count value; and revise the resource limit count value, by the scanner proxy, for the first scanner.

Claims

1. A computer-implemented method, implemented using a processor circuit, comprising:

estimating a resource limit count value representative of a resource capacity for

servicing scan requests for one or more of multiple scanners in a cluster of nodes;

detecting a first scan request exceeds the resource limit count value for a first scanner;

dynamically throttling each subsequent scan request for the first scanner in response to the first scan request exceeding the resource limit count value; and

revising the resource limit count value for the first scanner without discarding the first scan request and each subsequent scan request, wherein revising the resource limit count value for the first scanner comprises;

decreasing the resource limit count value for the first scanner when the first scan request exceeds the resource limit count value;

increasing the resource limit count value for the first scanner following a predetermined time period in which multiple scan requests do not exceed the resource limit count value;

reserve the first scanner for the first scan request;

issue a performance status for the first scanner in response to a scanner proxy requesting a reservation of the first scanner for the first scan request;

apply the dynamic throttling in response to failing to reserve the first scanner for the first scan request; and

forward the first scan request, by the processor circuit, to a second scanner over a computer network.

2. The method of claim 1, comprising revising the resource limit count value for each one of the multiple scanners in the cluster of nodes at a predetermined time period to increase or decrease a current number of outstanding scan requests.

3. The method of claim 1, comprising setting the resource limit count value for the first scanner equal to the current number of outstanding scan requests in response to the first scan request exceeding the resource limit count value.

4. The method of claim 1, comprising issuing a performance status for the first scanner.

5. The method of claim 1, comprising:

maintaining the current number of outstanding scan requests for the first scanner;

increasing the current number of outstanding scan requests for the first scanner in response to increasing the resource limit count value;

or

decreasing the current number of outstanding scan requests for the first scanner in response to decreasing the resource limit count value.

6. An apparatus, comprising:

a processor circuit; and

a dynamic throttling service component for execution by the processor circuit to dynamically throttle scan requests for multiple scanners in a cluster of nodes, the dynamic throttling service component configured to;

estimate a resource limit count value representative of resource capacity to service scan requests for one or more of the multiple scanners in the cluster of nodes,

detect when a scan request exceeds the resource limit count value for a scanner, dynamically throttle each subsequent scan request for the scanner in response to the scan request that exceeds the resource limit count value, and

revise the resource limit count value for the scanner without discarding the first scan request and each subsequent scan request, wherein revising the resource limit count value for the first scanner comprises;

decrease the resource limit count value for the first scanner when the first scan request exceeds the resource limit count value;

increase the resource limit count value for the first scanner following a predetermined time period in which multiple scan requests do not exceed the resource limit count value;

reserve the first scanner for the first scan request;

issue a performance status for the first scanner in response to a scanner proxy requesting a reservation of the first scanner for the first scan request;

apply the dynamic throttling in response to failing to reserve the first scanner for the first scan request;

and forward the first scan request, by the processor circuit, to a second scanner over a computer network.

7. The apparatus of claim 6, the dynamic throttling service component to revise the resource limit count value for each one of the multiple scanners in the cluster of nodes at a predetermined time period to increase or decrease a current number of outstanding scan requests.

8. The apparatus of claim 6, the dynamic throttling service component operative to set the resource limit count value for the scanner equal to the current number of outstanding scan requests in response to the scan request exceeding the resource limit count value.

9. The apparatus of claim 6, the dynamic throttling service component operative to issue a performance status for the scanner.

10. The apparatus of claim 6, the dynamic throttling service component operative to:

maintain the current number of outstanding scan requests for the scanner;

increase the current number of outstanding scan requests for the scanner in response to increasing the resource limit count value;

or

decrease the current number of outstanding scan requests for the scanner in response to decreasing the resource limit count value.

11. At least one non-transitory computer-readable storage medium comprising instructions that, when executed, by a processor circuit, cause a system to:

estimate a resource limit count value representative of a resource capacity for servicing scan requests for one or more of multiple scanners in a cluster of nodes;

detect a first scan request exceeds the resource limit count value for a first scanner;

dynamically throttle each subsequent scan request for the first scanner in response to the first scan request exceeding the resource limit count value; and

revise the resource limit count value for the first scanner without discarding the first scan request and each subsequent scan request, wherein revising the resource limit count value for the first scanner comprises;

decrease the resource limit count value for the first scanner when the first scan request exceeds the resource limit count value;

increase the resource limit count value for the first scanner following a predetermined time period in which multiple scan requests do not exceed the resource limit count value;

reserve the first scanner for the first scan request;

issue a performance status for the first scanner in response to a scanner proxy requesting a reservation of the first scanner for the first scan request;

apply the dynamic throttling in response to failing to reserve the first scanner for the first scan request; and

forward the first scan request, by the processor circuit, to a second scanner over a computer network.

12. The computer-readable storage medium of claim 11, comprising further instructions that, when executed, cause a system to revise the resource limit count value for each one of the multiple scanners in the cluster of nodes at a predetermined time period for one of increasing or decreasing a current number of outstanding scan requests.

13. The computer-readable storage medium of claim 11, comprising further instructions that, when executed, cause a system to set the resource limit count value for the first scanner equal to the current number of outstanding scan requests in response to the first scan request exceeding the resource limit count value.

14. The computer-readable storage medium of claim 11, comprising further instructions that, when executed, cause a system to:

maintain the current number of outstanding scan requests for the first scanner;

increase the current number of outstanding scan requests for the first scanner in response to increasing the resource limit count value; and

decrease the current number of outstanding scan requests for the first scanner in response to decreasing the resource limit count value.