Extensible mechanisms for workload shaping and anomaly mitigation

• US 10,454,843 B2
• Filed: 10/08/2014
• Issued: 10/22/2019
• Est. Priority Date: 10/09/2013
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Valbuena, Fabio Meireles
• Primary Examiner(s): Chea, Philip J
• Assistant Examiner(s): McAdams, Robert B
• Application Number:
  US14/509,694
• Publication Number:
  US 20150100698A1
• Time in Patent Office: 1,840 Days
• CPC Class Codes: H04L 41/5051 Service on demand, e.g. definition and deployment of services in real time
• CPC Class Codes: H04L 47/76 using dynamic resource allocation, e.g. in-call renegotiation requested by the user or requested by the network in response to changing network conditions

Abstract

Techniques and mechanisms for servicing requests for utilization of resources within a computing environment. A request is received from a remote electronic computing device with a regulator agent. The regulator functions to determine whether to regulate a request or to allow the request to be delivered without regulation. Regulating the request includes causing the request to be rejected, re-routed, isolated or delayed. Selectively regulating the request with the regulator based at least on application-level resources to be utilized by the application server in response to the request. Sending the request to a regulation server or to a computing device to provide an application server communicatively coupled with the regulator server depending on the regulation to be performed, if any.

Claims

1. A system for servicing requests for utilization of resources within a computing environment, the system comprising:

a regulator to receive a request from a remote electronic computing device, the request to utilize resources of at least one computing device within the computing environment, the regulator to determine in real time and at an application level whether to regulate a request or to allow the request to be delivered without regulation, wherein regulating the request comprises causing the request to be one of rejected, re-routed, isolated and delayed based on at least one of a specific organization, user, request performance trait, and target node data source, wherein the regulator makes the determination at the application level based on a resource cost analysis and whether the request represents an anomaly with respect to requests in a request stream;

a computing device to provide an application server communicatively coupled with the regulator, the computing device having resources to generate a response to the request and to cause the response to be transmitted to the remote electronic computing device;

wherein the regulator selectively regulates the request in real time based on application-level resources to be utilized by the application server in response to the request by analyzing the request prior to delivery to the application server, wherein the selective regulation at least routes requests to consume excessive portions of a resource class to a queue for subsequent service at a controlled rate, wherein the selective regulation further comprises filtering to select among incoming requests and an action that determines a handling behavior based on the requests that satisfies the filter predicates;

wherein the regulator receives application-level feedback information from one or more application servers configured to process requests to modify subsequent request filtering based, at least in part, on the application-level feedback information.

2. The system of claim 1 where re-routing the request comprises enqueuing one or more requests and dispatching requests at a pre-selected rate.

3. The system of claim 1 where re-routing the request comprises enqueuing one or more requests and maintaining a pre-selected number of concurrent requests.

4. The system of claim 1 wherein isolating the request comprises causing the request to be isolated to be directed to a computing device having a isolation mechanism to isolate the request from the application server.

5. The system of claim 1 further comprising a plurality of application servers coupled with the regulator.

6. The system of claim 5 further comprising a plurality of regulators coupled with the plurality of application servers, wherein the plurality of regulators coordinate regulation of requests.

7. The system of claim 1 wherein the regulator determines a regulation action based on at least one filter and at least one corresponding action, wherein the at least one filter determines what class of request attributes and features to select among incoming requests and wherein the action determines what regulation action is to be performed to satisfy the at least one filter.

8. The system of claim 1 wherein the regulator utilizes real-time and historic metrics from a plurality of resource classes of the application server to identify and classify usage patterns.

9. The system of claim 1 wherein the regulator operates within a multi-tenant on-demand services environment and the regulator provides regulation of the requests based at least on organization, user, request performance traits or data source.

10. A non-transitory computer-readable medium having instructions stored thereon that, when executed, cause one or more processors to servicing requests for utilization of resources within a computing environment, the instructions comprising instructions to cause the processors to:

receive, with a regulator agent, a request from a remote electronic computing device, the request to utilize resources of at least one computing device within the computing environment, the regulator to determine whether to regulate a request or to allow the request to be delivered without regulation, wherein regulating the request comprises causing the request to be one of rejected, re-routed, isolated and delayed based on at least one of a specific organization, user, request performance trait, and target node data source, wherein the regulator makes the determination at the application level based on a resource cost analysis and whether the request represents an anomaly with respect to requests in a request stream;

provide, with a computing device, an application server communicatively coupled with the regulator, the computing device having resources to generate a response to the request and to cause the response to be transmitted to the remote electronic computing device;

wherein the regulator selectively regulates the request based on application-level resources to be utilized by the application server in response to the request by analyzing the request prior to delivery to the application server, wherein the selective regulation at least routes requests to consume excessive portions of a resource class to a queue for subsequent service at a controlled rate, wherein the selective regulation further comprises filtering to select among incoming requests and an action that determines a handling behavior based on the requests that satisfies the filter predicates;

wherein the regulator receives application-level feedback information from one or more application servers configured to process requests to modify subsequent request filtering based, at least in part, on the application-level feedback information.

11. The non-transitory computer-readable medium of claim 10 wherein the instructions to cause re-routing of the request comprise instructions that, when executed, cause the one or more processors to enqueue one or more requests and dispatching requests at a pre-selected rate.

12. The non-transitory computer-readable medium of claim 10 wherein the instructions to cause re-routing of the request comprise instructions that, when executed, cause the one or more processors to enqueue one or more requests and maintaining a pre-selected number of concurrent requests.

13. The non-transitory computer-readable medium of claim 10 wherein the instructions to cause isolating of the request comprise instructions that, when executed cause the one or more processors to cause the request to be isolated to be directed to a computing device having an isolation mechanism to isolate the request from the application server.

14. The non-transitory computer-readable medium of claim 10 further comprising instructions that, when executed, cause a plurality of regulators coupled with the plurality of application servers to coordinate regulation of requests.

15. The non-transitory computer-readable medium of claim 10 wherein the regulator determines a regulation action based on at least one filter and at least one corresponding action, wherein the at least one filter determines what class of request attributes and features to select among incoming requests and wherein the action determines what regulation action is to be performed to satisfy the at least one filter.

16. The non-transitory computer-readable medium of claim 10 wherein the regulator utilizes real-time and historic metrics from a plurality of resource classes of the application server to identify and classify usage patterns.

17. The non-transitory computer-readable medium of claim 10 wherein the regulator operates within a multi-tenant on-demand services environment and the regulator provides regulation of the requests based at least on organization, user, request performance traits or data source.

18. A method for servicing requests for utilization of resources within a computing environment, the method comprising:

receiving, with a regulator agent, a request from a remote electronic computing device, the request to utilize resources of at least one computing device within the computing environment, the regulator to determine whether to regulate a request or to allow the request to be delivered without regulation, wherein regulating the request comprises causing the request to be one of rejected, re-routed, isolated and delayed based on at least one of a specific organization, user, request performance trait, and target node data source, wherein the regulator makes the determination at the application level based on a resource cost analysis and whether the request represents an anomaly with respect to requests in a request stream;

providing, with a computing device, an application server communicatively coupled with the regulator, the computing device having resources to generate a response to the request and to cause the response to be transmitted to the remote electronic computing device;

wherein the regulator selectively regulates the request based on application-level resources to be utilized by the application server in response to the request by analyzing the request prior to delivery to the application server, wherein the selective regulation at least routes requests to consume excessive portions of a resource class to a queue for subsequent service at a controlled rate, wherein the selective regulation further comprises filtering to select among incoming requests and an action that determines a handling behavior based on the requests that satisfies the filter predicates;

wherein the regulator receives application-level feedback information from one or more application servers configured to process requests to modify subsequent request filtering based, at least in part, on the application-level feedback information.

19. The method of claim 18 where re-routing the request comprises enqueuing one or more requests and dispatching requests at a pre-selected rate.

20. The method of claim 18 where re-routing the request comprises enqueuing one or more requests and maintaining a pre-selected number of concurrent requests.

21. The method of claim 18 wherein isolating the request comprises causing the request to be isolated to be directed to a computing device having a isolation mechanism to isolate the request from the application server.

22. The method of claim 21 further comprising a plurality of regulators coupled with the plurality of application servers, wherein the plurality of regulators coordinate regulation of requests.

23. The method of claim 22 wherein the regulator determines a regulation action based on at least one filter and at least one corresponding action, wherein the at least one filter determines what class of request attributes and features to select among incoming requests and wherein the action determines what regulation action is to be performed to satisfy the at least one filter.

24. The method of claim 18 wherein the regulator utilizes real-time and historic metrics from a plurality of resource classes of the application server to identify and classify usage patterns.

25. The method of claim 18 wherein the regulator operates within a multi-tenant on-demand services environment and the regulator provides regulation of the requests based at least on organization, user, request performance traits or data source.