SYSTEMS AND TECHNIQUES FOR UTILIZING RESOURCE AWARE QUEUES AND/OR SERVICE SHARING IN A MULTI-SERVER ENVIRONMENT

• US 20160080273A1
• Filed: 11/30/2015
• Published: 03/17/2016
• Est. Priority Date: 12/10/2010
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Yang, Ronald, Devadhar, Vijayanth, Cheenath, Manoj
• Granted Patent: US 10,452,997 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 2209/5019 Workload prediction
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

Systems and techniques for utilizing resource aware queues and/or service sharing in a multi-server environment. Requests directed to an application server are received into one or more queues in front of the application server. An acknowledgement of the requests is provided in response to the requests being received by the one or more queues. Metadata associated with the requests is utilized to manage the one or more queues. The requests from the one or more queues are processed based on the metadata.

Claims

1. A method for servicing requests in an environment having multiple application servers each having one or more queues to store at least indications of requests to be serviced by the application servers, the method comprising:

determining, with one or more processors corresponding to the multiple application servers, a utilization level for a first application server of the multiple application servers;

comparing, with the one or more processors, the utilization level to a pre-selected utilization threshold level;

determining, with the one or more processors, whether to service requests allocated to other application servers in response to the comparing;

servicing, with the one or more processors, at least one request allocated to a second application server.

2. The method of claim 1 wherein the utilization level is based, at least in part on one or more of queue depth, queue processing time, bandwidth utilization, processor utilization, and memory utilization.

3. The method of claim 1 further comprising:

analyzing, with the one or more processors, one or more queue parameters for the second application server; and

selectively servicing, with the one or more processors, requests allocated to the second application server based on the analysis.

4. The method of claim 1 wherein the application servers are part of a multitenant database environment that stores data for multiple client entities each identified by a tenant identifier (ID) having one of one or more users associated with the tenant ID, wherein users of each of multiple client entities can only access data identified by a tenant ID associated with the respective client entity, and wherein the multitenant database is a hosted database provided by an entity separate from the client entities, and provides on-demand database service to the client entities.

13. The system of claim 1 further configurable to analyze one or more queue parameters for the second application server, and to selectively service requests allocated to the second application server based on the analysis.

5. An article comprising a computer-readable medium having stored thereon instructions that when executed by one or more processors are configurable to service requests in an environment having multiple application servers each having one or more queues to store at least indications of requests to be serviced by the application servers by:

determining a utilization level for a first application server of the multiple application servers;

comparing the utilization level to a pre-selected utilization threshold level;

determining whether to service requests allocated to other application servers in response to the comparing;

servicing at least one request allocated to a second application server.

6. The article of claim 5 wherein the utilization level is based, at least in part on one or more of queue depth, queue processing time, bandwidth utilization, processor utilization, and memory utilization.

7. The article of claim 5 further comprising instructions that, when executed by the one or more processors, cause the one or more processors to:

analyze one or more queue parameters for the second application server; and

selectively service requests allocated to the second application server based on the analysis.

8. An apparatus for servicing requests in an environment having multiple application servers each having one or more queues to store at least indications of requests to be serviced by the application servers, the method comprising:

means for determining a utilization level for a first application server of the multiple application servers;

means for comparing the utilization level to a pre-selected utilization threshold level;

means for determining whether to service requests allocated to other application servers in response to the comparing;

means for servicing at least one request allocated to a second application server.

9. The apparatus of claim 8 wherein the utilization level is based, at least in part on one or more of queue depth, queue processing time, bandwidth utilization, processor utilization, and memory utilization.

10. The apparatus of claim 8 further comprising:

means for analyzing one or more queue parameters for the second application server; and

means for selectively servicing requests allocated to the second application server based on the analysis.

11. A system comprising:

at least one memory device;

one or more processors coupled with the at least one memory device, the one or more processors configurable to determine a utilization level for a first application server of the multiple application servers, to compare the utilization level to a pre-selected utilization threshold level, to determine whether to service requests allocated to other application servers in response to the comparing, and to service at least one request allocated to a second application server.

12. The system of claim 11 wherein the utilization level is based, at least in part on one or more of queue depth, queue processing time, bandwidth utilization, processor utilization, and memory utilization.

14. The system of claim 11 wherein the application servers are part of a multitenant database environment that stores data for multiple client entities each identified by a tenant identifier (ID) having one of one or more users associated with the tenant ID, wherein users of each of multiple client entities can only access data identified by a tenant ID associated with the respective client entity, and wherein the multitenant database is a hosted database provided by an entity separate from the client entities, and provides on-demand database service to the client entities.