Facilitating equitable distribution of thread resources for job types associated with tenants in a multi-tenant on-demand services environment

• US 9,529,626 B2
• Filed: 03/15/2013
• Issued: 12/27/2016
• Est. Priority Date: 09/12/2012
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Wang, Xiaodan, Devadhar, Vijayanth, Murugesan, Praveen
• Primary Examiner(s): Bates, Kevin
• Assistant Examiner(s): Mahmud, Golam
• Application Number:
  US13/841,417
• Publication Number:
  US 20140075030A1
• Time in Patent Office: 1,383 Days
• Field of Search: 709/226
• US Class Current: 1/1
• CPC Class Codes: G06F 21/40 by quorum, i.e. whereby two or more security principals are required
• CPC Class Codes: G06F 2209/508 Monitor
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06Q 30/08 Auctions
• CPC Class Codes: H04L 41/30 Decision processes by autonomous network management units using voting and bidding
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 47/50 Queue scheduling
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 47/83 based on usage prediction

Abstract

In accordance with embodiments, there are provided mechanisms and methods for facilitating a fair allocation and usage of thread resources for user messages according to one embodiment in an on-demand services environment. In one embodiment and by way of example, a method includes tracking resource usage associated with a plurality of messages performed and completed in response to requests placed by a user via a user interface at a computing device, where the tracking includes recording an amount of resources consumed by each completed message. The method may further include classifying the plurality of messages into job types based on the tracked resource usage associated with the plurality of messages, and enforcing, based on the classification of the messages, a message selection process to ensure equitable distribution of resources to subsequently received messages.

Claims

1. A database system-implemented method, comprising:

tracking, by the database system, resource usage associated with a plurality of job types requested by one or more tenants in a multi-tenant environment;

calculating, by the database system, a deficiency factor suffered by a job type associated with a tenant, wherein the deficiency factor is based on an actual usage and an expected usage of resources by the job type, wherein the deficiency factor indicates deficiency in usage of the resources by the job type such that the deficiency corresponds to the actual usage of the resources by the job type being lower than the expected usage assigned to the job type by measuring the usage over multiple predetermined segments of time, wherein the deficiency being temporary deficiency or chronic deficiency based on high latency in queuing time or high usage of the resources by one or more of the plurality of job types; and

enforcing, by the database system, an equitable distribution of the resources for the plurality of job types by adjusting a current distribution representing an inequitable distribution, wherein adjusting includes selectively lowering the high usage of the resources by the one or more job types until the deficiency factor is inconsequential such that the actual usage by the job type has increased to match the expected usage.

2. The method of claim 1, wherein calculating further comprises:

computing the actual usage by the job type and one or more actual usages representing the high usage by the one or more job types; and

computing the expected usage associated with the job type and one or more expected usages associated with the one or more job types.

3. The method of claim 1, wherein enforcing comprises triggering fair usage to ensure the equitable distribution of the resources for the plurality of job types.

4. The method of claim 3, wherein triggering comprises prioritizing one or more work hosts associated with the job type to boost processing of tasks associated with the job type, wherein prioritizing is performed over the multiple predetermined segments of time.

5. The method of claim 1, further comprising receiving a job request to perform the job type, wherein the job request is placed at a computing device associated with the tenant in the multi-tenant environment, wherein the job request is placed by a user having access to the computing device.

6. The method of claim 1, wherein the resource usage comprises usage of thread resources, wherein the thread resources are accessed via a plurality of message queues.

7. The method of claim 1, wherein selectively lowering the high usage comprises:

minimizing the deficiency factor by automatically adapting a selection process for selection of the plurality of job types; and

real-time tracking of the resource usage based on at least one of a sliding window scale, fairness usage, queuing time, and adaptive intervention via configurable threshold, wherein the sliding window scale to facilitate the multiple predetermined segments of time.

8. A system comprising a computing device having a memory device to store instructions, and a processing device to execute the instructions to facilitate a mechanism to perform operations comprising:

tracking, resource usage associated with a plurality of job types requested by one or more tenants in a multi-tenant environment;

calculating, a deficiency factor suffered by a job type associated with a tenant, wherein the deficiency factor is based on an actual usage and an expected usage of resources by the job type, wherein the deficiency factor indicates deficiency in usage of the resources by the job type such that the deficiency corresponds to the actual usage of the resources by the job type being lower than the expected usage assigned to the job type by measuring the usage over multiple predetermined segments of time, wherein the deficiency being temporary deficiency or chronic deficiency based on high latency in queuing time or high usage of the resources by one or more of the plurality of job types; and

enforcing an equitable distribution of the resources for the plurality of job types by adjusting a current distribution representing an inequitable distribution, wherein adjusting includes selectively lowering the high usage of the resources by the one or more job types until the deficiency factor is inconsequential such that the actual usage by the job type has increased to match the expected usage.

9. The system of claim 8, wherein the calculating comprises:

computing the actual usage by the job type and one or more actual usages representing the high usage by the one or more job types; and

computing the expected usage associated with the job type and one or more expected usages associated with the one or more job types.

10. The system of claim 8, wherein enforcing comprise triggering fair usage to ensure the equitable distribution of the resources for the plurality of job types.

11. The system of claim 10, wherein triggering comprises prioritizing one or more work hosts associated with the job type to boost processing of tasks associated with the job type, wherein prioritizing is performed over the multiple predetermined segments of time.

12. The system of claim 8, wherein the operations further comprise receiving a job request to perform the job type, wherein the job request is placed at a computing device associated with the tenant in the multi-tenant environment, wherein the job request is placed by a user having access to the computing device.

13. The system of claim 8, wherein the resource usage comprises usage of thread resources, wherein the thread resources are accessed via a plurality of message queues.

14. The system of claim 8, wherein selectively lowering the high usage comprises:

minimizing the deficiency factor by automatically adapting a selection process for selection of the plurality of job types; and

real-time tracking of the resource usage based on at least one of a sliding window scale, fairness usage, queuing time, and adaptive intervention via configurable threshold, wherein the sliding window scale to facilitate the multiple predetermined segments of time.

15. A non-transitory machine-readable medium having stored thereon instructions which, when executed by a machine, cause the machine to perform operations comprising:

tracking resource usage associated with a plurality of job types requested by one or more tenants in a multi-tenant environment;

calculating a deficiency factor suffered by a job type associated with a tenant, wherein the deficiency factor is based on an actual usage and an expected usage of resources by the job type, wherein the deficiency factor indicates deficiency in usage of the resources by the job type such that the deficiency corresponds to the actual usage of the resources by the job type being lower than the expected usage assigned to the job type by measuring the usage over multiple predetermined segments of time, wherein the deficiency being temporary deficiency or chronic deficiency based on high latency in queuing time or high usage of the resources by one or more of the plurality of job types; and

enforcing an equitable distribution of the resources for the plurality of job types by adjusting a current distribution representing an inequitable distribution, wherein adjusting includes selectively lowering the high usage of the resources by the one or more job types until the deficiency factor is inconsequential such that the actual usage by the job type has increased to match the expected usage.

16. The non-transitory machine-readable medium of claim 15, wherein the calculating comprises:

computing the actual usage by the job type and one or more actual usages representing the high usage by the one or more job types; and

computing the expected usage associated with the job type and one or more expected usages associated with the one or more job types.

17. The non-transitory machine-readable medium of claim 15, wherein enforcing comprise triggering fair usage to ensure the equitable distribution of the resources for the plurality of job types.

18. The non-transitory machine-readable medium of claim 17, wherein triggering comprises prioritizing one or more work hosts associated with the job type to boost processing of tasks associated with the job type, wherein prioritizing is performed over the multiple predetermined segments of time.

19. The non-transitory machine-readable medium of claim 15, wherein the operations further comprise receiving a job request to perform the job type, wherein the job request is placed at a computing device associated with the tenant in the multi-tenant environment, wherein the job request is placed by a user having access to the computing device.

20. The non-transitory machine-readable medium of claim 15, wherein the resource usage comprises usage of thread resources, wherein the thread resources are accessed via a plurality of message queues.

21. The non-transitory machine-readable medium of claim 15, wherein selectively lowering the high usage comprises:

minimizing the deficiency factor by automatically adapting a selection process for selection of the plurality of job types; and

real-time tracking of the resource usage based on at least one of a sliding window scale, fairness usage, queuing time, and adaptive intervention via configurable threshold, wherein the sliding window scale to facilitate the multiple predetermined segments of time.