Isolating resources between tenants in a software-as-a-service system using the estimated costs of service requests

• US 8,539,078 B2
• Filed: 07/08/2010
• Issued: 09/17/2013
• Est. Priority Date: 07/08/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Duan, Ning, Ghoting, Amol, Natarajan, Ramesh
• Primary Examiner(s): Dennison, Jerry
• Assistant Examiner(s): Murray, Daniel C
• Application Number:
  US12/832,559
• Publication Number:
  US 20120011518A1
• Time in Patent Office: 1,167 Days
• Field of Search: 709/226, 709/220, 709/223, 726/3
• US Class Current: 709/226
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources

Abstract

An apparatus hosting a multi-tenant software-as-a-service (SaaS) system maximizes resource sharing capability of the SaaS system. The apparatus receives service requests from multiple users belonging to different tenants of the multi-tenant SaaS system. The apparatus partitions the resources in the SaaS system into different resource groups. Each resource group handles a category of the service requests. The apparatus estimates costs of the service requests of the users. The apparatus dispatches service requests to resource groups according to the estimated costs, whereby the resources are shared, among the users, without impacting each other.

Claims

1. A method for real-time sharing of resources in a multi-tenant software-as-a-service (SaaS) system, the method comprising:

receiving service requests from multiple users belonging to different tenants of the multi-tenant SaaS system;

partitioning the resources in the SaaS system into different resource groups, each resource group handling a category of the service requests;

estimating costs of the service requests by using a tenant segmentation variable, a segment representing a group of tenants, a tenant representing a group of users, a first multiplication of the tenant segmentation variable and a first regression parameter estimate, a second multiplication of a current workload of the multi-tenant SaaS system and a second regression parameter estimate, an addition of a result of the first multiplication and a result of the second multiplication, and historical cost estimates of prior service requests from each of the users; and

dispatching the service requests to the resource groups according to the estimated costs, whereby the resources are shared, among the users, without impacting each other.

2. The method according to claim 1, further comprising:

analyzing the service requests to acquire user IDs of the users, tenant IDs of the tenants, and requested functions of the service requests.

3. The method according to claim 1, further comprising:

isolating a mutual performance impact between the different tenants.

4. The method according to claim 3, wherein a resource group handles first-type service requests and another resource group handles second-type service requests, the first-type service requests taking longer than a pre-determined time period in order to process the first-type service requests, the second-type service requests taking less than or equal to the pre-determined time period in order to process the second-type service requests.

5. The method according to claim 3, wherein the estimation includes steps of:

segmenting tenants according to tenants'"'"' characteristics;

modeling a variability of the cost estimation for each segment of the tenants;

modeling a variability of the cost estimation for each tenant within each segment; and

modeling a variability of the cost estimation for each user within each tenant.

6. The method according to claim 5, wherein the modelings include at least one regression technique.

7. The method according to claim 6, further comprising:

using a modeling based on the regression technique with model parameters obtained by maximum likelihood estimation or Bayesian estimation methods.

8. The method according to claim 1, wherein each resource group processes the service requests within a particular cost estimate ranges.

9. An apparatus hosting a multi-tenant software-as-a-service (SaaS) system to maximize resource sharing capability of the SaaS system, the apparatus comprising:

a memory device; and

a processor being connected to the memory device, wherein the processor performs steps of;

receiving service requests from multiple users belonging to different tenants of the multi-tenant SaaS system;

partitioning resources in the SaaS system into different resource groups, each resource group handling a category of the service requests;

estimating costs of the service requests by using a tenant segmentation variable, a segment representing a group of tenants, a tenant representing a group of users, a first multiplication of the tenant segmentation variable and a first regression parameter estimate, a second multiplication of a current workload of the multi-tenant SaaS system and a second regression parameter estimate, an addition of a result of the first multiplication and a result of the second multiplication, and historical cost estimates of prior service requests from each of the users; and

dispatching the service requests to the resource groups according to the estimated costs, whereby the resources are shared, among the users, without impacting each other.

10. The apparatus according to claim 9, wherein the processor further performs a step of:

analyzing the service requests to acquire user IDs of the users, tenant IDs of the tenants, and requested functions of the service requests.

11. The apparatus according to claim 9, wherein the processor further performs a step of:

isolating a mutual-performance impact between the different tenants.

12. The apparatus according to claim 11, wherein a resource group handles first-type service requests and another resource group handles second-type service requests, the first-type service requests taking longer than a pre-determined time period in order to process the first-type service requests, the second-type service requests taking less than or equal to the pre-determined time period in order to process the second-type service requests.

13. The apparatus according to claim 9, wherein the estimation includes steps of:

segmenting tenants according to tenants'"'"' characteristics;

modeling a variability of the cost estimation for each segment of the tenants;

modeling a variability of the cost estimation for each tenant within each segment;

modeling a variability of the cost estimation for each user within each tenant.

14. The apparatus according to claim 13, wherein the modelings include at least one regression technique.

15. The apparatus according to claim 14, wherein the processor further performs a step of:

using a modeling based on the regression technique with model parameters obtained by maximum likelihood estimation or Bayesian estimation methods.

16. A computer program product for sharing resources in a multi-tenant software-as-a-service (SaaS) system, the computer program product comprising a storage medium readable by a processing circuit, the storage medium excluding only a propagating signal and storing instructions run by the processing circuit for performing a method, the method comprising:

receiving service requests from multiple users belonging to different tenants of the multi-tenant SaaS system;

partitioning resources in the SaaS system into different resource groups, each resource group handling a category of the service requests;

estimating costs of the service requests by using a tenant segmentation variable, a segment representing a group of tenants, a tenant representing a group of users, a first multiplication of the tenant segmentation variable and a first regression parameter estimate, a second multiplication of a current workload of the multi-tenant SaaS system and a second regression parameter estimate, an addition of a result of the first multiplication and a result of the second multiplication, and historical cost estimates of prior service requests from each of the users; and

dispatching the service requests to the resource groups according to the estimated costs, whereby the resources are shared, among the users, without impacting each other.

17. The computer program product according to claim 16, wherein the method further comprises:

analyzing the service requests to acquire user IDs of the users, tenant IDs of the tenants, and requested functions of the service requests.

18. The computer program product according to claim 16, wherein the method further comprise:

isolating a mutual performance impact the different tenants.

19. The computer program product according to claim 18, wherein a resource group handles first-type service requests and another resource group handles second-type service requests, the first-type service requests taking longer than a pre-determined time period in order to process the first-type service requests, the second-type service requests taking less than or equal to the pre-determined time period in order to process the second-type service requests.

20. The computer program product according to claim 18, wherein the estimation includes steps of:

segmenting tenants according to tenants'"'"' characteristics;

modeling a variability of the cost estimation for each segment of the tenants;

modeling a variability of the cost estimation for each tenant within each segment; and

modeling a variability of the cost estimation for each user within each tenant.

21. The computer program product according to claim 20, wherein the modelings include at least one regression technique.

22. The computer program product according to claim 21, wherein the method further comprises:

using a modeling based on the regression technique with model parameters obtained by maximum likelihood estimation or Bayesian estimation methods.