Partition balancing in an on-demand services environment

• US 9,923,960 B2
• Filed: 08/18/2015
• Issued: 03/20/2018
• Est. Priority Date: 08/18/2015
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Helmich, Marco, Devadhar, Vijayanth
• Primary Examiner(s): Christensen, Scott B
• Application Number:
  US14/829,428
• Publication Number:
  US 20170054797A1
• Time in Patent Office: 945 Days
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/5041 characterised by the time relationship between creation and deployment of a service
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30

Abstract

Techniques for partition balancing. Organization identifiers (orgIDs) are acquired for one or more organizations within a multi-organization on-demand services environment having multiple nodes, each of which have one or more partitions. A mapping of the orgIDs to the partitions within the multi-organization on-demand services environment is determined. Resource consumption for the organizations is determined. Resource consumption for the partitions based on the resource consumption of the organization and the mapping of the organization to the partitions is determined. A score for the partitions based on the resource consumption is generated. The partitions are redistributed among the nodes based on the partition scores.

Claims

1. A method comprising:

acquiring organization identifiers (orgIDs) for one or more relevant organizations of a plurality of organizations within a multi-organization on-demand services environment having multiple computing nodes, each of which have one or more partitions, wherein each relevant organization utilizes each of the partitions to which it is assigned, wherein each organization within the multi-organization on-demand services environment is uniquely identified by a single orgID, and wherein each partition is configured to be associated with multiple organizations of the plurality of organizations and is further configured to be executed by a single computing node of the multiple computing nodes;

determining a mapping of the orgIDs to the partitions within the multi-organization on-demand services environment, wherein the mapping is static and is set in association with creation of the orgID;

determining a mapping of partitions to computing nodes, where multiple partitions are mapped to each computing node, wherein the mapping of partitions to computing nodes is dynamic and can be modified at runtime;

determining, based on the acquired orgIDs, first resource consumptions for the relevant organizations;

determining second resource consumptions for each of the partitions based on the first resource consumptions for the relevant organizations and the mapping of the relevant organizations to the partitions;

generating a partition score for each of the partitions based on the second resource consumptions;

redistributing the partitions with corresponding relevant organizations among the computing nodes based on the partition scores.

2. The method of claim 1 wherein the on-demand services environment comprises at least databases organized as nodes that allow multiple computing devices to run database management software simultaneously while accessing a single database instance.

3. The method of claim 1 wherein determining the first resource consumptions for the relevant organizations comprises:

loading log record types that have database statistics; and

extracting relevant statistical information.

4. The method of claim 3 wherein the statistical information comprises one or more of:

processor consumption, bandwidth utilization, memory utilization, physical reads, physical writes, and buffergets.

5. The method of claim 4 wherein a weighting value is applied to at least some of the statistical information.

6. The method of claim 1 wherein acquiring organization identifiers (orgIDs) for one or more relevant organizations within a multi-organization on-demand services environment having multiple computing nodes, each of which have one or more partitions comprises:

querying a database system for orgID to partition mapping information; and

storing the orgID to partition mapping in a file system framework.

7. The method of claim 1 wherein determining the second resource consumptions for the partitions based on the resource consumption of the organization and the mapping of the relevant organization to the partitions comprises joining the statistical information with the orgID to partition mapping.

8. A non-transitory computer readable medium having stored thereon instruction that, when executed by one or more processors, cause the one or more processors to:

acquire organization identifiers (orgIDs) for one or more relevant organizations of a plurality of organizations within a multi-organization on-demand services environment having multiple computing nodes, each of which have one or more partitions, wherein each relevant organization utilizes each of the partitions to which it is assigned, wherein each organization within the multi-organization on-demand services environment is uniquely identified by a single orgID, and wherein each partition is configured to be associated with multiple organizations of the plurality of organizations and is further configured to be executed by a single computing node of the multiple computing nodes;

determine a mapping of the orgIDs to the partitions within the multi-organization on-demand services environment, wherein the mapping is static and is set in association with creation of the orgID;

determine a mapping of partitions to computing nodes, where multiple partitions are mapped to each computing node, wherein the mapping of partitions to computing nodes is dynamic and can be modified at runtime;

determine, based on the acquired orgIDs, first resource consumptions for the relevant organizations;

determine second resource consumptions for each of the partitions based on first resource consumptions for the relevant organizations and the mapping of the relevant organizations to the partitions;

generate a partition score for each of the partitions based on the second resource consumptions;

redistribute the partitions with corresponding relevant organizations among the computing nodes based on the partition scores.

9. The non-transitory computer readable medium of claim 8 wherein the on-demand services environment comprises at least databases organized as nodes that allow multiple computing devices to run database management software simultaneously while accessing a single database instance.

10. The non-transitory computer readable medium of claim 8 wherein determining the first resource consumptions for the relevant organizations comprises:

loading log record types that have database statistics; and

extracting relevant statistical information.

11. The non-transitory computer readable medium of claim 10 wherein the statistical information comprises one or more of:

processor consumption, bandwidth utilization, memory utilization, physical reads, physical writes, and buffergets.

12. The non-transitory computer readable medium of claim 11 wherein a weighting value is applied to at least some of the statistical information.

13. The non-transitory computer readable medium of claim 8 wherein acquiring organization identifiers (orgIDs) for one or more relevant organizations within a multi-organization on-demand services environment having multiple computing nodes, each of which have one or more partitions comprises:

querying a database system for orgID to partition mapping information; and

storing the orgID to partition mapping in a file system framework.

14. The non-transitory computer readable medium of claim 8 wherein determining the second resource consumptions for the partitions based on the resource consumption of the organization and the mapping of the relevant organization to the partitions comprises joining the statistical information with the orgID to partition mapping.

15. A system comprising:

at least one memory device;

one or more hardware processing devices coupled with the at least one memory device, the one or more hardware processing devices configurable to acquire organization identifiers (orgIDs) for one or more relevant organizations of a plurality of organizations within a multi-organization on-demand services environment having multiple computing nodes, each of which have one or more partitions, wherein each relevant organization utilizes each of the partitions to which it is assigned, wherein each organization within the multi-organization on-demand services environment is uniquely identified by a single orgID, and wherein each partition is configured to be associated with multiple organizations of the plurality of organizations and is further configured to be executed by a single computing node of the multiple computing nodes, to determine a mapping of the orgIDs to the partitions within the multi-organization on-demand services environment, wherein the mapping is static and is set in association with creation of the orgID, to determine a mapping of partitions to computing nodes, where multiple partitions are mapped to each computing node, wherein the mapping of partitions to computing nodes is dynamic and can be modified at runtime, to determine, based on the acquired orgIDs, first resource consumptions for the relevant organizations, to determine second resource consumptions for each of the partitions based on first resource consumptions for the relevant organizations and the mapping of the relevant organizations to the partitions, to generate a partition score for each of the partitions based on the second resource consumptions, and to redistribute the partitions with corresponding relevant organizations among the computing nodes based on the partition scores.

16. The system of claim 15 wherein the on-demand services environment comprises at least databases organized as nodes that allow multiple computing devices to run database management software simultaneously while accessing a single database instance.

17. The system of claim 15 wherein determining the first resource consumptions for the relevant organizations comprises loading log record types that have database statistics and extracting relevant statistical information.

18. The system of claim 17 wherein the statistical information comprises one or more of:

processor consumption, bandwidth utilization, memory utilization, physical reads, physical writes, and buffergets.

19. The system of claim 18 wherein a weighting value is applied to at least some of the statistical information.

20. The system of claim 15 wherein acquiring organization identifiers (orgIDs) for one or more relevant organizations within a multi-organization on-demand services environment having multiple computing nodes, each of which have one or more partitions comprises querying a database system for orgID to partition mapping information and storing the orgID to partition mapping in a file system framework.