Providing consistent tenant experiences for multi-tenant databases

• US 9,229,996 B2
• Filed: 12/30/2013
• Issued: 01/05/2016
• Est. Priority Date: 12/30/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Konersmann, Scott Anthony
• Primary Examiner(s): Woo, Isaac M
• Application Number:
  US14/144,412
• Publication Number:
  US 20150186480A1
• Time in Patent Office: 736 Days
• Field of Search: 707600-899
• US Class Current: 1/1
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06F 2209/504 Resource capping
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The present invention extends to methods, systems, and computer program products for providing consistent tenant experiences at multi-tenant database. Embodiments of the invention include an import service that facilitates data imports without any distribution logic on a tenant. A tenant (caller) provides data in essentially any order. The import service understands the distribution of data across multiple databases and determines for any given piece of import data what database the import data is to be inserted into. Accordingly, the tenant (caller) is relieved from having to know how the data is distributed across a set (of potentially hundreds or thousands) of databases. The import service can optimize an import process to provide load balancing and fairness across a dynamic distributed database system. For example, the import service can insure that a large import by one tenant does not deprive the import other tenants of appropriate resources.

Claims

1. At a computer system, the computer system including a processor and system memory, the computer system included in a dynamic distributed database system, the dynamic distributed database system maintaining a plurality of databases across a plurality of nodes, a method for providing a consistent user experience when importing data into databases maintained by the dynamic distributed database system, the method comprising:

accessing first data, the first data associated with a tenant of a dynamic distributed database system, the first data having a plurality of data portions, each of the plurality of data portions having values within one or more ranges of a database of the tenant;

importing one or more data portions, from among the plurality of data portions, into the dynamic distributed database system, including for each of the one or more data portions;

referring to a global partition map for the dynamic distributed database system to schedule the data portion for insertion into an appropriate database for the tenant, the appropriate database for the tenant at a node of the dynamic distributed database system;

accessing second data, the second data associated with a second tenant of the dynamic distributed database system, the second data having values within one or more ranges of a database of the second tenant;

suspending import of the first data subsequent to accessing the second data and prior to completing import of all of the plurality of data portions such that a one or more data portions, from among the plurality of data portions, remain to be processed;

subsequent to suspending importing the first data into the dynamic distributed database system, importing a portion of the second data into the dynamic distributed database system, including;

referring to the global partition map to schedule the portion of the second data for insertion into appropriate database for the second tenant, the appropriate database for the second tenant at a node of the dynamic distributed database system.

2. The method of claim 1, wherein referring to a global partition map for the dynamic distributed database system to schedule the data portion for insertion into an appropriate database for the tenant comprises:

inserting the data portion into a bucket for a data range corresponding to the data portion, the bucket corresponding to the appropriate database; and

inserting the bucket into a queue for the appropriate node.

3. The method of claim 2, wherein inserting the data portion into a bucket, the bucket comprises inserting the data portion into a bucket of a defined size, the defined bucket size being less than the first data size such that a plurality of buckets are to be used to import the first data.

4. The method of claim 2, wherein referring to the global partition map to schedule the portion of the second data for insertion into appropriate database for the second tenant comprises:

inserting the portion of the second data into another bucket, the other bucket for a data range corresponding to the portion of the second data, the other bucket corresponding to the appropriate database for the second tenant; and

inserting the other bucket into a queue for the other appropriate node.

5. The method of claim 4, wherein inserting the portion of the second data into another bucket comprises inserting the portion of the second data into another bucket of the defined size.

6. The method of claim 1, further comprising resuming importing the first data into the dynamic distributed database system subsequent to importing the portion of the second data into the dynamic distributed database system.

7. The method of claim 1, wherein suspending import of the first data comprises suspending import of the first data in accordance with an import policy, the import policy defining resource usage thresholds for the tenant.

8. A computer program product for use at a computer system, the computer system included in a dynamic distributed database system, the dynamic distributed database system maintaining a plurality of databases across a plurality of nodes, the computer program product for implementing a method for providing a consistent user experience when importing data into databases maintained by the dynamic distributed database system, the computer program product comprising one or more computer storage devices having stored thereon computer-executable instructions that, when executed at a processor, cause the computer system to perform the method including the following:

access first data, the first data associated with a tenant of a dynamic distributed database system, the first data having a plurality of data portions, each of the plurality of data portions having values within one or more ranges of a database of the tenant;

import one or more data portions, from among the plurality of data portions, into the dynamic distributed database system, including for each of the one or more data portions;

refer to a global partition map for the dynamic distributed database system to schedule the data portion for insertion into an appropriate database for the tenant, the appropriate database for the tenant at a node of the dynamic distributed database system;

access second data, the second data associated with a second tenant of the dynamic distributed database system, the second data having values within one or more ranges of a database of the second tenant;

throttle import of the first data subsequent to accessing the second data and prior to completing import of all of the plurality of data portions such that a one or more data portions, from among the plurality of data portions, remain to be processed;

subsequent to throttling importing the first data into the dynamic distributed database system, import a portion of the second data into the dynamic distributed database system, including;

refer to the global partition map to schedule the portion of the second data for insertion into appropriate database for the second tenant, the appropriate database for the second tenant at a node of the dynamic distributed database system.

9. The computer program product of claim 8, wherein computer-executable instructions that, when executed, cause the computer system to refer to a global partition map for the dynamic distributed database system to schedule the data portion for insertion into an appropriate database for the tenant comprise computer-executable instructions that, when executed, cause the computer system to:

insert the data portion into a bucket for a data range corresponding to the data portion, the bucket corresponding to the appropriate database; and

insert the bucket into a queue for the appropriate node.

10. The computer program product of claim 9, wherein computer-executable instructions that, when executed, cause the computer system to insert the data portion into a bucket the bucket comprise computer-executable instructions that, when executed, cause the computer system to insert the data portion into a bucket of a defined size, the defined bucket size being less than the first data size such that a plurality of buckets are to be used to import the first data.

11. The computer program product of claim 9, wherein computer-executable instructions that, when executed, cause the computer system to refer to the global partition map to schedule the portion of the second data for insertion into appropriate database for the second tenant comprise computer-executable instructions that, when executed, cause the computer system to:

insert the portion of the second data into another bucket, the other bucket for a data range corresponding to the portion of the second data, the other bucket corresponding to the appropriate database for the second tenant; and

insert the other bucket into a queue for the other appropriate node.

12. The computer program product of claim 11, wherein computer-executable instructions that, when executed, cause the computer system to insert the portion of the second data into another bucket comprise computer-executable instructions that, when executed, cause the computer system to insert the portion of the second data into another bucket of the defined size.

13. The computer program product of claim 8, further comprising computer-executable instructions that, when executed, cause the computer system to unthrottle importing the first data into the dynamic distributed database system subsequent to importing the portion of the second data into the dynamic distributed database system.

14. The computer program product of claim 8, wherein computer-executable instructions that, when executed, cause the computer system to throttle import of the first data comprise computer-executable instructions that, when executed, cause the computer system to throttle import of the first data in accordance with an import policy, the import policy defining resource usage thresholds for the tenant.

15. A computer system, the computer system included in a dynamic distributed database system, the dynamic distributed database system maintaining a plurality of databases across a plurality of nodes, the computer system comprising:

one or more processors;

system memory; and

one or more computer storage devices having stored thereon computer-executable instructions representing a virtualization module, the virtualization module configured to;

access first data, the first data associated with a tenant of a dynamic distributed database system, the first data having a plurality of data portions, each of the plurality of data portions having values within one or more ranges of a database of the tenant;

import one or more data portions, from among the plurality of data portions, into the dynamic distributed database system, including for each of the one or more data portions;

refer to a global partition map for the dynamic distributed database system to schedule the data portion for insertion into an appropriate database for the tenant, the appropriate database for the tenant at a node of the dynamic distributed database system;

access second data, the second data associated with a second tenant of the dynamic distributed database system, the second data having values within one or more ranges of a database of the second tenant;

suspend import of the first data subsequent to accessing the second data and prior to completing import of all of the plurality of data portions such that a one or more data portions, from among the plurality of data portions, remain to be processed;

subsequent to suspending importing the first data into the dynamic distributed database system, import a portion of the second data into the dynamic distributed database system, including;

refer to the global partition map to schedule the portion of the second data for insertion into appropriate database for the second tenant, the appropriate database for the second tenant at a node of the dynamic distributed database system.

16. The computer system of claim 15, wherein the virtualization module being configured to refer to a global partition map for the dynamic distributed database system to schedule the data portion for insertion into an appropriate database for the tenant comprises the virtualization module being configured to:

insert the data portion into a bucket for a data range corresponding to the data portion, the bucket corresponding to the appropriate database; and

insert the bucket into a queue for the appropriate node.

17. The computer system of claim 16, wherein the virtualization module being configured to insert the data portion into a bucket the bucket comprises the virtualization module being configured to insert the data portion into a bucket of a defined size, the defined bucket size being less than the first data size such that a plurality of buckets are to be used to import the first data.

18. The computer system of claim 16, wherein the virtualization module being configured to refer to the global partition map to schedule the portion of the second data for insertion into appropriate database for the second tenant comprises the virtualization module being configured to:

insert the portion of the second data into another bucket, the other bucket for a data range corresponding to the portion of the second data, the other bucket corresponding to the appropriate database for the second tenant; and

insert the other bucket into a queue for the other appropriate node.

19. The computer program product of claim 18, wherein the virtualization module being configured to insert the portion of the second data into another bucket comprises the virtualization module being configured to insert the portion of the second data into another bucket of the defined size.

20. The computer system of claim 15, wherein the virtualization module being configured to suspend import of the first data comprises the virtualization module being configured to suspend import of the first data in accordance with an import policy, the import policy defining resource usage thresholds for the tenant.