Providing consistent tenant experiences for multi-tenant databases

• US 9,934,268 B2
• Filed: 10/14/2016
• Issued: 04/03/2018
• Est. Priority Date: 12/30/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Konersmann, Scott Anthony
• Primary Examiner(s): Woo, Isaac M
• Application Number:
  US15/294,124
• Publication Number:
  US 20170031972A1
• Time in Patent Office: 536 Days
• Field of Search: 707600-899
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06F 2209/504 Resource capping
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The present invention extends to methods, systems, and computer program products for providing consistent tenant experiences at multi-tenant database. Embodiments of the invention include an import service that facilitates data imports without any distribution logic on a tenant. A tenant (caller) provides data in essentially any order. The import service understands the distribution of data across multiple databases and determines for any given piece of import data what database the import data is to be inserted into. Accordingly, the tenant (caller) is relieved from having to know how the data is distributed across a set (of potentially hundreds or thousands) of databases. The import service can optimize an import process to provide load balancing and fairness across a dynamic distributed database system. For example, the import service can insure that a large import by one tenant does not deprive the import other tenants of appropriate resources.

Claims

1. An apparatus for dynamic load allocation in a multi-tenant distributed database, comprising:

system memory;

the system memory storing a mapping scheme that contains information associating a first tenant with a first database of the multi-tenant distributed database and information associating a second tenant with a second database of the multi-tenant distributed database;

the system memory coupled to a processor and storing instructions configured to cause the processor to;

initiate import of a first data portion associated with the first tenant into the first database in accordance with the mapping scheme; and

issue a suspend command to suspend importation of the first data portion in accordance with a fairness scheme; and

issue a command to schedule import of a second data portion associated with the second tenant into the second database in accordance with the mapping scheme.

2. The apparatus of claim 1, further comprising instructions configured to cause the processor to resume importing the first data portion subsequent to importing at least part of the second data portion.

3. The apparatus of claim 1, further comprising instructions configured to cause the processor to insert the first data portion into a bucket for the first tenant, the bucket configured to accumulate data for a specified data range, including a data value in the first data portion.

4. The apparatus of claim 3, further comprising instructions configured to cause the processor to insert the bucket into a queue, the queue corresponding to a node where the first database is located, the node from among a plurality of nodes in the multi-tenant distributed database.

5. The apparatus of claim 1, further comprising instructions configured to cause the processor to insert the second data portion into a bucket for the second tenant, the bucket configured to accumulate data for a specified data range, including a data value in the second data portion.

6. The apparatus of claim 5, further comprising instructions configured to cause the processor to insert the bucket into a queue, the queue corresponding to a node where the second database is located, the node from among a plurality of nodes in the multi-tenant distributed database.

7. The apparatus of claim 1, wherein instructions configured to cause the processor to issue a suspend command in accordance with a fairness scheme comprises instructions configured to cause the processor to issue a suspend command in accordance with a fairness schema that is based on an import policy defining resource usage thresholds for the first tenant and for the second tenant.

8. A computer system, the computer system comprising:

one or more hardware processors;

system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors;

the one or more hardware processors executing the instructions stored in the system memory to;

initiate import of one or more data portions into a first database of a distributed database system, the one or more data portions associated with a first tenant of the distributed database system, the first tenant mapped to the first database in data describing the distributed database;

prior to completely importing the one or more data portions, suspend importing of the one or more data portions into the first database to reallocate bandwidth for importing one or more other data portions into a second database of the distributed database system, the one or more other data portions associated with a second different tenant of the distributed database system, the second tenant mapped to the second database in the data describing the distributed database; and

subsequent to suspending import of the one or more data portions, initiate import of the one or more other data portions into the second database of distributed database system.

9. The computer system of claim 8, further comprising the one or more hardware processors executing the instructions stored in the system memory to resume import of the one or more data portions subsequent to importing the one or more other data portions.

10. The computer system of claim 8, wherein the one or more hardware processors executing the instructions stored in the system memory to suspend importing of the one or more data portions into the first database comprises the one or more hardware processors executing the instructions stored in the system memory to suspend importing of the one or more data portions in accordance with a fairness scheme.

11. The computer system of claim 10, wherein the one or more hardware processors executing the instructions stored in the system memory to suspend importing of the one or more data portions in accordance with a fairness scheme comprises the one or more hardware processors executing the instructions stored in the system memory to suspend importing of the one or more data portions in accordance with a fairness scheme that is based on an import policy defining resource usage thresholds for the first tenant and for the second tenant.

12. The computer system of claim 8, wherein the one or more hardware processors executing the instructions stored in the system memory to initiate import of a one or more data portions into a first database of a distributed database system comprise the one or more hardware processors executing the instructions stored in the system memory to initiate insertion of the one or more portions of data into a bucket for the first tenant, the bucket configured to accumulate data for a specified data range, a data value in the first data portion being within the data range.

13. The computer system of claim 12, further comprising the one or more hardware processors executing the instructions stored in the system memory to insert the bucket into a queue, the queue corresponding to a node where the first database is located, the node from among a plurality of nodes in the multi-tenant distributed database.

14. The computer system of claim 8, wherein the one or more hardware processors executing the instructions stored in the system memory to initiate import of the one or more other data portions into the second database comprise the one or more hardware processors executing the instructions stored in the system memory to initiate insertion of the one or more other data portions into a bucket for the second tenant, the other bucket configured to accumulate data for a specified other data range, a data value in the other data portion being within the other data range.

15. The computer system of claim 14, further comprising the one or more hardware processors executing the instructions stored in the system memory to insert the bucket into a queue, the queue corresponding to a node where the second database is located, the node from among a plurality of nodes in the multi-tenant distributed database.

16. A method for use at a computer system, the method comprising:

initiating import of one or more data portions into a first database of a distributed database system, the one or more data portions associated with a first tenant of the distributed database system, the first tenant mapped to the first database in data describing the distributed database;

prior to completely importing the one or more data portions, suspending importing of the one or more data portions into the first database to reallocate bandwidth for importing one or more other data portions into a second database of the distributed database system, the one or more other data portions associated with a second different tenant of the distributed database system, the second tenant mapped to the second database in the data describing the distributed database; and

subsequent to suspending import of the one or more data portions, initiating import of the one or more other data portions into the second database of distributed database system.

17. The method of claim 16, further comprising resuming import of the one or more data portions subsequent to importing the one or more other data portions.

18. The method of claim 16, wherein suspending import of the one or more data portions into the first database comprises suspending import of the one or more data portions in accordance with a fairness scheme that is based on an import policy defining resource usage thresholds for the first tenant and for the second tenant.

19. The method of claim 16, wherein initiating import of a one or more data portions into a first database of a distributed database system comprises initiating insertion of the one or more portions of data into a bucket for the first tenant, the bucket configured to accumulate data for a specified data range, a data value in the one or more portions of data being within the data range;

and

further comprising inserting the bucket into a queue, the queue corresponding to a node where the first database is located, the node from among a plurality of nodes in the multi-tenant distributed database.

20. The method of claim 16, wherein initiating import of the one or more other data portions into a second database of a distributed database system comprises initiating insertion of the one or more other portions of data into a bucket for the second tenant, the bucket configured to accumulate data for a specified data range, a data value in the one or more other portions of data being within the data range;

and

further comprising inserting the bucket into a queue, the queue corresponding to a node where the second database is located, the node from among a plurality of nodes in the multi-tenant distributed database.