DATABASE SHARD ARBITER

• US 20140214890A1
• Filed: 01/31/2013
• Published: 07/31/2014
• Est. Priority Date: 01/31/2013
• Status: Abandoned Application

• Current Assignee: Brightcove Incorporated
• Original Assignee: Unicorn Media, Inc. (Brightcove Incorporated)
• Inventors: Johnson, Matthew A.
• Application Number:
  US13/755,250
• Publication Number:
  US 20140214890A1
• Time in Patent Office: Days
• US Class Current: 707/770
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning

Abstract

Techniques described herein provide for a shard arbiter to act as an intermediary between querying and/or data-inserting applications and sharded databases. The shard arbiter can provide an interface with which the applications can provide a request (e.g., data insert and/or query) in any of a variety of database languages, and the data is inserted into and/or retrieved from sharded databases without the need for customization or any knowledge of how data is sharded. The shard arbiter can use business rules to determine how data is sharded among databases, and may utilize different types of databases—communicating with each database in its native language.

Claims

1. A method of providing database shard arbitration among a plurality of databases, the method comprising:

receiving, via a network interface, a database request, wherein the database request comprises;

a first database command, and

metadata related to the first database command, wherein the metadata comprises information indicative of at least one of;

an entity related to the database request,

a time of day, or

a type of data;

determining one or more business rules associated with the database request, based on the metadata;

determining, based on the one or more business rules, a plurality of sharded databases related to the database request;

formulating, with a processor, a plurality of database commands based on the one or more business rules, wherein each database command of the plurality of database commands;

corresponds with a sharded database of the plurality sharded of databases,

corresponds with a separate shard of data related to the database request, and

is determined based on the first database command; and

for each database command of the plurality of database commands, sending the database command to the sharded database to which it corresponds.

2. The method of providing database shard arbitration among a plurality of databases as recited in claim 1, wherein the first database command and the plurality of database commands comprise database queries, the method further comprising:

receiving, in response to sending the database commands, results from the plurality of sharded databases;

formulating a response to the database request, wherein formulating the response comprises combining the results from the plurality of sharded databases based on the one or more business rules; and

sending the response via the network interface.

3. The method of providing database shard arbitration among a plurality of databases as recited in claim 2, wherein formulating the response further comprises creating one or more data objects with the combined results.

4. The method of providing database shard arbitration among a plurality of databases as recited in claim 1, wherein:

the database request comprises one or more data objects; and

formulating the plurality of database commands comprises including, in each database command of the plurality of database commands, a subset of the one or more data objects.

5. The method of providing database shard arbitration among a plurality of databases as recited in claim 1, wherein:

the plurality of sharded databases includes sharded databases of more than one type; and

formulating the plurality of database commands includes, for each database command of the plurality of database commands, formulating the database command in a language of the sharded database to which the database command corresponds.

6. The method of providing database shard arbitration among a plurality of databases as recited in claim 1, wherein at least one database command of the plurality of database commands is sent via the network interface.

21. The method of providing database shard arbitration among a plurality of databases as recited in claim 1, wherein the first database command comprises a command to insert data.

7. (canceled)

8. A server providing database shard arbitration among a plurality of databases, the server comprising:

a communications interface;

a memory; and

a processing unit communicatively coupled with the memory and the communications interface, the processing unit configured to perform functions including;

receiving, via the communications interface, a database request, wherein the database request comprises;

a first database command, and

metadata related to the first database command, wherein the metadata comprises information indicative of at least one of;

an entity related to the database request,

a time of day, or

a type of data;

determining one or more business rules associated with the database request, based on the metadata;

determining, based on the one or more business rules, a plurality of sharded databases related to the database request;

formulating a plurality of database commands based on the one or more business rules, wherein each database command of the plurality of database commands;

corresponds with a sharded database of the plurality of sharded databases,

corresponds with a separate shard of data related to the database request, and

is determined based on the first database command; and

for each database command of the plurality of database commands, sending, via the communications interface, the database command to the sharded database to which it corresponds.

9. The server providing database shard arbitration among a plurality of databases as recited in claim 8, wherein the processing unit is further configured to perform functions including:

receiving, in response to sending the database commands, results from the plurality of sharded databases;

formulating a response to the database request, wherein formulating the response comprises combining the results from the plurality of sharded databases based on the one or more business rules; and

sending the response via the communications interface.

10. The server providing database shard arbitration among a plurality of databases as recited in claim 9, wherein the processing unit is further configured to formulate the response by creating one or more data objects with the combined results.

11. The server providing database shard arbitration among a plurality of databases as recited in claim 8, wherein the processing unit is configured to:

receive the database request comprising one or more data objects; and

formulate the plurality of database commands by including, in each database command of the plurality of database commands, a subset of the one or more data objects.

12. The server providing database shard arbitration among a plurality of databases as recited in claim 8, wherein the processing unit is configured to:

communicate with different types of sharded databases; and

for each database command of the plurality of database commands, formulate the database command in a language of the sharded database to which the database command corresponds.

13. (canceled)

14. A non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases, the computer-readable medium including instructions for:

receiving a database request via a network interface, wherein the database request comprises;

a first database command, and

metadata related to the first database command;

determining one or more business rules associated with the database request, based on the metadata;

determining, based on the one or more business rules, a plurality sharded of databases related to the database request;

formulating a plurality of database commands based on the one or more business rules, wherein each database command of the plurality of database commands;

corresponds with a sharded database of the plurality sharded of databases,

corresponds with a separate shard of data related to the database request, and

is determined based on the first database command; and

for each database command of the plurality of database commands, sending the database command to the database to which it corresponds.

15. The non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases as recited in claim 14, further including instructions for:

receiving, in response to sending the database commands, results from the plurality of sharded databases;

formulating a response to the database request, wherein formulating the response comprises combining the results from the plurality of sharded databases based on the one or more business rules; and

sending the response.

16. The non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases as recited in claim 15, wherein the instructions for formulating the response comprise instructions for creating one or more data objects with the combined results.

17. The non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases as recited in claim 14, wherein:

the database request comprises one or more data objects; and

the instructions for formulating the plurality of database commands comprise instructions for including, in each database command of the plurality of database commands, a subset of the one or more data objects.

18. The non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases as recited in claim 14, wherein:

the plurality of sharded databases includes sharded databases of more than one type; and

the instructions for formulating the plurality of database commands includes instructions for, for each database command of the plurality of database commands, formulating the database command in a language of the sharded database to which the database command corresponds.

19. The non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases as recited in claim 14, further including instructions for sending at least one database command of the plurality of database commands via a network interface.

20. The non-transitory computer-readable medium having instructions imbedded thereon providing database shard arbitration among a plurality of databases as recited in claim 14, further including instructions for identifying, in the metadata related to the first database command, information indicative of at least one of:

an entity related to the database request,

a time of day, or

a type of data.