SYSTEMS AND METHODS FOR AUTONOMOUS, SCALABLE, AND DISTRIBUTED DATABASE MANAGEMENT

• US 20170024450A1
• Filed: 07/22/2015
• Published: 01/26/2017
• Est. Priority Date: 07/22/2015
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Xu, Ke, Narayanan, Rajesh, Chen, YuLing
• Granted Patent: US 10,146,848 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 49/15 Interconnection of switching modules
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

The present invention relates generally to a distributed database environment. Aspects of the present invention include employing a distributed, scalable, autonomous resource discovery, management, and stitching system for use in the database. In embodiments of the present invention a database instance architecture can be used where each database instance maintains management of the database instance rather than the entire environment. In embodiments of the present invention each database instance includes an autonomous management system capable of communicating with autonomous management systems of other database instances to allocate and share resources between database instances.

Claims

1. A distributed database system, comprising:

at least one database instance;

an autonomous database management system for each database instance, the autonomous database management system comprising;

a database operation interface executing on a processor enabling the processor to interface with another autonomous database management system;

a database operation processing engine coupled to the database operation interface, the database operation processing engine executing on a processor enabling the processor to perform a database operation; and

a distributed indexing engine coupled to the database operating processing engine, the distributed indexing engine executing on a processor enabling the processor to index location of database storage and an address of the database storage

a local autonomous resource system executing on a processor enabling the processor to manage database storage on the at least one database instance, the local autonomous management system comprising;

a resource discovery engine executing on the processor enabling the processor to search within the at least one database instance responsive to a request for the database storage and to send a request to at least one remote autonomous resource system for discovery of the database storage; and

a resource assignment engine, operating in conjunction with the resource discovery engine, executing on the processor enabling the processor to assign a discovered database storage and to send a message to the remote autonomous resource system responsive to a request from the remote autonomous resource system.

2. The system of claim 1 further comprising a resource monitoring engine executing on the processor enabling the processor to monitor database storage on the local autonomous resource system and interface with the resource discovery engine.

3. The system of claim 1 further comprising a resource stitching engine executing on the processor enabling the processor to stitch the database storage assigned from the remote autonomous resource system.

4. The system of claim 1 further comprising a resource tear down engine executing on a processor enabling the processor to send a message to the remote autonomous resource system to release the resource.

5. The system of claim 1 wherein the local autonomous resource system enables replication of the database storage.

6. The system of claim 5 wherein the replication uses three replicas.

7. The system of claim 1 wherein the autonomous resource system enables database storage caching.

8. A method for managing a distributed database, comprising:

sending a request to a local autonomous resource system on a local database instance for a database storage;

searching the local database instance for the database storage;

sending a request to a remote autonomous resource system for the database storage;

receiving a response from a remote autonomous resource system, the response providing an indication of whether the remote autonomous resource system has the database storage;

assigning a database storage located on a remote database instance; and

sending the remote autonomous resource system data associated with the database storage.

9. The method of claim 8 further comprising monitoring the local database instance for resources.

10. The method of claim 8 further comprising releasing the database storage responsive to a request to release a database storage from the remote autonomous resource system.

11. The method of claim 8 further stitching the database storage assigned from a remote autonomous resource system.

12. The method of claim 8 further comprising indexing the database instance with the database storage and an address of the database storage.

13. The method of claim 8 further comprising caching the database storage to enable fast access.

14. The method of claim 8 further comprising replicating database storage to enable redundancy in the database storage.

15. The method of claim 8 further comprising forwarding a message to a remote autonomous resource system responsive to failing to have the resource on the local autonomous resource system.

16. A distributed database system, comprising:

a first node comprising;

at least one first database instance;

a first autonomous database management system for each first database instance, the autonomous database management system comprising;

a first database operation interface executing on a first processor enabling the first processor to interface with another autonomous database management system;

a first database operation processing engine coupled to the first database operation interface, the first database operation processing engine executing on a first processor enabling the first processor to perform a database operation; and

a first distributed indexing engine coupled to the first database operating processing engine, the first distributed indexing engine executing on a first processor enabling the processor to index location of database storage and an address of the database storage; and

a first autonomous resource system executing on a first processor enabling the first processor to manage database storage on the at least one database instance, the first autonomous resource system comprising;

a first resource discovery engine executing on the first processor enabling the first processor to search within the first at least one database instance responsive to a request from an application for a database storage;

a first resource assignment engine, operating in conjunction with the first resource discovery engine, executing on the first processor enabling the first processor to assign a discovered database storage; and

a second node comprising;

at least one second database instance;

a second autonomous database management system for each database instance, the second autonomous database management system comprising;

a second database operation interface executing on a second processor enabling the second processor to interface with another autonomous database management system;

a second database operation processing engine coupled to the second database operation interface, the second database operation processing engine executing on a second processor enabling the processor to perform a database operation; and

a second distributed indexing engine coupled to the second database operating processing engine, the second distributed indexing engine executing on a second processor enabling the second processor to index location of database storage and an address of the database storage

a second autonomous resource system executing on a second processor enabling the second processor to manage database storage on the second at least one database instance, the second autonomous resource system comprising;

a second resource discovery engine executing on the second processor enabling the second processor to search within the second at least one database instance responsive to a request from an application for a database storage and to send a request to the first autonomous resource system for discovery of the database storage; and

a second resource assignment engine, operating in conjunction with the second resource discovery engine, executing on the second processor enabling the second processor to assign the database storage from the first at least one database instance and to send a message to the first autonomous resource system responsive to a request from the first autonomous resource system.

autonomous resource.

17. The system of claim 16 wherein the first autonomous resource system enables replication of the database storage.

18. The system of claim 17 wherein the replication uses three replicas.

19. The system of claim 16 wherein the first autonomous resource system enables database storage caching.

20. The system of claim 16 wherein the second autonomous resource system enables database storage caching.