Replicated database startup for common database storage

• US 9,613,120 B1
• Filed: 11/11/2014
• Issued: 04/04/2017
• Est. Priority Date: 11/11/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Jung, Hyungsoo, Richardson, Andrew Scott, Kharatishvili, Tengiz, Verbitski, Alexandre Olegovich
• Primary Examiner(s): AL HASHEMI, SANA A
• Application Number:
  US14/538,752
• Time in Patent Office: 875 Days
• Field of Search: 707609, 707610, 707687, 707705, 707790, 707813, 707821, 707912
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/275 Synchronous replication

Abstract

Read-only nodes of a distributed database system may perform replicated database startup for common database storage. A read-only node may request a view of a database from a master node to initialize the read-only node for servicing queries. An indication of the view may be received and portions of data maintained for the distributed database may be read from a common data store maintaining the data for the database according to the indicated view of the database. In-memory data structures at the read-only node for servicing queries may be initialized based on the portions of data read from the common data store. The read-only node may then be made available for servicing queries.

Claims

1. A system, comprising:

a plurality of compute nodes that together implement a distributed database, wherein one the plurality of compute nodes is a master node that performs read and write requests to data maintained for the distributed database, wherein a different one of the plurality of compute nodes is a read-only node that performs reads of the data maintained for the distributed database;

a common data store maintaining the data for the distributed database;

the read-only node, configured to;

upon startup of the read-only node;

request from the master node a view of the distributed database to initialize the read-only node for servicing queries directed to the distributed database;

in response to receipt of an indication of the view of the distributed database at the read-only node;

read from the common data store one or more portions of the data according to the indicated view of the distributed database;

based, at least in part, on the obtained data portions from the common data store, initialize one or more in-memory data structures at the read-only node for servicing queries directed toward the distributed database; and

in response to the initialization of the one or more in-memory data structures at the read-only node, make the read-only node available for servicing queries.

2. The system of claim 1, wherein the read-only node is further configured to:

subsequent to the receipt of the indication of the view of the distributed database to initialize the read-only node, receive from the master node a plurality of change notifications to the distributed database maintained at the common data store for the distributed database, wherein the plurality of change notifications comprise a plurality of changes to user data and at least one indication of a current view of the distributed database;

store in a buffer at the read-only node the plurality of change notifications to user data and the at least one indication of a current view of the distributed database;

in response to receipt of a query for select data of the distributed database;

evaluate the buffer to determine a particular view of the distributed database to make available for the query; and

service the query according to the particular view of the distributed database and the one or more in-memory initialized at the read-only data node.

3. The system of claim 1, wherein the master node is configured to:

receive the request for the view of the distributed database to initialize the read-only node;

select one of a plurality of available views of the distributed database maintained at the common data store for the read-only node; and

send the indication of the selected view as the view to initialize the read-only node.

4. The system of claim 1, wherein the distributed database and the common data store are respective network-based services implemented as part of a network-based service platform.

5. A method, comprising:

performing, by one or more computing devices;

upon startup of a read-only node of a plurality of nodes implementing a distributed database;

requesting from a master node of the distributed database a view of the distributed database to initialize the read-only node for servicing queries directed to the distributed database;

in response to receiving an indication of the view of the distributed database at the read-only node;

obtaining, at the read-only node from a common data store maintaining data for the distributed database, one or more portions of the data according to the indicated view of the distributed database, wherein the common data store provides access to the master node and the read-only node;

based, at least in part, on the obtained data portions from the common data store, initializing one or more in-memory data structures at the read-only node for servicing queries directed toward the distributed database; and

in response to initializing the one or more in-memory data structures at the read-only node, making the read-only node available for servicing queries.

6. The method of claim 5, further comprising:

subsequent to receiving the indication of the view of the distributed database to initialize the read-only node, receiving from the master node a plurality of change notifications to the distributed database maintained at the common data store for the distributed database, wherein the plurality of change notifications comprise a plurality of changes to user data and at least one indication of a current view of the distributed database;

storing in a buffer at the read-only node the plurality of change notifications to user data and the at least one indication of a current view of the distributed database;

in response to receiving a query for select data of the distributed database at the read-only node;

evaluating the buffer to determine a particular view of the distributed database to make available for the query; and

servicing the query according to the particular view of the distributed database and the one or more in-memory initialized at the read-only data node.

7. The method of claim 6, wherein the plurality of change notifications further comprise at least one change to system metadata for the distributed database, and wherein the method further comprises:

updating at least one of the one or more in-memory data structures according to the at least one change to the system metadata for the distributed database.

8. The method of claim 5, further comprising:

receiving at the master node the request for the view of the distributed database to initialize the read-only node;

selecting one of a plurality of available views of the distributed database maintained at the common data store for the read-only node; and

sending the indication of the selected view as the view to initialize the read-only node.

9. The method of claim 8, wherein selecting one of a plurality of available views of the distributed database, comprises identifying a particular view of the plurality of available views not identified for reclamation at the common data store.

10. The method of claim 5, wherein the startup of the read-only node is triggered in response to a request to add the read-only node for servicing queries directed to the distributed database.

11. The method of claim 5, wherein a state of the distributed database prior to the initialization of the one or more in-memory data structures at the read-only node is different than a current state of the distributed data store upon completion of the initialization of the one or more in-memory data structures.

12. The method of claim 5, wherein the common data store for the distributed database is a log-structured data store, and wherein the indication of the view of the distributed database is a log sequence number (LSN).

13. The method of claim 5, wherein the distributed database and the common data store are respective network-based services implemented as part of a network-based service platform.

14. A non-transitory, computer-readable storage medium, storing program instructions that when executed by one or more computing devices cause the one or more computing devices to implement a read-only node of a plurality of nodes implementing a distributed database:

upon startup of the read-only node;

requesting from a master node of the distributed database a view of the distributed database to initialize the read-only node for servicing queries directed to the distributed database;

in response to receiving an indication of the view of the distributed database at the read-only node;

obtaining, at the read-only node from a common data store maintaining data for the distributed database, one or more portions of the data according to the indicated view of the distributed database, wherein the common data store provides access to the master node and the read-only node;

based, at least in part, on the obtained data portions from the common data store, initializing one or more in-memory data structures at the read-only node for servicing queries directed toward the distributed database; and

in response to initializing the one or more in-memory data structures at the read-only node, making the read-only node available for servicing queries.

15. The non-transitory, computer-readable storage medium of claim 14, wherein the program instructions further cause the read-only node to implement:

subsequent to receiving the indication of the view of the distributed database to initialize the read-only node, receiving from the master node a plurality of change notifications comprising a plurality of changes to user data maintained at the common data store and at least one indication of a current view of the distributed database;

storing in a buffer the plurality of change notifications to user data and the at least one indication of a current view of the distributed database;

in response to receiving a query for select data of the distributed database at the read-only node;

evaluating the buffer to determine a particular view of the distributed database to make available for the query; and

servicing the query according to the particular view of the distributed database and the one or more in-memory initialized at the read-only data node.

16. The non-transitory, computer-readable storage medium of claim 15, wherein the particular view of distributed database does not include at least one of the plurality of changes to the user data stored in the buffer at the read-only node.

17. The non-transitory, computer-readable storage medium of claim 15, wherein the plurality of change notifications further comprise at least one change to system metadata for the distributed database, and wherein the method further comprises:

updating at least one of the one or more in-memory data structures according to the at least one change to the system metadata for the distributed database.

18. The non-transitory, computer-readable storage medium of claim 14, wherein the startup of the read-only node is triggered in response to a restart of the read-only node for servicing queries directed to the distributed database.

19. The non-transitory, computer-readable storage medium of claim 14, wherein the common data store for the distributed database is a log-structured data store, and wherein the indication of the view of the distributed database is a log sequence number (LSN).

20. The non-transitory, computer-readable storage medium of claim 14, wherein the distributed database and the common data store are respective network-based services implemented as part of a network-based service platform.