Replication for on-line hot-standby database

• US 9,798,792 B2
• Filed: 03/18/2014
• Issued: 10/24/2017
• Est. Priority Date: 06/25/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Laiho, Kyosti M., Lindstrom, Jan P., Parkkinen, Jarmo, Raatikka, Vilho T.
• Primary Examiner(s): Wilson, Kimberly
• Application Number:
  US14/655,364
• Publication Number:
  US 20150339366A1
• Time in Patent Office: 1,316 Days
• Field of Search: 707610
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 16/275 Synchronous replication

Abstract

A method, and corresponding computer program product and computer system, for replicating a database image in a distributed database environment comprises: defining a checkpoint image of the primary node including a database structure and a plurality of database pages; creating a replica database by initiating a backup node and saving the defined structure on the initiated backup node; sending each database page of the checkpoint image for saving on the backup node; saving every transaction on the primary node and creating a corresponding REDO transaction; identifying each data page operated on by each REDO transaction; sending each created REDO transaction to the backup node in the order in which the corresponding transaction occurred, and prioritizing each identified database page so that it arrives at the backup node before or substantially at the same time as a corresponding REDO transaction.

Claims

1. A computer system for replicating a database image from an operational primary node in a distributed database environment, said computer system comprising:

one or more computer processors; and

one or more computer-readable storage media;

wherein program instructions are stored on the computer-readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising instructions to cause the at least one of the one or more computer processors to;

define a checkpoint image of the primary node including a database structure and a plurality of database pages;

create a replica database on a backup node by initiating a backup node and saving the defined database structure on the initiated backup node;

send each database page of the checkpoint image to the backup node for saving;

save, after creation of a checkpoint image is started, each subsequent transaction on the primary node thereby creating a corresponding REDO transaction for sending to the backup node;

identify each data page operated on by each subsequent transaction;

send, in parallel with the sending of the database pages, each created REDO transaction to the backup node in the order in which the corresponding transaction occurred so that the backup node can replicate the transactions in the correct order; and

prioritize each identified database page so that it arrives at the backup node before or substantially at the same time as a corresponding REDO transaction whereby the corresponding REDO transaction can operate on the identified database page without waiting for every database page to be saved on the backup node.

2. The computer system according to claim 1, whereby a modified database page is prioritized over an unmodified database page.

3. The computer system according to claim 1, wherein a database page in main memory is prioritized over database pages in persistent storage.

4. The computer system according to claim 1, further comprising program instructions to:

identify two or more data pages operated on by a REDO transaction; and

sending said two or more data pages in parallel with the sending of the created REDO transaction.

5. The computer system according to claim 1, wherein the primary node notifies the backup node that all database pages have been sent.

6. The computer system according to claim 1, wherein the backup node notifies the primary node that all database pages have been received.

7. The computer system according to claim 1, wherein REDO transactions and database pages are interleaved in a send buffer before sending to a backup node.

8. The computer system according to claim 1 wherein transactions place a continuous load on the primary node.

9. A method for replicating a database image of an operational primary node to a backup node in a distributed database environment, said method comprising:

defining a checkpoint image of a primary node including a database structure and a plurality of database pages;

creating a replica database on a backup node by initiating a backup node and saving the defined database structure on the initiated backup node;

sending each database page of the checkpoint image to the backup node for saving;

saving, after creation of a checkpoint image is started, each subsequent transaction on the primary node thereby creating a corresponding REDO transaction for sending to the backup node;

identifying each data page operated on by each subsequent transaction;

sending, in parallel with the sending of the database pages, each created REDO transaction to the backup node in the order in which the corresponding transaction occurred so that the backup node can replicate the transactions in the correct order; and

prioritizing each identified database page so that it arrives at the backup node before or substantially at the same time as a corresponding REDO transaction whereby the corresponding REDO transaction can operate on the identified database page without waiting for every database page to be saved on the backup node.

10. The method according to claim 9, whereby a modified database page is prioritized over an unmodified database page.

11. The method according to claim 9, wherein a database page in main memory is prioritized over database pages in persistent storage.

12. The method according to claim 9, further comprising:

identifying two or more data pages operated on by a REDO transaction; and

sending said two or more data pages in parallel with the sending of the created REDO transaction.

13. The method according to claim 9, wherein the primary node notifies the backup node that all database pages have been sent.

14. The method according to claim 9, wherein the backup node notifies the primary node that all database pages have been received.

15. The method according to claim 9, wherein REDO transactions and database pages are interleaved in a send buffer before sending to a backup node.

16. The method according to claim 9 wherein transactions place a continuous load on the primary node.

17. A computer program product for replicating a database image from an operational primary node to a backup node in a distributed database environment, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to:

define a checkpoint image of a primary node including a database structure and a plurality of database pages;

create a replica database on a backup node by initiating a backup node and saving the defined database structure on the initiated backup node;

send each database page of the checkpoint image to the backup node for saving;

save, after creation of a checkpoint image is started, each subsequent transaction on the primary node thereby creating a corresponding REDO transaction for sending to the backup node;

identify each data page operated on by each subsequent transaction;

send, in parallel with the sending of the database pages, each created REDO transaction to the backup node in the order in which the corresponding transaction occurred so that the backup node can replicate the transactions in the correct order; and

prioritize each identified database page so that it arrives at the backup node before or substantially at the same time as a corresponding REDO transaction whereby the corresponding REDO transaction can operate on the identified database page without waiting for every database page to be saved on the backup node.

18. The computer program product of claim 17, wherein a modified database page is prioritized over an unmodified database page.

19. The computer program product of claim 17, wherein a database page in main memory is prioritized over database pages in persistent storage.

20. The computer program product of claim 17, further comprising program instructions to:

identify two or more data pages operated on by a REDO transaction; and

sending said two or more data pages in parallel with the sending of the created REDO transaction.