Method of processing a synchronization point in a database management system to assure a database version using update logs from accumulated transactions

• US 5,778,388 A
• Filed: 09/15/1995
• Issued: 07/07/1998
• Est. Priority Date: 09/19/1994
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd., Hitachi Software Engineering Co., Ltd. (Hitachi, Ltd.)
• Inventors: Nagai, Hiroshi, Yamashita, Nobuyuki, Kawamura, Nobuo, Masai, Kazuo
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): Rones, Charles
• Application Number:
  US08/529,176
• Time in Patent Office: 1,026 Days
• Field of Search: 395/575, 395/182.13, 395/600, 395/602, 395/618, 395/182.18, 364/200, 371/12, 707/2, 707/202, 707/203
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1474 in transactions G06F16/20 takes precedence
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99954 Version management

Abstract

In a database management method and a database management system in which transactions need not be stopped at a synchronization point (syncpoint) acquired at a fixed interval of time, when a point to acquire a syncpoint is reached in a database control procedure, a syncpoint acquisition start log is output and then a syncpoint acquisition flag is set ON in a page control table of each updated page existing in a buffer pool. In the operation, a list of update page control tables is also created to write in the database the pages which are indicated in the list thus prepared. However, for a transaction accessing the pertinent updated page prior to the write operation thereof in the database, the data write operation is performed before the page is referenced, thereby enabling the access to be performed to the database without interrupting the transaction.

Claims

1. In a database management system for performing a plurality of transactions concurrently, in which a restart recovery process is assumed at an occurrence of a system failure, a method for acquiring a synchronization point (syncpoint) for assuring a database version on an external storage, said syncpoint being determined at each interval at which database update logs from the transactions are accumulated (incremented) to a given amount, said method comprising the steps of:

assigning, at the beginning of acquisition of a syncpoint, a mark indicating that syncpoint acquisition is in progress, the tables controlling all updated pages in a buffer pool mapped onto a main storage, said buffer pool including a plurality of buffers for storing respective pages, said updated pages not having been written into a database of an external storage;

writing, during the syncpoint acquisition, the updated pages for the marked table to the database of the external storage;

executing a transaction for further updating specific ones of the updated pages for the marked tables during the syncpoint acquisition process, before the updated page or pages are accessed, writing the further updated specific page or pages to said database, removing the mark from the control table for the further updated specific pages to allow a request of access to the further updated specific pages; and

determining, in response to termination of the write operation to said database, that the syncpoint acquisition is completed at the end of the write operation for all updated pages for the marked tables.

2. A database management method according to claim 1, further comprising the steps of:

detecting a point of time relative to a previous syncpoint acquiring point when an amount of log data written in a log file reaches a predetermined value;

setting said detected point of time as a pre-syncpoint acquisition point; and

asynchronously writing the updated pages in said buffer pool to said external storage of said database during a period of time ranging from the pre-syncpoint acquisition point to the beginning of syncpoint acquisition.

3. A database management method according to claim 2, wherein said pre-syncpoint acquisition process includes the step of assigning, at the beginning of syncpoint acquisition for each of the updated pages in the buffer which are not written in the database before the beginning of syncpoint acquisition, a mark indicating that syncpoint acquisition is in process to the updated page control table controlling all updated pages in the buffer.

4. A database management method according to claim 1, wherein the step of allowing an access request to the further updated specific pages after removal of the mark includes the steps of:

checking ON/OFF of a syncpoint acquisition flag disposed in the page control table controlling each page in the buffer, the flag indicating that a page is assigned as an output page at syncpoint acquisition;

setting, at detection of an event that the flag is ON, an output-in-process flag to ON, the output-in-process flag being disposed in the page control table and indicating that the page is being written in the database;

unlocking a buffer pool in which the buffer exists;

writing the updated page from the buffer pool in the database;

setting the output-in-process flag to OFF after the write operation is terminated; and

setting the synpoint acquisition flag and the output request flag to OFF, thereby allowing the access request.

5. A database management method according to claim 4, further comprising the steps of:

locking, when usage of the page accessed for the transaction is finished, the buffer pool before the step of checking ON/OFF of the syncpoint acquisition flag;

executing, after the output request flag is set to OFF, a concurrency control process to activate a transaction when an access is made to a page while the page is being written in the database; and

locking, yet again, the buffer pool after the concurrency control process is performed.

6. A database system including a computer system having a central processing system (CPU) and a main storage, an external storage having a database and terminals, said computer system further including a database management system which comprises:

means for acquiring a synchronization point (syncpoint) in said database management system for enabling a plurality of transactions to be performed concurrently in which a restart recovery process is assumed at an occurrence of a system failure, said syncpoint assuring a database version on said external storage, said syncpoint being determined at each interval at which database update logs from the transactions are accumulated (incremented) to a given amount, said means comprising;

a buffer and page control tables,

an update page control table,

mark means for assigning, at the beginning of an acquisition of a syncpoint, a mark indicating that syncpoint acquisition is in process to tables controlling all updated pages in a buffer pool mapped onto said main storage, said buffer pool including a plurality of buffers for storing respective pages, said updated pages not having been written into a database of said external storage,

write means for writing, during the syncpoint acquisition, the updated pages for the marked table to the database of said external storage,

update and access control means for further updating specific ones of the updated pages for the marked tables during the syncpoint acquisition process, before the specific updated pages are accessed, writing the further updated specific pages to said database, removing the mark from the control table for the further updated specific pages to allow a request of access and to the further updated specific pages, and

determining means for determining, in response to termination of a write operation of said database, that the syncpoint acquisition has been completed at the end of the write operation for all updated pages for the marked tables.

7. A database management system according to claim 6, wherein said means for allowing the access request after removal of the mark checks ON/OFF of a syncpoint acquisition flag disposed in the page control table controlling each page in the buffer, said flag indicating that a page is assigned as an output page at syncpoint acquisition;

sets, at detection of an event that the flag is ON, an output-in-process flag to ON, said output-in-process flag being disposed in the page control table and indicating that the page is being written in said database;

unlocks a buffer pool in which the buffer exists, writes the updated page from the buffer pool in the database, sets the output-in-process flag to OFF after the write operation is terminated, and sets the syncpoint acquisition flag and the output request flag to OFF to thereby allow the access request.

8. A database management system according to claim 6, further comprising a buffer pool control table for controlling a buffer pool reserved in the main storage with correspondences established between the buffer pool and pages having a physically fixed length as a unit of accumulating data in the database, wherein:

said table includes a number of updated pages existing in the buffer table and a deferred write flag indicating that a deferred write operation is being performed by a deferred write processing part;

said flag being responsive to operation of the deferred write processing part writing data updated in the buffer pool to said database in an asynchronous fashion with respect to transactions; and

when a number of log output operations reaches a value associated with a syncpoint acquiring point, control is passed to a pre-syncpoint acquiring process in which the buffer pool is locked, the deferred write flag is set to ON, and the buffer pool is unlocked.

13. A database management system according to claim 6, wherein:

said page control table controls buffers and all pages existing in a buffer pool;

said page control table includes a syncpoint acquisition flag indicating that a page related thereto is an output page at syncpoint acquisition and an output request flag; and

said syncpoint acquisition flag is set to a syncpoint acquisition state for a page in the buffer pool for which the output request flag is in an output request state and the update page control table is simultaneously generated, thereby controlling the pages to be written in said database during the syncpoint acquisition.

9. For a database management system for performing a plurality of transactions concurrently, in which a restart recovery process is assumed at an occurrence of a system failure, a method for acquiring a synchronization point (syncpoint) for assuring a database version on an external storage, said syncpoint being determined at each interval at which database update logs from the transactions are accumulated (incremented) to a given amount, said method comprising the steps of:

assigning, at the beginning of acquisition of a syncpoint, a mark indicating that syncpoint acquisition is in progress to tables controlling all updated pages in a buffer pool mapped onto a main storage, said buffer pool including a plurality of buffers for storing respective pages, said updated pages not having been written into a database of an external storage;

writing, during the syncpoint acquisition, the updated pages for the marked control table to the database of the external storage;

executing a transaction for further updating specific ones of the updated pages for the marked control table during the syncpoint acquisition process, before the updated page or pages are accessed, writing the further updated specific page or pages to said database, removing the mark from the marked control table for the further updated specific pages to allow a request of access to the further updated specific pages;

determining, in response to termination of the write operation to said database, that the syncpoint acquisition is completed at the end of the write operation for all updated pages for the marked tables;

detecting a point of time relative to a previous syncpoint acquiring point when an amount of log data written in a log file reaches a predetermined value;

setting said detected point of time as a pre-syncpoint acquisition point; and

asynchronously writing the updated pages in said buffer pool to said external storage of said database during a period of time ranging from the pre-syncpoint acquisition point to the beginning of syncpoint acquisition;

wherein said pre-syncpoint acquisition process comprises the steps of;

determining, at the beginning of syncpoint acquisition, whether or not the pre-syncpoint acquisition is completed;

correcting, when the pre-syncpoint acquisition is not completed, a setting value of the beginning of pre-syncpoint acquisition to a point of time earlier than that indicated by the setting value according to the number of updated pages in the buffer not written in the database; and

correcting, when the pre-syncpoint acquisition is completed, a setting value of a start point of presyncpoint acquisition to a point of time delayed as compared with a point of time indicated by the setting value according to the number of updated pages existing in the buffer when the syncpoint acquisition is performed.

10. A database system including a computer system having a central processing system (CPU) and a main storage, an external storage having a database and terminals, said computer system further including a database management system which comprises:

means for acquiring a synchronization point (syncpoint) in said database management system for enabling a plurality of transactions to be performed concurrently in which a restart recovery process is assumed at an occurrence of a system failure, said syncpoint being determined at each interval at which database update logs from the transactions are accumulated (incremented) to a given amount, said means comprising;

a buffer and page control tables,

an update page control table,

mark means for assigning, at the beginning of an acquisition of a syncpoint, a mark indicating that syncpoint acquisition is in process to tables controlling all updated pages in a buffer pool mapped onto said main storage, said buffer pool including a plurality of buffers for storing respective pages, said updated pages not having been written into a database of said external storage,

write means for writing, during the syncpoint acquisition, the updated pages for the marked control table to the database of said external storage,

update and access control means for further updating specific ones of the updated pages for the marked control table during the syncpoint acquisition process, before the specific updated pages are accessed, writing the further updated specific pages to said database, removing the mark from the control table for the further updated specific pages to allow a request of access and to the further updated specific pages, and

determining means for determining, in response to termination of a write operation of said database, that the syncpoint acquisition has been completed at the end of the write operation for all updated pages for the marked tables; and

means for detecting a point of time relative to a previous syncpoint acquiring point when an amount of log data written in a log file reaches a predetermined value, wherein

said update and access control means includes a pre-syncpoint processing means for asynchronously writing the updated pages in said buffer pool to said external storage of said database during a period of time ranging from the pre-syncpoint acquisition point to the beginning of syncpoint acquisition.

11. A database management system according to claim 10, further comprising means operative in the pre-syncpoint acquisition process for assigning, at the beginning of syncpoint acquisition for each of the updated pages in the buffer not written in the database before the beginning of syncpoint acquisition, a mark indicating that syncpoint acquisition is in progress to the updated page control table controlling all updated pages in the buffer.

12. A database management system according to claim 10, further comprising for the pre-syncpoint acquisition process:

means operative for storing at the beginning of syncpoint acquisition whether or not the pre-syncpoint acquisition is completed;

means for correcting, when the pre-syncpoint acquisition is not completed, a setting value of the begining of pre-syncpoint acquisition to a point of time earlier than that indicated by the setting value according to the number of updated pages in the buffer not written in said database; and

means for correcting, when the pre-syncpoint acquisition is completed, a setting value of the begining of pre-syncpoint acquisition to a point of time delayed as compared with a point of time indicated by the setting value according to the number of updated pages existing in the buffer when the syncpoint acquisition is performed.