System of database copy operations using a virtual page control table to map log data into physical store order

• US 5,321,832 A
• Filed: 05/22/1990
• Issued: 06/14/1994
• Est. Priority Date: 05/26/1989
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Tanaka, Kazuaki, Yamashita, Kuniaki, Ogata, Hiromichi
• Primary Examiner(s): Kulik, Paul V.
• Assistant Examiner(s): AMSBURY, WAYNE P
• Application Number:
  US07/526,838
• Time in Patent Office: 1,484 Days
• Field of Search: 364/200, 395/375, 395/700, 395/425, 395/400, 395/600, 395/575, 395/250
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A method for producing a duplication of a database stored in an external storage by writing over copy data of the database with update log data which was acquired after acquisition of the copy data. This method is implemented in a computer system having a virtual storage operating system. The system includes a virtual storage area which is defined as having virtual pages which have a one-to-one correspondence to blocks in an external copy data storage, where the virtual pages are the database copy data is stored and in an order according to physical addresses of the blocks. Each update log data is acquired in units of the blocks. A control table is provided which includes control values which have a one-to-one correspondence to the virtual pages. A control value from the control table is set when the update log data is set to the virtual pages. Repeated operations are made of reading out the update log data from the external log data storage and checking a corresponding control value to see if the control value is set, and setting the control value if it was not set. The control table is then searched in the order of virtual page arrangement and where the control values are set the update log data is read out and is written over the copy data in the external copy data storage. This writing thereby being done in such order that the actuator has a minimal travel distance to a track position of external storage where the copy data is stored.

Claims

1. A method of producing a duplication of a database having a writing step, in which copy data of said database in an external copy data storage are written over by update log data from an external log data storage, where the update log data was acquired after acquisition of said copy data, the method comprising the steps of:

(a) defining a virtual storage area which comprises virtual pages which have a one-to-one correspondence to blocks in said external copy data storage, and where the virtual pages are arranged in an order according to physical addresses of said blocks to which they correspond;

(b) defining a control table, which includes control values which have a one-to-one correspondence to said virtual pages, and where a control value of the control values will be set when the update log data is set to a corresponding virtual page;

(c) repeating the substeps of;

(i) reading out the update log data acquired in units of said blocks from said external log data storage;

(ii) checking said control value corresponding to the virtual page which corresponds to one of said blocks of copy data to be replaced by said update log data and

when the control value has not been set, assigning a real storage for the virtual page and storing said update log data to said real storage assigned thereto, and setting the control value,

when the control value has already been set, updating the real storage assigned for the virtual page with said update log data; and

(d) searching said control table in the order of virtual page arrangement and repeating the substep of;

(i) when said control value is set, reading out the update log data in said real storage and writing over said copy data in said external copy data storage with said update log data, and resetting said control value.

2. A database duplication producing method according to claim 1, wherein the update log data is read out of the external log data storage, where said update log data has been stored in advance, in the order of acquisition of said update log data.

3. A database duplication producing method according to claim 1, wherein, for each external copy data storage where copy data is stored, update log data, which is set in the virtual storage of the virtual pages, is written over the copy data in the external copy data storage.

4. A database duplication producing method according to claim 1, wherein update log data, which overwrites on a same track of the external copy data storage where copy data is stored and is set in the real storage of a group of virtual pages, is written over the copy data in the external copy data storage prior to overwriting other copy data.

5. A database duplication producing method according to claim 1, wherein update log data, which overwrites on tracks of the same cylinder of the external copy data storage where copy data is stored and is set in the real storage of a group of virtual pages, is written over the copy data in the external copy data storage prior to overwriting other copy data.

6. A database duplication producing method according to claim 4, wherein the update log data is written over the copy data such that the travel distance of the actuator to the track of external storage where the copy data is stored is minimal.

7. A database duplication producing method according to claim 5, wherein the update log data is written over the copy data such that the travel distance of the actuator to the track of external storage where the copy data is stored is minimal.

8. A database duplication producing method according to claim 6, wherein update log data in units corresponding to tracks is written sequentially to tracks of an adjacent cylinder.

9. A database duplication producing method according to claim 7, wherein update log data in units corresponding to tracks is written sequentially to tracks of an adjacent cylinder.

10. A database duplication producing method according to claim 6, wherein update log data in units corresponding to tracks is written sequentially to tracks of a same cylinder and, next, tracks of an adjacent cylinder.

11. A database duplication producing method according to claim 7, wherein update log data in units corresponding to tracks is written sequentially to tracks of a same cylinder and, next, tracks of an adjacent cylinder.

12. A database duplication producing method according to claim 1, wherein the control value to be set indicates the time sequential relation on the acquisition of the update log data.

13. A database duplication producing method according to claim 12, wherein the update log data is entered and set to a virtual page for each external storage where update log data is stored.

14. A database duplication producing method according to claim 13, wherein update log data is fetched, and the value indicative of the time sequential relation of the acquisition of the update log data is compared with a control value in a control table corresponding to the virtual page to which the update log data is set, and the contents of the real storage of the virtual page is judged to be the latest update log data.

15. A database duplication producing method according to claim 13, wherein a control flag for the exclusive use of a control table is provided, update log data is fetched for each of external storages where update log data is stored, and the comparison process on the time sequential relation of the acquisition of the update log data is implemented.

16. A database duplication producing method according to claim 1, wherein the real storage has been assigned, and, in place of a page-out process for a virtual page where the update log data is set, the update log data is written over the copy data and the real storage is freed from the virtual page.

17. A database duplication producing method according to claim 1, wherein the real storage has been assigned, and, in place of a page-out process for a virtual page where update log data is set, the update log data is written over the copy data and the real storage is freed from the virtual page, and the control value field of the virtual page is initialized.

18. A database duplication producing method according to claim 16, wherein real storage has been assigned, and, in place of a page-out process for the virtual pages where update log data is set, update log data which is set in real storage of virtual pages, with corresponding tracks being on a same track as the virtual pages, is written over copy data prior to overwriting other copy data.

19. A database duplication producing method according to claim 17, wherein real storage has been assigned, and, in place of a page-out process for the virtual page where update log data is set, update log data which is set in real storage of virtual pages, with corresponding tracks being on a same track as of the virtual pages, is written over copy data prior to overwriting other copy data.

20. A database duplication producing method according to claim 1, wherein real storage of virtual pages where update log data and control values are set is assigned to nonvolatile storage.

21. A database duplication producing method according to claim 1, wherein, when updating of the database has been accomplished, update log data is set in an update data storage area.

22. A database duplication producing method according to claim 1, wherein only selected update log data for blocks of an external storage are selected for duplication by a duplication means, from among a group of update log data, and the selected data is set in real storage of a corresponding virtual page.

23. A database duplication producing method according to claim 1, wherein virtual storage areas are provided for each of the copy data for which duplication is intended and the update log data is stored to a corresponding virtual area of said virtual storage area.

24. A method of producing a duplication of a database stored in an external storage to protect against a fault of the database by writing, over whole copy data of the database, differential copy data which is a copy of only an updated portion of the database and update log data acquired after the acquisition of said copy data, the method comprising the steps of:

(a) defining a virtual storage area, which comprises virtual pages which have a one-to-one correspondence to blocks in said external storage, and where the virtual pages are arranged in the virtual storage in an order according to physical addresses of the blocks in said external storage to which they correspond;

(b) assigning real storage for said differential copy data, to a virtual page corresponding to a block where copy data to be replaced by said particular differential copy data exists, and storing the particular differential copy data in the real storage assigned thereto;

(c) defining a control table, which includes control values which have a one-to-one correspondence to said virtual pages, and where a control value of the control values will be set when the update log data is set to a corresponding virtual page;

(d) repeating the substeps of;

(i) reading out the update log data acquired in units of said blocks from said external log data storage;

(ii) checking said control value corresponding to the virtual page which corresponds to one of said blocks of copy data to be replaced by said update log data and

when the control value has not been set, assigning real storage, for said update log data, to a virtual page corresponding to a block where copy data to be replaced by said update log data exists, and storing each update log data in the real storage assigned thereto and setting the control value,

when the control value has already been set, updating the real storage assigned for the virtual page with said update log data; and

(e) searching said control table in the order of virtual page arrangement and repeating the substep of;

(i) when said control value is set, reading the differential copy data and the update log data out of the real storages in the order of the virtual page arrangement and writing over the copy data in the external storage, and resetting said control value.

25. A database duplication producing method according to claim 24, wherein differential copy data is set in real storage of a virtual page and, next, update log data after the acquisition of the differential copy data is set in the real storage of the virtual page.

26. A database duplication producing method according to claim 25, wherein, when differential copy data exists over a plurality of generations, the differential copy data is fetched in the order of acquisition thereof.

27. A database duplication producing method according to claim 24, wherein,

storing the differential copy data, with a value indicative of the time sequential relation appended to the first update log data after the acquisition of the differential copy data being appended thereto;

storing the latest time sequential relation appended to each differential copy data, when different differential copy data corresponding to a same virtual page exists;

storing the latest time sequential relation appended to each update log data, when different differential copy data corresponding to a same virtual page exists;

when update log data and different update log data corresponding to a same virtual page exists, the update log data is stored in the real storage if the time sequential relation appended to the update log data is the same or newer than the time sequential relation appended to the differential copy data; and

when the differential copy data is stored in the real storage if the time sequential relation appended to the differential copy data is newer than the time sequential relation appended to the update log data.

28. A database duplication producing method according to claim 27, wherein,

in correspondence to virtual pages, control tables for setting values indicative of the time sequential relation of data, which is set in real storage of the virtual pages, and the type of data are provided;

a value indicative of the time sequential relation and a value indicative of differential data are set in the control tables of a virtual page where the differential copy data is set; and

a value indicative of the time sequential relation appended to update log data and a value indicative of update log data are set in the control tables of a virtual page where the update log data is set.

29. A database duplication producing method according to claim 27, wherein, in correspondence to virtual pages, a control table for setting the time sequential relation on differential copy data set in real storage of virtual pages and a control value field for setting the time sequential relation on update log data are provided.

30. A database duplication producing method according to claim 24, wherein a control flag for the exclusive use of the control table is provided, and process for setting the differential copy data and update log data to real storage of virtual pages is executed irrespective of the time sequential relation on the acquisition of said data.

31. A database duplication producing method according to claim 24, wherein only differential copy data for blocks of external storage, for which database duplication is intended, is selected from among a group of differential copy data, and the selected data is set in the real storage corresponding to a virtual page.

32. In a database system including an external copy data storage for storing copy data arranged into a plurality of blocks, and an external log data storage for storing update log data used to overwrite the copy data, a method for duplicating a database of the database system, the method comprising the steps of:

(a) defining a virtual storage including virtual pages which have a one-to-one correspondence with the copy data blocks;

(b) defining a control table, which comprises control values which are in a one-to-one correspondence to the virtual pages and where a control value of the control values when the update log data is set to a corresponding virtual page will be set;

(c) repeating the substeps of;

(i) reading out the update log data from the external log data storage in an arrangement corresponding to the blocks of copy data and setting the read out update log data to virtual pages in a reordered arrangement such that the update log data is reordered in the virtual storage to correspond to the arrangement of the copy data storage;

(ii) checking the control value corresponding to the virtual page which corresponds to one of the blocks of copy data to be replaced by the update log data and

when the control value has not been set,

assigning sequential real storage for the virtual pages set with the update log data and storing the virtual pages having the update log data to the real storage, and setting the control value;

when the control value has already been set, updating the real storage assigned for the virtual page with said update log data; and

(d) searching said control table in the order of virtual page arrangement and repeating the substep of;

(i) when the control value is set, reading out the update log data from the virtual pages into the real storage and writing over the copy data in a sequence according to the reordered arrangement, and resetting the control value.