High speed on-line backup when using logical log operations

• US 6,578,041 B1
• Filed: 06/30/2000
• Issued: 06/10/2003
• Est. Priority Date: 06/30/2000
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lomet, David B.
• Primary Examiner(s): Rones, Charles
• Assistant Examiner(s): Mahmoudi, Hassan
• Application Number:
  US09/607,614
• Time in Patent Office: 1,075 Days
• Field of Search: 707/102, 707/3, 707/10, 707/201, 707/202, 707/200, 707/1, 707/2, 707/9, 707/103.R, 707/104.1, 707/203, 707/204, 707/205, 328/162, 709/219, 714/4
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A database computer system and a high speed method for backup is provided for use when general logical operations are logged. Data is copied from the active stable database to a backup database while update activity continues. The stable database is divided into disjoint partitions, and backup progress is independently tracked in each partition. For each partition in which backup progress is to be tracked independently, two boundary values are maintained that separate objects into categories of pending, backed up, or in doubt. To permit backup to proceed with little synchronization between it and the cache manager, backup reports its progress only from time to time. Depending on system tuning considerations, the reporting can be made more or less precise by varying the granularity of the steps in which backup progress is reported.

Claims

1. In a database computer system having a non-volatile memory including a stable log and a stable database comprising a plurality of objects, a cache manager for flushing objects to the stable database, and a backup database, a computer-implemented method comprising the following steps:

(a) copying objects from a first region of the stable database to the backup database while a first update activity continues, in accordance with at least a first logical log operation, the first region of the stable database bounded by a first boundary value and a second boundary value;

(b) adjusting the first boundary value and adjusting the second boundary value to define a further region of the stable database; and

(c) copying objects from the further region of the stable database to the backup database while a second update activity continues, in accordance with at least a second logical log operation.

2. A computer-implemented method as recited in claim 1, further comprising performing steps (b) and (c) until substantially all of the objects of the stable database have been copied to the backup database.

3. A computer-implemented method as recited in claim 1, further comprising performing steps (b) and (c) until the objects of a predetermined portion of the stable database have been copied to the backup database.

4. A computer-implemented method as recited in claim 3, wherein the predetermined portion of the stable database is bounded by a minimum value and a maximum value, the first boundary value initially set to the minimum value.

5. A computer-implemented method as recited in claim 1, wherein adjusting the first boundary value comprises setting the first boundary value equal to the second boundary value and adjusting the second boundary value comprises increasing the second boundary value by a predetermined increment.

6. A computer-implemented method as recited in claim 1, wherein adjusting the first boundary value comprises increasing the first boundary value by a predetermined increment and adjusting the second boundary value comprises increasing the second boundary value by the predetermined increment.

7. A computer-implemented method as recited in claim 1, wherein each object has a value, with the objects being copied in order of increasing value.

8. A computer-implemented method as recited in claim 7, wherein the value of each object is determined from an associated physical location in the stable database.

11. A computer-implemented method as recited in claim 1, further comprising the cache manager obtaining a backup latch to prevent the boundary values from being altered when objects are being flushed to the stable database.

12. A computer-implemented method as recited in claim 11, further comprising acquiring the backup latch when adjusting the boundary values, and releasing the backup latch after the boundary values have been changed.

13. A computer-implemented method as recited in claim 1, further comprising posting to the stable log cache manager identity write log operations for objects that are being flushed.

14. A computer-implemented method as recited in claim 13, further comprising establishing flush order dependencies between objects in the stable database and enforcing the dependencies when the objects are copied to the backup database when the flush dependency is violated in the backup.

15. A computer programmed to perform the steps of the computer-implemented method as recited in claim 1.

16. A computer-readable memory that directs a computer to perform the steps in the method as recited in claim 1.

9. A computer-implemented method as recited in 7, wherein the copying of objects is responsive to a plurality of logical operations that are restricted to tree operations.

10. A computer-implemented method as recited in claim 9, further comprising reducing the copying of the objects updated by the tree operations.

17. A database computer system comprising:

a non-volatile memory including a stable log and a stable database comprising a plurality of objects;

a backup database; and

a resource manager including a cache manager which flushes objects to the stable database, the resource manager being configured to copy objects from a first region of the stable database to the backup database while a first update activity continues, in accordance with at least a first logical log operation, the first region of the stable database bounded by a first boundary value and a second boundary value;

adjust the first boundary value and adjust the second boundary value to define a further region of the stable database; and

copy objects from the further region of the stable database to the backup database while a second update activity continues, in accordance with at least a second logical log operation.

18. A database system as recited in claim 17, wherein the objects are copied and the boundaries are adjusted until a predetermined portion of the objects of the stable database have been copied to the backup database.

19. A database system as recited in claim 18, wherein the predetermined portion is substantially all of the objects.

20. A database system as recited in claim 18, wherein the predetermined portion of the stable database is bounded by a minimum value and a maximum value, the first boundary value initially set to the minimum value.

21. A database system as recited in claim 17, wherein the first boundary value is adjusted by increasing the first boundary value by a predetermined increment and the second boundary value is adjusted by increasing the second boundary value by the predetermined increment.

22. A database system as recited in claim 17, wherein the first boundary value is adjusted by setting the first boundary value equal to the second boundary value and the second boundary value is adjusted by increasing the second boundary value by a predetermined increment.

23. A database system as recited in claim 17, wherein each object has a value, with the objects being copied in order of increasing value.

24. A database system as recited in claim 23, wherein the value of each object is determined from an associated physical location in the stable database.

25. A database system as recited in claim 17, further comprising a plurality of logical operations that are restricted to tree operations.

26. A database system as recited in claim 17, further comprising a backup latch for preventing the boundary values from being altered when objects are being flushed to the stable database.

27. A database system as recited in claim 17, wherein the stable log includes cache manager identity write log operations for objects that are being flushed.

28. A database system as recited in claim 17, wherein the resource manager establishes flush order dependencies between cached objects of the stable database and enforces the dependencies when the objects are copied to the backup database.