CONTENT-INDEPENDENT AND DATABASE MANAGEMENT SYSTEM-INDEPENDENT SYNTHETIC FULL BACKUP OF A DATABASE BASED ON SNAPSHOT TECHNOLOGY

• US 20180129567A1
• Filed: 01/11/2018
• Published: 05/10/2018
• Est. Priority Date: 04/21/2015
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: KUMARASAMY, Paramasivam
• Granted Patent: US 10,303,550 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

The illustrative storage management system uses snapshot technologies and performs block-level analysis thereof and to synthesize full backups of a database, regardless of the database management system (DBMS) and content of the database and without involving native DBMS utilities. Synthetic full copies are created efficiently and use network transport resources sparingly. Successive snapshots of the database may be hardware snapshots and/or software snapshots. The illustrative storage management system tracks which data blocks in the database change over time after a baseline full copy is saved to secondary storage. Only the changed blocks are subsequently moved to secondary storage as incremental backups and are indexed for future reference. A synthetic full backup of the database, at a given point in time, may be created by synthesizing the original full backup with changed blocks from any number of later incremental backups. The synthetic full backup comprises pointers to appropriate data blocks, ignoring intermediate changes, and pointing to the most current data block in secondary storage relative to the given point in time chosen for the synthetic full backup. The illustrative storage management system may restore the synthetic full backup without native DBMS utilities.

Claims

1. A non-transitory computer-readable medium storing instructions that, when executed by a computing device, which comprises one or more processors and computer memory, cause the computing device to perform operations comprising:

storing a copy of a first snapshot of a database to a storage device,

wherein a database management system (DBMS) performs operations that change data in the database;

after each respective snapshot in a plurality of successive snapshots of the database is generated;

(i) receiving identifiers of changed data blocks that changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database,

(ii) extracting the changed data blocks from the respective snapshot based on the respective identifiers,

(iii) storing to the storage device a respective incremental backup of the database comprising the changed data blocks extracted from the respective snapshot of the database, and

(iv) indexing the changed data blocks that are in the respective incremental backup;

based on the indexing, generating a synthetic full block-level backup of the database represented at a given point in time,

wherein the synthetic full block-level backup comprises pointers to data blocks that are most current relative to the given point in time, including pointers to changed data blocks, and skipping over intermediate changed data blocks, as found in;

(a) the copy of the first snapshot of the database, and (b) one or more incremental backups of the database;

storing the synthetic full block-level backup of the database to the storage device; and

restoring the database from the synthetic full block-level backup in the storage device without using a native restore feature of the database management system.

2. The non-transitory computer-readable medium of claim 1 wherein the copy of the first snapshot comprises all data blocks in the first snapshot.

3. The non-transitory computer-readable medium of claim 1 wherein the restored database comprises all data blocks of the database at the time the most recent snapshot was generated in the plurality of successive snapshots.

4. The non-transitory computer-readable medium of claim 1 wherein a media agent that executes on the computing device performs the operations comprising:

the storing of the copy of the first snapshot, the receiving, the extracting, the storing of the respective incremental backup, the generating of the synthetic full block-level backup, and the storing of the synthetic full block-level backup.

5. The non-transitory computer-readable medium of claim 1 wherein the synthetic full block-level backup is independent of type of database management system.

6. A method for generating a full block-level backup copy of a database in a data storage management system, the method comprising:

storing a copy of a first snapshot of the database to a storage device, wherein a database management system (DBMS) performs operations that change data in the database, and

wherein the storing operation is performed by a media agent component of the data storage management system, which executes on a first computing device comprising one or more processors and computer memory;

after each respective snapshot in a plurality of successive snapshots of the database is generated in the data storage management system;

(i) receiving, by the media agent, identifiers of changed data blocks that changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database,

(ii) extracting, by the media agent, the changed data blocks from the respective snapshot based on the respective identifiers, and

(iii) storing, by the media agent to the storage device, a respective incremental backup of the database comprising the changed data blocks extracted from the respective snapshot of the database, and

(iv) indexing, by the media agent, the changed data blocks that are in the respective incremental backup;

based on the indexing, generating, by the media agent, a synthetic full block-level backup of the database represented at a given point in time,

wherein the synthetic full block-level backup comprises pointers to data blocks that are most current relative to the given point in time, including pointers to changed data blocks, and skipping over intermediate changed data blocks, as found in;

(a) the copy of the first snapshot of the database, and (b) one or more incremental backups of the database;

storing, by the media agent, the synthetic full block-level backup of the database to the storage device; and

restoring the database from the synthetic full block-level backup in the storage device without using a native restore feature of the database management system.

7. The method of claim 6 wherein the synthetic full block-level backup is independent of database content.

8. The method of claim 6 wherein the synthetic full block-level backup is independent of type of database management system.

9. The method of claim 6 wherein the plurality of successive snapshots of the database are generated by a storage device that also stores the database.

10. The method of claim 6 wherein the plurality of successive snapshots of the database are generated by a computing device that hosts the database management system.

11. The method of claim 6 wherein the restored database comprises all data blocks of the database at the time the most recent snapshot was generated in the plurality of successive snapshots.

12. The method of claim 6 further comprising:

monitoring, by a data agent component of the data storage management system, write operations performed by the database management system that change data in the database; and

identifying, by the data agent, changed data blocks which changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database, wherein the respective identifiers of the changed data blocks are received by the media agent from the data agent.

13. The method of claim 6 wherein the media agent receives the respective identifiers of the changed data blocks which changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database from a data agent that monitors write operations performed by the database management system that result in the changed data blocks.

14. A data storage management system comprising:

a first computing device that executes a database management system (DBMS), which operates upon a database, wherein the first computing device comprises one or more processors and computer memory;

a first storage device in communication with the first computing device, wherein the storage device stores the database and a plurality of successive snapshots of the database;

a second storage device for storing a full backup of a first snapshot of the database taken at a first time;

a second computing device in communication with the first computing device and with the second storage device; and

wherein the second computing device is configured to;

store a copy of a first snapshot of the database to the second storage device, after each respective snapshot in a plurality of successive snapshots of the database is generated;

(i) receive respective identifiers that identify changed data blocks which changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database,

(ii) extract the changed data blocks from the respective snapshot based on the respective identifiers,

(iii) store to the second storage device a respective incremental backup of the database comprising the changed data blocks extracted from the respective snapshot of the database, and

(iv) maintain an index of the changed data blocks that are in the respective incremental backup,

based on the index, generate a synthetic full block-level backup of the database represented at a given point in time,

wherein the synthetic full block-level backup comprises pointers to data blocks that are most current relative to the given point in time, including pointers to changed data blocks, and skipping over intermediate changed data blocks, as found in;

(a) the copy of the first snapshot of the database, and (b) one or more incremental backups of the database,

store the synthetic full block-level backup of the database to the second storage device, and

restore the database from the synthetic full block-level backup in the storage device without using a native restore feature of the database management system.

15. The data storage management system of claim 14 wherein the restored database comprises all data blocks of the database at the time the most recent snapshot was generated in the plurality of successive snapshots.

16. The data storage management system of claim 14 wherein the plurality of successive snapshots of the database are generated by the first storage device that also stores the database.

17. The data storage management system of claim 14 wherein the plurality of successive snapshots of the database are generated by the first computing device that hosts the database management system.

18. The data storage management system of claim 14 wherein the first computing device is configured to:

monitor write operations performed by the database management system that change data in the database.

19. The data storage management system of claim 14 wherein the first computing device is configured to:

identify changed data blocks that changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database, wherein the respective identifiers that identify the changed data blocks are received by the second computing device from the first computing device.

20. The data storage management system of claim 14 wherein the second computing device receives the respective identifiers that identify the changed data blocks which changed in the database relative to corresponding data blocks in an immediately preceding snapshot of the database from the first computing device, which is configured to monitor write operations performed by the database management system that result in the changed data blocks.