Point in time database restore from storage snapshots

• US 9,558,078 B2
• Filed: 10/28/2014
• Issued: 01/31/2017
• Est. Priority Date: 10/28/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Farlee, Kevin, Chan, Lin, Cherry, Andrew Jason
• Primary Examiner(s): Iqbal, Nadeem
• Application Number:
  US14/526,137
• Publication Number:
  US 20160117228A1
• Time in Patent Office: 826 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

Archiving a database and point in time recovery of the database. A method includes taking a first snapshot of a database. The first snapshot of the database includes a first snapshot of the data in the data storage and a first snapshot of the log records in the log storage. The method further includes taking a second snapshot of the database. The second snapshot of the database includes a second snapshot of the data in data storage and a second snapshot of the log records. The method further includes restoring the database to a particular point by applying the first snapshot of the data in the data storage to the database, applying the first snapshot of the log records in the log storage to the database and applying a portion of the second snapshot of the log records in the log storage to the database.

Claims

1. A system comprising:

a database, wherein the database comprises;

data storage for storing data items;

log storage for storing log records that comprise a list of operations performed on the data storage at discrete points in time; and

a mapping structure representing state of the data in the database at any given point in time, the mapping structure comprising a set of pointers to storage locations for data as currently stored at the given point in time;

one or more physical computer storage media comprising computer executable instructions;

one or more processors, which when executing the computer executable instructions, cause the system to archive the database by providing point in time recovery of the database by restoring the database to a selected point in time between adjacent snapshots, by performing the following;

taking a plurality of snapshots each comprising;

a data portion comprising pointers to storage locations for data items existing in the database at each respective point in time;

a log portion comprising a state of the log storage containing records that represent an enumeration of operations performed on the data storage at each respective point in time;

and

restoring the database to a particular point in time between a first point in time and a second point in time that is adjacent to the first point in time, by performing the following;

for a first snapshot corresponding to the first point in time, performing the following;

applying the data portion comprising pointers to storage locations for data items existing in the database at the first point in time; and

applying the log portion comprising a state of the log storage containing records that represent an enumeration of operations performed on the data storage at the first point in time; and

for a second snapshot corresponding to the adjacent second point in time, applying a portion which comprises some but not all of the log portion of the second snapshot, wherein the applied portion comprises only those log records that represent an enumeration of operations performed on stored data up to the particular point in time between the first point in time and the second point in time.

2. The system of claim 1, wherein first and second snapshots are performed in a unified snapshot of the database.

3. The system of claim 1, wherein the data portion of each snapshot comprises capturing the set of pointers in the data mapping structure at each point in time corresponding to each snapshot.

4. The system of claim 1, wherein size of the log storage of the database is limited to avoid unrestrained expansion by adjusting frequency of the plurality of snapshots taken.

5. The system of claim 1, wherein the database is a distributed database implemented in a cloud environment, such that different portions of the database are implemented on different virtual machines in the cloud environment.

6. The system of claim 1, wherein the database is a versioned database storing different versions of data items.

7. The system of claim 1, wherein the log storage comprises a ring buffer, and wherein storage locations in the log storage are made available, for new records, once existing records in those locations have been captured.

8. A system comprising:

a database, wherein the database comprises;

data storage for storing data items;

log storage for storing log records that comprise a list of operations performed on the data storage at discrete points in time; and

a mapping structure representing state of the data in the database at any given point in time, the mapping structure comprising a set of pointers to storage locations for data as currently stored at the given point in time;

one or more physical computer storage media comprising computer executable instructions;

one or more processors, which when executing the computer executable instructions, cause the system to archive the database by providing point in time recovery of the database by restoring the database to a selected point in time between two snapshots, by performing the following;

taking a first snapshot of the database at a first time, and wherein the first snapshot comprises;

a data portion containing the set of pointers in the mapping structure at the first time corresponding to the first snapshot of the data in the data storage of the databases; and

a log portion containing the list of any operations performed on data up to the first time corresponding to the first snapshot of the log records in the log storage;

taking one or more additional snapshots of the database at one or more times subsequent to the first time, wherein the one or more additional snapshots each comprise;

a data portion containing the set of pointers in the mapping structure corresponding to each subsequent time for a taken subsequent snapshot of the data storage; and

a log portion containing the list of any operations performed on data up to the subsequent time corresponding to each subsequent snapshot, wherein for each additional snapshot the corresponding list of the log portion is a list of all log records occurring after the time of the additional snapshot of the database from a most recent previous snapshot of the database; and

restoring the database to a particular point between two snapshots of the database by performing the following;

applying the data and log portions of the first snapshot; and

then applying some but not all of the log portions from two or more of the additional snapshots, wherein the applied log portions comprise only those records that represent an enumeration of operations performed on stored data up to the particular point in time.

9. The system of claim 8, wherein the data portion of each snapshot comprises capturing the set of pointers in the data mapping structure at each point in time corresponding to each snapshot.

10. The system of claim 8, wherein size of the log storage of the database is limited to avoid unrestrained expansion by adjusting frequency of the plurality of snapshots taken.

11. The system of claim 8, wherein the database is a distributed database implemented in a cloud environment, such that different portions of the database are implemented on different virtual machines in the cloud environment.

12. The system of claim 8, wherein the database is a versioned database storing different versions of data items.

13. The system of claim 8, wherein the log storage comprises a ring buffer, and wherein storage locations in the log storage are made available, for new records, once existing records in those locations have been captured.

14. A computer-implemented method for archiving a database by providing point in time recovery of the database, the computer-implemented method being performed by one or more processors executing computer executable instructions for the computer-implemented method, and the computer-implemented method comprising:

taking a plurality of snapshots each comprising;

a data portion comprising pointers to storage locations for data items existing in the database at each respective point in time;

a log portion comprising a state of the log storage containing records that represent an enumeration of operations performed on the data storage at each respective point in time; and

restoring the database to a particular point in time between a first point in time and a second point in time that is adjacent to the first point in time, by performing the following;

for a first snapshot corresponding to the first point in time, performing the following;

applying the data portion comprising pointers to storage locations for data items existing in the database at the first point in time; and

applying the log portion comprising a state of the log storage containing records that represent an enumeration of operations performed on the data storage at the first point in time; and

for a second snapshot corresponding to the adjacent second point in time, applying a portion which comprises some but not all of the log portion of the second snapshot, wherein the applied portion comprises only those log records that represent an enumeration of operations performed on stored data up to the particular point in time between the first point in time and the second point in time.

15. The computer-implemented method of claim 14, wherein after applying the log portion of the first snapshot, the computer-implemented method further comprises:

pausing the recovery;

discarding the data portion of the second snapshot; and

then resuming recovery by applying said portion which comprises some but not all of the log portion of the second snapshot.

16. The computer-implemented method of claim 15, wherein the computer implemented method further comprises:

zeroing out the log portion of the second snapshot that is not applied once the records up to the give point in time have been applied; and

then carrying out an undo operation.

17. The computer-implemented method of claim 14, wherein size of the log storage of the database is limited to avoid unrestrained expansion by adjusting frequency of the plurality of snapshots taken.

18. The computer-implemented method of claim 14, wherein first and second snapshots are performed in a unified snapshot of the database.

19. The computer-implemented method of claim 14, wherein the data portion of each snapshot comprises capturing the set of pointers in the data mapping structure at each point in time corresponding to each snapshot.

20. The computer-implemented method of claim 14, wherein size of the log storage of the database is limited to avoid unrestrained expansion by adjusting frequency of the plurality of snapshots taken.

21. The computer-implemented method of claim 14, wherein the database is a distributed database implemented in a cloud environment, such that different portions of the database are implemented on different virtual machines in the cloud environment.

22. The computer-implemented method of claim 14, wherein the database is a versioned database storing different versions of data items.

23. The computer-implemented method of claim 14, wherein the log storage comprises a ring buffer, and wherein storage locations in the log storage are made available, for new records, once existing records in those locations have been captured.