Fast archiving for database systems

• US 10,379,958 B2
• Filed: 06/01/2016
• Issued: 08/13/2019
• Est. Priority Date: 06/03/2015
• Status: Active Grant

• Current Assignee: Axxana (Israel) Ltd.
• Original Assignee: Axxana (Israel) Ltd.
• Inventors: Winokur, Alex
• Primary Examiner(s): Morrison, Jay A
• Assistant Examiner(s): Hoang, Ken
• Application Number:
  US15/169,811
• Publication Number:
  US 20160357639A1
• Time in Patent Office: 1,168 Days
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Methods, storage facilities and computer software products implement embodiments of the present invention that include mapping, by a storage system including one or more storage devices, a set of storage blocks on a given storage device to a redo log file configured to store transactions performed by a transaction processing system. An archiving condition is specified, and upon the transaction processing system completing a given transaction a copy of the given transaction is stored to the redo log file. Upon the archiving condition being met, the storage system can remap the set of storage blocks to an archive log file.

Claims

1. A method for generating an archive file for data generated by a software application configured to access an application file, comprising:

mapping, by a storage system comprising one or more storage devices, a first set of storage blocks on one or more storage devices to an application file;

receiving, by the storage system at a first time from a software application, a request to store first data to the application file;

storing, to the first set of storage blocks mapped to the application file, the first data received from the software application;

receiving, by the storage system at a second time subsequent to the first time, an indication that a specified archiving condition has been met;

in response to receiving the indication that the specified archiving condition has been met;

remapping the first set of storage blocks to an archive file, thereby removing the mapping of the first set of storage blocks to the application file, and

mapping a second set of storage blocks on the one or more storage devices to the application file, wherein the first and the second sets of storage blocks are mutually exclusive;

receiving, from the software application at a third time subsequent to the second time, a request to store second data to the application file; and

storing, to the second set of storage blocks mapped to the application file, the second data received from the software application.

2. The method according to claim 1, wherein the storage system comprises a block-level storage system.

3. The method according to claim 2, wherein the application file has a first file name, wherein remapping the first set of storage blocks comprises assigning, by a host computer coupled to the block-level storage system, a second file name to the first set of storage blocks, and wherein mapping the second set of storage blocks comprises assigning, by the host computer, the first file name to the second set of storage blocks.

4. The method according to claim 1, wherein the storage system comprises a file-level storage system, wherein the application file has a first file name, and wherein remapping the first set of storage blocks comprises assigning, by the file-level storage system, a second file name to the first set of storage blocks.

5. The method according to claim 1, wherein the application file comprises a set of file blocks, and wherein mapping a given set of storage blocks to the application file comprises mapping the set of file blocks to the given set of storage blocks.

6. The method according to claim 1, wherein the software application comprises a transaction processing system, wherein the application file comprises a redo log file for the transaction processing system, wherein the first and the second data comprise transactions for the transaction processing system.

7. The method according to claim 1, and comprising detecting that the archiving condition is met by detecting one or more of:

a specific time interval, a specific number of transactions in the application file, overwriting the application file, and a specific amount of storage space used by the application file.

8. The method according to claim 1, wherein the storage system comprises a first storage system, and comprising mirroring the application file to an additional set of storage blocks on a second storage system, and wherein remapping the first set of storage blocks to the archive file comprises remapping the additional set of the storage blocks to the archive file.

9. The method according to claim 1, wherein the given storage device comprises a logical volume storing the first set of storage blocks, and wherein remapping the first set of storage blocks to the archive file comprises generating a snapshot of the logical volume.

10. The method according to claim 9, wherein the snapshot comprises a redirect-on-write snapshot.

11. The method according to claim 6, wherein the transaction processing system comprises a database management system.

12. A storage system, comprising:

one or more storage devices, each of the storage devices comprising a plurality of storage blocks; and

a storage processor configured;

to map a first set of the storage blocks on one or more of the storage devices to an application file,

to receive, at a first time from a software application, a request to store first data to the application file,

to store, to the first set of storage blocks mapped to the application file, the first data received from the software application,

to receive, at a second time subsequent to the first time, an indication that a specified archiving condition has been met,

in response to receiving the indication that the specified archiving condition has been met;

to remap the first set of storage blocks to an archive file, thereby removing the mapping of the first set of storage blocks to the application file, and

to map a second set of storage blocks on the one or more storage devices to the application file, wherein the first and the second sets of storage blocks are mutually exclusive,

to receive, from the software application at a third time subsequent to the second time, a request to store second data to the application file, and

to store, to the second set of storage blocks mapped to the application file, the second data received from the software application.

13. The storage system according to claim 12, wherein the storage processor is configured to execute a block manager that is configured to map a logical volume to a given storage device.

14. The storage system according to claim 13, wherein the application file has a first file name, and wherein the storage processor is configured to remap the first set of storage blocks by assigning, by a host computer coupled to the block-level storage system, a second file name to the first set of storage blocks, and wherein mapping the second set of storage blocks comprises assigning, by the host computer, the first file name to the second set of storage blocks.

15. The storage system according to claim 12, wherein the storage processor is configured to execute a file-level manager, wherein the application file has a first file name, and wherein the file-level manager is configured to remap the first set of storage blocks by assigning a second file name to the first set of storage blocks.

16. The storage system according to claim 12, wherein the application file comprises a set of file blocks, and wherein the storage processor is configured to map a given set of storage blocks to the redo log file by mapping the given set of storage blocks to the set of file blocks.

17. The storage system according to claim 12, wherein the software application comprises a transaction processing system, wherein the application file comprises a redo log file for the transaction processing system, wherein the first and the second data comprise transactions for the transaction processing system.

18. The storage system according to claim 12, and comprising detecting that the archiving condition is met by detecting one or more of:

a specific time interval, a specific number of transactions in the application file, overwriting the application file, and a specific amount of storage space used by the application file.

19. The storage system according to claim 12, wherein the storage system comprises a first storage system, wherein the storage processor comprises a first storage processor, and wherein the first storage processor is configured to mirror the application file to an additional set of the storage blocks on a second storage system comprising a second storage processor, and wherein the second storage processor is configured to remap the first set of the storage blocks to the archive file by remapping the additional set of the storage blocks to the archive file.

20. The storage system according to claim 12, wherein the given storage device comprises a logical volume storing the first set of storage blocks, and wherein the storage processor is further configured to remap the first set of storage blocks to the archive file by generating a snapshot of the volume.

21. The storage system according to claim 20, wherein the snapshot comprises a redirect-on-write snapshot.

22. The storage system according to claim 17, wherein the transaction processing system comprises a database management system.

23. A computer software product, the product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer, cause the computer:

to map, by a storage system comprising one or more storage devices, a first set of storage blocks on one or more storage devices to an application file,

receiving, by the storage system at a first time from a software application, a request to store first data to the application file,

storing, to the first set of storage blocks mapped to the application file, the first data received from the software application,

receiving, by the storage system at a second time subsequent to the first time, an indication that a specified archiving condition has been met,

in response to receiving the indication that the specified archiving condition has been met;

to remap, the first set of storage blocks to an archive file, thereby removing the mapping of the first set of storage blocks to the application file, and

to map a second set of storage blocks on the one or more storage devices to the application file, wherein the first and the second sets of storage blocks are mutually exclusive,

to receive, from the software application at a third time subsequent to the second time, a request to store second data to the application file, and

to store, to the second set of storage blocks mapped to the application file, the second data received from the software application.