Synthetic full backups for incremental file backups

• US 10,078,555 B1
• Filed: 04/14/2015
• Issued: 09/18/2018
• Est. Priority Date: 04/14/2015
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Kumar, Kiran M V, Mandic, Vladimir, Jagannatha, Manjunath, Panem, Ravi Shankar
• Primary Examiner(s): Cao, Phuong Thao
• Application Number:
  US14/686,701
• Time in Patent Office: 1,253 Days
• Field of Search: 707645, 707646, 707640, 707656
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: H04L 65/765 intermediate

Abstract

First and second virtual hard disk files are accessed. The first virtual hard disk file corresponds to a backup of a file and includes a first set of payload blocks to store data associated with the backup. The second virtual hard disk file corresponds to an incremental backup of the file and includes a second set of payload blocks to store data associated with the incremental backup. Data from a payload block of the first set of payload blocks is merged with data from a payload block of a corresponding payload block of the second set of payload blocks to form a merged payload block. The merged payload block is streamed for storage as a synthetic full backup of the first and second virtual hard disk files. The merging does not alter the first and second virtual hard disk files.

Claims

1. A method comprising:

receiving an identification of a file on a volume to be backed up;

performing a backup of the file to a first virtual hard disk file, the performing a backup comprising;

creating a template virtual volume;

creating, on the template virtual volume, a file system structure that corresponds to a file system structure of the volume having the file to be backed up;

backing up metadata of the file from the template virtual volume; and

backing up content of the file from the volume;

tracking changes to blocks of the volume;

identifying a subset of tracked changed blocks on the volume as being associated with the file;

performing an incremental backup of the file by backing up the subset of tracked changed blocks to a second virtual hard disk file and filtering other tracked changed blocks of the volume not associated with the file, wherein the performing an incremental backup comprises not creating another template virtual volume;

accessing the first virtual hard disk file corresponding to the backup of the file, the first virtual hard disk file comprising a first plurality of payload blocks to store data associated with the backup;

accessing the second virtual hard disk file corresponding to the incremental backup of the file, the second virtual hard disk file comprising a second plurality of payload blocks to store data associated with the incremental backup;

merging data from a payload block of the first plurality payload blocks with data from a corresponding payload block of the second plurality of payload blocks to form a merged payload block; and

streaming the merged payload block to a backup media for storage as a synthetic full backup of the first and second virtual hard disk files, wherein the merging does not alter the first and second virtual hard disk files.

2. The method of claim 1 wherein the payload block of the first plurality of payload blocks comprises a first extent, the corresponding payload block of the second plurality of payload blocks comprises a second extent, and the merging comprises:

placing the first and second extents in the merged payload block.

3. The method of claim 1 wherein the payload block of the first plurality of payload blocks comprises a first extent, the corresponding payload block of the second plurality of payload blocks comprises a second extent, and the merging comprises:

replacing the first extent with the second extent for the merged payload block, the merged payload block thereby having the second extent and not having the first extent.

4. The method of claim 1 comprising after the merging, determining whether a next payload block of the first plurality of payload blocks should be merged;

determining that the next payload block should not be merged because the second plurality of payload blocks do not include changes corresponding to the next payload block; and

streaming data of the next payload block to the backup media for storage as the synthetic full backup of the first and second virtual hard disk files.

5. The method of claim 1 comprising:

streaming data of the merged payload block in a stream; and

streaming data of another payload block in the same stream, the data of the other payload block comprising data from a next payload block of the first plurality of payload blocks, data from a next payload block of the second plurality of payload blocks, or both.

6. The method of claim 1 wherein the file comprises a database.

7. The method of claim 1 comprising:

after the performing the backup of the file, deleting the template virtual volume.

8. The method of claim 1 wherein the creating on the template virtual volume a file system structure that corresponds to a file system structure of the volume having the file to be backed up comprises:

creating on the template virtual volume a folder path that matches a folder path of the volume in which the file is located.

9. The method of claim 1 wherein the template virtual volume does not include the content of the file.

10. A system for synthesizing a full backup of a file in a mountable format, the system comprising:

a processor-based system executed on a computer system and comprising a hardware processor, wherein the hardware processor is configured to;

receive an identification of a file on a volume to be backed up;

perform a backup of the file to a first virtual hard disk file, the performance of the backup comprising;

creating a template virtual volume;

creating, on the template virtual volume, a file system structure that corresponds to a file system structure of the volume having the file to be backed up;

backing up metadata of the file from the template virtual volume; and

backing up content of the file from the volume;

track changes to blocks of the volume;

identify a subset of tracked changed blocks on the volume as being associated with the file;

perform an incremental backup of the file by backing up the subset of tracked changed blocks to a second virtual hard disk file and filter other tracked changed blocks of the volume not associated with the file, wherein the performance of the incremental backup comprises not creating another template virtual volume;

access the first virtual hard disk file corresponding to the backup of the file, the first virtual hard disk file comprising a first plurality of payload blocks to store data associated with the backup;

access the second virtual hard disk file corresponding to the incremental backup of the file, the second virtual hard disk file comprising a second plurality of payload blocks to store data associated with the incremental backup;

merge data from a payload block of the first plurality payload blocks with data from a corresponding payload block of the second plurality of payload blocks to form a merged payload block; and

stream the merged payload block to a backup media for storage as a synthetic full backup of the first and second virtual hard disk files, wherein the merge does not alter the first and second virtual hard disk files.

11. The system of claim 10 wherein the payload block of the first plurality of payload blocks comprises a first extent, the corresponding payload block of the second plurality of payload blocks comprises a second extent, and the processor-based system is configured to:

place the first and second extents in the merged payload block.

12. The system of claim 10 wherein the payload block of the first plurality of payload blocks comprises a first extent, the corresponding payload block of the second plurality of payload blocks comprises a second extent, and the processor-based system is configured to:

replace the first extent with the second extent for the merged payload block, the merged payload block thereby having the second extent and not having the first extent.

13. The system of claim 10 wherein the processor-based system is configured to:

after the merge, determine whether a next payload block of the first plurality of payload blocks should be merged;

determine that the next payload block should not be merged because the second plurality of payload blocks do not include changes corresponding to the next payload block; and

stream data of the next payload block to the backup media for storage as the synthetic full backup of the first and second virtual hard disk files.

14. The system of claim 10 wherein the processor-based system is configured to:

stream data of the merged payload block in a stream; and

stream data of another payload block in the same stream, the data of the other payload block comprising data from a next payload block of the first plurality of payload blocks, data from a next payload block of the second plurality of payload blocks, or both.

15. The system of claim 10 wherein the template virtual volume does not include the content of the file.

16. A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method comprising:

receiving an identification of a file on a volume to be backed up;

performing a backup of the file to a first virtual hard disk file, the performing a backup comprising;

creating a template virtual volume;

creating, on the template virtual volume, a file system structure that corresponds to a file system structure of the volume having the file to be backed up;

backing up metadata of the file from the template virtual volume; and

backing up content of the file from the volume;

tracking changes to blocks of the volume;

identifying a subset of tracked changed blocks on the volume as being associated with the file;

performing an incremental backup of the file by backing up the subset of tracked changed blocks to a second virtual hard disk file and filtering other tracked changed blocks of the volume not associated with the file, wherein the performing an incremental backup comprises not creating another template virtual volume;

accessing the first virtual hard disk file corresponding to the backup of the file, the first virtual hard disk file comprising a first plurality of payload blocks to store data associated with the backup;

accessing the second virtual hard disk file corresponding to the incremental backup of the file, the second virtual hard disk file comprising a second plurality of payload blocks to store data associated with the incremental backup;

merging data from a payload block of the first plurality payload blocks with data from a corresponding payload block of the second plurality of payload blocks to form a merged payload block; and

streaming the merged payload block to a backup media for storage as a synthetic full backup of the first and second virtual hard disk files, wherein the merging does not alter the first and second virtual hard disk files.

17. The computer program product of claim 16 wherein the payload block of the first plurality of payload blocks comprises a first extent, the corresponding payload block of the second plurality of payload blocks comprises a second extent, and the merging comprises:

placing the first and second extents in the merged payload block.

18. The computer program product of claim 16 wherein the payload block of the first plurality of payload blocks comprises a first extent, the corresponding payload block of the second plurality of payload blocks comprises a second extent, and the merging comprises:

replacing the first extent with the second extent for the merged payload block, the merged payload block thereby having the second extent and not having the first extent.

19. The computer program product of claim 16 wherein the method comprises after the merging, determining whether a next payload block of the first plurality of payload blocks should be merged;

determining that the next payload block should not be merged because the second plurality of payload blocks do not include changes corresponding to the next payload block; and

streaming data of the next payload block to the backup media for storage as the synthetic full backup of the first and second virtual hard disk files.

20. The computer program product of claim 16 wherein the method comprises:

streaming data of the merged payload block in a stream; and

streaming data of another payload block in the same stream, the data of the other payload block comprising data from a next payload block of the first plurality of payload blocks, data from a next payload block of the second plurality of payload blocks, or both.