Backup systems and methods for a virtual computing environment

• US 8,375,003 B1
• Filed: 09/23/2011
• Issued: 02/12/2013
• Est. Priority Date: 07/14/2008
• Status: Active Grant

• Current Assignee: Quest Software, Inc.
• Original Assignee: Vizioncore, Inc. (Quest Software, Inc.)
• Inventors: Afonso, Delano Xavier, Feathergill, David Allen, Mattox, Jason, Herman, Jeremy Christopher
• Primary Examiner(s): Breene, John E
• Assistant Examiner(s): ASPINWALL, EVAN S
• Application Number:
  US13/244,187
• Time in Patent Office: 508 Days
• Field of Search: 707/645, 707/649, 707/657, 707/820, 711/15, 711/117, 711/161, 711/162
• US Class Current: 707/645
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 2201/815 Virtual
• CPC Class Codes: G06F 2201/83 the solution involving signatures
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

Improved backup and storage operations are disclosed for virtual computing environments using a backup proxy server to perform storage operations on one or more virtual machine disks. The proxy server can include a module that intercepts application programming interface (API) calls, for writing backup data to a first location, prior to the data arriving on the proxy disk. During the intercept process, the data can be compressed in memory pages of the proxy server and redirected to an alternative backup disk location. The proxy server can also include a differential engine that identifies changes to the virtual machine disk at the block level since the last full backup. The differential engine can advantageously leverage memory pages of the proxy server to compare differences between signatures of blocks of the last full backup with signatures of new blocks. Subsequently, only blocks with non-matching signatures are processed for backup.

Claims

1. A method for performing backup of virtual machine data to a target datastore, the method comprising:

under control of a backup computing device comprising a volatile memory and nonvolatile storage that is different from the target datastore,

intercepting a plurality of calls made by a backup process to create a backup of one or more virtual machine disks to the target datastore, the one or more virtual machine disks comprising a plurality of data blocks, the plurality of intercepted calls comprising;

(1) at least one open call programmed to open a proxy backup file at a first destination location on the nonvolatile storage of the backup computing device, the open call programmed to reserve space at the first destination location on the nonvolatile storage for the requested size of the proxy backup file, and

(2) at least one write call programmed to write a proxy backup copy of each of the one or more virtual machine disks to the proxy backup file at the first destination location on the nonvolatile storage of the backup computing device;

for each intercepted open call, substituting the open call with at least a second open call programmed to;

open a sparse file at the first destination location, the sparse file providing the appearance that the proxy backup file having the requested size was opened at the first destination location; and

for each intercepted write call, substituting the intercepted write call with at least a second write call, wherein the at least the second write call is further programmed to;

transfer the data block associated with the particular intercepted write call to the volatile memory of the backup computing device without writing the data block to the nonvolatile storage of the backup computing device; and

redirect the data block stored in the volatile memory to a second destination location on the target datastore that is different than the first destination location on the nonvolatile storage of the backup computing device, wherein the redirecting occurs without writing the data block to the nonvolatile storage of the computing device.

2. The method of claim 1, additionally comprising:

computing a signature of the data block while the data block is stored in the volatile memory of the backup computing device, and

comparing the computed signature with a predetermined signature while the data block is stored in the volatile memory of the backup computing device.

3. The method of claim 2, additionally comprising, for each data block having a computed signature that matches the predetermined signature:

disregarding the data block rather than redirecting the data block to the second destination location on the target datastore.

4. The method of claim 2, additionally comprising performing a full or incremental backup of the one or more virtual machine disks prior to said intercepting a plurality of calls.

5. The method of claim 4, wherein said comparing comprises comparing the computed signature of the data block with the predetermined signature of a corresponding data block in the respective full or incremental backup of the one or more virtual machine disks.

6. The method of claim 1, additionally comprising compressing the data block while the data block is stored in the volatile memory of the backup computing device.

7. The method of claim 6, additionally comprising:

opening a compressed file at the second destination location on the target datastore; and

storing the redirected compressed data block in the compressed file.

8. The method of claim 1, additionally comprising:

intercepting a call to close the proxy backup file; and

substituting, for the intercepted close call, a call programmed to close the second destination location on the target datastore.

9. The method of claim 1, additionally comprising informing the backup process when each of the plurality of data blocks has been written to the second destination location on the target datastore.

10. A system for performing backup of virtual machine data, the system comprising:

nontransitory computer storage comprising one or more virtual machine disks, each virtual machine disk comprising a plurality of data blocks; and

a physical computing device configured to communicate with the storage device, the physical computing device configured to execute an intercept module configured to redirect backup operations of a backup module executing on a proxy computing device, the backup module configured to create a proxy backup file in a first destination location on a disk of the proxy computing device, wherein the proxy backup file comprises a copy of the one or more virtual machine disks,

the intercept module further configured to replace select calls made by the backup module with alternative functions to;

ignore a call to reserve space for the proxy backup file on the disk of the proxy computing device;

transfer each data block associated with a write call of the select calls to a buffer memory of the proxy computing device without writing the data block to a disk of the proxy computing device;

while the data block is stored in the buffer memory of the proxy computing device, determine whether the data block has been modified since a previous backup of the virtual machine disk containing the data block; and

in response to a determination that the data block has been modified, redirect the data block from the buffer memory of the proxy computing device to a second destination location on a target datastore, the second destination on the target datastore different from the first destination location on the proxy computing device,

wherein the redirecting occurs without writing the data block to the disk of the proxy computing device.

11. The system of claim 10, wherein to determine whether the data block has been modified since a previous backup of the virtual machine disk containing the data block, the intercept module is configured to:

compute a signature of the data block while the data block is stored in the buffer memory of the proxy computing device; and

compare the computed signature with a predetermined signature while the data block is stored in the buffer memory of the proxy computing device.

12. The system of claim 11, wherein the intercept module is configured to compute the signature using a message digest algorithm or a hash function.

13. The system of claim 11, wherein the computer storage comprises a signature map configured to store the predetermined signatures corresponding to data blocks of the one or more virtual machine disks.

14. The system of claim 10, wherein to determine whether the data block has been modified since a previous backup of the virtual machine disk containing the data block, the intercept module is configured to access a dirty block map that identifies data blocks that have been modified since the previous backup.

15. The system of claim 10, wherein the physical computing device is configured to execute a compression module configured to compress the data blocks being redirected to the second destination location on the target datastore.

16. A method for performing backup of a virtual machine file, the method comprising:

intercepting an open call for opening a proxy backup file at a first destination location on a proxy disk, the open call programmed to reserve space on the proxy disk for a requested size of the proxy backup file;

substituting the open call with a second open call to open a target backup file at a second destination location on a backup datastore that is different from the proxy disk;

intercepting a plurality of write calls for creating a backup copy of a plurality of data blocks of a virtual machine file at the first destination location on the proxy disk;

substituting each intercepted write call with a second write call, wherein the second write call is programmed to;

transfer the data block associated with the particular write call to a memory without first writing the data block to the proxy disk, and

determine whether the data block has been modified since a previous backup of the virtual machine file; and

in response to a determination that the data block that has been modified, storing the data block to the target backup file at the second destination location on the backup datastore without storing the data block on the proxy disk.

17. The method of claim 16, wherein to determine whether the data block has been modified since a previous backup of the virtual machine file, the method comprises:

computing a signature of the data block, and

comparing the computed signature with a predetermined signature.

18. The method of claim 16, wherein in response to a determination that the data block that has not been modified, disregarding the data block.

19. The method of claim 16, wherein the second call is configured to open a sparse file at the first destination location on the proxy disk, the sparse file providing the appearance that the proxy backup file was opened at the first destination location with a file size requested in the open call.

20. The method of claim 16, additionally comprising compressing the data block prior to storing the data block to the target backup file.