Efficiently restoring execution of a backed up virtual machine based on coordination with virtual-machine-file-relocation operations

• US 9,710,465 B2
• Filed: 09/22/2014
• Issued: 07/18/2017
• Est. Priority Date: 09/22/2014
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Dornemann, Henry Wallace, Pawar, Rahul S., Kumarasamy, Paramasivam, Kilaru, Satish Chandra, Venkatesha, Ananda
• Primary Examiner(s): Hoang, Son T
• Application Number:
  US14/493,200
• Publication Number:
  US 20160085636A1
• Time in Patent Office: 1,030 Days
• Field of Search: None
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/2308 Concurrency control transaction processing G06F9/466
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

The disclosed systems and methods enable a virtual machine, including any applications executing thereon, to quickly start executing and servicing users based on pre-staged data blocks supplied from a backup copy in secondary storage. Substantially concurrently with the ongoing execution of the virtual machine, a virtual-machine-file-relocation operation may move data blocks originating in the backup copy to a primary storage destination that becomes the virtual machine'"'"'s primary data store after the relocation operation completes. An enhanced data agent, operating in conjunction with an enhanced media agent in a storage management system, coordinates restoring of the virtual machine and the launch of the relocation operation. The enhanced media agent may pre-stage certain backed up data blocks which may be needed to launch the virtual machine, based on predictive analysis pertaining to the virtual machine'"'"'s operational profile. The enhanced media agent may also pre-stage backed up data blocks for the relocation operation, based on the operation'"'"'s relocation scheme. Servicing read requests to the virtual machine may take priority over ongoing pre-staging of backed up data. Read requests may be tracked so that the media agent may properly maintain the contents of an associated read cache. Some embodiments of the illustrative storage management system may lack, or may simply not require, the relocation operation, and may operate in a “live mount” configuration.

Claims

1. A system for restoring a virtual machine to execute on a host computing device, based on coordination with a virtual-machine-file-relocation operation, the system comprising:

the host computing device configured to execute the virtual machine and further configured to execute the virtual-machine-file-relocation operation concurrently with the virtual machine, wherein the virtual-machine-file-relocation operation comprises a logical transfer, based on a relocation sequence, of a copy of data associated with the virtual machine to a destination on a primary storage device in communication with the host computing device, and wherein the copy of data associated with the virtual machine comprises at least one of a configuration file and a virtual disk;

a secondary storage computing device in communication with the host computing device, wherein the secondary storage computing device comprises a media agent, a read-cache, and a shared file system mounted to the host computing device, and wherein the shared file system is configured as a recovery point for the virtual machine and as a source of data for the virtual-machine-file-relocation operation;

a virtualization-client computing device in communication with the secondary storage computing device, wherein the virtualization-client computing device comprises a data agent;

a secondary storage device in communication with the secondary storage computing device, wherein the secondary storage device comprises the copy of data associated with the virtual machine;

wherein the data agent is configured to;

instruct the media agent to determine, based on a profile of the virtual machine, a first set of data blocks in the copy of data associated with the virtual machine,

instruct the media agent to copy the first set of data blocks from the copy of data to the read-cache,

instruct the media agent to copy a second set of data blocks from the copy of data to the read-cache, wherein the second set of data blocks is based on the relocation sequence of the virtual-machine-file-relocation operation, and

instruct the media agent to serve a read request for a data block by;

(i) copying the requested data block from the copy of data to the read-cache if the requested data block is not found in the read-cache, and (ii) transmitting the requested data block from the read-cache in response to the read request; and

wherein the computing devices are each implemented at least partially by hardware.

2. The system of claim 1, wherein the read request is received from the host computing device.

3. The system of claim 1, wherein the data agent is further configured to transmit the profile of the virtual machine to the media agent.

4. The system of claim 1, wherein the data agent is further configured to:

when the virtual machine and the virtual-machine-file-relocation operation execute concurrently on the host computing device, instruct the media agent to copy a third set of data blocks from the copy of data to the read-cache, at the same priority as serving the read request, wherein the third set of data blocks is based on the relocation sequence of the virtual-machine-file-relocation operation.

5. The system of claim 1, wherein the data agent is further configured to:

instruct the media agent to determine whether a plurality of read requests comprises a sequence of data blocks according to the relocation sequence of the virtual-machine-file-relocation operation, and

if the plurality of read requests comprises the sequence of data blocks according to the relocation sequence of the virtual-machine-file-relocation operation, instruct the media agent to purge the sequence of data blocks from the read-cache after the plurality of read requests has been served.

6. The system of claim 1, wherein the data agent is further configured to:

determine whether a plurality of read requests comprises a sequence of data blocks according to the relocation sequence of the virtual-machine-file-relocation operation, and

if the plurality of read requests comprises the sequence of data blocks according to the relocation sequence of the virtual-machine-file-relocation operation, instruct the media agent to purge the sequence of data blocks from the read-cache after the plurality of read requests has been served.

7. The system of claim 1, wherein the data agent is further configured to, after launch of execution of the virtual machine and prior to launch of the virtual-machine-file-relocation operation, instruct the media agent to copy the second set of data blocks from the copy of data to the read-cache at a lower priority than serving the read request.

8. The system of claim 1, wherein the data agent is further configured to, after the virtual-machine-file-relocation operation has completed, and concurrently with execution of the virtual machine on the host computing device, instruct the media agent to de-associate the secondary storage device from the virtual machine.

9. The system of claim 1, wherein the data agent is further configured to, after the virtual-machine-file-relocation operation has completed, and concurrently with execution of the virtual machine on the host computing device, (a) instruct the media agent to de-associate the secondary storage device from the virtual machine, and (b) instruct the virtual machine to use the destination on the primary storage device as a primary data store.

10. The system of claim 1, wherein the coordination with the virtual-machine-file-relocation operation comprises the data agent being configured to:

after launch of execution of the virtual machine and prior to launch of the virtual-machine-file-relocation operation, instruct the media agent to copy the second set of data blocks from the copy of data to the read-cache at a lower priority than serving the read request.

11. The system of claim 1, wherein the coordination with the virtual-machine-file-relocation operation comprises the data agent being configured to:

if a plurality of read requests comprises a sequence of data blocks according to the relocation sequence of the virtual-machine-file-relocation operation, instruct the media agent to purge the sequence of data blocks from the read-cache after the plurality of read requests has been served.

12. The system of claim 1, wherein the coordination with the virtual-machine-file-relocation operation comprises the data agent being configured to:

after the virtual-machine-file-relocation operation has completed, and concurrently with execution of the virtual machine on the host computing device, (a) instruct the media agent to de-associate the secondary storage device from the virtual machine, and (b) instruct the virtual machine to use the destination on the primary storage device as a primary data store.

13. A method for restoring execution of a virtual machine on a host computing device in a storage management system, based on coordination with a virtual-machine-file-relocation operation, the method comprising:

prior to execution of the virtual machine, receiving, by a media agent component of the storage management system from a data agent component of the storage management system, a profile of the virtual machine;

determining, by the media agent, based on the profile of the virtual machine, a first set of data blocks to be copied from a backup copy of data associated with the virtual machine, wherein the backup copy is stored on a secondary storage device in communication with the media agent, and wherein the backup copy comprises at least one of a configuration file and a virtual disk associated with the virtual machine;

copying the first set of data blocks, by the media agent, from the backup copy to a read-cache associated with the media agent on a secondary storage computing device;

launching execution of the virtual machine on the host computing device, based on the first set of data blocks, which set of blocks is served by the media agent from the read-cache;

copying a second set of data blocks, by the media agent, from the backup copy to the read-cache, wherein the second set of data blocks is based on a relocation sequence of the virtual-machine-file-relocation operation, and wherein the virtual-machine-file-relocation operation comprises a logical transfer, according to the relocation sequence, of the backup copy to a destination on a primary storage device in communication with the host computing device;

serving a read request for a data block, by the media agent, wherein the serving the read request comprises;

(i) if the requested data block is not found in the read-cache, copying, by the media agent, the requested data block from the backup copy to the read-cache, and

(ii) transmitting, by the media agent, the requested data block from the read-cache; and

wherein while the virtual machine executes on the host computing device prior to the virtual-machine-file-relocation operation, the media agent serves the read request at a higher priority than the copying the second set of data blocks from the backup copy to the read-cache, as instructed by the data agent.

14. The method of claim 13, further comprising:

while the virtual machine and the virtual-machine-file-relocation operation execute concurrently on the host computing device, copying a third set of data blocks, by the media agent, from the backup copy to the read-cache, wherein the third set of data blocks is based on the relocation sequence of the virtual-machine-file-relocation operation, and wherein the media agent serves the read request at the same priority as the copying the third set of data blocks, as instructed by the data agent.

15. The method of claim 13, further comprising:

after the virtual-machine-file-relocation operation has completed, and concurrently with execution of the virtual machine on the host computing device, de-associating, by the media agent the secondary storage device from the virtual machine, as instructed by the data agent.

16. The method of claim 13, further comprising:

after the virtual-machine-file-relocation operation has completed, using the destination on the primary storage device, by the virtual machine, as a primary data store for the virtual machine.

17. A method for coordinating, in a storage management system, between a restoration of a virtual machine and a virtual-machine-file-relocation operation, the method comprising:

instructing a media agent, by a data agent, to copy a first set of data blocks from a copy of data associated with the virtual machine to a read-cache associated with the media agent,

wherein the copy of data comprises one or more configuration files and one or more virtual disks and is stored on a secondary storage device, and

wherein the first set of data blocks is based on a profile of the virtual machine that pertains to launching execution of the virtual machine on a host computing device;

launching execution of the virtual machine on the host computing device, based at least in part on the first set of data blocks;

instructing the media agent, by the data agent, to copy a second set of data blocks from the copy of data to the read-cache,

wherein the virtual-machine-file-relocation operation comprises a logical transfer, according to a relocation sequence, of the copy of data associated with the virtual machine to a destination on a primary storage device that is in communication with the host computing device, and

wherein the second set of data blocks is based on the relocation sequence;

while the virtual machine executes on the host computing device prior to the virtual-machine-file-relocation operation, instructing the media agent, by the data agent, to serve a read request for a data block that originates from the host computing device, wherein serving the read request comprises;

(i) if the requested data block is not found in the read-cache, copying, by the media agent, the requested data block from the copy of data to the read-cache, and

(ii) transmitting, by the media agent, the requested data block from the read-cache, wherein the read request is to be served at a higher priority than the copying the second set of data from the copy of data to the read-cache; and

while the virtual machine and the virtual-machine-file-relocation operation execute concurrently on the host computing device, instructing the media agent, by the data agent, to;

(A) serve the read request for the data block that originates from the host computing device, wherein serving the read request comprises;

(i) if the requested data block is not found in the read-cache, copying, by the media agent, the requested data block from the copy of data to the read-cache, and (ii) transmitting, by the media agent, the requested data block from the read-cache, and

(B) copy a third set of data blocks from the copy of data to the read-cache, wherein the third set of data blocks is based on the relocation sequence of the virtual-machine-file-relocation operation, and wherein the copying of the third set of data blocks is to be at the same priority as the serving the read request.

18. The method of claim 17, further comprising:

after the virtual-machine-file-relocation operation has completed, and concurrently with execution of the virtual machine on the host computing device, (a) instructing the media agent, by the data agent, to de-associate the secondary storage device from the virtual machine and, (b) using the destination on the primary storage device, by the virtual machine, as a primary data store.