HYPERVISOR-INDEPENDENT BLOCK-LEVEL LIVE BROWSE FOR ACCESS TO BACKED UP VIRTUAL MACHINE (VM) DATA AND HYPERVISOR-FREE FILE-LEVEL RECOVERY (BLOCK-LEVEL PSEUDO-MOUNT)

• US 20170262204A1
• Filed: 02/17/2017
• Published: 09/14/2017
• Est. Priority Date: 03/09/2016
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: DORNEMANN, Henry Wallace, PAWAR, Rahul S., MITKAR, Amit, GUTTA, Sunil Kumar, DEGAONKAR, Sumedh Pramod, CHEN, Jianwei
• Granted Patent: US 10,296,368 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/1484 involving virtual machines
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

Hypervisor-independent block-level live browse is used for directly accessing backed up virtual machine (VM) data. Hypervisor-free file-level recovery (block-level pseudo-mount) from backed up VMs also is disclosed. Backed up virtual machine (“VM”) data can be browsed without needing or using a hypervisor. Individual backed up VM files can be requested and restored to anywhere without a hypervisor and without the need to restore the rest of the backed up virtual disk. Hypervisor-agnostic VM backups can be browsed and recovered without a hypervisor and from anywhere, and individual backed up VM files can be restored to anywhere, e.g., to a different VM platform, to a non-VM environment, without restoring an entire virtual disk, and without a recovery data agent at the destination.

Claims

1. A method comprising:

storing to a secondary storage device a secondary copy of virtual-machine payload data backed up from a virtual disk of a virtual machine,

wherein the payload data in the secondary copy comprises (i) a catalogue of the virtual machine file system, and (ii) a plurality of extents comprising data blocks;

creating a pseudo-disk on a first computing device,

wherein the first computing device (a) is distinct from another computing device that hosted the virtual machine and (b) is in communication with the secondary storage device,

wherein the pseudo-disk is created by a pseudo-disk driver executing on the first computing device, and

wherein a media agent also executes on the first computing device;

mounting the pseudo-disk to the first computing device,

wherein the pseudo-disk driver presents, to a file system on the first computing device, the pseudo-disk as a physical block data storage device and not as a virtual disk;

retrieving by the pseudo-disk driver the catalogue of the virtual machine file system from the secondary copy on the secondary storage device and into the pseudo-disk;

enumerating, by the file system on the first computing device, the retrieved catalogue of the virtual machine file system;

transmitting, by the media agent, in response to a request to browse the virtual machine, an enumeration of the catalogue of the virtual machine file system obtained by the media agent from the file system on the first computing device;

wherein the enumerating of the retrieved catalogue of the virtual machine file system is performed at the first computing device lacking a hypervisor to interpret the retrieved catalogue of the virtual machine file system, and further lacking a communicative coupling to another computing device with a hypervisor to interpret the retrieved catalogue of the virtual machine file system; and

wherein the media agent and the file system on the first computing device lack direct access to the secondary copy comprising the catalogue of the virtual machine file system backed up from the virtual disk of the virtual machine.

2. The method of claim 1 wherein the secondary copy does not comprise hypervisor-specific metadata from the virtual disk of the virtual machine.

3. The method of claim 1 further comprising:

receiving by the media agent a request for a first file from the secondary copy of virtual-machine payload data backed up from the virtual disk of the virtual machine;

restoring the first file, at least in part by the media agent, from one or more extents in the plurality of extents comprising data blocks, wherein the one or more extents are retrieved by the pseudo-disk driver from the secondary copy into the pseudo-disk based on information about the first file in the enumerated catalogue of the virtual machine file system; and

wherein the restoring of the first file is performed at the first computing device without using, accessing, or connecting to a hypervisor.

4. The method of claim 3 wherein the information about the first file found in the enumerated catalogue comprises associations between the first file and a first set of data blocks that collectively form the first file and which first set of data blocks are stored in the plurality of extents in the secondary copy.

5. The method of claim 3 wherein the information about the first file found in the enumerated catalogue associates the first file with a first set of data blocks that collectively form the first file and which first set of data blocks are stored in the plurality of extents in the secondary copy;

and

wherein an index generated when the secondary copy was stored to the secondary storage device points to the retrieved one or more extents.

6. The method of claim 1 further comprising:

based on a response to the request to browse the virtual machine, receiving by the media agent a request for a first file of the virtual machine;

identifying, by the file system on the first computing device, a first set of data blocks that collectively form the first file;

in response to one or more read requests for the identified first set of data blocks from the file system on the first computing device to the pseudo-disk, (A) retrieving, by the pseudo-disk driver from the secondary copy and into the pseudo-disk, one or more extents in the plurality of extents, wherein the one or more extents comprise the first set of data blocks that collectively form the first file, and (B) serving the first set of data blocks to the file system on the first computing device in response to the one or more read requests;

restoring the first file, at least in part by the media agent, from the first set of data blocks; and

transmitting, the restore first file in response to the request for the first file of the virtual machine; and

wherein the response to the request for the first file of the virtual machine is generated at the first computing device without using, accessing, or connecting to a hypervisor.

7. The method of claim 6 wherein an index generated when the secondary copy was stored to the secondary storage device points to the retrieved one or more extents.

8. A method comprising:

storing to a secondary storage device a secondary copy of virtual-machine payload data backed up from a virtual disk of a virtual machine,

wherein the payload data in the secondary copy comprises (i) a catalogue of the virtual machine file system, and (ii) a plurality of extents comprising data blocks, and

wherein the secondary copy does not comprise hypervisor-specific metadata from the virtual disk of the virtual machine;

creating a pseudo-disk on a first computing device,

wherein the first computing device (a) is distinct from another computing device that hosted the virtual machine and (b) is in communication with the secondary storage device,

wherein the pseudo-disk is created by a pseudo-disk driver executing on the first computing device, and

wherein a media agent also executes on the first computing device;

mounting the pseudo-disk to the first computing device,

wherein the pseudo-disk driver presents, to a file system on the first computing device, the pseudo-disk as a physical block data storage device and not as a virtual disk;

retrieving by the pseudo-disk driver the catalogue of the virtual machine file system from the secondary copy on the secondary storage device and into the pseudo-disk;

interpreting, by the file system on the first computing device, the retrieved catalogue of the virtual machine file system;

transmitting, by the media agent, in response to a request to browse the virtual machine, an enumeration, based on the interpreting, of the catalogue of the virtual machine file system obtained by the media agent from the file system on the first computing device;

wherein the interpreting of the retrieved catalogue of the virtual machine file system is performed at the first computing device lacking a hypervisor to interpret the retrieved catalogue of the virtual machine file system, and further lacking a communicative coupling to another computing device with a hypervisor to interpret the retrieved catalogue of the virtual machine file system; and

wherein the media agent and the file system on the first computing device lack direct access to the secondary copy comprising the catalogue of the virtual machine file system backed up from the virtual disk of the virtual machine.

9. The method of claim 8 further comprising:

receiving by the media agent a request for a first file from the secondary copy of virtual-machine payload data backed up from the virtual disk of the virtual machine;

restoring the first file, at least in part by the media agent, from one or more extents in the plurality of extents comprising data blocks, wherein the one or more extents are retrieved by the pseudo-disk driver from the secondary copy into the pseudo-disk based on information about the first file in the enumerated catalogue of the virtual machine file system; and

wherein the restoring of the first file is performed at the first computing device without using, accessing, or connecting to a hypervisor.

10. The method of claim 8 wherein the information about the first file found in the enumerated catalogue comprises associations between the first file and a first set of data blocks that collectively form the first file and which first set of data blocks are stored in the plurality of extents in the secondary copy.

11. The method of claim 8 wherein the information about the first file found in the enumerated catalogue associates the first file with a first set of data blocks that collectively form the first file and which first set of data blocks are stored in the plurality of extents in the secondary copy;

and

wherein an index generated when the secondary copy was stored to the secondary storage device points to the retrieved one or more extents.

12. The method of claim 8 further comprising:

based on the response to the request to browse the virtual machine, receiving by the media agent a request for a first file of the virtual machine;

identifying, by the file system on the first computing device, a first set of data blocks that collectively form the first file;

in response to one or more read requests for the identified first set of data blocks from the file system on the first computing device to the pseudo-disk, (A) retrieving, by the pseudo-disk driver from the secondary copy and into the pseudo-disk, one or more extents in the plurality of extents, wherein the one or more extents comprise the first set of data blocks that collectively form the first file, and (B) serving the first set of data blocks to the file system on the first computing device in response to the one or more read requests;

restoring the first file, at least in part by the media agent, from the first set of data blocks; and

transmitting, the restored first file in response to the request for the first file of the virtual machine; and

wherein the response to the request for the first file of the virtual machine is generated at the first computing device without using, accessing, or connecting to a hypervisor.

13. The method of claim 12 wherein an index generated when the secondary copy was stored to the secondary storage device points to the retrieved one or more extents.

14. The method of claim 8 wherein the first file is restored to a primary data format without other files in the secondary copy being restored.

15. The method of claim 8 wherein the first file is restored to a primary data format without the secondary copy of virtual-machine payload data being restored in its entirety.

16. A method comprising:

storing to a secondary storage device a secondary copy of virtual-machine payload data backed up from a virtual disk of a virtual machine,

wherein the payload data in the secondary copy comprises (i) a catalogue of the virtual machine file system, and (ii) a plurality of extents comprising data blocks;

creating a pseudo-disk on a first computing device,

wherein the first computing device (a) is distinct from another computing device that hosted the virtual machine, and (b) is in communication with the secondary storage device,

wherein the pseudo-disk is created by a pseudo-disk driver executing on the first computing device, and

wherein a media agent also executes on the first computing device;

mounting the pseudo-disk to the first computing device,

wherein the pseudo-disk driver presents, to a file system on the first computing device, the pseudo-disk as a physical block data storage device and not as a virtual disk;

retrieving by the pseudo-disk driver the catalogue of the virtual machine file system from the secondary copy on the secondary storage device and into the pseudo-disk;

interpreting, by the file system on the first computing device, the retrieved catalogue of the virtual machine file system;

receiving by the media agent a request for a first file of the virtual machine;

restoring the first file, at least in part by the media agent, from one or more extents in the plurality of extents comprising data blocks, wherein the one or more extents are retrieved by the pseudo-disk driver from the secondary copy into the pseudo-disk based on information about the first file in the enumerated catalogue of the virtual machine file system; and

wherein the restoring of the first file is performed at the first computing device without using, accessing, or connecting to a hypervisor.

17. The method of claim 16 wherein the enumerating of the retrieved catalogue of the virtual machine file system is performed at the first computing device lacking a hypervisor to interpret the retrieved catalogue of the virtual machine file system, and further lacking a communicative coupling to another computing device with a hypervisor to interpret the retrieved catalogue of the virtual machine file system

18. The method of claim 16 wherein the media agent and the file system on the first computing device lack direct access to the secondary copy comprising the catalogue of the virtual machine file system backed up from the virtual disk of the virtual machine.

19. The method of claim 16 further comprising:

identifying, by the file system on the first computing device, a first set of data blocks that collectively form the first file;

in response to one or more read requests for the identified first set of data blocks from the file system on the first computing device to the pseudo-disk, (A) retrieving, by the pseudo-disk driver from the secondary copy and into the pseudo-disk, one or more extents in the plurality of extents, wherein the one or more extents comprise the first set of data blocks that collectively form the first file, and (B) serving the first set of data blocks to the file system on the first computing device in response to the one or more read requests;

wherein the restoring of the first file is based on the first set of data blocks extracted from the retrieved one or more extents; and

transmitting, the restored first file in response to the request for the first file of the virtual machine; and

wherein the first file of the virtual machine is restored at the first computing device without using, accessing, or connecting to a hypervisor.

20. The method of claim 16 wherein an index generated when the secondary copy was stored to the secondary storage device points to the retrieved one or more extents.