Systems and methods to process block-level backup for selective file restoration for virtual machines

• US 9,495,404 B2
• Filed: 12/06/2013
• Issued: 11/15/2016
• Est. Priority Date: 01/11/2013
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kumarasamy, Paramasivam, Pawar, Rahul S., Mitkar, Amit, Kilaru, Satish Chandra
• Primary Examiner(s): Chen, Susan
• Application Number:
  US14/098,894
• Publication Number:
  US 20140201152A1
• Time in Patent Office: 1,075 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/168 Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs query results presentation G06F16/156
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

A data storage system protects virtual machines using block-level backup operations and restores the data at a file level. The system accesses the virtual machine file information from the file allocation table of the host system underlying the virtualization layer. A file index associates this virtual machine file information with the related protected blocks in a secondary storage device during the block-level backup. Using the file index, the system can identify the specific blocks in the secondary storage device associated with a selected restore file. As a result, file level granularity for restore operations is possible for virtual machine data protected by block-level backup operations without restoring more than the selected file blocks from the block-level backup data.

Claims

1. A method to process block-level data protection of virtual machine files for selective file-level restoration in a data management system, the method comprising:

automatically identifying, with a storage manager in a first computing device comprising computer hardware, an information store comprising virtual files associated with a virtual machine, wherein the virtual machine is associated with a media agent in a second computing device comprising computer hardware, and a host operating system having a file allocation table (FAT) comprising file information for each virtual file within the information store;

automatically transferring, with the media agent, blocks of data comprising the virtual files from the information store to a secondary storage device during a block-level data protection operation of the virtual machine to create transferred blocks of data in the secondary storage device;

automatically updating, with the media agent, a file index associating a location of a corresponding transferred block of data in the secondary storage device;

accessing, with the media agent, the file information in the FAT of the host operating system during the block-level data protection operation of the virtual machine; and

automatically associating in the file index, with the media agent, the file information associated with each block of data that was transferred from the information store during the block-level data protection operation of the virtual machine with the location of the corresponding transferred block of data in the secondary storage device;

wherein, using the file index to locate the transferred blocks of data in the secondary storage device that comprise at least a portion of the selected virtual file, the media agent restores one or more transferred blocks of data in the secondary storage device that are associated with the at least a portion of the selected virtual file without restoring transferred blocks of data associated with other than the selected virtual file; and

wherein, using the file index to locate the at least a portion of the selected virtual file in the restored one or more blocks of data, the media agent recreates the selected virtual file from the restored one or more blocks of data.

2. The method of claim 1 further comprising displaying a listing of files with a graphical user interface, the listing of files based on the file index from the media agent.

3. The method of claim 1 wherein the file information comprises, for each virtual file, a linked list of one or more clusters across which the virtual file is stored on the information store.

4. The method of claim 1 further comprising instructing, with the storage manager, the media agent to attach to the host operating system underlying the virtual machine.

5. The method of claim 1 further comprising instructing, with the storage manager, the host operating system underlying the virtual machine to attach to the media agent.

6. The method of claim 1 further comprising, instructing, with the storage manager, the media agent to perform the block-level data protection operation of the virtual machine and to create the file index by determining which blocks of data relate to which virtual files based at least in part on the file information stored in the FAT of the host operating system.

7. The method of claim 1 wherein the media agent comprises a media agent index, and the file index is associated with the media agent index.

8. The method of claim 1 wherein the media agent comprises a media agent index which incorporates the file index.

9. The method of claim 1 further comprising:

automatically querying, with the storage manager, the media agent for an address of a virtual machine disk associated with the virtual machine, wherein the media agent looks up the address in a media agent index associated with the media agent; and

automatically receiving, with the storage manager, the address in the information store of the virtual machine disk from the media agent.

10. The method of claim 4 wherein attaching the media agent to the host operating system creates a new virtual machine comprising the media agent in virtual machine management software.

11. A system to process block-level data protection of virtual machine files for selective file-level restoration in a data management system, the system comprising:

a storage manager in a first computing system comprising computer hardware configured to automatically identify an information store comprising virtual files associated with a virtual machine, wherein the virtual machine is associated with a media agent in a second computing device comprising computer hardware, and a host operating system having a file allocation table (FAT) comprising file information for each virtual file within the information store;

the media agent configured to automatically transfer blocks of data comprising the virtual files from the information store to a secondary storage device during a block-level data protection operation of the virtual machine to create transferred blocks of data in the secondary storage device;

the media agent further configured to automatically update a file index associating a location of a corresponding transferred block of data in the secondary storage device;

the media agent further configured to access the file information in the FAT of the host operating system during the block-level data protection operation of the virtual machine; and

the media agent further configured to automatically associate in the file index the file information associated with each block of data that was transferred from the information store during the block-level data protection operation of the virtual machine with the location of the corresponding transferred block of data in the secondary storage device;

wherein, using the file index to locate the transferred blocks of data in the secondary storage device that comprise at least a portion of the selected virtual file, the media agent is further configured to restore one or more transferred blocks of data in the secondary storage device that are associated with the at least a portion of the selected virtual file without restoring transferred blocks of data associated with other than the selected virtual file; and

wherein, using the file index to locate the at least a portion of the selected virtual file in the restored one or more blocks of data, the media agent is further configured to recreate the selected virtual file from the restored one or more blocks of data.

12. The system of claim 11 further comprising a graphical user interface configured to display a listing of files that are based on the file index from the media agent.

13. The system of claim 11 wherein the file information comprises, for each virtual file, a linked list of one or more clusters across which the virtual file is stored on the information store.

14. The system of claim 11 wherein the storage manager is further configured to instruct the media agent to attach to the host operating system underlying the virtual machine.

15. The system of claim 11 wherein the storage manager is further configured to instruct the host operating system underlying the virtual machine to attach the media agent.

16. The system of claim 11 wherein the storage manager is further configured to instruct the media agent to perform the block-level data protection operation of the virtual machine and to create the file index by determining which blocks of data relate to which virtual files based at least in part on the file information stored in the FAT of the host operating system.

17. The system of claim 11 wherein the media agent comprises a media agent index, and the file index is associated with the media agent index.

18. The system of claim 11 wherein the media agent comprises a media agent index which incorporates the file index.

19. The system of claim 11 wherein the storage manager is further configured to automatically query the media agent for an address of a virtual machine disk associated with the virtual machine, wherein the media agent looks up the address in a media agent index associated with the media agent, and wherein the storage manager is further configured to automatically receive the address in the information store of the virtual machine disk from the media agent.

20. The system of claim 14 wherein attaching the media agent to the host operating system creates a new virtual machine comprising the media agent in virtual machine management software.