Incremental virtual machine metadata extraction

• US 10,534,759 B1
• Filed: 08/23/2018
• Issued: 01/14/2020
• Est. Priority Date: 08/23/2018
• Status: Active Grant

• Current Assignee: Cohesity, Inc.
• Original Assignee: Cohesity, Inc.
• Inventors: Manjunath, Chinmaya, Duttagupta, Anirvan, Gupta, Anubhav, Mishra, Sidharth, Qiu, Zhihuan
• Primary Examiner(s): Raab, Christopher J
• Application Number:
  US16/110,314
• Time in Patent Office: 509 Days
• Field of Search: None
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/188 Virtual file systems

Abstract

A virtual machine container file is analyzed to determine which portion of the virtual machine container file corresponds to a virtual machine file system metadata of the virtual machine container file. One or more differences between a first version of a virtual machine container file and a second version of the virtual machine container file are determined at least in part by traversing a snapshot structure associated with the virtual machine container file. The determined one or more differences that corresponds to the virtual machine file system metadata portion of the virtual machine container file are identified based at least in part on the analysis of the virtual machine container file. The identified one or more differences corresponding to the virtual machine file system metadata portion of the virtual machine file are utilized to identify one or more changes from the content files included in the first version of the virtual machine container file to content files included in the second version of the virtual machine container file.

Claims

1. A system, comprising:

a processor configured to;

analyze a virtual machine container file to determine which portion of the virtual machine container file corresponds to a virtual machine file system metadata of the virtual machine container file, wherein the virtual machine container file includes data associated with a plurality of virtual machine content files and metadata associated with the plurality of virtual machine content files;

determine one or more differences between a first version of the virtual machine container file and a second version of the virtual machine container file at least in part by;

traversing a snapshot structure associated with the virtual machine container file; and

determining one or more leaf nodes of the snapshot structure associated with the virtual machine container file that are not shared between the first version of the virtual machine container file and the second version of the virtual machine container file;

identify which of the determined one or more leaf nodes correspond to the virtual machine file system metadata portion of the virtual machine container file based at least in part on the analysis of the virtual machine container file; and

utilize the identified one or more leaf nodes corresponding to the virtual machine file system metadata portion of the virtual machine file to identify one or more changes from virtual machine content files included in the first version of the virtual machine container file to virtual machine content files included in the second version of the virtual machine container file;

create a file system index of the virtual machine content files that are included in the second version of the virtual machine container file based in part on the virtual machine file system metadata; and

a memory coupled to the processor and configured to provide the processor with instructions.

2. The system of claim 1, wherein the processor is further configured to receive from a primary system a backup snapshot of file system data that includes the second version of the virtual machine container file.

3. The system of claim 2, wherein the processor is further configured to generate a view of the backup snapshot of the file system data, wherein the view includes a tree data structure associated with the second version of the virtual machine container file.

4. The system of claim 3, wherein the tree data structure associated with the second version of the virtual machine container file includes a first reference to the snapshot structure associated with the second version of the virtual machine container file and a second reference to the snapshot structure associated with the first version of the virtual machine container file.

5. The system of claim 1, wherein the processor is further configured to analyze the virtual machine container file to determine a file offset range corresponding to the virtual machine file system metadata portion of the virtual machine container file.

6. The system of claim 5, wherein the processor is further configured to determine which portion of the file offset range corresponding to the virtual machine file system metadata portion corresponds to which virtual machine content file of a plurality of virtual machine content files included in the virtual machine container file.

7. The system of claim 6, wherein the processor is further configured to generate and store a data structure that associates file offset ranges of the virtual machine file system metadata portion with its corresponding virtual machine content file.

8. The system of claim 1, wherein the processor is further configured to read the metadata of the identified one or more differences corresponding to the virtual machine file system metadata portion of the virtual machine container file to identify the one or more changes from content files included in the first version of the virtual machine container file to content files included in the second version of the virtual machine container file.

9. The system of claim 1, wherein the processor is further configured to:

use the file system index to determine one or more virtual machine content files that are included in the second version of the virtual machine container file and not included in the first version of the virtual machine container file; and

scan the portion of the virtual machine container file corresponding to the determined one or more virtual machine content files.

10. The system of claim 1, wherein the processor is further configured to:

receive a request for a particular version of a virtual machine content file;

use the file system index to determine a virtual machine container file that stores the particular version of the virtual machine content file; and

provide the data associated with the particular version of the virtual machine content file.

11. The system of claim 1, wherein the analysis of virtual machine container file to determine which portion of the virtual machine container file corresponds to a virtual machine file system metadata of the virtual machine container file is utilized for analysis of a different version of the virtual machine container file.

12. The system of claim 1, further comprising analyzing a later version of the virtual machine container file to determine which portion of the later version of the virtual machine container file corresponds to a virtual machine file system metadata of the later version of the virtual machine container file, wherein the determined portion for the later version of the virtual machine container file is different than determined portion for a previous version of the virtual machine container file.

13. A method, comprising:

analyzing a virtual machine container file to determine which portion of the virtual machine container file corresponds to a virtual machine file system metadata of the virtual machine container file, wherein the virtual machine container file includes data associated with a plurality of virtual machine content files and metadata associated with the plurality of virtual machine content files;

determining one or more differences between a first version of the virtual machine container file and a second version of the virtual machine container file at least in part by;

traversing a snapshot structure associated with the virtual machine container file; and

determining one or more leaf nodes of the snapshot structure associated with the virtual machine container file that are not shared between the first version of the virtual machine container file and the second version of the virtual machine container file;

identifying which of the determined one or more leaf nodes correspond to the virtual machine file system metadata portion of the virtual machine container file based at least in part on the analysis of the virtual machine container file;

utilizing the identified one or more leaf nodes corresponding to the virtual machine file system metadata portion of the virtual machine file to identify one or more changes from virtual machine content files included in the first version of the virtual machine container file to virtual machine content files included in the second version of the virtual machine container file; and

creating a file system index of the virtual machine content files that are included in the second version of the virtual machine container file based in part on the virtual machine file system metadata.

14. The method of claim 13, further comprising receiving from a primary system a backup snapshot of file system data that includes the second version of the virtual machine container file.

15. The method of claim 14, further comprising generating a view of the backup snapshot of the file system data, wherein the view includes a tree data structure associated with the second version of the virtual machine container file.

16. The method of claim 15, wherein the tree data structure associated with the second version of the virtual machine container file includes a first reference to the snapshot structure associated with the second version of the virtual machine container file and a second reference to the snapshot structure associated with the first version of the virtual machine container file.

17. The method of claim 13, further comprising analyzing the virtual machine container file to determine a file offset range corresponding to metadata associated with a plurality of virtual machine content files included in the virtual machine container file.

18. The method of claim 17, further comprising determining which portion of the file offset range corresponding to metadata associated with a plurality of virtual machine content files corresponds to which virtual machine content file of the plurality of virtual machine content files included in the virtual machine container file.

19. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

analyzing a virtual machine container file to determine which portion of the virtual machine container file corresponds to a virtual machine file system metadata of the virtual machine container file, wherein the virtual machine container file includes data associated with a plurality of virtual machine content files and metadata associated with the plurality of virtual machine content files;

determining one or more differences between a first version of the virtual machine container file and a second version of the virtual machine container file at least in part by;

traversing a snapshot structure associated with the virtual machine container file; and

determining one or more leaf nodes of the snapshot structure associated with the virtual machine container file that are not shared between the first version of the virtual machine container file and the second version of the virtual machine container file;

identifying which of the determined one or more leaf nodes correspond to the virtual machine file system metadata portion of the virtual machine container file based at least in part on the analysis of the virtual machine container file;

utilizing the identified one or more leaf nodes corresponding to the virtual machine file system metadata portion of the virtual machine file to identify one or more changes from virtual machine content files included in the first version of the virtual machine container file to virtual machine content files included in the second version of the virtual machine container file; and

creating a file system index of the virtual machine content files that are included in the second version of the virtual machine container file based in part on the virtual machine file system metadata.