Change tracking of individual virtual disk files

• US 8,326,803 B1
• Filed: 05/06/2010
• Issued: 12/04/2012
• Est. Priority Date: 05/06/2010
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Corporation (NortonLifeLock Inc.)
• Inventors: Stringham, Russell R.
• Primary Examiner(s): HO, BINH VAN
• Application Number:
  US12/775,245
• Time in Patent Office: 943 Days
• Field of Search: 707/652
• US Class Current: 707/652
• CPC Class Codes: G06F 11/1466 to make the backup process non-disruptive
• CPC Class Codes: G06F 11/1484 involving virtual machines
• CPC Class Codes: G06F 11/2046 where the redundant components share persistent storage G06F11/2043 takes precedence
• CPC Class Codes: G06F 16/2308 Concurrency control transaction processing G06F9/466
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A first write operation is intercepted. The first write operation is a write from a virtual machine to a virtual disk. The first write operation is a change to a first data location. The change to the first data location is recorded. The recording creates a first change record. The first change record is stored separately from the first data location. A first backup operation is performed. The first backup operation, the intercepting, and the recording are performed by an application executing on a host of the virtual machine. The first backup operation includes a read request for the first data location. The read request for the first data location is fulfilled based on the first change record.

Claims

1. A method, comprising:

intercepting a first write operation, wherein

said first write operation is a write from a virtual machine to a virtual disk, and

said first write operation is a change to a first data location;

recording said change to said first data location, wherein

said recording creates a first change record, and

said first change record is stored separately from said first data location;

performing a first backup operation, wherein

said first backup operation, said intercepting, and said recording are performed by one or more applications executing on a host of said virtual machine,

said first backup operation comprises a read request for said first data location, and

said read request for said first data location is fulfilled based on said first change record;

identifying said first data location, wherein

first data of a data structure is stored at said first data location;

creating a snapshot of said data structure;

copying said first data to a secondary storage location, wherein,

said recording comprises associating said first data to said first data location in said first change record,

said first write operation is performed at said first data location after a completion of said recording and said copying,

said first backup operation comprises answering said read request from said secondary storage location,

said first backup operation creates a first backup data structure;

responsive to a completion of said first backup operation, releasing said first data;

intercepting a second write operation, wherein

said second write operation is addressed to said data structure, and

said second write operation is received after said releasing;

identifying a second data location, wherein

said second write operation is a change to said second data location, and

second data of said data structure is stored at said second data location;

recording said change to said second data location; and

performing a second backup operation, wherein

said second backup operation comprises copying said second data location to a second backup data structure, and

said second backup operation is an incremental backup of said data structure.

2. The method of claim 1, further comprising,

installing a file filter driver on an operating system of a virtual machine host, wherein

said file filter driver performs said intercepting said first write operation,

a storage object provides storage to said virtual machine host, and

said virtual disk is associated with a virtual machine hosted by said virtual machine host.

3. The method of claim 1, further comprising,

installing a data structure filter driver on a hypervisor of a virtual machine host, wherein

said data structure filter driver performs said intercepting said first write operation,

a shared storage object provides storage to said virtual machine host, and

said virtual disk is associated with a virtual machine hosted by said virtual machine host.

4. The method of claim 3, further comprising,

said virtual machine host first propagating a quiesce event to said virtual machine;

and

said virtual machine second propagating said quiesce event to an application of said virtual machine.

5. The method of claim 1, further comprising,

determining whether a third write operation is addressed to said data structure, wherein

said third write operation is addressed to a shared storage object;

and

in response to determining that said third write operation is not addressed to said data structure, performing said write operation.

6. The method of claim 1, wherein

said secondary storage location is located on a shared storage object;

and

said first change record is located on a cluster shared volume.

7. A non-transitory computer-readable storage medium storing instructions executable by a processor, said instructions comprising:

a first set of instructions configured to intercept a first write operation, wherein

said first write operation is a write from a virtual machine to a virtual disk, and

said first write operation is a change to a first data location;

a second set of instructions configured to record said change to said first data location, wherein

said second set of instructions further creates a first change record, and

said first change record is stored separately from said first data location;

a third set of instructions configured to perform a first backup operation, wherein

said first backup operation comprises a read request for said first data location, and

said read request for said first data location is fulfilled based on said first change record;

a fourth set of instructions configured to identify said first data location, wherein

first data of a data structure is stored at said first data location;

a fifth set of instructions configured to create a snapshot of said data structure;

a sixth set of instructions configured to copy said first data to a secondary storage location, wherein,

said recording comprises associating said first data to said first data location in said first change record,

said first write operation is performed at said first data location after a completion of said recording and said copying,

said first backup operation comprises answering said read request from said secondary storage location,

said first backup operation creates a first backup data structure; and

a seventh set of instructions configured to, responsive to a completion of said first backup operation, release said first data;

an eighth set of instructions configured to intercept a second write operation, wherein

said second write operation is addressed to said data structure, and

said second write operation is received after said releasing;

a ninth set of instructions configured to identify a second data location, wherein

said second write operation is a change to said second data location, and

second data of said data structure is stored at said second data location;

a tenth set of instructions configured to record said change to said second data location; and

an eleventh set of instructions configured to perform a second backup operation, wherein

said second backup operation comprises copying said second data location to a second backup data structure, and

said second backup operation is an incremental backup of said data structure.

8. The non-transitory computer-readable storage medium of claim 7, further comprising,

a twelfth set of instructions configured to install a file filter driver on an operating system of a virtual machine host, wherein

said file filter driver performs said intercepting said first write operation,

a storage object provides storage to said virtual machine host, and

said virtual disk is associated with a virtual machine hosted by said virtual machine host.

9. The non-transitory computer-readable storage medium of claim 7, wherein

said secondary storage location is located on a shared storage object;

and

said first change record is located on a cluster shared volume.

10. A system, comprising:

a processor;

a memory coupled to the processor;

a file filter driver configured to

intercept a first write operation, wherein

said first write operation is a write from a virtual machine to a virtual disk, and

said first write operation is a change to a first data location, and

record said change to said first data location, wherein

said file filter driver is located on a host of said virtual machine,

said file filter driver creates a first change record, and

said first change record is stored separately from said first data location,

identify said first data location, wherein

first data of a data structure is stored at said first data location,

copy said first data to a secondary storage location, wherein,

said recording comprises associating said first data to said first data location in said first change record, and

said first write operation is performed at said first data location after a completion of said recording and said copying,

intercept a second write operation, wherein

said second write operation is addressed to said data structure, and

said second write operation is received after releasing first data,

identify a second data location, wherein

said second write operation is a change to said second data location, and

second data of said data structure is stored at said second data location, and

record said change to said second data location; and

a backup application configured to

perform a first backup operation, wherein

said backup application is located on said host of said virtual machine,

said first backup operation comprises a read request for said first data location,

said first backup operation comprises answering said read request from said secondary storage location,

said first backup operation creates a first backup data structure,

said file filter driver is further configured to, responsive to a completion of said first backup operation, release said first data, and

said read request for said first data location is fulfilled based on said first change record

create a snapshot of said data structure, and

perform a second backup operation, wherein

said second backup operation comprises copying said second data location to a second backup data structure, and

said second backup operation is an incremental backup of said data structure.

11. The system of claim 10, further comprising,

an installation module configured to install said file filter driver on an operating system of a virtual machine host, wherein

said file filter driver performs said intercepting said first write operation,

a storage object provides storage to said virtual machine host, and

said virtual disk is associated with a virtual machine hosted by said virtual machine host.

12. The system of claim 10, further comprising,

an installation module configured to install said filter driver on a hypervisor of a virtual machine host, wherein

said data structure filter driver performs said intercepting said first write operation,

a shared storage object provides storage to said virtual machine host, and

said virtual disk is associated with a virtual machine hosted by said virtual machine host.

13. The system of claim 12, wherein,

said operating system is configured to first propagate a quiesce event to said virtual machine;

and

said virtual machine is configured to second propagate said quiesce event to an application of said virtual machine.

14. The system of claim 10, wherein

said secondary storage location is located on a shared storage object;

and

said first change record is located on a cluster shared volume.