Efficient data synchronization for storage containers

• US 9,817,835 B2
• Filed: 03/10/2014
• Issued: 11/14/2017
• Est. Priority Date: 03/12/2013
• Status: Active Grant

• Current Assignee: Tintri Incorporated
• Original Assignee: Tintri, Inc.
• Inventors: Sudarsanam, Raj Ashok, Lee, Edward K., Gritter, Mark G., Singh, Pratap V.
• Primary Examiner(s): Mofiz, Apu
• Assistant Examiner(s): Holland, Sheryl
• Application Number:
  US14/202,836
• Publication Number:
  US 20140279909A1
• Time in Patent Office: 1,345 Days
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

Performing data synchronization is disclosed, including: receiving an indication to synchronize a container to a snapshot, wherein the container has a first data state and an identity, wherein the snapshot corresponds to a second data state; causing the container to have the second data state corresponding to the snapshot; and maintaining the identity of the container.

Claims

1. A system, comprising:

a processor configured to;

receive an indication to synchronize a current data state of a first container to match a data state that is represented by a snapshot of a second container without duplicating at least a subset of physical data associated with the snapshot of the second container;

wherein the snapshot comprises a data structure that stores a plurality of mappings of logical locations to physical locations at which snapshot data is stored at a physical storage device;

wherein the first container has a first container type, wherein the first container type is one or more of the following;

a virtual machine, a virtual disk associated with the virtual machine, and a file associated with the virtual machine;

wherein the first container has identity information that is determined based at least in part on the first container type;

wherein the identity information associated with the first container comprises a first value prior to a synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

perform the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container, including to;

provide a new current data structure associated with the first container, wherein the new current data structure is initially empty of any mappings of logical locations to physical locations, wherein the new current data structure is configured to store one or more mappings of logical locations to physical locations of data that represents the current data state of the first container;

store a pointer from the new current data structure associated with the first container to the snapshot of the second container;

determine that the identity information of the first container has been at least partially overwritten by identity information associated with the second container associated with the snapshot; and

restore the identity information of the first container to the first value that is associated with the identity information of the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container; and

subsequent to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

receive a read request for a requested mapping of a logical location to a physical location from the first container;

in response to the read request, search the new current data structure associated with the first container for the requested mapping; and

in the event that the requested mapping is not found in the new current data structure associated with the first container;

use the pointer from the new current data structure associated with the first container to the snapshot of the second container to access the snapshot of the second container; and

search for the requested mapping at the snapshot of the second container; and

a memory coupled to the processor and configured to store the snapshot of the second container.

2. The system of claim 1, wherein providing the new current data structure associated with the first container comprises:

emptying an existing current data structure associated with the first container by removing existing one or more mappings of logical locations to corresponding physical locations of data that were previously written to the first container from the existing current data structure.

3. The system of claim 1, wherein to restore the identity information of the first container to the first value that is associated with the identity information of the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container includes to modify data or metadata or both data and metadata associated with the first container.

4. The system of claim 1, wherein the second container is different from the first container.

5. The system of claim 1, wherein the first container and the second container are the same container, wherein the data state corresponding to the snapshot of the second container comprises an earlier-in-time data state than the current data state associated with the first container.

6. The system of claim 1, wherein to perform the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container does not preclude preservation of a previously generated snapshot associated with the first container.

7. The system of claim 1, wherein the processor is further configured to:

receive an indication to delete the snapshot of the second container;

remove a data corresponding to the snapshot from a user history data structure associated with the second container; and

maintain the snapshot of the second container until the snapshot is no longer needed.

8. The system of claim 1, wherein the processor is further configured to:

store, in a user history data structure associated with the first container, data associated with a first snapshot of the first container, wherein the first snapshot of the first container is generated prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container; and

subsequent to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

generate a second snapshot of the first container based at least in part on the new current data structure associated with the first container; and

store, in the user history data structure associated with the first container, data associated with the second snapshot of the first container.

9. The system of claim 1, wherein the first value of the identity information associated with the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container comprises one or more of the following:

an inode number, a file handle, a disk signature, a universal unique identifier (UUID), and a security identifier.

10. A method, comprising:

receiving an indication to synchronize a current data state of a first container to match a data state that is represented by a snapshot of a second container without duplicating at least a subset of physical data associated with the snapshot of the second container;

wherein the snapshot comprises a data structure that stores a plurality of mappings of logical locations to physical locations at which snapshot data is stored at a physical storage device;

wherein the first container has a first container type, wherein the first container type is one or more of the following;

a virtual machine, a virtual disk associated with the virtual machine, and a file associated with the virtual machine;

wherein the first container has identity information that is determined based at least in part on the first container type;

wherein the identity information associated with the first container comprises a first value prior to a synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

performing the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container based at least in part by;

providing a new current data structure associated with the first container, wherein the new current data structure is initially empty of any mappings of logical locations to physical locations, wherein the new current data structure is configured to store one or more mappings of logical locations to physical locations of data that represents the current data state of the first container;

storing a pointer from the new current data structure associated with the first container to the snapshot of the second container;

determining that the identity information of the first container has been at least partially overwritten by identity information associated with the second container associated with the snapshot; and

restoring the identity information of the first container to the first value that is associated with the identity information of the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container; and

subsequent to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

receiving a read request for a requested mapping of a logical location to a physical location from the first container;

in response to the read request, searching the new current data structure associated with the first container for the requested mapping; and

in the event that the requested mapping is not found in the new current data structure associated with the first container;

using the pointer from the new current data structure associated with the first container to the snapshot of the second container to access the snapshot of the second container; and

searching for the requested mapping at the snapshot of the second container.

11. The method of claim 10, wherein restoring the identity information of the first container to the first value that is associated with the identity information of the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container includes modifying data or metadata or both data and metadata associated with the first container.

12. The method of claim 10, wherein the second container is different from the first container.

13. The method of claim 10, wherein the first container and the second container are the same container, wherein the data state corresponding to the snapshot of the second container comprises an earlier-in-time data state than the current data state associated with the first container.

14. The method of claim 10, wherein performing the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container does not preclude preservation of a previously generated snapshot associated with the first container.

15. The method of claim 10, further comprising:

receiving an indication to delete the snapshot of the second container;

removing a data corresponding to the snapshot from a user history data structure associated with the second container; and

maintaining the snapshot of the second container until the snapshot is no longer needed.

16. The method of claim 10, wherein providing the new current data structure associated with the first container comprises:

emptying an existing current data structure associated with the first container by removing existing one or more mappings of logical locations to corresponding physical locations of data that were previously written to the first container from the existing current data structure.

17. The method of claim 10, further comprising:

storing, in a user history data structure associated with the first container, data associated with a first snapshot of the first container, wherein the first snapshot of the first container is generated prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container; and

subsequent to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

generating a second snapshot of the first container based at least in part on the new current data structure associated with the first container; and

storing, in the user history data structure associated with the first container, data associated with the second snapshot of the first container.

18. The method of claim 10, wherein the first value of the identity information associated with the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container comprises one or more of the following:

an inode number, a file handle, a disk signature, a universal unique identifier (UUID), and a security identifier.

19. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising instructions for:

receiving an indication to synchronize a current data state of a first container to match a data state that is represented by a snapshot of a second container without duplicating at least a subset of physical data associated with the snapshot of the second container;

wherein the snapshot comprises a data structure that stores a plurality of mappings of logical locations to physical locations at which snapshot data is stored at a physical storage device,

wherein the first container has a first container type, wherein the first container type is one or more of the following;

a virtual machine, a virtual disk associated with the virtual machine, and a file associated with the virtual machine;

wherein the first container has identity information that is determined based at least in part on the first container type;

wherein the identity information associated with the first container comprises a first value prior to a synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

performing the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container based at least in part by;

providing a new current data structure associated with the first container, wherein the new current data structure is initially empty of any mappings of logical locations to physical locations, wherein the new current data structure is configured to store one or more mappings of logical locations to physical locations of data that represents the current data state of the first container;

storing a pointer from the new current data structure associated with the first container to the snapshot of the second container;

determining that the identity information of the first container has been at least partially overwritten by identity information associated with the second container associated with the snapshot; and

restoring the identity information of the first container to the first value that is associated with the identity information of the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container; and

subsequent to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

receiving a read request for a requested mapping of a logical location to a physical location from the first container;

in response to the read request, searching the new current data structure associated with the first container for the requested mapping; and

in the event that the requested mapping is not found in the new current data structure associated with the first container;

using the pointer from the new current data structure associated with the first container to the snapshot of the second container to access the snapshot of the second container; and

searching for the requested mapping at the snapshot of the second container.

20. The computer program product of claim 19, wherein providing the new current data structure associated with the first container comprises:

emptying an existing current data structure associated with the first container by removing existing one or more mappings of logical locations to corresponding physical locations of data that were previously written to the first container from the existing current data structure.

21. The computer program product of claim 19, further comprising:

storing, in a user history data structure associated with the first container, data associated with a first snapshot of the first container, wherein the first snapshot of the first container is generated prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container; and

subsequent to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container;

generating a second snapshot of the first container based at least in part on the new current data structure associated with the first container; and

storing, in the user history data structure associated with the first container, data associated with the second snapshot of the first container.

22. The computer program product of claim 19, wherein the first value of the identity information associated with the first container prior to the synchronization of the current data state of the first container to match the data state that is represented by the snapshot of the second container comprises one or more of the following:

an inode number, a file handle, a disk signature, a universal unique identifier (UUID), and a security identifier.