Synchronizing configuration of partner objects across distributed storage systems using transformations

• US 10,621,146 B2
• Filed: 11/22/2017
• Issued: 04/14/2020
• Est. Priority Date: 09/25/2014
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Vijayan, Anoop Chakkalakkal
• Primary Examiner(s): Channavajjala, Srirama
• Application Number:
  US15/820,743
• Publication Number:
  US 20180095990A1
• Time in Patent Office: 874 Days
• CPC Class Codes: G06F 11/0712 in a virtual computing platform, e.g. logically partitioned systems
• CPC Class Codes: G06F 11/1484 involving virtual machines
• CPC Class Codes: G06F 11/1658 Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
• CPC Class Codes: G06F 11/20 using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0667 at data level, e.g. file, record or object virtualisation
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A configuration for a component of a primary node is synchronized with a configuration for a component of a partner node in a different cluster by replicating the primary node configuration with the partner node. A baseline configuration replication comprises a snapshot of a component configuration on the primary. The baseline configuration can be generated by traversing through the configuration objects, capturing their attributes and encapsulating them in a package. The baseline package can then be transferred to the partner node. The configuration objects can be applied on the partner node in the order in which they were captured on the primary node. Attributes of the configuration objects are identified that are to be transformed. Values for the identified attributes are transformed from a name space in the primary node to a name space in the partner node.

Claims

1. A method comprising:

ordering configuration objects of a first virtual machine hosted by a first node into a baseline configuration for the first virtual machine based upon a dependency amongst the configuration objects; and

replicating a first configuration object within the baseline configuration to a second node, the replicating comprising;

comparing a first key attribute of the first configuration object for the first virtual machine with a second key attribute of a second configuration object at the second node to determine whether the first and second key attributes match;

in response to not identifying a match, creating a new configuration object at the second node, wherein an object attribute of the first configuration object is copied into the new configuration object, and wherein a first identifier within the first configuration object for the first virtual machine is transformed into a second identifier, of a second virtual machine at the second node, for inclusion within the new configuration object; and

in response to identifying a match, modifying one or more attributes of the second configuration object to match the object attribute of the first configuration object.

2. The method of claim 1, comprising:

replicating an update for the first configuration object from the first node to the second node through a replication stream for applying the update to the second configuration object.

3. The method of claim 1, comprising:

deleting the second configuration object based upon a value of the first key attribute of the first configuration object being less than a value of the second key attribute of the second configuration object.

4. The method of claim 1, wherein the ordering comprises ordering the configuration objects according to an order of object creation.

5. The method of claim 1, wherein transforming the first identifier comprises replacing a first name used to identify the first virtual machine with a second name used to identify the second virtual machine.

6. The method of claim 1, comprising replicating, according to an ordering of the configuration objects within the baseline configuration, the configuration objects within the baseline configuration to the second node for applying to the second virtual machine.

7. A non-transitory machine readable medium having stored thereon instructions comprising machine executable code that when executed by a machine, causes the machine to:

order configuration objects of a first virtual machine hosted by a first node into a baseline configuration for the first virtual machine based upon a dependency amongst the configuration objects; and

replicate a first configuration object within the baseline configuration to a second node, comprising;

comparing a first key attribute of the first configuration object for the first virtual machine with a second key attribute of a second configuration object at the second node to determine whether the first and second key attributes match;

in response to not identifying a match, creating a new configuration object at the second node, wherein an object attribute of the first configuration object is copied into the new configuration object, and wherein a first identifier within the first configuration object for the first virtual machine is transformed into a second identifier, of a second virtual machine at the second node, for inclusion within the new configuration object; and

in response to identifying a match, modifying one or more attributes of the second configuration object to match the object attribute of the first configuration object.

8. The non-transitory machine readable medium of claim 7, wherein the machine executable code further comprises machine executable code to cause the machine to:

traverse configuration objects associated with the first virtual machine to create a baseline configuration object of configuration objects ordered based upon dependencies between the configuration objects, wherein the configuration objects comprise the first configuration object of the first virtual machine and one or more additional configuration objects of the first virtual machine.

9. The non-transitory machine readable medium of claim 8, wherein the machine executable code further comprises machine executable code to cause the machine to:

lock the first configuration object to prevent modification to the first configuration object during the creation of the baseline configuration object.

10. The non-transitory machine readable medium of claim 8, wherein the machine executable code further comprises machine executable code to cause the machine to:

specify a rule that a snapshot policy configuration object is to be ordered after a volume creation configuration object based upon the snapshot policy configuration object comprising an instruction to apply a snapshot policy to a new volume that is to be created by the volume creation configuration object.

11. The non-transitory machine readable medium of claim 7, wherein a byte-by-byte comparison is performed upon a value of the first key attribute of the first configuration object and a value of the second key attribute of the second configuration object.

12. The non-transitory machine readable medium of claim 7, wherein the machine executable code further comprises machine executable code to cause the machine to:

invoke a schema complier to transform the first identifier to the second identifier based upon a tag for the first configuration object indicating that the first identifier is to be transformed.

13. The non-transitory machine readable medium of claim 12, wherein the tag for the first configuration object is specified in a configuration schema for the first configuration object.

14. A computing device comprising:

a processor; and

memory having stored thereon instructions comprising processor executable code that when executed by the processor, causes the processor to;

order configuration objects of a first virtual machine hosted by a first node into a baseline configuration for the first virtual machine based upon a dependency amongst the configuration objects; and

replicate a first configuration object within the baseline configuration to a second node, comprising;

comparing a first key attribute of the first configuration object for the first virtual machine with a second key attribute of a second configuration object at the second node to determine whether the first and second key attributes match;

in response to not identifying a match, creating a new configuration object at the second node, wherein an object attribute of the first configuration object is copied into the new configuration object, and wherein a first identifier within the first configuration object for the first virtual machine is transformed into a second identifier, of a second virtual machine at the second node, for inclusion within the new configuration object; and

in response to identifying a match, modifying one or more attributes of the second configuration object to match the object attribute of the first configuration object.

15. The computing device of claim 14, wherein the first configuration object comprises volume configuration information for a volume associated with the first virtual machine.

16. The computing device of claim 14, wherein the first configuration object comprises a policy used by the first virtual machine.

17. The computing device of claim 14, wherein the first configuration object comprises an interface used by first virtual machine.

18. The computing device of claim 14, wherein a text string replacement operation is used to transform the first identifier.

19. The computing device of claim 14, wherein an integer replacement operation is used to transform the first identifier.