Cluster families for cluster selection and cooperative replication

• US 10,073,641 B2
• Filed: 05/01/2017
• Issued: 09/11/2018
• Est. Priority Date: 12/11/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bish, Thomas W., Nohta, Takeshi, Swingler, Joseph M., Twito, Rufus-John Y.
• Primary Examiner(s): Nguyen, Than Vinh
• Application Number:
  US15/583,235
• Publication Number:
  US 20170235508A1
• Time in Patent Office: 498 Days
• Field of Search: 711148, 711162
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/2082 Data synchronisation
• CPC Class Codes: G06F 12/0802 Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0686 Libraries, e.g. tape libraries, jukebox
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Cluster families for cluster selection and cooperative replication are created. The clusters are grouped into family members of a cluster family base on their relationships and roles. Members of the cluster family determine which family member is in the best position to obtain replicated information and become cumulatively consistent within their cluster family. Once the cluster family becomes cumulatively consistent, the data is shared within the cluster family so that all copies within the cluster family are consistent.

Claims

1. A method for cooperative replication of multiple clusters, the method comprising:

arranging at least one subset of the multiple clusters into family members of a cluster family;

negotiating between cluster family members to determine which cluster family member is in the best position to obtain at least one outside data object from an outside cluster, the outside cluster being apart from the cluster family;

selecting one family member of the cluster family to obtain the outside data object; and

sharing the outside data objects among the cluster family so that each cluster within the cluster family is consistent with respect to outside data objects;

wherein a first family member to replicate 1/Nth volumes informs the outside cluster that the first family member will maintain the volumes for the cluster family members and relieves the outside cluster from maintaining the volumes in a cache of the outside cluster.

2. The method of claim 1, further comprising creating a relationship among cluster families based on at least one of a cluster relationship and role.

3. The method of claim 1, wherein the family member with a consistent source maintains a volume in cache in order to make the volume readily available to other family members for peer replication.

4. The method of claim 3, wherein the family member maintaining the volume in cache for the other family members relieves the outside cluster from maintaining a copy in the outside cluster cache.

5. The method of claim 1, wherein each family member in the cluster family replicates 1/Nth volumes and N represents a total number of cluster family members in the cluster family.

6. The method of claim 1, further comprising a plurality of cluster families wherein at least one family member from each cluster family replicates a volume.

7. The method of claim 1, further comprising a domain comprising a plurality of clusters from the multiple clusters that cooperate to make sure at least one family member from each cluster family replicates a volume and remaining cluster family members from each cluster family surrender replication requirements.

8. A system for cooperative replication of multiple clusters, the system comprising:

a network;

a plurality of sites in communication over the network, each site comprising at least one host and a storage system comprising a plurality of clusters, each cluster comprising at least one tape drive configured to access volumes stored on magnetic tape, at least one tape volume cache, and a cluster manager configured to execute computer readable programs using a processor and a memory, wherein the computer readable programs;

arrange at least one subset of the multiple clusters into family members of a cluster family;

negotiate between cluster family members to determine which cluster family member is in the best position to obtain at least one outside data object an outside cluster, the outside cluster being apart the cluster family;

select one family member of the cluster family to obtain the outside data object; and

share the outside data objects among the cluster family so that each cluster within the cluster family is consistent with respect to outside data objects;

wherein a first family member to replicate 1/Nth volumes informs the outside cluster that the first family member will maintain the volumes for the cluster family members and relieves the outside cluster from maintaining the volumes in a cache of the outside cluster.

9. The system of claim 8, further comprising creating a relationship among cluster families based on at least one of a cluster relationship and role.

10. The system of claim 8, wherein the family member with a consistent source maintains a volume in cache in order to make the volume readily available to other family members for peer replication.

11. The system of claim 10, wherein the family member maintaining the volume in cache for the other family members relieves the outside cluster from maintaining a copy in the outside cluster cache.

12. The system of claim 8, wherein each family member in the cluster family replicates 1/Nth volumes and N represents a total number of cluster family members in the cluster family.

13. The system of claim 8, further comprising a plurality of cluster families wherein at least one family member from each family replicates a volume.

14. The system of claim 8, further comprising a domain comprising the plurality of clusters wherein the clusters cooperate to make sure at least one family member from each cluster family replicates a volume and remaining cluster family members from each cluster family surrender replication requirements.

15. A computer program product comprising a non-transitory computer readable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

arrange at least one subset of the multiple clusters into family members of a cluster family;

negotiate between cluster family members to determine which cluster family member is in the best position to obtain at least one outside data object from an outside cluster, the outside cluster being apart from the cluster family;

select one family member of the cluster family to obtain the outside data object; and

share the outside data objects among the cluster family so that each cluster within the cluster family is consistent with respect to outside data objects;

wherein a first family member to replicate 1/Nth volumes informs the outside cluster that the first family member will maintain the volumes for the cluster family members and relieves the outside cluster from maintaining the volumes in a cache of the outside cluster.

16. The computer program product of claim 15, further comprising creating a relationship among cluster families based on at least one of a cluster relationship and role.

17. The computer program product of claim 15, wherein the family member with a consistent source maintains a volume in cache in order to make the volume readily available to other family members for peer replication.

18. The computer program product of claim 17, wherein each family member in the cluster family replicates 1/Nth volumes and N represents a total number of cluster family members in the cluster family.