Replication of assets across data centers

• US 9,298,790 B2
• Filed: 01/18/2013
• Issued: 03/29/2016
• Est. Priority Date: 01/18/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Susanto, Ferry, Ghani, Usman, Rajaram, Koushik, Dournov, Pavel, Wright, Eron D.
• Primary Examiner(s): MOSER, BRUCE M
• Application Number:
  US13/745,557
• Publication Number:
  US 20140207736A1
• Time in Patent Office: 1,166 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

The replication of an asset from a source cluster in a source data center to multiple target clusters in multiple destination data centers. The replication occurs by first estimating or determining a cost parameter associated with copying of the asset from the source cluster to each of at least some of the target clusters. As an example, the cost parameter might be a geographical parameter, but might also be any cost parameter such as a channel bandwidth, channel cost, utilization ratio or the like. Based on the cost parameters, an order of replication priority is determined. Then, the replication is initiated in accordance with the prioritization. The replication may occur in multiple phases, and replication prioritization may occur on a per phase basis.

Claims

1. A method for replicating an asset from a source cluster in a source data center to a plurality of target clusters in a plurality of destination data centers, the method comprising:

an act of at least estimating a cost parameter associated with copying of the asset from the source cluster to each of at least some of the target clusters;

an act of prioritizing an order of replication based on the cost parameter; and

an act of initiating the replication in accordance with the prioritization,

wherein the replication occurs in a plurality of phases; and

wherein a number of copy operations at least of a first type are limited to a first limit per replication phase, but a number of copy operations of a second type are not limited per replication phase.

2. The method in accordance with claim 1, wherein the cost parameter for at least one of the target clusters comprises a geographical relationship between the source cluster and the target cluster.

3. The method in accordance with claim 1, wherein a number of copy operations of a third type are limited to a second limit per replication phase.

4. The method in accordance with claim 1, wherein the cost parameter for at least one of the target clusters comprises a bandwidth of the channel between the source cluster and the target cluster.

5. The method in accordance with claim 1, wherein the cost parameter for at least one of the target clusters comprises a utilization of the channel between the source cluster and the target cluster.

6. The method in accordance with claim 1, wherein the asset is a virtual machine image.

7. The method in accordance with claim 1, wherein the asset is an application package.

8. The method in accordance with claim 1, further comprising:

an act of tracking a state of replication associated with each of the at least some of the target clusters.

9. The method in accordance with claim 1, further comprising:

an act of receiving the asset into the source cluster.

10. The method in accordance with claim 9, further comprising:

an act of receiving a command to replicate, wherein the act of at least estimating and the act of prioritizing occurs in response to the command to replicate.

11. The method in accordance with claim 1, further comprising:

an act of locking each replicated copy of the asset after replication so that writing to the replicated copy of the asset or deleting the replicated asset is prohibited.

12. The method of claim 11, wherein if a lock of the replicated copy of the asset on a particular target cluster is broken, the replicated copy of the asset in the particular target cluster is deleted, and marked for re-replication from another cluster that has a replicated copy of the asset.

13. A computer program product comprising one or more computer-readable hardware storage devices having thereon computer-executable instructions that are executable by one or more processors of a computing system for causing the computing system to replicate an asset from a source cluster in a source data center to a plurality of target clusters in a plurality of destination data centers by:

at least estimating a cost parameter associated with copying of the asset from the source cluster to each of at least some of the target clusters;

prioritizing an order of replication based on the cost parameter; and

initiating the replication in accordance with the prioritization,

wherein the replication occurs in a plurality of phases, with a number of copy operations at least of a first type being limited to a first limit per replication phase and with a number of copy operations of a second type being unlimited per replication phase.

14. A computing system comprising:

one or more processors; and

one or more hardware storage device having stored computer-executable instructions for instantiating a replication engine configured to perform replication of an asset from a source cluster in a source data center to a plurality of target clusters in a plurality of destination data centers by performing the following;

an act of at least estimating a cost parameter associated with copying of the asset from the source cluster to each of at least some of the target clusters;

an act of prioritizing an order of replication based on the cost parameter;

an act of initiating the replication in accordance with the prioritization; and

an act of locking a replicated copy of the asset after replication so that writing to the replicated copy of the asset or deleting the replicated copy of the asset is prohibited while the replicated copy is locked; and

wherein if a lock of the locked replicated copy of the asset on a particular target cluster is broken, the replicated copy of the asset in the particular target cluster is deleted, and marked for re-replication from another cluster that has a replicated copy of the asset.

15. The computing system in accordance with claim 14, wherein the replication occurs in a plurality of phases.

16. The computing system in accordance with claim 15, wherein the prioritization of the order of replication occurs one replication phase at a time.

17. The computing system in accordance with claim 15, wherein the cost parameter for at least one of the target clusters comprises a geographical relationship between the source cluster and the target cluster, wherein at least one remotely located target cluster within a given remote region is prioritized for copying of the asset within an initial replication phase.

18. The computing system in accordance with claim 17, wherein the at least one remotely located target cluster is located on a different continent than the source cluster.