Preventing pauses in algorithms requiring pre-image information concerning modifications during data replication

• US 9,720,995 B1
• Filed: 07/28/2015
• Issued: 08/01/2017
• Est. Priority Date: 01/09/2009
• Status: Active Grant

• Current Assignee: Pivotal Software, Inc. (Broadcom, Inc.)
• Original Assignee: Pivotal Software, Inc. (Broadcom, Inc.)
• Inventors: Schuchardt, Bruce
• Primary Examiner(s): Beausoliel, Jr., Robert
• Assistant Examiner(s): Pham, Michael
• Application Number:
  US14/811,706
• Time in Patent Office: 735 Days
• Field of Search: 707726, 707626
• CPC Class Codes: G06F 11/1658 Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]

Abstract

Data accessible to a first process is replicated for use by a second process. Modifications to the data during the replication process may cause algorithms requiring the values of data both before and after replication to pause. Sending the values of the datum, before and after modification, to a process that will access the replicated data enables algorithms that use both values to initiate execution without waiting for the replication process to be completed.

Claims

1. A method performed by a distributed computing system comprising a plurality of computing nodes and a plurality of processes, the system including a first process holding a data region and executing on a first node, a second process on a second node, and a third process executing on a third node, the third process using the data region and holding a replica of the data region, the first, second, and third nodes being distinct from each other, the method being a method of replicating the data region from the first node to the second node, the method comprising:

determining to create a new replica of the entire data region in the second process on the second node directly from the first node, wherein, at a time of the determining, the second process does not hold any replica of the data region, wherein the second process includes an algorithm that, when executed, uses data of the data region stored on the first node and alters a datum of the data region, and wherein the datum as altered by the algorithm is transmitted to the first node for storage in the data region;

initiating a capturing of an image of the entire data region on the first node and a replicating of the image on the second node;

after initiating the capturing of the image, after capturing a first data item from the data region on the first node as a captured data item in the image, and before the replicating of the image on the second node is completed, (i) receiving a change to the first data item in the data region caused by the third process on the third node that changes the first data item to a changed data item in the data region on the first node, whereby the captured data item in the image and the changed data item in the data region on the first node are different, and (ii) sending, by the third process, the changed data item to the second node; and

executing the algorithm on the second node, the algorithm using as an input the changed data item on the second node before the replicating of the image on the second node is completed.

2. The method of claim 1, further comprising:

receiving, at the first node, a communication indicating an intent to replicate the data region at the second node to create the new replica of the data region on the second node, wherein capturing the image of the data region on the first node occurs in response to receiving the communication.

3. The method of claim 2, further comprising:

waiting on the first node until completion of all operations capable of altering the data region that were pending when the communication is received, before initiating the capturing of the image of the data region on the first node.

4. The method of claim 1, further comprising:

storing, on the second node, the changed data item as post-image data that will be incorporated, after the replicating of the image on the second node is completed, into the new replica on the second node.

5. The method of claim 1, further comprising:

sending both the changed data item and the captured data item to the second node; and

providing both the changed data item and the captured data item as input to the algorithm before the replicating of the image on the second node is completed.

6. One or more computer-readable non-transitory storage media encoded with instructions that, when executed by a distributed computing system comprising a plurality of computing nodes and a plurality of processes, the system including a first process holding a data region and executing on a first node, a second process on a second node, and a third process executing on a third node, the third process using the data region and holding a replica of the data region, the first, second, and third nodes being distinct from each other, cause the distributed computing system to perform operations for replicating a data region from the first node to the second node, the operations comprising:

determining to create a new replica of the entire data region in the second process on the second node directly from the first node, wherein, at a time of the determining, the second process does not hold any replica of the data region, wherein the second process includes an algorithm that, when executed, uses data of the data region stored on the first node and alters a datum of the data region, and wherein the datum as altered by the algorithm is transmitted to the first node for storage in the data region;

initiating a capturing of an image of the entire data region on the first node and a replicating of the image on the second node;

after initiating the capturing of the image, after capturing a first data item from the data region on the first node as a captured data item in the image, and before the replicating of the image on the second node is completed, (i) receiving a change to the first data item in the data region caused by the third process on the third node that changes the first data item to a changed data item in the data region on the first node, whereby the captured data item in the image and the changed data item in the data region on the first node are different, and (ii) sending, by the third process, the changed data item to the second node; and

executing the algorithm on the second node, the algorithm using as an input the changed data item on the second node before the replicating of the image on the second node is completed.

7. The one or more media of claim 6, wherein the operations further comprise:

receiving, at the first node, a communication indicating an intent to replicate the data region at the second node to create the new replica of the data region on the second node, wherein capturing the image of the data region on the first node occurs in response to receiving the communication.

8. The one or more media of claim 7, wherein the operations further comprise:

waiting on the first node until completion of all operations capable of altering the data region that were pending when the communication is received, before initiating the capturing of the image of the data region on the first node.

9. The one or more media of claim 6, wherein the operations further comprise:

storing, on the second node, the changed data item as post-image data that will be incorporated, after the replicating of the image on the second node is completed, into the new replica on the second node.

10. The one or more media of claim 6, wherein the operations further comprise:

sending both the changed data item and the captured data item to the second node; and

providing both the changed data item and the captured data item as input to the algorithm before the replicating of the image on the second node is completed.

11. A system comprising:

a distributed computing system comprising a plurality of computing nodes and a plurality of processes, the system including a first process holding a data region and executing on a first node, a second process on a second node, and a third process executing on a third node, the third process using the data region and holding a replica of the data region, the first, second, and third nodes being distinct from each other, the distributed computing system further comprising one or more storage devices storing instructions that are operable, when executed by the distributed computing system, to cause the distributed computing system to perform operations for replicating a data region from the first node to the second node, the operations comprising;

determining to create a new replica of the entire data region in the second process on the second node directly from the first node, wherein, at a time of the determining, the second process does not hold any replica of the data region, wherein the second process includes an algorithm that, when executed, uses data of the data region stored on the first node and alters a datum of the data region, and wherein the datum as altered by the algorithm is transmitted to the first node for storage in the data region;

initiating a capturing of an image of the entire data region on the first node and a replicating of the image on the second node;

after initiating the capturing of the image, after capturing a first data item from the data region on the first node as a captured data item in the image, and before the replicating of the image on the second node is completed, (i) receiving a change to the first data item in the data region caused by the third process on the third node that changes the first data item to a changed data item in the data region on the first node, whereby the captured data item in the image and the changed data item in the data region on the first node are different, and (ii) sending, by the third process, the changed data item to the second node; and

executing the algorithm on the second node, the algorithm using as an input the changed data item on the second node before the replicating of the image on the second node is completed.

12. The system of claim 11, wherein the operations further comprise:

receiving, at the first node, a communication indicating an intent to replicate the data region at the second node to create the new replica of the data region on the second node, wherein capturing the image of the data region on the first node occurs in response to receiving the communication.

13. The system of claim 12, wherein the operations further comprise:

waiting on the first node until completion of all operations capable of altering the data region that were pending when the communication is received, before initiating the capturing of the image of the data region on the first node.

14. The system of claim 11, wherein the operations further comprise:

storing, on the second node, the changed data item as post-image data that will be incorporated, after the replicating of the image on the second node is completed, into the new replica on the second node.

15. The system of claim 11, wherein the operations further comprise:

sending both the changed data item and the captured data item to the second node; and

providing both the changed data item and the captured data item as input to the algorithm before the replicating of the image on the second node is completed.