Hybrid real-time data replication
First Claim
1. A data replication method comprising:
- synchronously capturing data modifications, the synchronously capturing comprising;
accepting a request from a client device to modify data;
performing the data modifications; and
adding data attributes of the modified data to a message queue;
asynchronously replicating the data modifications to one or more destination devices, the asynchronously replicating comprising;
saving the data attributes in a journal queue on a storage device;
retrieving the data attributes from the journal queue;
comparing the data attributes to configuration data for each of at least one pathway, each of the at least one pathways corresponding to a destination device, the configuration data comprising a replication policy; and
for each of the data attributes and each of the at least one pathway, inserting the data attribute into a corresponding one of at least one pathway journal if the data attribute matches the configuration data for the pathway.
27 Assignments
0 Petitions
Accused Products
Abstract
Techniques are described for replicating data from one to one or more heterogeneous data processing or communication devices for the purpose of remote backup, redundancy, content distribution, communications, observations or measurements. In a first phase, the attributes of the data that are modified or created on a device or that are passing through the device are tracked and journaled in volatile or non-volatile storage in real-time. In a second phase, the attributes that match patterns pre-specified in a configuration are used to determine which data to replicate and which modifications to make the devices. In a third phase, the data is replicated. In a preferred embodiment, the described techniques comprise an application that runs on a host device or is embedded in a logic or memory device. The described invention is designed to be transparent for system redundancy and error recovery processes such as error correction, re-transmission on links, and raid configuration.
-
Citations
11 Claims
-
1. A data replication method comprising:
-
synchronously capturing data modifications, the synchronously capturing comprising; accepting a request from a client device to modify data; performing the data modifications; and adding data attributes of the modified data to a message queue; asynchronously replicating the data modifications to one or more destination devices, the asynchronously replicating comprising; saving the data attributes in a journal queue on a storage device; retrieving the data attributes from the journal queue; comparing the data attributes to configuration data for each of at least one pathway, each of the at least one pathways corresponding to a destination device, the configuration data comprising a replication policy; and for each of the data attributes and each of the at least one pathway, inserting the data attribute into a corresponding one of at least one pathway journal if the data attribute matches the configuration data for the pathway. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A device for replication of data across a distributed computing system, the device comprising:
-
a pass-through component that synchronously intercepts data modifications, wherein the pass-through component; accepts a request to modify data from a client device; performs the data modifications; and adds data attributes of the modified data to a message queue; a data replication engine that asynchronously replicates the data modifications on one or more remote storage devices, wherein the data replication engine; saves the data attributes in a journal queue on one or more of the storage devices; retrieves the data attributes from the journal queue; compares the data attributes against configuration data for each of at least one pathway, each of the at least one pathway corresponding to a destination device, the configuration data comprising a replication policy; and for each data attribute and each of the at least one pathway, inserts the data attribute into a corresponding one of at least one pathway journal if the data attribute matches the configuration data for the pathway. - View Dependent Claims (8, 9, 10, 11)
-
Specification