Filtered replication of data in distributed system of data centers

• US 10,191,818 B2
• Filed: 11/14/2016
• Issued: 01/29/2019
• Est. Priority Date: 11/14/2016
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Boshev, Stoyan, Wirth, Marc
• Primary Examiner(s): Patel, Haresh N
• Application Number:
  US15/350,110
• Publication Number:
  US 20180137015A1
• Time in Patent Office: 806 Days
• Field of Search: 713154
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 21/602 Providing cryptographic facilities or services
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload

Abstract

Various embodiments of systems, computer program products, and methods to replicate data in a distributed environment are described herein. In an aspect, the data from a first persistent storage unit associated with a primary data center is received. Further, at least a part of the received data is determined to be replicated by filtering the data based on one or more predetermined conditions. The determined part of the data is transmitted to replicate in a second persistent storage unit associated with a secondary data center to recover the part of the data during failure of the primary data center.

Claims

1. A non-transitory computer readable storage medium storing instructions, which when executed by a computer cause the computer to:

receive data from a first persistent storage unit associated with a primary data center, wherein receiving the data includes;

determine a modification of the data in the first persistent storage unit at regular time intervals, and

receive the data upon determining the modification of the data in the first persistent storage unit;

determine at least a part of the received data to be replicated by filtering the data based on one or more predetermined conditions, wherein the one or more predetermined conditions define relevant data to be replicated and the one or more predetermined conditions comprise filtering out the data not relevant to other data centers and filtering out restorable data; and

transmit the determined part of the data to replicate in a second persistent storage unit associated with a secondary data center to recover the part of the data during failure of the primary data center.

2. The non-transitory computer-readable medium of claim 1, wherein the secondary data center is in a different geographical location than the primary data center.

3. The non-transitory computer-readable medium of claim 1, wherein transmitting the determined part of the data comprises encrypting the determined part of the data before transmitting the determined part of the data.

4. The non-transitory computer-readable medium of claim 3, further comprising instructions, which when executed by the computer cause the computer to:

receive the encrypted part of the data to be replicated at the secondary data center;

decrypt the encrypted part of the data; and

store the decrypted part of the data in the second persistent storage unit associated with the secondary data center.

5. The non-transitory computer-readable medium of claim 4, wherein decrypting the encrypted part of the data further comprises modifying the decrypted part of the data specific to the secondary data center.

6. A computer-implemented method to replicate data in a distributed environment, comprising:

receiving the data from a first persistent storage unit associated with a primary data center, wherein receiving the data includes;

determining a modification of the data in the first persistent storage unit at regular time intervals, and

receiving the data upon determining the modification of the data in the first persistent storage unit;

determining at least a part of the received data to be replicated by filtering the data based on one or more predetermined conditions, wherein the one or more predetermined conditions define relevant data to be replicated and the one or more predetermined conditions comprise filtering out the data not relevant to other data centers and filtering out restorable data; and

transmitting the determined part of the data to replicate in a second persistent storage unit associated with a secondary data center to recover the part of the data during failure of the primary data center.

7. The computer-implemented method of claim 6, wherein the secondary data center is in a different geographical location than the primary data center.

8. The computer-implemented method of claim 6, wherein transmitting the determined part of the data comprises encrypting the determined part of the data before transmitting the determined part of the data.

9. The computer-implemented method of claim 8, further comprising:

receiving the encrypted part of the data to be replicated at the secondary data center;

decrypting the encrypted part of the data; and

storing the decrypted part of the data in the second persistent storage unit associated with the secondary data center.

10. The computer-implemented method of claim 9, wherein decrypting the encrypted part of the data further comprises modifying the decrypted part of the data specific to the secondary data center.

11. A computing system, comprising:

at least one processor; and

one or more memory devices communicative with the at least one processor, wherein the one or more memory devices store instructions to;

receive data from a first persistent storage unit associated with a primary data center, wherein receiving the data includes;

determine a modification of the data in the first persistent storage unit at regular time intervals, and

receive the data upon determining the modification of the data in the first persistent storage unit;

determine at least a part of the received data to be replicated by filtering the data based on one or more predetermined conditions, wherein the one or more predetermined conditions define relevant data to be replicated and the one or more predetermined conditions comprise filtering out the data not relevant to other data centers and filtering out restorable data; and

transmit the determined part of the data to replicate in a second persistent storage unit associated with a secondary data center to recover the part of the data during failure of the primary data center.

12. The computing system of claim 11, wherein the secondary data center is in a different geographical location than the primary data center.

13. The computing system of claim 11, wherein transmitting the determined part of the data comprises encrypting the determined part of the data before transmitting the determined part of the data.

14. The computing system of claim 13, further comprising instructions to:

receive the encrypted part of the data to be replicated at the secondary data center;

decrypt the encrypted part of the data; and

store the decrypted part of the data in the second persistent storage unit associated with the secondary data center.