Data synchronization method, apparatus, and system

• US 10,754,873 B2
• Filed: 12/18/2019
• Issued: 08/25/2020
• Est. Priority Date: 01/18/2016
• Status: Active Grant

• Current Assignee: Advanced Nova Technologies Holding Pte Limited
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Shao, Shuai
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): Bogacki, Michal
• Application Number:
  US16/719,402
• Publication Number:
  US 20200125580A1
• Time in Patent Office: 251 Days
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/24552 Database cache management
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation

Abstract

A determination is made, by a first device, that data in a first database is modified. The first database is associated with the first device. A notification is generated by the first device. The notification includes information associated with the data modification in the first database. The notification is transmitted by the first device to at least one second device. At least one second database is associated with the at least one second device.

Claims

1. A computer-implemented method, comprising:

determining, by a first device, that data in a first database is modified, wherein the first database is associated with the first device;

generating, by the first device, a notification, wherein the notification includes information associated with the data modification in the first database, and wherein generating the notification includes;

determining whether a size of the data modification exceeds a predetermined threshold;

in response to a determination that the size of the data modification does not exceed the predetermined threshold, generating the notification to include the data modification; and

in response to a determination that the size of the data modification does exceed the predetermined threshold, generating the notification to include an operation identifier associated with the data modification in the first database; and

transmitting, by the first device, the notification to at least one second device, wherein at least one second database is associated with the at least one second device.

2. The computer-implemented method of claim 1, wherein the data modification in the first database is to be synchronized in the at least one second database.

3. The computer-implemented method of claim 1, further comprising synchronizing the at least one second database with the first database after the data modification in the first database is completed.

4. The computer-implemented method of claim 1, further comprising:

receiving, by the at least one second device, the notification from the first device; and

updating, by the at least one second device, at least one cache based on the notification, wherein the at least one cache is associated with the at least one second database.

5. The computer-implemented method of claim 4, wherein updating, by the at least one second device, at least one cache based on the notification includes:

if the notification includes the data modification, directly updating the at least one cache based on the data modification included in the notification; and

if the notification includes the operation identifier associated with the data modification;

monitoring the at least one second database based on the operation identifier; and

when a synchronization operation corresponding to the operation identifier is detected in the at least one second database, updating the at least one cache based on synchronized data in the at least one second database.

6. The computer-implemented method of claim 5, wherein the notification is a real-time data modification notification, and directly updating the at least one cache based on the data modification included in the notification is performed before the at least one second database is synchronized with the data modification in the first database.

7. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

determining, by a first device, that data in a first database is modified, wherein the first database is associated with the first device;

generating, by the first device, a notification, wherein the notification includes information associated with the data modification in the first database, and wherein generating the notification includes;

determining whether a size of the data modification exceeds a predetermined threshold;

in response to a determination that the size of the data modification does not exceed the predetermined threshold, generating the notification to include the data modification; and

in response to a determination that the size of the data modification does exceed the predetermined threshold, generating the notification to include an operation identifier associated with the data modification in the first database; and

transmitting, by the first device, the notification to at least one second device, wherein at least one second database is associated with the at least one second device.

8. The non-transitory, computer-readable medium of claim 7, wherein the data modification in the first database is to be synchronized in the at least one second database.

9. The non-transitory, computer-readable medium of claim 7, the operations further comprising synchronizing the at least one second database with the first database after the data modification in the first database is completed.

10. The non-transitory, computer-readable medium of claim 7, the operations further comprising:

receiving, by the at least one second device, the notification from the first device; and

updating, by the at least one second device, at least one cache based on the notification, wherein the at least one cache is associated with the at least one second database.

11. The non-transitory, computer-readable medium of claim 10, wherein updating, by the at least one second device, at least one cache based on the notification includes:

if the notification includes the data modification, directly updating the at least one cache based on the data modification included in the notification; and

if the notification includes the operation identifier associated with the data modification;

monitoring the at least one second database based on the operation identifier; and

when a synchronization operation corresponding to the operation identifier is detected in the at least one second database, updating the at least one cache based on synchronized data in the at least one second database.

12. The non-transitory, computer-readable medium of claim 11, wherein the notification is a real-time data modification notification, and directly updating the at least one cache based on the data modification included in the notification is performed before the at least one second database is synchronized with the data modification in the first database.

13. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations comprising;

determining, by a first device, that data in a first database is modified, wherein the first database is associated with the first device;

generating, by the first device, a notification, wherein the notification includes information associated with the data modification in the first database, and wherein generating the notification includes;

determining whether a size of the data modification exceeds a predetermined threshold;

in response to a determination that the size of the data modification does not exceed the predetermined threshold, generating the notification to include the data modification; and

in response to a determination that the size of the data modification does exceed the predetermined threshold, generating the notification to include an operation identifier associated with the data modification in the first database; and

transmitting, by the first device, the notification to at least one second device, wherein at least one second database is associated with the at least one second device.

14. The computer-implemented system of claim 13, wherein the data modification in the first database is to be synchronized in the at least one second database.

15. The computer-implemented system of claim 13, the operations further comprising synchronizing the at least one second database with the first database after the data modification in the first database is completed.

16. The computer-implemented system of claim 13, the operations further comprising:

receiving, by the at least one second device, the notification from the first device; and

updating, by the at least one second device, at least one cache based on the notification, wherein the at least one cache is associated with the at least one second database.

17. The computer-implemented system of claim 16, wherein updating, by the at least one second device, at least one cache based on the notification includes:

if the notification includes the data modification, directly updating the at least one cache based on the data modification included in the notification; and

if the notification includes the operation identifier associated with the data modification;

monitoring the at least one second database based on the operation identifier; and

when a synchronization operation corresponding to the operation identifier is detected in the at least one second database, updating the at least one cache based on synchronized data in the at least one second database.

18. The computer-implemented system of claim 17, wherein the notification is a real-time data modification notification, and directly updating the at least one cache based on the data modification included in the notification is performed before the at least one second database is synchronized with the data modification in the first database.