Common runtime and recovery framework for manipulating data in main memory of database systems

• US 10,642,823 B2
• Filed: 11/30/2016
• Issued: 05/05/2020
• Est. Priority Date: 11/30/2016
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Andrei, Mihnea, Blanco, Rolando, Chen, Shiping, Heidel, Martin, Kandiyanallur, Vivek, Peh, Thomas, Schmidt, Joern, Song, Liang, Steinemann, Peter
• Primary Examiner(s): Phillips, III, Albert M
• Application Number:
  US15/365,396
• Publication Number:
  US 20180150539A1
• Time in Patent Office: 1,252 Days
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing

Abstract

A computer implemented method for manipulating data comprises receiving log transaction information from a primary database system at a secondary database system and parsing the log transaction information to identify data objects that have been modified on the primary database system. The secondary database system determines whether the data objects are present in main memory on the secondary database system. If the data objects are not in the main memory, they are copied from persistence data volumes to the main memory. The data objects are modified by replaying the log transactions on the data objects in the main memory. Then, the data objects in the persistence data volumes are modified. Related apparatus, systems, techniques and articles are also described.

Claims

1. A computer implemented method comprising:

receiving log transaction information from a primary database system at a secondary database system;

parsing, at a secondary database system, the log transaction information to identify one or more data objects that have been modified on the primary database system;

determining whether the one or more data objects are present in main memory on the secondary database system;

copying the one or more data objects from persistence data volumes to the main memory, if the one or more data objects are not in the main memory;

modifying the one or more data objects by replaying the log transactions on the one or more data objects in the main memory; and

modifying the one or more data objects in the persistence data volumes,

wherein the secondary database actively responds to queries delegated to the secondary database system by the primary database system based on data contained in the main memory.

2. The method of claim 1, wherein the primary database system and the secondary database system are configured to operate in a load balancing operation.

3. The method of claim 1, wherein process for updating data on the secondary database system defines a common framework that is also implemented to manipulate data on the primary database system.

4. The method of claim 1, wherein the secondary database system is configured as a back-up database system.

5. The method of claim 1, wherein the one or more data objects are tables.

6. The method of claim 1, wherein the log transaction information is generated by the primary database system based on queries received by the primary database system.

7. The method of claim 6, wherein the queries are data manipulation language (DML) queries.

8. The method of claim 1, wherein the first database system and the second database system are in memory database (IMDB) systems.

9. The method of claim 1, wherein the first database system and the second database system are column oriented database systems.

10. A system comprising:

a processor; and

a non-transitory computer readable media having computer executable instructions stored therein, which, when executed by the processor, causes the system to perform operations comprising;

receiving log transaction information from a primary database system at a secondary database system;

parsing, at a secondary database system, the log transaction information to identify one or more data objects that have been modified on the primary database system;

determining whether the one or more data objects are present in main memory on the secondary database system;

copying the one or more data objects from persistence data volumes to the main memory, if the one or more data objects are not in the main memory;

modifying the one or more data objects by replaying the log transactions on the one or more data objects in the main memory; and

modifying the one or more data objects in the persistence data volumes,

wherein the secondary database actively responds to queries delegated to the secondary database system by the primary database system based on data contained in the main memory.

11. The system of claim 10, wherein the primary database system and the secondary database system are configured to operate in a load balancing operation.

12. The system of claim 10, wherein process for updating data on the secondary database system defines a common framework that is also implemented to manipulate data on the primary database system.

13. The system of claim 10, wherein the secondary database system is configured as a back-up database system.

14. The method of claim 10, wherein the one or more data objects are tables.

15. The system of claim 10, wherein the log transaction information is generated by the primary database system based on queries received by the primary database system.

16. The system of claim 15, wherein the queries are data manipulation language (DML) queries.

17. The system of claim 10, wherein the first database system and the second database system are in memory database (IMDB) systems.

18. The system of claim 10, wherein the first database system and the second database system are column oriented database systems.