DELETING RECORDS IN A MULTI-LEVEL STORAGE ARCHITECTURE

• US 20140122439A1
• Filed: 03/15/2013
• Published: 05/01/2014
• Est. Priority Date: 04/30/2012
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Faerber, Franz, Lee, Juchang, Schreter, Ivan
• Granted Patent: US 9,171,020 B2
• Time in Patent Office: Days
• US Class Current: 707/683
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/221 Column-oriented storage; Management thereof
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity

Abstract

Deleting a data record from the second level storage or main store is disclosed. A look-up is performed for the data record in the first level storage, where the data record is defined by a row identifier. If the row identifier is found in the first level storage, a look-up is performed for an updated row identifier representing an update of the data record in the second level storage and the main store, the update of the data record being defined by an updated row identifier. If the updated row identifier is found in the second level storage, an undo log is generated from the first level storage to invalidate a row identifier of the row identifier. A flag is generated representing an invalid updated row identifier, and a redo log is generated to restore the data record in the first level storage.

Claims

1. In a unified table architecture of an in-memory computing system having a multi-level storage architecture, the storage architecture having a first level storage structure to store incoming data requests in a logical row format as data records, a second level storage structure to encode and store the data records in a logical column format, and a main store to compress and store the encoded data records for long-term storage, a method of deleting a data record from the second level storage or main store, the method comprising:

performing, by one or more processors, a look-up for the data record in a table in the first level storage, the data record being defined by a row identifier of the table;

if the row identifier is found in the first level storage, performing, by one or more processors, a look-up for an updated row identifier representing an update of the data record in the second level storage and the main store;

if the updated row identifier is found in the second level storage, generating, by one or more processors, an undo log from the first level storage to invalidate a row identifier of the row identifier; and

if the updated row identifier is not found in the second level storage, generating, by one or more processors, a redo log to restore the data record in the first level storage.

2. The method in accordance with claim 1, wherein generating the undo log from the first level storage further comprises generating a flag representing an invalid updated row identifier.

3. The method in accordance with claim 1, further comprising recovering the data record in the first level storage during a restart if the updated row identifier is not yet persisted in a savepoint in the multi-level storage architecture.

4. The method in accordance with claim 4, further comprising generating a second invalid updated row identifier during the restart.

5. A computer implemented method comprising:

providing a unified table architecture of an in-memory computing system, the unified table architecture having a multi-level storage architecture, the storage architecture having a first level storage structure to store incoming data requests in a logical row format as data records, a second level storage structure to encode and store the data records in a logical column format, and a main store to compress and store the encoded data records for long-term storage, a method of deleting a data record from the second level storage or main store;

performing, by one or more processors, a look-up for the data record in the first level storage, the data record being defined by a row identifier;

if the row identifier is found in the first level storage, performing, by one or more processors, a look-up for an updated row identifier representing an update of the data record in the second level storage and the main store, the update of the data record defined by an updated row identifier;

if the updated row identifier is found in the second level storage, generating, by one or more processors, an undo log from the first level storage to invalidate a row identifier of the row identifier, and generating a flag representing an invalid updated row identifier; and

generating, by one or more processors, a redo log to restore the data record in the first level storage.

6. The method in accordance with claim 5, further comprising recovering the data record in the first level storage during a restart if the updated row identifier is not yet persisted in a savepoint in the multi-level storage architecture.

7. The method in accordance with claim 6, further comprising generating a second invalid updated row identifier during the restart.

8. A system comprising:

at least one programmable processor;

a unified table memory arranged in a multi-level storage architecture having a first level storage structure to store incoming data requests in a logical row format as data records, a second level storage structure to encode and store the data records in a logical column format, and a main store to compress and store the encoded data records for long-term storage; and

a non-transitory, machine-readable medium storing instructions that, when executed by the at least one processor, cause the at least one programmable processor to perform operations comprising;

performing a look-up for the data record in the first level storage, the data record being defined by a row identifier;

if the row identifier is found in the first level storage, performing a look-up for an updated row identifier representing an update of the data record in the second level storage and the main store;

if the updated row identifier is found in the second level storage, generating an undo log from the first level storage to invalidate a row identifier of the row identifier; and

if the updated row identifier is not found in the second level storage, generating a redo log to restore the data record in the first level storage.

9. The system in accordance with claim 8, wherein generating the undo log from the first level storage further comprises operations for generating a flag representing an invalid updated row identifier.

10. The system in accordance with claim 8, wherein the operations further comprise recovering the data record in the first level storage during a restart if the updated row identifier is not yet persisted in a savepoint in the multi-level storage architecture.

11. The system in accordance with claim 10, wherein the operations further comprise generating a second invalid updated row identifier during the restart.

12. The system in accordance with claim 8, wherein the unified table memory is implemented in an in-memory database system.