MODIFYING ARCHIVE DATA WITHOUT TABLE CHANGES

• US 20190065536A1
• Filed: 08/30/2017
• Published: 02/28/2019
• Est. Priority Date: 08/30/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Becker, Patric, Immel, Thomas, Martin, Daniel, Stolze, Knut
• Granted Patent: US 10,838,934 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/219 Managing data history or versioning querying versioned data G06F16/2474; querying temporal data G06F16/2477
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/2456 Join operations
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Abstract

A method, computer system, and computer program product for accessing archived data in a data processing system. The data processing system includes a transactional engine maintaining a first data table and an analytical engine. The method includes first archiving at the analytical engine the first data table, resulting in a first archived data table. Changes applicable to the first archived data table may be archived, wherein the second archiving includes: in case the changes induce a change in the structure of the first archived data table or modify the values of the first data table a second archived data table is created. In case the changes include data having a structure different from the structure of the first archived data table part of the changes that is storable according to the structure of the first archived data table may be inserted in the first archived data table.

Claims

1. A method for accessing archived data in a data processing system, the data processing system comprising a transactional engine maintaining a first data table and an analytical engine, the method comprising:

performing a first archiving at the analytical engine of the first data table, wherein the first archiving creates a first archived data table;

based on a structure difference between the first archived data table and the first data table or a data difference between a first data value of the first data table compared to a corresponding first data value of the first archived data table, performing a second archiving at the analytical engine, wherein performing the second archiving comprises creating a second archived data table, storing a first portion of the first data value in the first archived data table, and storing a remaining portion of the first data value in the second archived data table, and wherein the remaining portion corresponds to the structure difference;

receiving at the analytical engine a query for accessing archived data; and

running the query on a combination of the first archived data table and the second archived data table.

2. The method of claim 1, further comprising:

creating a database view comprising a combination of the first archived data table and the second archived data table, wherein running the query comprises redirecting the received query for running against the database view.

3. The method of claim 1, the combination of the first archived data table and the second archived data table further comprises:

joining the first archived data table with records of the second archived data table having corresponding records of the first archived data table.

4. The method of claim 1, wherein the structure difference comprises an additional attribute of the first data table.

5. The method of claim 1, wherein the structure difference comprises a change of a type of an attribute of the first data table.

6. The method of claim 1, further comprising:

performing a third archiving at the analytical engine; and

creating a third archived data table, wherein the third archived data table comprises a description of the second archiving.

7. The method of claim 1, the data processing system comprises a hybrid on-line analytical processing (OLTP) and on-line analytical processing (OLAP) database system, wherein the transactional engine is configured for performing OLTP processes, and wherein the analytical engine is configured for performing OLAP processes.

8. The method of claim 1, further comprising:

based on a second structure difference between the first data table and a combination of the first archived data table and the second archived data table or a difference between a second data value of the first data table compared to a corresponding second data value of the combined first archived data table and the second archived data table, performing a third archiving at the analytical engine, wherein performing the third archiving comprises creating a third archived data table, storing a first portion of the second data value in the first archived data table, storing a second portion of the second data value in the second archived data table, and storing a remaining portion of the second data value in the third archived data table, wherein the remaining portion of the second data value corresponds to the second structure difference;

receiving at the analytical engine a second query for accessing archived data; and

running the query on a combination of the first archived data table, the second archived data table, and the third archived data table.

9. The method according to claim 1, wherein the first data table comprises an arrangement of data in one or more rows and one or more columns, and wherein a data element corresponds to each combination of a row of the one or more rows and a column of the one or more columns, and wherein a record comprises data elements of a column of the one or columns and corresponding data elements of a row of the one or more rows.

10. The method according to claim 1, wherein the structure comprises both a set of data types and a set of constraints per each of one of more columns of the first data table.

11. The method according to claim 1, further comprising:

identifying a new record in the first data table, wherein the new record is not in the first archived data table; and

archiving the new record in the first archived data table.

12. A computer program product for accessing archived data in a data processing system, the data processing system comprising a transactional engine maintaining a first data table and an analytical engine, the computer program product comprising:

one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the program instructions comprising;

program instructions to perform a first archiving at the analytical engine of the first data table, wherein the first archiving creates a first archived data table;

based on a structure difference between the first archived data table and the first data table, or a data difference between a first data value of the first data table compared to a corresponding first data value of the first archived data table, program instructions to perform a second archiving at the analytical engine, wherein program instructions to perform the second archiving comprises program instructions to create a second archived data table, program instructions to store a first portion of the first data value in the first archived data table, and program instructions to store a remaining portion of the first data value in the second archived data table, and wherein the remaining portion corresponds to the structure difference;

program instructions to receive at the analytical engine a query for accessing archived data; and

program instructions to run the query on a combination of the first archived data table and the second archived data table.

13. The computer program product of claim 12, further comprising:

creating a database view comprising a combination of the first archived data table and the second archived data table, wherein running the query comprises redirecting the received query for running against the database view.

14. The computer program product of claim 12, the combination of the first archived data table and the second archived data table further comprises:

program instructions to join the first archived data table with records of the second archived data table having corresponding records of the first archived data table.

15. The computer program product of claim 12, wherein the structure difference comprise an additional attribute of the first data table.

16. A computer system for accessing archived data in a data processing system, the data processing system comprising a transactional engine maintaining a first data table and an analytical engine, the computer system comprising:

one or more computer processors, one or more computer-readable storage media, and program instructions stored on the one or more of the computer-readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to perform a first archiving at the analytical engine of the first data table, wherein the first archiving creates a first archived data table;

based on a structure difference between the first archived data table and the first data table, or a data difference between a first data value of the first data table compared to a corresponding first data value of the first archived data table, program instructions to perform a second archiving at the analytical engine, wherein program instructions to perform the second archiving comprises program instructions to create a second archived data table, program instructions to store a first portion of the first data value in the first archived data table, and program instructions to store a remaining portion of the first data value in the second archived data table, and wherein the remaining portion corresponds to the structure difference;

program instructions to receive at the analytical engine a query for accessing archived data; and

program instructions to run the query on a combination of the first archived data table and the second archived data table.

17. The computer system of claim 16, wherein the structure difference comprises a change of a type of an attribute of the first data table.

18. The computer system of claim 16, further comprising:

program instructions to perform a third archiving at the analytical engine; and

program instructions to create a third archived data table, wherein the third archived data table comprises a description of the second archiving.

19. The computer system of claim 16, the data processing system comprises a hybrid on-line analytical processing (OLTP) and on-line analytical processing (OLAP) database system, wherein the transactional engine is configured for performing OLTP processes, and wherein the analytical engine is configured for performing OLAP processes.

20. The computer system of claim 16, further comprising:

based on a second structure difference between the first data table and a combination of the first archived data table and the second archived data table, or a difference between a second data value of the first data table compared to a corresponding second data value of the combined first archived data table and the second archived data table;

program instructions to perform a third archiving at the analytical engine, wherein performing the third archiving comprises program instructions to create a third archived data table, program instructions to store a first portion of the second data value in the first archived data table, program instructions to store a second portion of the second data value in the second archived data table, and program instructions to store a remaining portion of the second data value in the third archived data table, wherein the remaining portion of the second data value corresponds to the second structure difference;

program instructions to receive at the analytical engine a second query for accessing archived data; and

program instructions to run the query on a combination of the first archived data table, the second archived data table, and the third archived data table.