QUERY PROCESSING USING PRIMARY DATA VERSIONING AND SECONDARY DATA

• US 20180018370A1
• Filed: 07/15/2016
• Published: 01/18/2018
• Est. Priority Date: 07/15/2016
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Feiks, Frank, Gross-Boelting, Thomas, Mueller, Michael, Weidenschlager, Armin, Forstreuter, Anton, Wang, Xiaomeng, Roeger, Florian, Tchorbadjiyski, Jordan, MacFadden, Ruadhan
• Granted Patent: US 10,956,400 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity

Abstract

Technologies are described for facilitating querying a data set formed from a version of primary data and secondary data. First and second versions of primary data are stored in a primary data version store. Secondary data is received. The secondary data is stored in a secondary data store. A query language statement is received. The query language statement is executed by selecting query results from a data set that includes the secondary data and elements of the first version of primary data not inconsistent with the secondary data.

Claims

1. One or more tangible, non-transitory computer-readable storage media storing computer-executable instructions for causing a database system, the database system comprising one or more processing units and a memory, when programmed thereby to perform operations to produce query results using a version of primary data and secondary data, the operations comprising:

storing a first version of primary data for a plurality of database records in a primary data version store;

storing a second version of primary data in the primary data version store, the second version of primary data comprising second primary version data for at least a portion of the plurality of database records;

receiving first secondary data;

storing the first secondary data in a secondary data store;

receiving a first query language statement; and

with at least one of the one or more processing units, executing the first query language statement, wherein the executing comprises selecting query results from a data set comprising the first secondary data and data elements of the first version of primary data not inconsistent with the first secondary data.

2. The one or more tangible, non-transitory computer-readable storage media of claim 1, wherein the operations further comprise:

associating the first version of primary data with a first version identifier;

associating the second version of primary data with a second version identifier;

associating a first secondary data identifier with the first secondary data; and

associating a first base primary data version identifier with the first secondary data identifier, the first base primary data version identifier associated with the first version of primary data;

wherein the first query language statement is associated with the first secondary data identifier, and wherein, for the executing the first query, the first base primary data version identifier indicates the data elements of the first version of the primary data.

3. The one or more tangible, non-transitory computer-readable storage media of claim 2, wherein the operations further comprise:

storing the association between the first base primary data version identifier and the first secondary data identifier in a metadata store.

4. The one or more tangible, non-transitory computer-readable storage media of claim 1, wherein the data set for the selecting consists of the first secondary data and data elements of the first version of primary data not inconsistent with the first secondary data.

5. The one or more tangible, non-transitory computer-readable storage media of claim 4, wherein the operations further comprise:

receiving second secondary data;

associating a second secondary data identifier with the second secondary data;

associating a second base primary data version identifier with the second secondary data identifier, the second base primary data version identifier indicating the first version of primary data or the second version of primary data;

storing the second secondary data in the secondary data store.

6. The one or more tangible, non-transitory computer-readable storage media of claim 5, wherein the operations further comprise:

receiving a second query language statement, the second query language statement associated with the second secondary data identifier; and

with at least one of the one or more processing units, executing the second query language statement, wherein the executing comprises selecting query results from a data set comprising the second secondary data and data elements of the version of primary data indicated by the second base primary data version identifier that are not inconsistent with the second secondary data.

7. The one or more tangible, non-transitory computer-readable storage media of claim 6, wherein, in executing the second query language statement, the data set for the selecting consists of the second secondary data and data elements of the version of primary data indicated by the second base primary data version identifier not inconsistent with the second secondary data.

8. The one or more tangible computer-readable storage media of claim 1, wherein the operations further comprise:

analyzing the first query language statement to determine database read operations to execute the first query language statement.

9. The one or more tangible, non-transitory computer-readable storage media of claim 1, wherein the operations further comprise:

associating the first version of primary data with a first version identifier; and

storing the first version identifier with the first version of primary data in the primary data version store.

10. The one or more tangible, non-transitory computer-readable storage media of claim 1, wherein the operations further comprise:

associating the first version of primary data with a first version identifier;

comparing the first version identifier with a threshold value; and

deleting the first version of primary data from the primary data version store if the first version identifier is less than the threshold value.

11. The one or more tangible, non-transitory computer-readable storage media of claim 1, wherein selecting query results from a data set comprising the first secondary data and data elements of the first version of primary data not inconsistent with the first secondary data comprises determining primary key values of the first secondary data and not selecting for the data set data of the first version of primary data having the primary key values.

12. A computing system that implements a data processing service, the computing system comprising:

memory;

one or more processing units coupled to the memory; and

one or more non-transitory computer readable storage media storing instructions that, when loaded into the memory, cause the one or more processing units to perform operations for;

receiving first version data for a plurality of data records;

storing the first version data in a version data store;

receiving second version data, the second version data comprising second version data for at least a portion of the plurality of data records;

receiving first secondary data;

storing the first secondary data in a secondary data store;

receiving a data processing request; and

with at least one of the one or more processing units, selecting request results from a data set comprising the first secondary data and data elements of the second version data not inconsistent with the first secondary data.

13. The computing system of claim 12, wherein the operations further comprise:

associating the first version data with a first version identifier;

associating the second version data with a second version identifier;

associating a first secondary data identifier with the first secondary data; and

associating a base data version identifier with the first secondary data identifier, the base data version identifier associated with the first version data;

wherein the data processing request is associated with the first secondary data identifier, and wherein, for the selecting request results, the base data version identifier indicates the data elements of the second version data.

14. The computing system of claim 13, wherein the operations further comprise:

storing the association between the base data version identifier and the first secondary data identifier in a metadata store.

15. The computing system of claim 12, wherein the operations further comprise selecting request results from a data set comprising the first secondary data and data elements of the second version data not inconsistent with the first secondary data.

16. In a computing system comprising a memory and one or more processors, a method of performing a query on a merged data set that includes a version of primary data and secondary data, the method comprising:

storing a first version of primary data and a first version identifier associated with the first version of primary data in a primary data version store;

storing a second version of primary data and a second version identifier associated with the second version of primary data in the primary data version store;

receiving a simulation request, the simulation request comprising a simulation identifier;

determining a base primary data version identifier associated with the simulation identifier;

determining simulation results from a data set comprising secondary data associated with the simulation identifier and version data of the primary data version store having a version identifier corresponding to the base primary data version identifier associated with the simulation identifier and not represented in the secondary data.

17. The method of claim 16, wherein determining simulation results comprises comparing a primary key value of data elements of the secondary data to a primary key value of data elements of the primary data version store, wherein data of the primary data version store having a primary key value corresponding to the primary key value of data elements of the secondary data are not included in the data set.

18. The method of claim 16, wherein the first version identifier comprises an indicator indicating a time that data is valid from.

19. The method of claim 18, wherein the first version identifier further comprises an indicator indicating a time that data is valid to.

20. The method of claim 16, wherein the first version identifier comprises an indicator indicating a time that data is valid to.