Executing Queries Referencing Data Stored in a Unified Data Layer

• US 20180165307A1
• Filed: 01/29/2018
• Published: 06/14/2018
• Est. Priority Date: 12/09/2016
• Status: Active Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cadarette, Paul M., Lukkoor, Anjan G., Spyker, James D.
• Application Number:
  US15/881,989
• Publication Number:
  US 20180165307A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/256 in federated or virtual databases

Abstract

A mechanism is provided in a data processing system for executing queries referencing data stored in a unified data layer. A relational engine executing on the data processing system receives a structured query language (SQL) query from a client. A query processor executing on the data processing system accesses integrated data sources including a unified data layer (UDL) data source storing UDL topic files via a data virtualization layer to form query results. The data virtualization layer projects the UDL topic files into relational form. The relational engine returns the query results to the client.

Claims

1. A method, in a data processing system, for executing queries

referring data stored in a unified data layer, the method comprising:

receiving, by a relational engine executing on the data processing system, a structured query language (SQL) query from a client;

accessing, by a query processor executing on the data processing system, integrated data sources including a unified data layer (UDL) data source storing UDL topic files via a data virtualization layer to form query results, wherein the data virtualization layer projects the UDL topic files into relational form; and

returning, by the relational engine, the query results to the client.

2. The method of claim 1, wherein a mapping service maps schema from a schema registry to UDL topic files.

3. The method of claim 2, wherein the data virtualization layer projects the UDL topic tiles into relational form using the mapping of the schema to the UDL topic files.

4. The method of claim 1, wherein the data virtualization layer projects the UDL topic files into relational form based on a SQL execution plan.

5. The method of claim 1, wherein the integrated data sources further include a federated database management system data source.

6. The method of claim 1, wherein the query processor requests subsetted results from each UDL topic file.

7. The method of claim 1, wherein the query processor uses an index to determine if there are any UDL topic files that need not be included because they have no data of interest based on the SQL query.

8. The method of claim 1, wherein the client is an object-oriented database connectivity client or an Open Database Connectivity (ODBC) client.

9-20. -20. (canceled)