Method and system for improved access to non-relational databases

• US 6,502,088 B1
• Filed: 07/08/1999
• Issued: 12/31/2002
• Est. Priority Date: 07/08/1999
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Thorpe, Robert Tod, Hess, Bradley Allan, Kemp, Julie Anne Hill, Lewis, Jerry Jay, Gajda, Kimberly Lynn
• Primary Examiner(s): Vu, Kim
• Assistant Examiner(s): Ly, Anh
• Application Number:
  US09/349,607
• Time in Patent Office: 1,272 Days
• Field of Search: 707/1-10, 707/101, 707/102, 707/104
• US Class Current: 1/1
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation

Abstract

The method and system of the present invention provides improved access to databases in a computer system. The present invention includes a plurality of data sources, the data sources including at least one non-relational data source; a server coupled to the plurality of data sources, the server capable of providing client access to the plurality of data sources; and a store place data access layer (SPDAL) coupled to the server and the at least one non-relational data source, the SPDAL providing relational features to the at least one non-relational data source. In the preferred embodiment, the relational features provided include a two-phase commit process; a process for performing Structured Query Language (SQL) operations from within a single application; a referential integrity process; and a process for providing indices for non-relational data source files. These features allow the computer system to perform data changes across multiple database sources within a single operation; perform SQL operations from a single application across heterogeneous file systems; provide referential integrity of data in both relational and non-relational databases; and perform ad-hoc queries of data and other queries efficiently in non-relational databases. By adding these features, significant flexibility is added to the computer system.

Claims

1. A system for improved access to databases in a computer system, comprising:

a plurality of data sources, the data sources including at least one non-relational data source and at least one relational data source;

a server coupled to the plurality of data sources, the server capable of providing client access to the plurality of data sources; and

a store place data access layer (SPDAL) coupled to the server, the at least one relational data source, and the at least one non-relational data source, the SPDAL providing a single access point for data manipulation concurrently across the at least one non-relational data source and the at least one relational data source, wherein the data manipulation is performed with a single query to the SPDAL.

2. The system of claim 1, wherein the data manipulation comprises:

a two-phase commit process performed concurrently across the at least one non-relational data source and the at least one relational data source with a single operation at the SPDAL;

a process for performing Structured Query Language (SQL) operations concurrently across the at least one non-relational data source and the at least one relational data source from within a single application;

a referential integrity process performed concurrently across the at least one non-relational data source and the at least one relational data source with a single query to the SPDAL; and

a process for providing indices for non-relational data source files for use with a single query to the SPDAL for concurrent data manipulation across the at least one non-relational data source and the at least one relational data source.

3. The system of claim 1, wherein the server is a DB2 DataJoiner.

4. The system of claim 3, wherein the DB2 DataJoiner comprises a Generic Access Applications Programming Interface (API) which allows for customized access to data sources not already supported by DataJoiner.

5. The system of claim 1, wherein the SPDAL comprises:

a SPDAL Open Database Connectivity (ODBC) API coupled to the server;

an ODBC Driver Manager coupled to a Generic Access API;

a Generic Driver coupled to the ODBC Driver Manager; and

a SQL Engine coupled to the Generic Driver.

6. The system of claim 5, wherein the Generic Driver comprises:

an intercept layer, the intercept layer functioning as a resource manager for the at least one non-relational database during a two-phase commit process.

7. The system of claim 5, further comprising:

an index manager coupled to the SQL Engine, the index manager allowing for the creation of indices for the at least one non-relational data source.

8. The system of claim 7, wherein the index manager comprises:

an index manager API;

a hash-keyed and sequential file interface;

a B-Tree function; and

a support function.

9. A system for improved access to databases in a computer system, comprising:

a plurality of data sources, the data sources including at least one non-relational data source;

a server coupled to the plurality of data sources, the server capable of providing client access to the plurality of data sources and at least one relational data source; and

a SPDAL coupled to the server, the at least one relational data source, and the at least one non-relational data source, the SPDAL providing a single access point for data manipulation concurrently across the at least one non-relational data source and at least one relational data source, wherein the data manipulation comprises;

a two-phase commit process performed concurrently across the at least one non-relational data source and the at least one relational data source with a single operation at the SPDAL;

a process for performing SQL operations concurrently across the at least one non-relational data source and the at least one relational data source from within a single application;

a referential integrity process performed concurrently across the at least one non-relational data source and the at least one relational data source with a single query to the SPDAL; and

a process for providing indices for non-relational data source files for use with a single query to the SPDAL for concurrent data manipulation across the at least one non-relational data source and the at least one relational data source.

10. The system of claim 9, wherein the server is a DB2 DataJoiner.

11. The system of claim 10, wherein the DB2 DataJoiner comprises a Generic Access API which allows for customized access to data sources not already supported by DataJoiner.

12. The system of claim 9, wherein the SPDAL comprises:

a SPDAL ODBC API coupled to the server;

an ODBC Driver Manager coupled to a Generic Access API;

Generic Driver coupled to the ODBC Driver Manager; and

a SQL Engine coupled to the Generic Driver.

13. The system of claim 12, wherein the Generic Driver comprises:

an intercept layer, the intercept layer functioning as a resource manager for the at least one non-relational database during a two-phase commit process.

14. The system of claim 12, further comprising:

an index manager coupled to the SQL Engine, the index manager allowing for the creation of indices for the at least one non-relational data source.

15. The system of claim 14, wherein the index manager comprises:

an index manager API;

a hash-keyed and sequential file interface;

a B-Tree function; and

a support function.

16. A system for improved access to databases in a computer system, comprising:

a plurality of data sources, the data sources including at least one non-relational data source and at least one relational data source;

a server coupled to the plurality of data sources, the server capable of providing client access to the plurality of data sources; and

a SPDAL coupled to the server, the at least one relational data source, and the at least one non-relational data source, the SPDAL providing a single access point for data manipulation concurrently across the at least one non-relational data source and the at least one relational data source,

wherein the data manipulation comprises;

a two-phase commit process performed concurrently across the at least one non-relational data source and the at least one relational data source with a single operation at the SPDAL;

a process for performing SQL operations concurrently across the at least one non-relational data source and the at least one relational data source from within a single application;

a referential integrity process performed concurrently across the at least one non-relational data source and the at least one relational data source with a single query to the SPDAL; and

a process for providing indices for non-relational data source files for use with a single query to the SPDAL for concurrent data manipulation across the at least one non-relational data source and the at least one relational data source;

wherein the SPDAL comprises;

a SPDAL ODBC API coupled to the server;

an ODBC Driver Manager coupled to a Generic Access API;

a Generic Driver coupled to the ODBC Driver Manager, the Generic Driver comprising an intercept layer, the intercept layer functioning as a resource manager for the at least one non-relational database during the two-phase commit process;

a SQL Engine coupled to the Generic Driver; and

an index manager coupled to the SQL Engine, the index manager allowing for the creation of indices for the at least on e non-relational data source.

17. The system of claim 16, wherein the server is a DB2 DataJoiner, the DB2 DataJoiner comprising a Generic Access API which allows for customized access to data sources not already supported by DataJoiner.

18. The system of claim 16, wherein the index manager comprises:

an index manager API;

a hash-keyed and sequential file interface;

a B-Tree function; and

a support function.

19. A method for performing SQL operations in a computer system, the computer system including a plurality of data sources, the plurality of data sources including at least one non-relational data source and at least one relational data source, comprising the steps of:

(a) providing a plurality of metadata tables, wherein a first metadata table describes a content of the at least one non-relational data source and a second metadata table describes a content of the at least one relational data source; and

(b) utilizing the first and second metadata tables to gain concurrent access to the at least one non-relational data source and the at least one relational data source through a single query to a SPDAL, wherein the SPDAL provides a single access point for data manipulation concurrently across the at least one non-relational data source and the at least one relational data source.

20. A computer readable medium with program instructions for performing SQL operations in a computer system, the computer system including a plurality of data sources, the plurality of data sources including at least one non-relational data source and at least one relational data source, program instructions for:

(a) providing a plurality of metadata tables, wherein a first the metadata table describes a content of the at least on e non-relational data source and a second metadata table describes a content of the at least one relational table; and

(b) utilizing the first and second metadata tables to gain concurrent access to the at least one non-relational data source and the at least one relational data source through a single query to a SPDAL, wherein the SPDAL provides a single access point for data manipulation concurrently across the at least one non-relational data source and the at least one relational data source.