Providing metadata to database systems and environments with multiple processing units or modules

• US 10,042,907 B2
• Filed: 11/29/2012
• Issued: 08/07/2018
• Est. Priority Date: 11/29/2012
• Status: Active Grant

• Current Assignee: Teradata Corporation
• Original Assignee: Teradata US, Inc. (Teradata Corporation)
• Inventors: Milby, Gregory Howard, Li, Guofang, Virgil, Kevin Dean, Reed, Michael Leon
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): CHEUNG, HUBERT G
• Application Number:
  US13/688,767
• Publication Number:
  US 20140149349A1
• Time in Patent Office: 2,077 Days
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

Metadata can be provided to multiple processing units of a database system by using local storages respectively provided for the processing units, such that a local storage is accessible only to its respective processing unit. As a result, processing units can access metadata when needed (e.g., when needed to process a database request at runtime) without having to access a source external to the database system. In addition, metadata (e.g., an XML object, XML schema, XSLT stylesheets, XQuery modules) can be provided using a database request or command, for example, by using a register statement.

Claims

1. A computer-implemented method of providing data objects to a database system that includes multiple processing units in one or more database nodes that each include at least one processor configured to process at least a portion of data for the database system, wherein at least one of the database nodes includes first and second processing units, and first and second local storages that can be accessed only by the first and second processing units, respectively, and wherein the computer-implemented method comprises:

obtaining one or more data objects, pertaining to metadata describing the organization of data stored in the database system and needed for processing of database queries of the data stored in the database system, to be provided to at least the first and second processing units of the at least one database node of the database system;

storing a copy of the same one or more obtained objects pertaining to the metadata in each one of the first and second local storages for access only by the first and second processing units, respectively, wherein each one of the first and second local storages are partitioned into multiple portions for storing multiple types of database objects pertaining to organization of data stored in the database system, wherein the storing or at least facilitating storage of a copy of the one or more obtained objects stores or at least facilitates storage of the copy of the one or more obtained objects in a respective portion of the first and second local storages corresponding to the type of the one or more obtained objects;

allowing each one of the first and second processing units to access its own copy of the one or more database objects pertaining to the metadata, stored in its respective one of the first and second local storages by searching its own local storage, without sharing its own copy with the other one of the first and second processing units;

allowing each one of the first and second processing units to access its own copy of the one or more database objects pertaining to the metadata, stored in its respective one of the first and second local storages by searching its own local storage, without accessing data from an external source being external to the database system; and

searching, by each one of the multiple database nodes, its own copy of the one or more database objects pertaining to the metadata needed for processing of the database queries of the data stored in the database system, in response to the database queries of the database.

2. The computer-implemented method of claim 1, wherein the external source can be accessed by the database system via a computer network.

3. The computer-implemented method of claim 2, wherein the computer network is one of the following:

the Internet, a public network, a computer network that is not secured.

4. The computer-implemented method of claim 1, wherein at least one of the first and second local storages includes a local unhashed dictionary repository that can be searched by each one of the multiple database nodes to retrieve the one or more objects.

5. The computer-implemented method of claim 4, wherein the local unhashed dictionary repository is partitioned into multiple portions for storing multiple types of the one or more database objects.

6. The computer-implemented method of claim 1, wherein the one or more data objects include one or more eXtensible Markup Language (XML) objects or XML data.

7. The computer-implemented method of claim 6, wherein the one or more XML objects include at least one of:

one or more XML schema, one or more eXtensible Stylesheet Language Transformation (XSLT) stylesheet, and one or more XQuery modules.

8. The computer-implemented method of claim 1, wherein the obtaining of the one or more data objects pertaining to metadata associated with the database system comprises:

receiving a database request that includes the one or more database objects, and

wherein the facilitating of the storage of the copy of the one or more objects in each one of the first and second local storages for access only the first and second processing units comprises;

storing the one or more objects in each of respective local unhashed dictionary repositories of the processing units that can be searched by each one of the processing units to retrieve the one or more objects in response to a database request requiring the one or more database objects.

9. The computer-implemented method of claim 8, wherein the database request includes a Structured Query Language (SQL) registration request or command that can be input by a user of the database system, and wherein the database request requiring the one or more database objects is a SQL list registered data that can be input by a user of the database system.

10. The computer-implemented method of claim 9, wherein the computer-implemented method further comprises:

determining, at the first processing unit, to access the one or more data objects;

looking up the one or more objects, by the first processing unit, a first local storage of the local storages designated for access only by the first database node;

thereafter, accessing by the processing unit, the first local storage to retrieve the one or more data objects for processing data associated with the database system.

11. The computer-implemented method of claim 1, wherein the database nodes are shared nothing database nodes arranged not to share access to data.

12. An apparatus that includes one or more processors configured to:

provide data objects to a database system that includes multiple processing units in one or more database nodes that each include at least one processor configured to process at least a portion of data for the database system, wherein at least one of the database nodes includes first and second processing units, and first and second local storages that can be accessed only by the first and second processing units, respectively;

obtain one or more data objects, pertaining to metadata describing the organization of data stored in the database system and needed for processing of database queries of the data stored in the database system, to be provided to at least the first and second processing units of the at least one database node of the database system;

store a copy of the same one or more obtained objects pertaining to the metadata in each one of the first and second local storages for access only by the first and second processing units, respectively, wherein each one of the first and second local storages are partitioned into multiple portions for storing multiple types of database objects pertaining to organization of data stored in the database system, wherein the storing or at least facilitating storage of a copy of the one or more obtained objects stores or at least facilitates storage of the copy of the one or more obtained objects in a respective portion of the first and second local storages corresponding to the type of the one or more obtained objects;

allow each one of the first and second processing units to access its own copy of the one or more database objects pertaining to the metadata, stored in its respective one of the first and second local storages by searching its own local storage, without sharing its own copy with the other one of the first and second processing units;

allow each one of the first and second processing units to access its own copy of the one or more database objects pertaining to the metadata, stored in its respective one of the first and second local storages by searching its own local storage, without accessing data from an external source being external to the database system; and

allow searching, by each one of the multiple database nodes, its own copy of the one or more database objects pertaining to the metadata needed for processing of the database queries of the data stored in the database system, in response to the database queries of the database.

13. The apparatus of claim 12, wherein the external source can be accessed by the database system via a computer network.

14. The apparatus of claim 13, wherein the computer network is one of the following:

the Internet, a public network, a computer network that is not secured.

15. The apparatus of claim 12, wherein at least one of the first and second local storages includes a local unhashed dictionary repository that can be searched by each one of the multiple database nodes to retrieve the one or more objects.

16. The apparatus of claim 12, wherein at least one of the first and second local storages includes a local unhashed dictionary repository that can be searched by at least one of the multiple database nodes to retrieve the one or more objects.

17. The apparatus of claim 16, wherein the local unhashed dictionary repository is partitioned into multiple portions for storing multiple types of the one or more database objects.

18. A non-transitory computer readable storage medium storing at least computer executable code configured to provide data objects to a database system that includes multiple processing units in one or more database nodes that each include at least one processor configured to process at least a portion of data for the database system, wherein at least one of the database nodes includes first and second processing units, and first and second local storages that can be accessed only by the first and second processing units, respectively, and wherein the executable computer code when executed is configured to:

obtain one or more data objects, pertaining to metadata describing the organization of data stored in the database system and needed for processing of database queries of the data stored in the database system, to be provided to at least the first and second processing units of the at least one database node of the database system;

store a copy of the same one or more obtained objects pertaining to the metadata in each one of the first and second local storages for access only by the first and second processing units, respectively, wherein each one of the first and second local storages are partitioned into multiple portions for storing multiple types of database objects pertaining to organization of data stored in the database system, wherein the storing or at least facilitating storage of a copy of the one or more obtained objects stores or at least facilitates storage of the copy of the one or more obtained objects in a respective portion of the first and second local storages corresponding to the type of the one or more obtained objects;

allow each one of the first and second processing units to access its own copy of the one or more database objects pertaining to the metadata, stored in its respective one of the first and second local storages by searching its own local storage, without sharing its own copy with the other one of the first and second processing units;

allow each one of the first and second processing units to access its own copy of the one or more database objects pertaining to the metadata, stored in its respective one of the first and second local storages by searching its own local storage, without accessing data from an external source being external to the database system; and

search, by each one of the multiple database nodes, its own copy of the one or more database objects pertaining to the metadata needed for processing of the database queries of the data stored in the database system, in response to the database queries of the database.