Parallel processing database system
First Claim
Patent Images
1. A parallel processing database system, comprising:
- a database catalog associated with a master node comprising metadata defining database objects;
the master node, wherein the master node comprises one or more processors, wherein the master node is configured to receive a query from a client node, to obtain metadata from the database catalog using a catalog server session that is established in connection with the query, to send one or more query plans and corresponding metadata to one or more of a plurality of worker nodes, to obtain additional metadata to be used in connection with execution of the corresponding query plan from the database catalog using the catalog server session that was established in connection with the query, and to provide the additional metadata to one or more of the plurality of worker nodes; and
the plurality of worker nodes in communication with the master node, wherein one or more of the plurality of worker nodes are configured to use the corresponding query metadata received from the master node in connection with execution of the one or more query plans, and a first worker node of the plurality of worker nodes determines that the received corresponding query metadata is not sufficient to execute the corresponding query plan, and in response to determining that the received corresponding query metadata is not sufficient to execute the corresponding query plan requests additional metadata from one or more other of the plurality of worker nodes.
8 Assignments
0 Petitions
Accused Products
Abstract
A method and system for executing database queries in parallel using a shared metadata store. The metadata store may reside on a master node, where the master node is the root node in a tree. The master node may distribute query plans and query metadata to other nodes in the cluster. These additional nodes may request additional metadata from each other or the master nodes as necessary.
-
Citations
20 Claims
-
1. A parallel processing database system, comprising:
-
a database catalog associated with a master node comprising metadata defining database objects; the master node, wherein the master node comprises one or more processors, wherein the master node is configured to receive a query from a client node, to obtain metadata from the database catalog using a catalog server session that is established in connection with the query, to send one or more query plans and corresponding metadata to one or more of a plurality of worker nodes, to obtain additional metadata to be used in connection with execution of the corresponding query plan from the database catalog using the catalog server session that was established in connection with the query, and to provide the additional metadata to one or more of the plurality of worker nodes; and the plurality of worker nodes in communication with the master node, wherein one or more of the plurality of worker nodes are configured to use the corresponding query metadata received from the master node in connection with execution of the one or more query plans, and a first worker node of the plurality of worker nodes determines that the received corresponding query metadata is not sufficient to execute the corresponding query plan, and in response to determining that the received corresponding query metadata is not sufficient to execute the corresponding query plan requests additional metadata from one or more other of the plurality of worker nodes. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A method comprising:
-
receiving, by a master node, a query from a client node, wherein the master node is associated with at least one processor configured to communicate with a database catalog that includes metadata defining database objects, and wherein the master node is in communication with a plurality of worker nodes; obtaining, by the master node, metadata from the database catalog using a catalog server session that is established in connection with the query; sending, by the master node, a corresponding query plan and corresponding query metadata to one or more of the plurality of worker nodes, wherein the one or more of the plurality of worker nodes are configured to use the corresponding query metadata received from the master node in connection with execution of the corresponding query plan; obtaining, by the master node, additional metadata to be used in connection with execution of the corresponding query from the database catalog using the catalog server session that was established in connection with the query, a first worker node of the plurality of worker nodes determines that the received corresponding query metadata is not sufficient to execute the corresponding query plan, and in response to determining that the received corresponding query metadata is not sufficient to execute the corresponding query plan requests additional metadata from one or more other of the plurality of worker nodes; and providing the additional metadata to one or more of the plurality of worker nodes.
-
-
20. A computer program product embodied in a tangible non-transitory computer-readable storage medium and comprising computer instructions for:
-
receiving, by a master node, a query from a client node, wherein the master node is associated with a database catalog that includes metadata defining database objects, and wherein the master node is in communication with a plurality of worker nodes; obtaining, by the master node, metadata from the database catalog using a catalog server session that is established in connection with the query; sending, by the master node, a corresponding query plan and corresponding query metadata to one or more of the plurality of worker nodes, wherein the one or more of the plurality of worker nodes are configured to use the corresponding query metadata received from the master node in connection with execution of the corresponding query plan; obtaining, by the master node, additional metadata to be used in connection with execution of the corresponding query from the database catalog using the catalog server session that was established in connection with the query, a first worker node of the plurality of worker nodes determines that the received corresponding query metadata is not sufficient to execute the corresponding query plan, and in response to determining that the received corresponding query metadata is not sufficient to execute the corresponding query plan requests additional metadata from one or more other of the plurality of worker nodes; and providing the additional metadata to one or more of the plurality of worker nodes.
-
Specification