Self-described query execution in a massively parallel SQL execution engine

• US 9,626,411 B1
• Filed: 03/29/2013
• Issued: 04/18/2017
• Est. Priority Date: 02/25/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Chang, Lei, Wang, Zhanwei, Ma, Tao, Lonergan, Luke, Jian, Lirong, Ma, Lili
• Primary Examiner(s): MOSER, BRUCE M
• Application Number:
  US13/853,060
• Time in Patent Office: 1,481 Days
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/1858 Parallel file systems, i.e. file systems supporting multiple processors
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24524 Access plan code generation and invalidation; Reuse of access plans
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 16/24532 of parallel queries
• CPC Class Codes: G06F 16/24542 Plan optimisation
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A query is executed in a massively parallel processing data storage system comprising a master node communicating with a cluster of multiple segments that access data in distributed storage by producing a self-described query plan at the master node that incorporates changeable metadata and information needed to execute the self-described query plan on the segments, and that incorporates references to obtain static metadata and information for functions and operators of the query plan from metadata stores on the segments. The distributed storage may be the Hadoop distributed file system, and the query plan may be a full function SQL query plan.

Claims

1. A method of query execution in a massively parallel processing (MPP) data storage system comprising a master node and a cluster of multiple distributed segments that access data in distributed storage, comprising:

producing a self-described query plan at the master node that is responsive to a query for accessing data in the distributed storage to satisfy the query, said producing comprising incorporating, into a query plan at the master node, metadata and other information needed by the segments to execute the query plan to create said self-described query plan, wherein said metadata and other information comprise information as to locations of said data in said distributed storage that are accessed by said self-described query plan, and catalog information for functions and operators used in the self-described query plan for processing the data, and wherein said metadata and other information are stored in a store at said master node, wherein in the event that a part of such metadata or a part of such other information needed by the segments to execute the query plan is stored at the cluster of multiple distributed segments, the master node includes an identifier associated with the part of such metadata or the part of such other information that is stored at the cluster of multiple distributed segments and excludes the part of such metadata or the part of such other information that is stored at the cluster of multiple distributed segments from the query plan;

broadcasting said self-described query plan to said segments for execution; and

executing the self-described query plan to process said data.

2. The method of claim 1, wherein said segments comprise stateless servers, and wherein said incorporating of the metadata and other information into the query plan comprises incorporating all metadata and information needed for execution of the self-described query plan such that all the metadata and information needed for execution is contained in said self-described query plan.

3. The method of claim 1 further comprising storing said metadata and other information that is changeable in a central store at said master node, and further storing at each of said segments static information comprising function and query operator information needed by the segments for executing the self-described query plan.

4. The method of claim 1 further comprising storing static information comprising type and built-in function and operator information in a read-only cache at each segment, and accessing such static information in said read-only cache of a segment by said self-described query plan as needed for execution of said self-described query plan on such segment.

5. The method of claim 4, wherein said producing comprises incorporating in said self-described query plan a reference to said static information with which one of the distributed segments accesses said such static information from said read-only cache as needed for execution of said self-described query plan.

6. The method of claim 4, wherein the self-described query plan is executed such that the segments do not access a central metadata store in connection with executing the self-described query plan.

7. The method of claim 1, wherein said self-described query plan comprises a SQL query plan, and the method further comprises storing at each of said segments static SQL function and operator information needed by said segments to execute said SQL query plan.

8. The method of claim 1, wherein said cluster comprises distributed server nodes hosting said segments, and said distributed storage comprises a distributed file system on said server nodes, and wherein said executing comprises executing said self-described query plan in parallel on said distributed server nodes.

9. The method of claim 1, wherein said cluster comprises distributed relational database nodes.

10. The method of claim 1, wherein said master node comprises a query planner for producing said self-described query plan, and the method further comprises slicing by said master node said self-described query plan into slices, informing each of said segments to set up a query executor for said each slice on each segment.

11. The method of claim 10, wherein said incorporating comprises inserting into said self-described query plan slice and segment index information for each such segment to identify the metadata that each query executor needs to access to execute said self-described query plan.

12. The method of claim 1, wherein the executing the self-described query plan to process the data comprises executing, by said segments, the self-described query plan to process said data without accessing a central metadata store.

13. The method of claim 1, wherein the self-described query plan is executed such that the segments do not access a central metadata store in connection with executing the self-described query plan.

14. The method of claim 1, further comprising:

compressing the self-described query plan before the broadcasting of the self-described query plan.

15. The method of claim 1, wherein the query plan comprises an identifier associated with information that is stored at the cluster of multiple distributed segments.

16. Computer readable storage media for storing executable instructions for controlling the operation of one or more computers in a massively parallel processing (MPP) data storage system comprising a master node and a cluster of multiple distributed segments that access data in distributed storage to perform a method of query execution comprising:

producing a self-described query plan at the master node that is responsive to a query for accessing data in the distributed storage to satisfy the query, said producing comprising incorporation, into a query plan at the master node, metadata and other information needed by the segments to execute the query plan to create said self-described query plan, wherein said metadata and other information comprise information as to locations of said data in said distributed storage that are accessed by said self-described query plan, and catalog information for functions and operators used in the self-described query plan for processing the data, and wherein said metadata and other information are stored in a store at said master node, wherein in the event that a part of such metadata or a part of such other information needed by the segments to execute the query plan is stored at the cluster of multiple distributed segments, the master node includes an identifier associated with the part of such metadata or the part of such other information that is stored at the cluster of multiple distributed segments and excludes the part of such metadata or the part of such other information that is stored at the cluster of multiple distributed segments from the query plan;

broadcasting said self-described query plan to said segments for execution; and

executing the self-described query plan to process said data.

17. The computer readable storage media of claim 16, wherein said segments comprise stateless servers, and wherein said incorporating of the metadata and other information into the query plan comprises incorporating all metadata and information needed for execution of the self-described query plan such that all the metadata and information needed for execution is contained in said self-described query plan.

18. The computer readable storage media of claim 16 further comprising storing said metadata and other information that is changeable in a central store at said master node, and further storing at each of said segments static information comprising function and query operator information needed by the segments for executing the self-described query plan.

19. The computer readable storage media of claim 16 comprising storing static information comprising type and built-in function and query operator information in a read-only cache at each segment, and accessing such static information in said read-only cache of a segment as needed for execution of said self-described query plan on such segment.

20. The computer readable storage media of claim 16, wherein said self-described query plan comprises a SQL query plan, and the method further comprises storing at each of said segments static SQL function and operator information needed by said segments to execute said SQL query plan.

21. The computer readable storage media of claim 16, wherein said cluster comprises distributed server nodes hosting said segments, and said distributed storage comprises a distributed file system on said server nodes, and wherein said executing comprises executing said self-described query plan in parallel on said distributed server nodes.

22. The computer readable storage media of claim 16, wherein said master node comprises a query planner for producing said self-described query plan, and the method further comprises slicing by said master node said self-described query plan into slices, and informing each of said segments to set up a query executor for each slice on said each segment.

23. The computer readable storage media of claim 22, wherein said incorporating comprises inserting into said self-described query plan slice and segment index information for each such segment to identify the metadata that each query executor needs to access to execute said self-described query plan.

24. The computer readable storage media of claim 16, wherein the self-described plan is executed to process said data such that the segments execute the self-described query plan to process said data without accessing a central metadata store.