Adjusting a resource estimate in response to progress of execution of a request

• US 8,516,488 B1
• Filed: 11/09/2010
• Issued: 08/20/2013
• Est. Priority Date: 11/09/2010
• Status: Active Grant

• Current Assignee: Teradata US, Inc. (Teradata Corporation)
• Original Assignee: Teradata US, Inc. (Teradata Corporation)
• Inventors: Brown, Douglas P., Richards, Anita
• Primary Examiner(s): TO, JENNIFER N
• Application Number:
  US12/942,466
• Time in Patent Office: 1,015 Days
• Field of Search: None
• US Class Current: 718/104
• CPC Class Codes: G06F 16/24542 Plan optimisation
• CPC Class Codes: G06F 2209/5021 Priority
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups

Abstract

A database system includes an optimizer to generate resource estimates regarding execution of a request in the database system, and a regulator to monitor progress of execution of the request (and in some examples every step of the request), and to adjust the resource estimates based on the monitored progress. The regulator also adjusts a priority setting of the request according to the adjusted resource estimates.

Claims

1. A database system comprising:

at least one processor;

an optimizer executable on the at least one processor to generate resource estimates regarding execution of a request in the database system; and

a regulator executable on the at least one processor to;

monitor progress of execution of the request to determine actual consumption of resources during the execution of the request;

compare the actual consumption of the resources during the execution of the request with the resource estimates;

adjust the resource estimates based on the comparing;

adjust a priority setting of the request according to the adjusted resource estimates;

receive cardinality estimates provided by the optimizer regarding a size of at least one table or a size of at least one spool for storing an intermediate result; and

adjust the resource estimates based on determining that the cardinality estimates are inaccurate.

2. The database system of claim 1, wherein the resource estimates from the optimizer are selected from the group consisting of a time estimate, an estimate of usage of a processor resource, an estimate of usage of an input/output resource, and an estimate of usage of a network resource.

3. The database system of claim 2, wherein the estimate of usage of the processor resource comprises an estimate of usage of one or more central processing units (CPUs) provided in one or more computer nodes of the database system, wherein the estimate of usage of the input/output resource comprises an estimate of a number of accesses of a disk-based storage, and the estimate of usage of the network resource comprises an estimate of an amount of data to be communicated over a network between processing modules of the database system.

4. The database system of claim 1, wherein the regulator is executable to adjust the resource estimates by increasing the resource estimates in response to the comparing indicating that the actual consumption of the resources is greater than the resource estimates.

5. The database system of claim 1, wherein the regulator is executable to adjust the resource estimates by decreasing the resource estimates in response to the comparing indicating that the actual consumption of the resources is less than the resource estimates.

6. The database system of claim 1, wherein the optimizer is executable to:

provide a query plan for the request, wherein the query plan includes a plurality of steps; and

provide resource estimates for each of the plurality of steps of the query plan.

7. The database system of claim 6, wherein the regulator is executable to adjust the resource estimates in response to comparing the resource estimates for each of the plurality of steps with actual usage of the resources during execution of the request up to a corresponding one of the plurality of steps.

8. The database system of claim 1, wherein the regulator is executable to adjust the resource estimates at specified time intervals.

9. A method for use in a database system comprising:

receiving, from an optimizer, a resource estimate for a request;

comparing, by a regulator executing on at least one processor in the database system, actual consumption of a resource during execution of the request with the resource estimate;

in response to determining based on the comparing that the actual consumption of the resource is greater than or less than consumption indicated by the resource estimate, the regulator adjusting the resource estimate;

adjusting a priority setting of the request according to the adjusted resource estimate;

receiving cardinality estimates provided by the optimizer regarding a size of at least one table or a size of at least one spool for storing an intermediate result; and

adjusting the resource estimate based on determining that the cardinality estimates are inaccurate.

10. The method of claim 9, further comprising:

in response to determining based on the comparing that the actual consumption of the resource is equal or substantially equal to within a predefined range consumption indicated by the resource estimate, the regulator not adjusting the resource estimate.

11. The method of claim 9, further comprising:

generating, by the optimizer, a query plan for the request, wherein the query plan includes a plurality of steps;

determining whether actual consumption of the resource is greater than or less than consumption indicated by the resource estimate for a particular one of the plurality of steps,

wherein adjusting the resource estimate of the request is based on the determining.

12. The method of claim 9, further comprising:

generating, by the optimizer, a query plan for the request, wherein the query plan has a plurality of steps,

wherein the comparing, adjusting of resource estimate, and adjusting of priority setting are iteratively performed for multiple ones of the plurality of steps.

13. An article comprising at least one non-transitory machine-readable storage medium storing instructions that upon execution cause at least one processor in a database system to:

receive, from an optimizer, a resource estimate for a request;

compare, by a regulator, actual consumption of a resource during execution of the request with the resource estimate;

in response to determining based on the comparing that the actual consumption of the resource is greater than or less than consumption indicated by the resource estimate, adjust, by the regulator, the resource estimate;

adjust a priority setting of the request according to the adjusted resource estimate;

receive cardinality estimates provided by the optimizer regarding a size of at least one table or a size of at least one spool for storing an intermediate result; and

adjust the resource estimate based on determining that the cardinality estimates are inaccurate.

14. The article of claim 13, wherein the resource estimate from the optimizer is selected from the group consisting of a time estimate, an estimate of usage of a processor resource, an estimate of usage of a input/output resource, and an estimate of usage of a network resource.