PREDICTIVE RESOURCE MANAGEMENT

• US 20120173477A1
• Filed: 12/29/2010
• Published: 07/05/2012
• Est. Priority Date: 12/29/2010
• Status: Active Grant

• Current Assignee: Teradata US, Inc. (Teradata Corporation)
• Original Assignee: Teradata US, Inc. (Teradata Corporation)
• Inventors: Coutts, Michael G., Scheie, Eric
• Granted Patent: US 9,965,498 B2
• Time in Patent Office: Days
• US Class Current: 707/602
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409

Abstract

Apparatus, systems, and methods may operate to monitor database system resource consumption over various time periods, in conjunction with scheduled data loading, data export, and query operations. Additional activities may include generating a database system resource consumption map based on the monitoring, and adjusting database system workload throttling to accommodate predicted database system resource consumption based on the resource consumption map and current system loading, prior to the current database resource consumption reaching a predefined critical consumption level. The current system loading may be induced by data loading, data export, or query activity. Other apparatus, systems, and methods are disclosed.

Claims

1. An apparatus, comprising:

a monitoring module to monitor database system resource consumption over time, in conjunction with scheduled data loading, data export, and query operations; and

a processor to generate a database system resource consumption map based on the database system resource consumption over time, and to adjust database system workload throttling to accommodate predicted database system resource consumption based on the resource consumption map and current system loading induced by at least one of data loading, data export, or query activity, prior to the current database resource consumption reaching a predefined critical consumption level.

2. The apparatus of claim 1, wherein the monitoring module comprises:

a processing node housing a systems manager to receive messages associated with the database system resource consumption.

3. The apparatus of claim 1, further comprising.

multiple database processors, including the processor, coupled to corresponding storage nodes that form a portion of the database system.

4. The apparatus of claim 1, further comprising:

a first node to house a storage medium used to store data supplied by the data loading activity; and

a second node to house the processor comprising at least one data access module processor.

5. The apparatus of claim 1, further comprising:

a display to display the current database resource consumption and the predicted database resource consumption.

6. A processor-implemented method to execute on one or more processors that perform the method, comprising:

monitoring database system resource consumption over time, in conjunction with scheduled data loading, data export, and query operations;

generating a database system resource consumption map based on the monitoring; and

adjusting database system workload throttling to accommodate predicted database system resource consumption based on the resource consumption map and current system loading induced by at least one of data loading, data export, or query activity, prior to the current database resource consumption reaching a predefined critical consumption level.

7. The method of claim 6, wherein the monitoring comprises:

monitoring at least one of processor usage, input/output operation quantity, or memory usage as the scheduled data loading, data export, and query operations occur over time.

8. The method of claim 6, wherein the monitoring comprises:

receiving messages generated by a systems manager, the messages communicating at least one of timing, periodicity, or resource consumption associated with the external loads.

9. The method of claim 6, wherein the generating comprises:

generating a map of maximum resource consumption amounts per unit time associated with the current database system resource consumption.

10. The method of claim 6, wherein the adjusting comprises:

at least one of shifting data loads over time, restricting processor usage, restricting a number of concurrent user sessions, or restricting a number of reports generated for a selected time period.

11. The method of claim 6, wherein the adjusting comprises:

changing workload definitions to provide reduced access to data warehouse resources associated with the database system.

12. The method of claim 6, wherein the adjusting comprises:

at least one of filtering or rejecting requests initiated by a selected user for a selected time period.

13. The method of claim 6, wherein the adjusting comprises:

removing workload access rights associated with at least one of the data loading, data export, or query activity.

14. The method of claim 6, further comprising:

activating an alarm to indicate that the current database resource consumption is expected to reach the predefined critical consumption level within a selected alarm time period.

15. The method of claim 6, wherein the monitoring comprises:

accessing data provided by a time-based data collection service to determine at least one of timing, periodicity, or resource consumption associated with the external loads.

16. The method of claim 6, further comprising:

displaying the predicted database resource consumption in conjunction with a specific future time along a scaled timeline that includes a current time and the specific future time.

17. The method of claim 6, further comprising:

receiving event messages associated with the occurrence of data loading, data export, or query jobs;

receiving automatic registration information associated with the data loading, data export, or query jobs; and

categorizing the data loading, data export, or query jobs as the scheduled data loading, data export, or query operations based on a number of repeated occurrences associated with the data loading, data export, or query jobs.

18. A processor-implemented method to execute on one or more processors that perform the method, comprising:

monitoring current database system resource consumption over time across multiple database systems, in conjunction with scheduled data loading and query operations;

generating a database system resource consumption map based on the monitoring; and

adjusting database system workload throttling to accommodate predicted database resource consumption based on the resource consumption map and current system loading induced by at least one of data loading, data export, or query activity, prior to the current database system resource consumption for a first one of the multiple database systems reaching a predefined critical consumption level.

19. The method of claim 18, wherein the adjusting comprises:

moving data from the first one of the multiple database systems to a second one of the multiple database systems, wherein the predicted relative database resource consumption for the first one is greater than the predicted relative database resource consumption for the second one.

20. The method of claim 18, wherein the adjusting comprises:

redirecting a loading process or queries from the first one of the multiple database systems to a second one of the multiple database systems, wherein the predicted relative database resource consumption for the first one is greater than the predicted relative database resource consumption for the second one.