Database monitoring system

• US 20050192921A1
• Filed: 02/26/2004
• Published: 09/01/2005
• Est. Priority Date: 02/26/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Konig, Arnd Christian, Chaudhuri, Surajit, Narasayya, Vivek
• Granted Patent: US 7,194,451 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: Y10S 707/955 Object-oriented
• CPC Class Codes: Y10S 707/962 Entity-attribute-value
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing

Abstract

A framework is provided within a database system for specifying database monitoring rules that will be evaluated as part of the execution code path of database events being monitored. The occurrence of a selected database event triggers a rule that evaluates some parameter of an object related to the event against a condition in the rule. If the condition is met, a specified action is taken that can alter the execution of the database event or database system performance. Lightweight aggregation tables are utilized to enable aggregation of object parameter values so that presently occurring events can be compared to a summary of the object parameter values from previously occurring database events. Signatures are assigned to queries based on the structure of the query plan so that information in the lightweight aggregation tables can be grouped according to query signature.

Claims

1. A database monitoring system that monitors performance of a database system in which database events having an execution code path are occurring, comprising:

a collection of database system object types each having at least one object attribute that corresponds to a property of the object type

a rule engine that evaluates rules for taking action based on database system performance;

wherein a rule is triggered by the occurrence of a database event and specifies a condition and an action to be taken by the monitoring system when the condition is met; and

wherein the rule engine evaluates the condition and takes the specified action if the condition is met as part of the database event'"'"'s execution code path.

2. The system of claim 1 further comprising a collection of attribute probes that collect information about object attributes and wherein the rule engine accesses a probe corresponding to an object attribute referenced in a condition to evaluate the condition.

3. The system of claim 2 wherein the collection of probes includes a signature probe that identifies a logical structure of a query plan for a query object and computes a query signature for the query based on the logical structure of the query plan.

4. The system of claim 2 wherein the collection of probes includes a signature probe that identifies a physical structure of a query plan for a query object and computes a query signature for the query based on the physical structure of the query plan.

5. The system of claim 1 further comprising at least one aggregation table object that stores in column-value attributes aggregate information for a collection of monitored query objects having an object attribute value in common.

6. The system of claim 5 further comprising a reporting table that is an aggregation table materialized on a stable storage medium.

7. The system of claim 5 further comprising an aggregation table maintenance module that maintains the memory size of the aggregation table to less than a threshold amount.

8. The system of claim 2 further comprising at least one aggregation table object that stores in column-value attributes aggregate information over a collection of monitored query objects and wherein the collection of probes includes a signature probe that identifies a logical structure of a query plan for a query object and computes a query signature for the query based on the logical structure of the query plan and wherein entries in the aggregation table are aggregated by query signature.

9. The system of claim 2 further comprising at least one aggregation table object that stores in column-value attributes aggregate information over a collection of monitored query objects and wherein the collection of probes includes a signature probe that identifies a physical structure of a query plan for a query object and computes a query signature for the query based on the physical structure of the query plan and wherein entries in the aggregation table are aggregated by query signature.

10. The system of claim 5 wherein the object attribute is an aggregate of object attribute values stored in the aggregation table.

11. A method that initiates a response action when a database event meets a specified condition, comprising:

inserting a branch instruction within the execution code path of the database event that branches to a set of rules, wherein a rule specifies the condition and the response action to be taken when the condition is true;

triggering the specified action when the database event meets the specified condition.

12. The method of claim 11 comprising storing aggregated information pertaining to the condition from previous occurrences of the database event in an aggregation table.

13. The method of claim 12 wherein the aggregation table stores an aggregated value of a parameter associated with an object related to the database event over all occurrences of the database event.

14. The method of claim 13 comprising limiting a memory size of the aggregation table to n entries by sorting entries in the aggregation table based on the value of the parameter and discarding an n+1 ranked entry.

15. The method of claim 11 comprising identifying a query structure for a query object executed on the database and assigning a query signature to the query object based on the identified structure.

16. The method of claim 15 comprising storing aggregated information pertaining to the condition from previous occurrences of database events having the same query signature in an aggregation table.

17. One or more computer readable media comprising computer-executable instructions for performing the method of claim 11.

18. One or more computer readable media comprising computer executable instructions for monitoring performance of a database system in which database events having an execution code path are occurring, the instructions comprising:

defining a collection of database system object types each having at least one object attribute that corresponds to a property of the object type

as part of the database event'"'"'s execution code path, evaluating rules for taking action based on database system performance;

wherein a rule is triggered by the occurrence of a database event and specifies a condition on at least one object attribute and an action to be taken by the monitoring system when the condition is met; and

taking the specified action if the condition is met.

19. The computer readable medium of claim 18 wherein the instructions further comprise defining attribute probes that collect information about an object attribute and accessing a probe corresponding to an object attribute in the condition to evaluate the condition.

20. The computer readable medium of claim 19 wherein the instructions further comprise defining a signature probe that identifies a logical structure of a query plan for a query object and computing a query signature for the query based on the logical structure of the query plan.

21. The computer readable medium of claim 19 wherein the instructions comprise defining a signature probe that identifies a physical structure of a query plan for a query object and computing a query signature for the query based on the physical structure of the query plan.

22. The computer readable medium of claim 19 wherein the instructions further comprise constructing at least one aggregation table that stores aggregate information for a collection of monitored query objects having an object attribute value in common.

23. The computer readable medium of claim 22 wherein the instructions further comprise constructing a reporting table by materializing a an aggregation table on a stable storage medium.

24. The computer readable medium of claim 22 wherein the instructions further comprise maintaining the memory size of the aggregation table to less than a threshold amount.

25. The computer readable medium of claim 20 wherein the instructions further comprise constructing at least one aggregation table that stores aggregate information over a collection of monitored query events, defining a signature probe that identifies a logical structure of a query plan for a query object, computing a query signature for the query object based on the logical structure of the query event'"'"'s plan, and aggregating entries in the aggregation table by query signature.

26. The computer readable medium of claim 20 wherein the instructions further comprise constructing at least one aggregation table that stores aggregate information over a collection of monitored query objects, defining a signature probe that identifies a physical structure of a query plan for a query object, computing a query signature for the query object based on the physical structure of the query event'"'"'s plan, and aggregating entries in the aggregation table by query signature.

27. The computer readable medium of claim 22 wherein the instructions further comprise aggregating object attribute values and evaluating the condition based on an aggregated object attribute value stored in the aggregation table.

28. A database monitoring system schema comprising:

a first element representing a monitored object type; and

a set of attribute elements and events mapped to each monitored object type representing properties of an instance of the monitored object type.

29. The database monitoring system schema of claim 28 wherein the first element represents a query executed on a database system.

30. The database monitoring system schema of claim 29 wherein the query element has a signature attribute element corresponding to a query plan structure associated with the query.

31. A apparatus that initiates a response action when a database event meets a specified condition, comprising:

means for inserting a database monitoring rule within the execution code path of the database event that specifies the condition and the response action to be taken when the specified condition is true; and

means for triggering the specified response action when the database event meets the specified condition.

32. The apparatus of claim 31 comprising means for storing aggregated information pertaining to the condition from previous occurrences of the database event in an aggregation table.

33. The apparatus of claim 32 wherein the means for storing aggregated information stores an aggregated value of a parameter associated with an object related to the database event over all occurrences of the database event in the aggregation table.

34. The apparatus of claim 33 comprising means for limiting a memory size of the aggregation table to n entries by that includes means for sorting entries in the aggregation table based on the value of the parameter and means for discarding an n+1 ranked entry.

35. The apparatus of claim 31 comprising means for identifying a query structure for each query object executed on the database and means for assigning a query signature to each query object executed on the database based on the identified structure.

36. The apparatus of claim 35 comprising means for storing aggregated information pertaining to the condition from previous occurrences of query objects having the same query signature in an aggregation table.