Managing transactional data for high use databases

• US 9,917,885 B2
• Filed: 07/30/2013
• Issued: 03/13/2018
• Est. Priority Date: 07/30/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Campbell, John J., Kozin, Daniel, Slinger, Nigel G., Tobler, John B.
• Primary Examiner(s): To, Baoquoc N
• Assistant Examiner(s): Allen, Nicholas
• Application Number:
  US13/954,423
• Publication Number:
  US 20150039576A1
• Time in Patent Office: 1,687 Days
• Field of Search: 707703
• CPC Class Codes: G06F 11/3082 the data filtering being achieved by aggregating or compressing the monitored data
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

According to one embodiment of the present invention, a system compares database transactions to corresponding performance information to identify conforming database transactions with an acceptable deviation from the performance information and outlier database transactions beyond the acceptable deviation from the performance information. The system aggregates information from a threshold quantity of conforming database transactions into an aggregated record, wherein the threshold quantity is dynamically adjusted, and generates a record for each outlier database transaction, wherein conditions for identifying the outlier database transactions are dynamically adjusted. Embodiments of the present invention further include a method and computer program product for managing database transactions in substantially the same manners described above.

Claims

1. A system for managing database transactions comprising:

at least one processor configured to;

receive transaction information associated with a database transaction;

compare the transaction information associated with the database transaction to corresponding performance information to determine whether the transaction information is within an acceptable deviation from the performance information or is associated with an outlier database transaction beyond the acceptable deviation from the performance information;

when the transaction information associated with the database transaction is within an acceptable deviation from the performance information, add the transaction information to an aggregated record of conforming database transactions that is cached in a local memory and, in response to determining that the number of conforming database transactions stored in the aggregated record exceeds a threshold quantity of transactions, externalize the aggregated record of conforming database transactions by transferring the aggregated record into an external data store; and

when the transaction information is associated with an outlier database transaction, generate an individual record for the outlier database transaction, the individual record comprising resource usage information associated with the outlier database transaction, wherein conditions for determining the outlier database transaction are dynamically adjusted based on a configuration parameter indicating the acceptable deviation from the performance information.

2. The system of claim 1, wherein the database transaction is associated with an identifier that is based on the transaction information and the performance information is accumulated based on each transaction information associated with the identifier.

3. The system of claim 2, wherein the aggregated record comprises transaction information that is separately aggregated for one or more database transactions associated with each of the identifiers.

4. The system of claim 1, wherein the database transaction is directed to one or more database servers within a cloud environment.

5. The system of claim 1, wherein the performance information includes average values for one or more performance metrics and deviation values for the performance metrics.

6. The system of claim 5, wherein the deviation values include one of a standard deviation and an average difference between the transaction information associated with the database transaction and current average values for the one or more performance metrics.

7. The system of claim 1, wherein the performance information is updated dynamically.

8. A computer program product for managing database transactions comprising:

a computer readable storage medium having computer readable program code embodied therewith for execution on a processing system, the computer readable program code comprising computer readable program code configured to;

receive transaction information associated with a database transaction;

compare the transaction information associated with the database transaction to corresponding performance information to determine whether the transaction information is within an acceptable deviation from the performance information or is associated with an outlier database transaction beyond the acceptable deviation from the performance information;

when the transaction information associated with the database transaction is within an acceptable deviation from the performance information, add the transaction information to an aggregated record of conforming database transactions that is cached in a local memory and, in response to determining that the number of conforming database transactions stored in the aggregated record exceeds a threshold quantity of transactions, externalize the aggregated record of conforming database transactions by transferring the aggregated record into an external data store; and

when the transaction information is associated with an outlier database transaction, generate an individual record for the outlier database transaction, the individual record comprising resource usage information associated with the outlier database transaction, wherein conditions for determining the outlier database transaction are dynamically adjusted based on a configuration parameter indicating the acceptable deviation from the performance information.

9. The computer program product of claim 8, wherein the database transaction is associated with an identifier that is based on the transaction information and the performance information is accumulated based on each transaction information associated with the identifier.

10. The computer program product of claim 8, wherein the database transaction is directed to one or more database servers within a cloud environment.

11. The computer program product of claim 8, wherein the performance information includes average values for one or more performance metrics and deviation values for the performance metrics.

12. The computer program product of claim 8, wherein the deviation values include one of a standard deviation and an average difference between the transaction information associated with the database transaction and current average values for the one or more performance metrics.

13. The computer program product of claim 8, wherein the performance information is updated dynamically.

14. The computer program product of claim 8, wherein the aggregated record comprises transaction information that is separately aggregated for one or more database transactions associated with each of the identifiers.