Assessing application performance with an operational index
First Claim
1. A computer-implemented method of identifying a source of a problem in an application running on a computer system, the method comprising:
- receiving, by a server, data related to a plurality of types of metrics associated with the application;
determining, by the server, a respective first value for each type of metric that corresponds to unsatisfactory performance;
determining, by the server, a respective second value for each type of metric that corresponds to satisfactory performance;
determining, by the server, a respective parameter for each type of metric that indicates a sensitivity of a respective index to a change in the corresponding type of metric between the respective first and second values; and
calculating, by the server, the respective index for each type of metric that ranges between the respective first and second values based on the respective first value, the respective second value, and the respective parameter.
21 Assignments
0 Petitions
Accused Products
Abstract
The present invention relates to a system and method for assessing application performance and user satisfaction. In one embodiment, the system and method calculates an Operational Index (OPdex) representing user satisfaction with an application. The OPdex may be a number quantifying user satisfaction with an application, such as a web application, and system performance. The OPdex may be based on one or more measurable metrics having a range of values that may affect user satisfaction or performance of an application. The OPdex may comprise calculating the index based on a soft threshold, a hard threshold, and measurements indicating a perceived application response time. The OPdex calculation may also account for sensitivity of user satisfaction to response time. Based on the OPdex, the system and methods also provide information indicating the relationship among application response time thresholds set by the users, the user satisfaction level, and the mean response time.
59 Citations
25 Claims
-
1. A computer-implemented method of identifying a source of a problem in an application running on a computer system, the method comprising:
-
receiving, by a server, data related to a plurality of types of metrics associated with the application; determining, by the server, a respective first value for each type of metric that corresponds to unsatisfactory performance; determining, by the server, a respective second value for each type of metric that corresponds to satisfactory performance; determining, by the server, a respective parameter for each type of metric that indicates a sensitivity of a respective index to a change in the corresponding type of metric between the respective first and second values; and calculating, by the server, the respective index for each type of metric that ranges between the respective first and second values based on the respective first value, the respective second value, and the respective parameter. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-implemented method for calculating an index indicating performance of an application running on a computer system, wherein the index ranges between a first value corresponding to unsatisfactory performance and a second value corresponding to a completely satisfactory performance, the method comprising:
-
receiving, from at least one instrument coupled to the computer system, data indicating at least one metric having a range of values related to the performance of the application; determining a first threshold for the at least one metric indicating a value of the metric beyond which the performance of the application is categorized as declining; determining a second threshold for the at least one metric indicating a value of the metric beyond which the performance of the application is categorized as unsatisfactory; determining a set of parameters indicating a sensitivity of the index to a change in the value of the metric between the first and second threshold; and calculating the index indicating the performance of the application between the first threshold and second threshold based on the first threshold, the second threshold, and the set of parameters. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A method of modeling performance of an application based on an index in a computer system, wherein the index ranges between a first threshold corresponding to unsatisfactory performance and a second threshold corresponding to a completely satisfactory performance, the method comprising:
-
receiving, by the computer system, a set of desired values for the index between the first and second thresholds; determining, by the computer system, a sensitivity of the index based on the received set of desired values; and determining, by the computer system, a function for the index based on the received set of desired values, wherein the function calculates the index for response times between the first threshold and second threshold based on the sensitivity. - View Dependent Claims (17, 18, 19, 20)
-
-
21. A non-transitory computer-readable storage medium having control logic recorded thereon that, when executed by a processor, causes the processor to perform a method for calculating an index in a computer system, the method comprising:
-
receiving, from an instrument coupled to the computer system, data indicating a metric having a range of values related to a performance of an application; determining a first threshold for the metric indicating a value of the metric beyond which the performance of the application is categorized as declining; determining a second threshold for the metric indicating a value of the metric beyond which the performance of the application is categorized as unsatisfactory; determining a set of parameters indicating a sensitivity of the index to a change in the value of the metric between the first and second threshold; and calculating an index indicating the performance of the application between the first threshold and second threshold based on the first threshold, the second threshold, and the set of parameters. - View Dependent Claims (22, 23, 24, 25)
-
Specification