Regression Evaluation Using Behavior Models of Software Applications
First Claim
1. A method performed by at least one hardware processor, said method comprising:
- receiving a behavior model for an application, said behavior model comprising n-gram frequencies observed from executing a first version of said application, said n-grams representing sequences of operations of said application;
determining a representative sample of said n-grams;
determining a first performance metric for said application by;
for each of said n-grams in said representative sample, determining an n-gram frequency and a first performance measurement, and multiplying said n-gram frequency by said first performance measurement to produce a first n-gram performance metric;
summing said first n-gram performance metrics for all of said n-grams in said representative sample to generate said first performance metric.
2 Assignments
0 Petitions
Accused Products
Abstract
Comparisons of different versions of an application may be compared using a behavior model of the application. A behavior model may be derived from n-gram analysis of observations of the application in production. The behavior model may include sequences of inputs received by the application or functions performed by the application, where each sequence is an n-gram observed in tracer data. Each n-gram may be coupled with a resource consumption to give a behavior model with performance data. A regression analysis may apply a behavior model derived from a first version of an application to the performance observations of a new version to create an expected performance metric for the new version. A similarly calculated metric from a previous version may be compared to the metric from a new version to determine an improvement or degradation of performance.
-
Citations
20 Claims
-
1. A method performed by at least one hardware processor, said method comprising:
-
receiving a behavior model for an application, said behavior model comprising n-gram frequencies observed from executing a first version of said application, said n-grams representing sequences of operations of said application; determining a representative sample of said n-grams; determining a first performance metric for said application by; for each of said n-grams in said representative sample, determining an n-gram frequency and a first performance measurement, and multiplying said n-gram frequency by said first performance measurement to produce a first n-gram performance metric; summing said first n-gram performance metrics for all of said n-grams in said representative sample to generate said first performance metric. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system comprising:
-
a hardware processor; a version analyzer that; receives a behavior model for an application, said behavior model comprising n-gram frequencies observed from executing a first version of said application, said n-grams representing sequences of operations of said application; determines a representative sample of said n-grams; determines a first performance metric for said application by; for each of said n-grams in said representative sample, determining an n-gram frequency and a first performance measurement, and multiplying said n-gram frequency by said first performance measurement to produce a first n-gram performance metric; summing said first n-gram performance metrics for all of said n-grams in said representative sample to generate said first performance metric. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification