Automated regression testing for software applications
First Claim
1. A method performed on at least one computer processor on a first hardware device, said method comprising:
- receiving a first version of a software module, said software module comprising a plurality of functions;
configuring a first execution environment;
causing said first version of said software module to be executed on said first execution environment with a tracer;
receiving first tracer data from said tracer, said first tracer data being collected while said first version of said software module is executed on said first execution environment, said first tracer data comprising performance data for at least some of said plurality of functions;
receiving second tracer data from said tracer, said second tracer data being collected while a second version of said software module is executed on a second execution environment, said second tracer data comprising performance data for at least some of said plurality of functions;
comparing said first tracer data to said second tracer data to populate a regression database comprising performance differences for said at least some of said plurality of functions.
2 Assignments
0 Petitions
Accused Products
Abstract
Regression testing of an application may gather performance tests for multiple functions within an application and determine when performance changes from one version of the application to another. The analysis may be further broken down by input sequences that may be processed by various functions. A detailed regression analysis may be presented as a heat map or other visualizations. A regression testing system may be launched during a build process by automatically launching a set of performance tests against an application. In many cases, the application may be executed in a system with a known or consistent performance capabilities. The application may be executed and tested in a new version and at least one prior version on the same hardware and software execution environment, so that results may be normalized from one execution run to another. A regression testing system may be deployed as a paid-for service that may integrate into a source code repository.
-
Citations
22 Claims
-
1. A method performed on at least one computer processor on a first hardware device, said method comprising:
-
receiving a first version of a software module, said software module comprising a plurality of functions; configuring a first execution environment; causing said first version of said software module to be executed on said first execution environment with a tracer; receiving first tracer data from said tracer, said first tracer data being collected while said first version of said software module is executed on said first execution environment, said first tracer data comprising performance data for at least some of said plurality of functions; receiving second tracer data from said tracer, said second tracer data being collected while a second version of said software module is executed on a second execution environment, said second tracer data comprising performance data for at least some of said plurality of functions; comparing said first tracer data to said second tracer data to populate a regression database comprising performance differences for said at least some of said plurality of functions. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system comprising:
-
a testing component that; receives a first version of a software module, said software module comprising a plurality of functions; configures a first execution environment; causes said first version of said software module to be executed on said first execution environment with a tracer; an analysis component executing on a computer processor, said analysis component that; receives first tracer data from said tracer, said first tracer data being collected while said first version of said software module is executed on said first execution environment, said first tracer data comprising performance data for at least some of said plurality of functions; receives second tracer data from said tracer, said second tracer data being collected while a second version of said software module is executed on a second execution environment, said second tracer data comprising performance data for at least some of said plurality of functions; compares said first tracer data to said second tracer data to populate a regression database comprising performance differences for said at least some of said plurality of functions. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
Specification