Automated application testing system
First Claim
Patent Images
1. A platform, comprising one or more computing devices configured to:
- receive a request for initiation of a test of an application under test (AUT);
allocate a plurality of resources for the test, the resources including a plurality of virtual computing environment instances, each virtual computing environment (VCE) instance corresponding to one of a plurality of device operating systems (OSs);
establish a plurality of first two-way communication links, each of the first two-way communication links being between a corresponding one of the VCE instances and an instance of the AUT;
establish a second two-way communication link between a first VCE instance and a control/capture service (CCS) associated with the automated test platform, the second two-way communication link being distinct from the first two-way communication link corresponding to the first VCE instance;
receive a plurality of test commands via a third two-way communication link that is distinct from the first and second communication links;
apply the test commands to each instance of the AUT using the corresponding VCE instance and the corresponding first two-way communication link;
receive test results responsive to application of the test commands to each instance of the AUT with the corresponding VCE instance via the corresponding first two-way communication link;
transmit control commands to the first VCE instance from the CCS via the second two-way communication link, the control commands being configured to control the first VCE instance via an application programming interface associated with the first VCE instance without interfering with application of the test commands to the corresponding instance of the AUT;
receive state information with the CCS from the first VCE instance via the second two-way communication link, the state information resulting from application of the control commands to the first VCE instance, the state information representing one or more states associated with the first VCE instance and relating to the test of the corresponding instance of the AUT;
for the first VCE instance, correlating the test commands, the test results, and the state information to generate a correlated data set for the first VCE instance; and
store the correlated data set for the first VCE instance.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatus are described by which a rich, time-correlated information set is captured during automated testing of an application in a way that allows the application developer to understand the state of the application under test (AUT), the browser interacting with the AUT, and/or the device interacting with the AUT, as it/they changed over time. Mechanisms or features associated with browsers and/or device operating systems are exploited to capture such information, not only for the purpose of better understanding individual test runs, but also to enable the use of analytics over data sets.
-
Citations
22 Claims
-
1. A platform, comprising one or more computing devices configured to:
-
receive a request for initiation of a test of an application under test (AUT); allocate a plurality of resources for the test, the resources including a plurality of virtual computing environment instances, each virtual computing environment (VCE) instance corresponding to one of a plurality of device operating systems (OSs); establish a plurality of first two-way communication links, each of the first two-way communication links being between a corresponding one of the VCE instances and an instance of the AUT; establish a second two-way communication link between a first VCE instance and a control/capture service (CCS) associated with the automated test platform, the second two-way communication link being distinct from the first two-way communication link corresponding to the first VCE instance; receive a plurality of test commands via a third two-way communication link that is distinct from the first and second communication links; apply the test commands to each instance of the AUT using the corresponding VCE instance and the corresponding first two-way communication link; receive test results responsive to application of the test commands to each instance of the AUT with the corresponding VCE instance via the corresponding first two-way communication link; transmit control commands to the first VCE instance from the CCS via the second two-way communication link, the control commands being configured to control the first VCE instance via an application programming interface associated with the first VCE instance without interfering with application of the test commands to the corresponding instance of the AUT; receive state information with the CCS from the first VCE instance via the second two-way communication link, the state information resulting from application of the control commands to the first VCE instance, the state information representing one or more states associated with the first VCE instance and relating to the test of the corresponding instance of the AUT; for the first VCE instance, correlating the test commands, the test results, and the state information to generate a correlated data set for the first VCE instance; and store the correlated data set for the first VCE instance. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer program product, comprising one or more non-transitory computer-readable media having computer program instructions stored therein, the computer program instructions being configured such that, when executed by one or more computing devices, the computer program instructions cause the one or more computing devices to:
-
establish a first two-way communication link to a virtual computing environment (VCE) instance for use in conjunction with a test of an application under test (AUT), the test of the AUT being conducted via a second two-way communication link to the VCE instance, the VCE instance corresponding to a device OS, the second two-way communication link being distinct from the first two-way communication link; transmit control commands to the VCE instance via the first two-way communication link, the control commands being configured to control the VCE instance via an application programming interface associated with the VCE instance without interfering with application of test commands to the AUT; receive state information from the VCE instance via the first two-way communication link, the state information resulting from application of the control commands to the VCE instance, the state information representing one or more states associated with the VCE instance and relating to the test of the AUT; correlate the state information with test commands and test results transmitted via the second two-way communication link to generate a correlated data set; and store the correlated data set. - View Dependent Claims (18, 19, 20, 21, 22)
-
Specification