Enhancing automated mobile application testing
First Claim
1. A non-transitory computer-readable medium embodying a program executable in at least one computing device, wherein, when executed, the program causes the at least one computing device to at least:
- receive an application for testing;
select a specific application category of a plurality of application categories based at least in part on the application;
determine that an automated testing pattern subset associated with the specific application category is incomplete based at least in part on at least one of a number of other applications tested using the automated testing pattern subset or a number of testing patterns included in the automated testing pattern subset; and
in response to determining that the automated testing pattern subset associated with the specific application category is incomplete;
perform automated random testing on the application, the automated random testing generating a plurality of random testing patterns;
determine a plurality of random testing results based at least in part on the automated random testing of the application, individual ones of the plurality of random testing results corresponding to a respective random testing pattern of the plurality of random testing patterns;
store the plurality of random testing results and the plurality of random testing patterns;
receive a plurality of manual testing results determined from manual testing of the application;
calculate an accuracy score for individual ones of the plurality of random testing patterns based at least in part on a comparison of the plurality of manual testing results with the plurality of random testing results; and
determine whether to add at least one of the plurality of random testing patterns to the automated testing pattern subset associated with the specific application category based at least in part on the accuracy score associated with the individual ones of the plurality of random testing patterns.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are various embodiments for enhancing automated testing for mobile applications by using an automated testing set. An automated testing pattern set may include multiple patterns that have been determined to yield accurate results in testing applications within a particular application category. The automated testing pattern set may be created for each application category by applying automated random pattern generator tests to applications within the same application category and verifying the accuracy of the random patterns produced by the random pattern generator tests by comparing the results from manual testing. The automated testing pattern set is then created based on patterns ranked according to an assigned accuracy score.
-
Citations
20 Claims
-
1. A non-transitory computer-readable medium embodying a program executable in at least one computing device, wherein, when executed, the program causes the at least one computing device to at least:
-
receive an application for testing; select a specific application category of a plurality of application categories based at least in part on the application; determine that an automated testing pattern subset associated with the specific application category is incomplete based at least in part on at least one of a number of other applications tested using the automated testing pattern subset or a number of testing patterns included in the automated testing pattern subset; and in response to determining that the automated testing pattern subset associated with the specific application category is incomplete; perform automated random testing on the application, the automated random testing generating a plurality of random testing patterns; determine a plurality of random testing results based at least in part on the automated random testing of the application, individual ones of the plurality of random testing results corresponding to a respective random testing pattern of the plurality of random testing patterns; store the plurality of random testing results and the plurality of random testing patterns; receive a plurality of manual testing results determined from manual testing of the application; calculate an accuracy score for individual ones of the plurality of random testing patterns based at least in part on a comparison of the plurality of manual testing results with the plurality of random testing results; and determine whether to add at least one of the plurality of random testing patterns to the automated testing pattern subset associated with the specific application category based at least in part on the accuracy score associated with the individual ones of the plurality of random testing patterns. - View Dependent Claims (2, 3)
-
-
4. A system, comprising:
-
at least one computing device; and at least one application executable in the at least one computing device, wherein, when executed, the at least one application causes the at least one computing device to at least; select a specific application category of a plurality of application categories based at least in part on an application received for testing; determine that an automated testing pattern subset associated with the specific application category is incomplete based at least in part on at least one of a number of other applications tested using the automated testing pattern subset or a number of testing patterns included in the automated testing pattern subset; and in response to determining that the automated testing pattern subset associated with the specific application category is incomplete; perform automated random testing on the application, the automated random testing generating a plurality of random testing patterns; determine a plurality of random testing results based at least in part on the automated random testing of the application, individual ones of the plurality of random testing results corresponding to a respective random testing pattern of the plurality of random testing patterns; receive a plurality of manual testing results determined from manual testing of the application; calculate an accuracy score for individual ones of the plurality of random testing patterns based at least in part on a comparison of the plurality of manual testing results with the plurality of random testing results; and determine whether to add at least one of the plurality of random testing patterns to the automated testing pattern subset associated with the specific application category based at least in part on the accuracy score associated with the individual ones of the plurality of random testing patterns. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method, comprising:
-
selecting, via at least one computing device, a specific application category of a plurality of application categories based at least in part on an application received for testing; determining, via the at least one computing device, that an automated testing pattern subset associated with the specific application category is incomplete based at least in part on at least one of a number of other applications tested using the automated testing pattern subset or a number of testing patterns included in the automated testing pattern subset; and in response to determining that the automated testing pattern subset associated with the specific application category is incomplete; performing, via the at least one computing device, automated random testing on the application, the automated random testing generating a plurality of random testing patterns; determining, via at least one computing device, a plurality of random testing results based at least in part on the automated random testing of the application, individual ones of the plurality of random testing results corresponding to a respective random testing pattern of the plurality of random testing patterns; receiving, via at least one computing device, a plurality of manual testing results determined from manual testing of the application; calculating, via at least one computing device, an accuracy score for individual ones of the plurality of random testing patterns based at least in part on a comparison of the plurality of manual testing results with the plurality of random testing results; and determining, via the at least one computing device, whether to add at least one of the plurality of random testing patterns to the automated testing pattern subset associated with the specific application category based at least in part on the accuracy score associated with the individual ones of the plurality of random testing patterns. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification