Automated mobile application verification

• US 10,013,330 B2
• Filed: 10/02/2015
• Issued: 07/03/2018
• Est. Priority Date: 03/22/2012
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Kuo, Calvin Y., Peracha, Zahur A.
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Luu, Cuong V
• Application Number:
  US14/873,590
• Publication Number:
  US 20160026555A1
• Time in Patent Office: 1,005 Days
• CPC Class Codes: G06F 11/3612 by runtime analysis performance monitoring G06F11/3466
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3676 for coverage analysis
• CPC Class Codes: G06F 11/3692 for test results analysis

Abstract

Disclosed are various embodiments for automatically testing and verifying applications. A user input profile is generated for an application by performing a static analysis on the application. Simulated user input for the application is generated based at least in part on the user input profile. Execution of the application is initiated in a computing device. The simulated user input is provided to the application executed in the computing device. It is verified whether the application meets performance criteria in the computing device.

Claims

1. A method, comprising:

installing, by at least one computing device, an application in a testing computing device;

initiating, by the at least one computing device, execution of the application in the testing computing device;

generating, by the at least one computing device, a user input profile for the application by performing a static analysis on the application;

generating, by the at least one computing device, simulated user input for the application based at least in part on the user input profile generated by performing the static analysis on the application;

providing, by the at least one computing device, the simulated user input to the application executed in the testing computing device; and

verifying, by the at least one computing device, whether the application meets at least one performance criterion in the testing computing device, wherein the at least one performance criterion comprises at least one of;

a stability criterion based at least in part on whether the application becomes unresponsive or a security criterion based at least in part on whether the application accesses a protected resource.

2. The method of claim 1, further comprising establishing, by the at least one computing device, a price for the application in an application marketplace based at least in part on whether the application meets the at least one performance criterion.

3. The method of claim 1, wherein initiating execution of the application in the testing computing device further comprises initiating, by the at least one computing device, execution of the application in an emulated environment corresponding to a particular mobile computing device.

4. The method of claim 1, further comprising obtaining, by the at least one computing device, the application from a source entity.

5. The method of claim 4, further comprising:

obtaining, by the at least one computing device, a manifest from the source entity describing user input for the application; and

wherein the simulated user input is generated based at least in part on the manifest from the source entity.

6. The method of claim 4, further comprising sending, by the at least one computing device, reporting data to the source entity indicating whether the application meets the at least one performance criterion in the testing computing device.

7. The method of claim 1, wherein the application is a mobile application, and the testing computing device is a mobile computing device.

8. The method of claim 1, wherein generating the simulated user input further comprises generating, by the at least one computing device, simulated touchscreen gesture input for the application.

9. The method of claim 1, wherein generating the simulated user input further comprises generating, by the at least one computing device, the simulated user input further based at least in part on a manual review of a screen capture from the application.

10. The method of claim 1, wherein generating the simulated user input further comprises generating, by the at least one computing device, the simulated user input further based at least in part on an automated analysis of a screen capture from the application.

11. A non-transitory computer-readable medium embodying a program executable in at least one computing device, wherein when executed the program causes the at least one computing device to at least:

generate a user input profile for a mobile application by performing a static analysis on the mobile application;

generate simulated user input for the mobile application based at least in part on the user input profile generated by performing the static analysis on the mobile application;

initiate execution of the mobile application in a mobile computing device;

provide the simulated user input to the mobile application executed in the mobile computing device; and

add the mobile application to an application marketplace based at least in part on whether the mobile application meets at least one performance criterion in the mobile computing device, wherein the at least one performance criterion comprises at least one of;

a stability criterion based at least in part on whether the mobile application becomes unresponsive or a security criterion based at least in part on whether the mobile application accesses a protected resource.

12. The non-transitory computer-readable medium of claim 11, wherein, when executed the program further causes the at least one computing device to at least obtain the mobile application from a source entity.

13. The non-transitory computer-readable medium of claim 11, wherein when executed the program further causes the at least one computing device to at least determine that the mobile application is compatible with the mobile computing device based at least in part on the at least one performance criterion.

14. A system, comprising:

at least one computing device having a hardware processor; and

at least one service executable in the at least one computing device, wherein when executed the at least one service causes the at least one computing device to at least;

initiate an instance of a mobile application in a mobile computing device;

generate a user input profile for the mobile application by performing a static analysis on the mobile application;

generate simulated user input based at least in part on the user input profile generated by performing the static analysis on the mobile application;

provide the simulated user input to the instance of the mobile application; and

evaluate at least one performance criterion for the instance of the mobile application in response to the simulated user input, wherein the at least one performance criterion comprises at least one of;

a stability criterion based at least in part on whether the mobile application becomes unresponsive or a security criterion based at least in part on whether the mobile application accesses a protected resource.

15. The system of claim 14, wherein when executed the at least one service further causes the at least one computing device to at least initiate another instance of the mobile application in another mobile computing device that is different from the mobile computing device.

16. The system of claim 15, wherein when executed the at least one service further causes the at least one computing device to at least provide the simulated user input to the another instance of the mobile application.

17. The system of claim 16, wherein when executed the at least one service further causes the at least one computing device to at least evaluate the at least one performance criterion for the another instance of the mobile application in response to the simulated user input.

18. The system of claim 14, wherein the simulated user input is generated at least in part by way of a randomized process.

19. The system of claim 14, wherein the instance of the mobile application is initiated in a testing environment.

20. The system of claim 14, wherein the at least one performance criterion further comprises:

a progress criterion based at least in part on a progress among a plurality of activities in the mobile application.