Mobile application testing platform

• US 8,978,014 B1
• Filed: 09/16/2014
• Issued: 03/10/2015
• Est. Priority Date: 09/17/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Xamarin Incorporated (Microsoft Corporation)
• Inventors: Larsen, Jonas Maturana, Depizzol, Vinicius Scopel, Friedman, Nathaniel Dourif, Krukow, Karl, Siegel, David, Smith, Jason Adam
• Primary Examiner(s): Wang, Philip
• Application Number:
  US14/488,023
• Publication Number:
  US 20150082282A1
• Time in Patent Office: 175 Days
• Field of Search: None
• US Class Current: 717/125
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Embodiments are directed towards testing mobile applications for a plurality of mobile computers. A server computer may be provided a mobile application, a test script, and mobile computer criteria. One or more mobile computers may be filtered from a larger set on the mobile computer criteria. The server computer may install the mobile application on each determined mobile computer. Next, each portion of the test script for the mobile application may be performed and/or executed on each determined mobile computer, wherein a result for each performed portion may be stored. During the test run at least one screenshot may be generated based on at least one performed portion of the test script, wherein the screenshots may be stored. The server computer may generate a displayable report that may include each screenshot and a result for each performed portion of the test script.

Claims

1. A method for evaluating mobile applications over a network using a computer that performs actions, comprising:

installing a mobile application and at least one script on a plurality of mobile computers, wherein each of the plurality of mobile computers is in communication with the computer;

performing each of the at least one script for the mobile application on each mobile computer, wherein at least one result for each performed script is stored by the computer; and

concurrently displaying a plurality of screenshots for each of the plurality of mobile computers, wherein each screenshot corresponds to execution of at least one portion of the at least one script.

2. The method of claim 1, further comprising, generating a displayable report that includes each screenshot and a result for each performed portion of the at least one script.

3. The method of claim 1, further comprising:

determining one or more significant deviations in the values of one or more performance metrics of the mobile application as compared to the one or more performance metrics of other mobile applications that have been previously evaluated; and

storing a record of each determined significant deviation in the computer.

4. The method of claim 1, wherein concurrently displaying the plurality of screenshots, further comprises:

determining at least one mobile computer by filtering the plurality of mobile computers based on at least one criteria; and

displaying one or more screenshots that correspond to the least one determined mobile computer.

5. The method of claim 1, wherein concurrently displaying the plurality of screenshots, further comprises,

determining a display order of one or more screenshots that correspond to the plurality of mobile computers based on a rank order of at least one sort criteria;

and

displaying one or more screenshots that correspond to the plurality of mobile computers in the determined display order.

6. The method of claim 1, further comprising:

receiving market share information from at least one provider of market share data; and

determining the plurality of mobile computers based in part on the market share information.

7. The method of claim 1, further comprising:

determining at least one defect in the mobile application on at least one mobile computer of the plurality of mobile computer based on the execution of at least one portion of the at least one script; and

shifting a view window for a user interface that displays a displayable report to show the at least one mobile computer of the plurality of mobile computers that is associated with the at least one defect.

8. The method of claim 1, further comprising:

displaying a sidebar interface that includes at least one list item, wherein each list item corresponds to a description of at least one portion of the at least one script;

enabling a user to select the least one list item; and

displaying a detail view pane interface that shows each step that comprises the at least one portion of the at least one script.

9. A system for evaluating mobile applications, comprising:

a network computer, including;

a transceiver that communicates over the network;

a memory that stores at least instructions;

a processor device that executes instructions that perform actions, including;

installing a mobile application and at least one script on a plurality of mobile computers, wherein each of the plurality of mobile computers is in communication with the computer;

performing each of the at least one script for the mobile application on each mobile computer, wherein at least one result for each performed script is stored by the computer; and

concurrently displaying a plurality of screenshots for each of the plurality of mobile computers, wherein each screenshot corresponds to execution of at least one portion of the at least one script; and

a client computer, including;

a transceiver that communicates over the network;

a memory that stores at least instructions;

a processor device that executes instructions that perform actions, including;

providing the mobile application to the network computer.

10. The system of claim 9, wherein the network computer processor device executes instructions that perform actions further comprising, generating a displayable report that includes each screenshot and a result for each performed portion of the at least one script.

11. The system of claim 9, wherein the network computer processor device executes instructions that perform actions further comprising:

determining one or more significant deviations in the values of one or more performance metrics of the mobile application as compared to the one or more performance metrics of other mobile applications that have been previously evaluated; and

storing a record of each determined significant deviation in the computer.

12. The system of claim 9, wherein concurrently displaying the plurality of screenshots, further comprises:

determining at least one mobile computer by filtering the plurality of mobile computers based on at least one criteria; and

displaying one or more screenshots that correspond to the least one determined mobile computer.

13. The system of claim 9, wherein concurrently displaying the plurality of screenshots, further comprises,

determining a display order of one or more screenshots that correspond to the plurality of mobile computers based on a rank order of at least one sort criteria;

and

displaying one or more screenshots that correspond to the plurality of mobile computers in the determined display order.

14. The system of claim 9, wherein the network computer processor device executes instructions that perform actions further comprising:

receiving market share information from at least one provider of market share data; and

determining the plurality of mobile computers based in part on the market share information.

15. The system of claim 9, wherein the network computer processor device executes instructions that perform actions further comprising:

determining at least one defect in the mobile application on at least one mobile computer of the plurality of mobile computer based on the execution of at least one portion of the at least one script; and

shifting a view window for a user interface that displays a displayable report to show the at least one mobile computer of the plurality of mobile computers that is associated with the at least one defect.

16. The system of claim 9, wherein the network computer processor device executes instructions that perform actions further comprising:

displaying a sidebar interface that includes at least one list item, wherein each list item corresponds to a description of at least one portion of the at least one script;

enabling a user to select the least one list item; and

displaying a detail view pane interface that shows each step that comprises the at least one portion of the at least one script.

17. A network computer for evaluating mobile applications, comprising:

a transceiver that communicates over the network;

a memory that stores at least instructions;

a processor device that executes instructions that perform actions, including;

installing a mobile application and at least one script on a plurality of mobile computers, wherein each of the plurality of mobile computers is in communication with the computer;

performing each of the at least one script for the mobile application on each mobile computer, wherein at least one result for each performed script is stored by the computer; and

concurrently displaying a plurality of screenshots for each of the plurality of mobile computers, wherein each screenshot corresponds to execution of at least one portion of the at least one script.

18. The network computer of claim 17, wherein the processor device executes instructions that perform actions further comprising, generating a displayable report that includes each screenshot and a result for each performed portion of the at least one script.

19. The network computer of claim 17, wherein the processor device executes instructions that perform actions further comprising:

determining one or more significant deviations in the values of one or more performance metrics of the mobile application as compared to the one or more performance metrics of other mobile applications that have been previously evaluated; and

storing a record of each determined significant deviation in the computer.

20. The network computer of claim 17, wherein concurrently displaying the plurality of screenshots, further comprises:

determining at least one mobile computer by filtering the plurality of mobile computers based on at least one criteria; and

displaying one or more screenshots that correspond to the least one determined mobile computer.

21. The network computer of claim 17, wherein concurrently displaying the plurality of screenshots, further comprises,

determining a display order of one or more screenshots that correspond to the plurality of mobile computers based on a rank order of at least one sort criteria;

and

displaying one or more screenshots that correspond to the plurality of mobile computers in the determined display order.

22. The network computer of claim 17, wherein the processor device executes instructions that perform actions further comprising:

receiving market share information from at least one provider of market share data; and

determining the plurality of mobile computers based in part on the market share information.

23. The network computer of claim 17, wherein the processor device executes instructions that perform actions further comprising:

determining at least one defect in the mobile application on at least one mobile computer of the plurality of mobile computer based on the execution of at least one portion of the at least one script; and

shifting a view window for a user interface that displays a displayable report to show the at least one mobile computer of the plurality of mobile computers that is associated with the at least one defect.

24. A processor readable non-transitory storage media that includes instructions for evaluating mobile applications, wherein a computer that executes at least a portion of the instructions performs actions, comprising:

installing a mobile application and at least one script on a plurality of mobile computers, wherein each of the plurality of mobile computers is in communication with the computer;

performing each of the at least one script for the mobile application on each mobile computer, wherein at least one result for each performed script is stored by the computer; and

concurrently displaying a plurality of screenshots for each of the plurality of mobile computers, wherein each screenshot corresponds to execution of at least one portion of the at least one script.

25. The media of claim 24, further comprising, generating a displayable report that includes each screenshot and a result for each performed portion of the at least one script.

26. The media of claim 24, further comprising:

determining one or more significant deviations in the values of one or more performance metrics of the mobile application as compared to the one or more performance metrics of other mobile applications that have been previously evaluated; and

storing a record of each determined significant deviation in the computer.

27. The media of claim 24, wherein concurrently displaying the plurality of screenshots, further comprises:

determining at least one mobile computer by filtering the plurality of mobile computers based on at least one criteria; and

displaying one or more screenshots that correspond to the least one determined mobile computer.

28. The media of claim 24, wherein concurrently displaying the plurality of screenshots, further comprises,

determining a display order of one or more screenshots that correspond to the plurality of mobile computers based on a rank order of at least one sort criteria;

and

displaying one or more screenshots that correspond to the plurality of mobile computers in the determined display order.

29. The media of claim 24, further comprising:

receiving market share information from at least one provider of market share data; and

determining the plurality of mobile computers based in part on the market share information.

30. The media of claim 24, further comprising:

determining at least one defect in the mobile application on at least one mobile computer of the plurality of mobile computer based on the execution of at least one portion of the at least one script; and

shifting a view window for a user interface that displays a displayable report to show the at least one mobile computer of the plurality of mobile computers that is associated with the at least one defect.