Testing user interface responsiveness for mobile applications

• US 9,053,242 B2
• Filed: 10/09/2014
• Issued: 06/09/2015
• Est. Priority Date: 09/17/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Xamarin Incorporated (Microsoft Corporation)
• Inventors: Smith, Jason Adam, Depizzol, Vinicius Scopel, Friedman, Nathaniel Dourif, Krukow, Karl, Larsen, Jonas Maturana, Siegel, David
• Primary Examiner(s): WANG, RONGFA PHILIP
• Application Number:
  US14/511,117
• Publication Number:
  US 20150082283A1
• Time in Patent Office: 243 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs

Abstract

Embodiments are directed towards testing a responsiveness of a graphical user interface (GUI) for an application executing on a computer. During execution of each portion of a test, stimuli may be provided to the application. The stimuli may be provided to the application thread that is associated with rendering graphics for the GUI. Responses from the application to the stimuli may be monitored to determine a responsiveness of the application for at least one portion of the test. The responsiveness may be determined based on a wait time between providing a request and receiving a reply to the request, which may indicate that the application is in a state to accept input through the GUI. Responsiveness may be determined separately for each portion of the test. A displayable report may be generated to include the responsiveness of the application for each portion of the test.

Claims

1. A method for improving testing of mobile applications for mobile computers over a network, wherein the method employs a network computer to perform actions, comprising:

providing a plurality of stimuli to a mobile application based on execution of a test script, wherein each stimulus requests a response from the mobile application that is executing on a mobile computer;

determining responsiveness of at least the mobile application based on at least monitored information for the mobile computer, wherein the responsiveness is based on at least an amount of time for the mobile application to return to a state ready to accept another stimulus;

displaying of at least a representation of the responsiveness of the mobile application executing on the mobile computer;

concurrently displaying separate screen shots of the mobile application executing on both the mobile computer and a plurality of other different mobile computers; and

displaying a relationship between each displayed screen shot and execution of at least a portion of equivalent test scripts on each mobile computer.

2. The method of claim 1, wherein providing the plurality of stimuli, further comprises at least one of:

providing at least one stimulus to a process thread of the mobile application that also performs graphics rendering for a graphical user interface;

or

providing a heartbeat to execute with a main logical loop of the mobile application.

3. The method of claim 1, wherein displaying the at least representation of the responsiveness, further comprises at least one of memory consumption, processor utilization, power consumption, or network latency, for at least one executed portion of a test script.

4. The method of claim 1, wherein displaying the at least representation of the responsiveness, further comprises a comparison of the responsiveness of the mobile application and equivalent test scripts separately executing on each of a plurality of different mobile computers for at least one portion of their equivalent test scripts.

5. The method of claim 1, wherein displaying the representation further comprises at least one of:

employing a side bar to display at least one test step for at least one portion of a test script;

or

selecting at least one test step in the side bar, wherein additional information regarding the execution of the selected test step is displayed.

6. The method of claim 1, wherein displaying at least the representation, further comprises at least one of:

displaying at least one screen shot of the mobile application executing on the mobile computer;

displaying a relationship between each displayed screen shot and execution of at least a portion of a test script on the mobile computer;

or

displaying at least one of status bars, changing colored objects, text highlighting, representative numbers, or indicators.

7. The method of claim 1, wherein displaying at least the representation, further comprises displaying at least one emblem that corresponds to at least one of importance, priority, type of information, or degree of failure.

8. A network computer for improving the testing of mobile applications over a network, comprising:

a memory for storing at least instructions; and

a processor that executes the instructions to enable actions, including;

providing a plurality of stimuli to a mobile application based on execution of a test script, wherein each stimulus requests a response from the mobile application that is executing on a mobile computer;

determining responsiveness of at least the mobile application based on at least monitored information for the mobile computer, wherein the responsiveness is based on at least an amount of time for the mobile application to return to a state ready to accept another stimulus;

displaying of at least a representation of the responsiveness of the mobile application executing on the mobile computers;

concurrently displaying separate screen shots of the mobile application executing on both the mobile computer and a plurality of other different mobile computers; and

displaying a relationship between each displayed screen shot and execution of at least a portion of equivalent test scripts on each mobile computer.

9. The network computer of claim 8, wherein providing the plurality of stimuli, further comprises at least one of:

providing at least one stimulus to a process thread of the mobile application that also performs graphics rendering for a graphical user interface;

or

providing a heartbeat to execute with a main logical loop of the mobile application.

10. The network computer of claim 8, wherein displaying the at least representation of the responsiveness, further comprises at least one of memory consumption, processor utilization, power consumption, or network latency, for at least one executed portion of a test script.

11. The network computer of claim 8, wherein displaying the at least representation of the responsiveness, further comprises a comparison of the responsiveness of the mobile application and equivalent test scripts separately executing on each of a plurality of different mobile computers for at least one portion of their equivalent test scripts.

12. The network computer of claim 8, wherein displaying the representation further comprises at least one of:

employing a side bar to display at least one test step for at least one portion of a test script;

or

selecting at least one test step in the side bar, wherein additional information regarding the execution of the selected test step is displayed.

13. The network computer of claim 8, wherein displaying at least the representation, further comprises at least one of:

displaying at least one screen shot of the mobile application executing on the mobile computer;

displaying a relationship between each displayed screen shot and execution of at least a portion of a test script on the mobile computer;

or

displaying at least one of status bars, changing colored objects, text highlighting, representative numbers, or indicators.

14. The network computer of claim 8, wherein displaying at least the representation, further comprises displaying at least one emblem that corresponds to at least one of importance, priority, type of information, or degree of failure.

15. A system for improving the testing of mobile applications over a network, comprising:

a mobile computer that is configured to perform actions, including;

providing a plurality of stimuli to a mobile application based on execution of a test script, wherein each stimulus requests a response from the mobile application that is executing on the mobile computer; and

a network computer that is configured to perform actions, including;

determining responsiveness of at least the mobile application based on at least monitored information for the mobile computer, wherein the responsiveness is based on at least an amount of time for the mobile application to return to a state ready to accept another stimulus; and

displaying of at least a representation of the responsiveness of the mobile application executing on the mobile computer, wherein the representation includes one or more comparisons of the responsiveness of the mobile application and equivalent test scripts separately executing on each of a plurality of different mobile computers for at least one portion of their equivalent test scripts.

16. The system of claim 15, wherein providing the plurality of stimuli, further comprises at least one of:

providing at least one stimulus to a process thread of the mobile application that also performs graphics rendering for a graphical user interface;

or

providing a heartbeat to execute with a main logical loop of the mobile application.

17. The system of claim 15, further comprising:

concurrently displaying separate screen shots of the mobile application executing on both the mobile computer and a plurality of other different mobile computers; and

displaying a relationship between each displayed screen shot and execution of at least a portion of equivalent test scripts on each mobile computer.

18. The system of claim 15, wherein displaying the representation further comprises at least one of:

employing a side bar to display at least one test step for at least one portion of a test script;

or

selecting at least one test step in the side bar, wherein additional information regarding the execution of the selected test step is displayed.

19. The system of claim 15, wherein displaying at least the representation, further comprises at least one of:

displaying at least one screen shot of the mobile application executing on the mobile computer;

displaying a relationship between each displayed screen shot and execution of at least a portion of a test script on the mobile computer;

or

displaying at least one of status bars, changing colored objects, text highlighting, representative numbers, or indicators.

20. The system of claim 15, wherein displaying at least the representation, further comprises displaying at least one emblem that corresponds to at least one of importance, priority, type of information, or degree of failure.

21. A processor readable non-transitory storage media that includes instructions for improving the testing of mobile applications over a network, wherein execution of the instructions by a network computer enables actions, comprising:

providing a plurality of stimuli to a mobile application based on execution of a test script, wherein each stimulus requests a response from the mobile application that is executing on a mobile computer;

determining responsiveness of at least the mobile application based on at least monitored information for the mobile computer, wherein the responsiveness is based on at least an amount of time for the mobile application to return to a state ready to accept another stimulus; and

displaying of at least a representation of the responsiveness of the mobile application executing on the mobile computer, wherein the representation includes one or more comparisons of the responsiveness of the mobile application and equivalent test scripts separately executing on each of a plurality of different mobile computers for at least one portion of their equivalent test scripts.

22. The media of claim 21, wherein displaying at least the representation, further comprises displaying at least one emblem that corresponds to at least one of importance, priority, type of information, or degree of failure.

23. The media of claim 21, further comprising:

concurrently displaying separate screen shots of the mobile application executing on both the mobile computer and a plurality of other different mobile computers; and

displaying a relationship between each displayed screen shot and execution of at least a portion of equivalent test scripts on each mobile computer.

24. The media of claim 21, wherein displaying the at least representation of the responsiveness, further comprises at least one of memory consumption, processor utilization, power consumption, or network latency, for at least one executed portion of a test script.

25. The media of claim 21, wherein displaying the representation further comprises at least one of:

employing a side bar to display at least one test step for at least one portion of a test script;

or

selecting at least one test step in the side bar, wherein additional information regarding the execution of the selected test step is displayed.

26. The media of claim 21, wherein displaying at least the representation, further comprises at least one of:

displaying at least one screen shot of the mobile application executing on the mobile computer;

displaying a relationship between each displayed screen shot and execution of at least a portion of a test script on the mobile computer;

or

displaying at least one of status bars, changing colored objects, text highlighting, representative numbers, or indicators.