Monitoring web applications

• US 8,863,085 B1
• Filed: 01/31/2012
• Issued: 10/14/2014
• Est. Priority Date: 01/31/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Stahlberg, Patrick
• Primary Examiner(s): DAO, THUY CHAN
• Application Number:
  US13/362,885
• Time in Patent Office: 987 Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22

Abstract

Methods, systems, and apparatuses for monitoring web applications are provided. An exemplary method for monitoring a web application includes executing a first test on a first browser residing on a server. The exemplary method also includes executing a second test on a second browser residing on the server. The first and second browsers are heterogeneous browsers and run in heterogeneous browser environments.

Claims

1. A computer-implemented method for monitoring a web application, comprising:

executing a first test in a first browser residing on a server, wherein the first test is a first complete user session, the first complete user session comprising a first simulated sequence of user actions with a first user interface of the first browser during the first complete user session and wherein executing the first test comprises;

sending a first command to the first browser to perform a first user operation;

executing, in the first browser, first client-side code included in a first response responsive to the first user operation; and

determining a status of the first test based at least on the first response and a result of the executed first client-side code; and

executing a second test in a second browser residing on the server, the first and second browsers being heterogeneous browsers operating in heterogeneous browsing environments, wherein the second test is another complete user session, the another complete user session comprising a second simulated sequence of user actions with a second user interface of the second browser during the another complete user session and wherein executing the second test comprises;

sending a second command to the second browser to perform a second user operation;

executing, in the second browser, second client-side code included in a second response responsive to the second user operation; and

determining a status of the second test based at least on the second response and a result of the executed second client-side code.

2. The method of claim 1, wherein the first client-side code is Java Script code.

3. The method of claim 1, wherein the executing the first test comprises

sending, from a virtual machine residing on the server, a third command to the first browser to perform a third user operation, and

executing, in the first browser, third client-side code included in a third response responsive to the third user operation;

and

the determining a status of the first test (a)(iii) comprises determining the status of the first test based at least on the third response and a result of the executed third client-side code, the first and third commands being associated with the first complete user session.

4. The method of claim 3, wherein a state of the third command is dependent on a state of the first command.

5. The method of claim 1, further comprising:

determining whether the first test has previously succeeded;

incrementing a first counter when it is determined that the first test has previously succeeded;

incrementing a second counter when it is determined that the first test has previously failed; and

generating an alert when the second counter exceeds a threshold.

6. The method of claim 1, further comprising:

determining whether the first test has previously failed; and

executing the first test automatically when it is determined that the first test has previously failed.

7. The method of claim 1, further comprising generating a log that includes metadata of the first test, wherein the metadata includes at least one of a status of the first test, a timestamp of the first test, a number of attempted test runs of the first test, a total time spent executing the first test, a number of times the first test has previously failed, or a number of times the first test has previously succeeded.

8. The method of claim 1, wherein the first browser runs on a first operating system, the second browser runs on a second operating system, and the first operating system is different from the second operating system.

9. A system for monitoring a web application, comprising:

a first server comprising;

a memory;

at least one processor coupled to the memory;

a test executor, implemented on the first server, and configured to;

execute a first test in a first browser residing on the first server, wherein the first test is a first complete user session, the first complete user session comprising a first simulated sequence of user actions with a first user interface of the first browser during the first complete user session,

execute a second test in a second browser residing on the first server, wherein the second test is another complete user session, the another complete user session comprising a second simulated sequence of user actions with a second user interface of the second browser during the another complete user session and wherein the first and second browsers are heterogeneous browsers,

send a first command to the first browser to perform a first user operation,

send a second command to the second browser to perform a second user operation,

determine a status of the first test based at least on the first response and a result of the executed first client-side code, and

determine a status of the second test based at least on the second response and a result of the executed second client-side code;

a first command executor, implemented on the first server, and configured to execute, in the first browser, first client-side code included in a first response responsive to the first user operation; and

a second command executor, implemented on the first server, and configured to execute, in the second browser, second client-side code included in a second response responsive to the second user operation.

10. The system of claim 9, further comprising a second server that comprises the test executor, first command executor, and second command executor.

11. The system of claim 9, wherein the first command executor resides in a first environment, the second command executor resides in a second environment, and the first environment is different from the second environment.

12. The system of claim 9, wherein the test executor resides in a first virtual machine and the second command executor resides in a second virtual machine.

13. The system of claim 9, wherein the first browser runs on a first operating system, the second browser runs on a second operating system, and the first operating system is different from the second operating system.

14. The system of claim 13, wherein the first browser is run natively on the first operating system.

15. The system of claim 9, further comprising a repository configured to store a list of previous test executions and metadata associated with the test executions.

16. The system of claim 9, wherein the first and second browsers run in a production environment.

17. The system of claim 9, further comprising a scheduler configured to coordinate test executions.

18. The system of claim 17, wherein the scheduler is configured to execute tests in a round robin scheduling algorithm.

19. A non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a computing device, cause the computing device to perform operations comprising:

executing a first test in a first browser residing on a server, wherein the first test is a first complete user session, the first complete user session comprising a first simulated sequence of user actions with a first user interface of the first browser during the first complete user session and wherein executing the first test comprises;

sending a first command to the first browser to perform a first user operation;

executing, in the first browser, first client-side code included in a first response responsive to the first user operation; and

determining a status of the first test based at least on the first response and a result of the executed first client-side code; and

executing a second test in a second browser residing on the server, the first and second browsers being heterogeneous browsers operating in heterogeneous browsing environments, wherein the second test is another complete user session, the another complete user session comprising a second simulated sequence of user actions with a second user interface of the second browser during the another complete user session and wherein executing the second test comprises;

sending a second command to the second browser to perform a second user operation;

executing, in the second browser, second client-side code included in a second response responsive to the second user operation; and

determining a status of the second test based at least on the second response and a result of the executed second client-side code.

20. The non-transitory computer readable storage medium of claim 19, wherein the client-side code is Java Script code.

21. The non-transitory computer readable storage medium of claim 19, wherein the first browser runs on a first operating system, the second browser runs on a second operating system, and the first operating system is different from the second operating system.