AUTOMATED SOFTWARE TESTING

• US 20140380281A1
• Filed: 06/23/2014
• Published: 12/25/2014
• Est. Priority Date: 06/24/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: LinkedIn Corporation (Microsoft Corporation)
• Inventors: McLaughlin, Seth
• Granted Patent: US 9,910,764 B2
• Time in Patent Office: Days
• US Class Current: 717/127
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Disclosed in some examples are systems, machine readable mediums and methods which automate testing of web-based application code by automatically generating test harnesses based on a specified configuration and test script, hosting the test harness, causing the test harness to be run to test the code, and delivering the test results to the user. In some examples, the specified conditions may specify one or more test environments corresponding to an execution environment. This allows users greater flexibility in support of testing libraries and support of testing environments. The end users of the software under test will be provided software that is better tested for many different environments.

Claims

1. A method of testing software, the method comprising:

using one or more computer processors to perform the operations of;

receiving a command from a user to test the software using a configuration selected from a plurality of configurations, the configuration specifying a test environment and a test system, wherein the test system is any computing device capable of simulating the test environment;

receiving a test case written in accordance with one of a plurality of compatible test frameworks;

automatically generating a test harness for the test based upon the test case and the software;

hosting the generated test harness at a determined resource locator;

causing the test system to request the test harness;

receiving a request from the test system to provide the test harness, and responsive to receiving the request, providing the test harness to the test system and causing the test system to run the test in the configuration specified by the test environment;

receiving the test result from the test system; and

displaying the test result to the user.

2. The method of claim 1, wherein the test software comprises a JavaScript application.

3. The method of claim 2, wherein the test environment specifies a selection of a type of Internet browser and wherein the test system executes the test harness in an instance of the selected type of Internet browser to run the test.

4. The method of claim 1, wherein the testing system is located on a remote server.

5. The method of claim 4, wherein the remote server uses a virtual machine to simulate the selected testing environment.

6. The method of claim 1, wherein the test system is executed by the one or more processors.

7. The method of claim 1, further comprising:

receiving a second test case written in accordance with a different one of a plurality of compatible test frameworks; and

automatically generating the test harness for the test based also upon the second test case.

8. A system for testing software, the system comprising:

one or more computer processors configured to include;

an I/O module configured to;

receive a command from a user to test the software using a configuration selected from a plurality of configurations, the configuration specifying a test environment and a test system, wherein the test system is any computing device capable of simulating the test environment;

receive a test case written in accordance with one of a plurality of compatible test frameworks;

a test harness generator module configured to;

automatically generate a test harness for the test based upon the test case and the software;

the I/O module further configured to;

host the generated test harness at a determined resource locator;

cause the test system to request the test harness;

receive a request from the test system to provide the test harness, and responsive to receiving the request, provide the test harness to the test system and causing the test system to run the test in the configuration specified by the test environment;

receive the test result from the test system; and

cause a display of the test result to the user.

9. The system of claim 8, wherein the test software comprises a JavaScript application.

10. The system of claim 8, wherein the test environment specifies a selection of a type of Internet browser and wherein the test system executes the test harness in an instance of the selected type of Internet browser to run the test.

11. The system of claim 8, wherein the testing system is located on a remote server.

12. The system of claim 11, wherein the remote server uses a virtual machine to simulate the selected testing environment.

13. The system of claim 8, wherein the test system is executed by the one or more processors.

14. The system of claim 8, wherein the I/O module is further configured to:

receive a second test case written in accordance with a different one of a plurality of compatible test frameworks;

and the test harness generator module is further configured to;

automatically generate the test harness for the test based also upon the second test case.

15. A machine readable medium that stores instructions which when performed by a machine, cause the machine to perform the operations comprising:

receiving a command from a user to test the software using a configuration selected from a plurality of configurations, the configuration specifying a test environment and a test system, wherein the test system is any computing device capable of simulating the test environment;

receiving a test case written in accordance with one of a plurality of compatible test frameworks;

automatically generating a test harness for the test based upon the test case and the software;

hosting the generated test harness at a determined resource locator;

causing the test system to request the test harness;

receiving a request from the test system to provide the test harness, and responsive to receiving the request, providing the test harness to the test system and causing the test system to run the test in the configuration specified by the test environment;

receiving the test result from the test system; and

displaying the test result to the user.

16. The machine readable medium of claim 15, wherein the test software comprises a JavaScript application.

17. The machine readable medium of claim 15, wherein the test environment specifies a selection of a type of Internet browser and wherein the test system executes the test harness in an instance of the selected type of Internet browser to run the test.

18. The machine readable medium of claim 15, wherein the testing system is located on a remote server.

19. The machine readable medium of claim 18, wherein the remote server uses a virtual machine to simulate the selected testing environment.

20. The machine readable medium of claim 15, wherein the test system is executed by the machine.

21. The machine readable medium of claim 15, wherein the operations comprise:

receiving a second test case written in accordance with a different one of a plurality of compatible test frameworks;

automatically generating the test harness for the test based also upon the second test case.