CLOUD-BASED APPLICATION TESTING

• US 20140026122A1
• Filed: 07/16/2013
• Published: 01/23/2014
• Est. Priority Date: 07/18/2012
• Status: Active Grant

• Current Assignee: Infosys Limited
• Original Assignee: Infosys Limited
• Inventors: Markande, Krishna, Jayaram, Sridhar Murthy
• Granted Patent: US 9,047,410 B2
• Time in Patent Office: Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Cloud-based testing of applications allows an application under test (AUT) to be subjected to test loads mimicking expected high volume real-time production loads. Test loads can be applied from geographically distributed test load sources. During testing, the system can monitor usage of AUTs and the underlying cloud infrastructure (virtual machines, test servers, etc.) on which the AUT is executing. An AUT can be scaled, for instance, additional instances of the application can be started, and additional virtual machines can be configured and test servers provisioned if AUT or infrastructure usage exceeds specified thresholds during testing. A testing services provider can supply a web-based unified management console from which admins and test users can manage AUT testing.

Claims

1. One or more computer-readable storage media storing computer-executable instructions, the computer-executable instructions comprising:

a provision manager configured to deploy an application under test (AUT) to one or more clouds and start testing of an AUT;

a test monitor configured to generate usage metrics as the AUT is being tested; and

an application manager configured to scale the AUT while the AUT is being tested based on the usage metrics.

2. The one or more computer-readable storage media of claim 1, wherein the usage metrics comprises an application response time metric, and the application manager is configured to scale the AUT if the application response time metric exceeds a specified response time threshold.

3. The one or more computer-readable storage media of claim 1, wherein the application manager scales the AUT by increasing or decreasing a number of instances of the AUT executing on the one or more clouds.

4. The one or more computer-readable storage media of claim 1, wherein the provision manager is further configured to allow a user to configure one or more test loads to be applied to the AUT during testing of the AUT and to specify one or more test load sources for the one or more test loads.

5. The one or more computer-readable storage media of claim 4, wherein at least one of the one or more test load sources is external to the one or more clouds.

6. The one or more computer-readable storage media of claim 4, wherein the one or more test load sources comprises a plurality of test load sources that are geographically distributed.

7. The one or more computer-readable storage media of claim 1, wherein the provision manager is further configured to allow a user to configure a priority for the AUT, the application manager being further configured to scale the AUT based at least in part on the priority.

8. The one or more computer-readable storage media of claim 1, wherein the provision manager is capable of deploying the AUT to one or more private, public or hybrid clouds.

9. The one or more computer-readable storage media of claim 1, the computer-executable instructions further comprising:

a server manager configured to provide management of a test environment of the AUT;

a network manager configured to manage a private cloud on which the AUT is to be tested; and

a storage manager configured to dynamically allocate storage for the AUT based on application usage during testing.

10. The one or more computer-readable storage media of claim 1, wherein the test monitor comprises one or more monitoring agents executing in the one or more clouds.

11. The one or more computer-readable storage media of claim 1, the computer-executable instructions further comprising a unified management platform from which the provision manager and application manager can be accessed.

12. A method for testing an application under test (AUT), the method comprising:

deploying the AUT to one or more clouds for testing;

configuring a test load to be applied to the AUT during testing of the AUT;

testing the AUT;

determining from usage metrics generated during the testing of the AUT that at least one of the usage metrics exceeds a test condition associated with the AUT; and

scaling the AUT or cloud infrastructure available to test the AUT.

13. The method of claim 12, wherein the test condition is an application response time or an application throughput.

14. The method of claim 12, wherein the AUT is deployed to a plurality of clouds.

15. The method of claim 14, wherein the plurality of clouds comprises at least one private cloud and at least one public cloud.

16. The method of claim 12, wherein the test load is configured to originate from a plurality of geographically distributed test load sources.

17. The method of claim 12, further comprising determining an amount of cloud infrastructure for testing the AUT, wherein the AUT is deployed to the one or more clouds if the one or more clouds can provide the amount of cloud infrastructure and the amount of cloud infrastructure is currently available at the one or more clouds.

18. The method of claim 12, wherein the AUT is a first AUT and has an associated first priority, the method further comprising:

deploying a second AUT to the one or more clouds, the second AUT having an associated second priority that is greater than the first priority;

testing the second AUT;

throttling down or suspending testing of the first AUT while the second AUT is being tested; and

throttling up or resuming the testing of the first AUT after testing of the second AUT has been completed.

19. At least one computer programmed to carry out a method of testing a first application under test (AUT), the method comprising:

deploying the first AUT to one or more clouds for testing, the first AUT having a first priority;

testing the first AUT;

deploying a second AUT to the one or more clouds, the second AUT having a second priority that is greater than the first priority;

testing the second AUT;

throttling down or suspending testing of the first AUT while the second AUT is being tested; and

throttling up or resuming testing of the first AUT when testing of the second AUT has been completed.

20. A method for testing an application under test (AUT), the method comprising:

specifying one or more test conditions for the AUT;

deploying the AUT to a plurality of clouds for testing, the plurality of clouds comprising clouds of at least two different types;

configuring a test load to be applied to the AUT during testing of the AUT from a plurality of geographically distributed test load sources;

testing the AUT;

monitoring usage metrics generated during testing of the AUT;

determining that at least one usage metrics corresponding to cloud infrastructure usage exceeds at least one of the one or more test conditions;

scaling a number of virtual machines or a number of test servers available for testing the AUT; and

increasing a number of instances of the AUT executing on the one or more clouds.