Systems and methods for performance testing cloud applications from multiple different geographic locations
First Claim
1. A cloud based performance testing system comprising:
- a test creation and management interface in a cloud;
an execution mechanism on an application server which receives requests from the test creation and management interface in the cloud, processes the requests and generates load concurrently from multiple geographic locations in cooperation with an elastic load balancer based on parameters specified in the test creation and management interface and directed against a service under test in the cloud;
a results mechanism hardware server that collects, processes and stores performance measurements of the service under test from the multiple geographic locations in response to the load generated by the execution mechanism; and
a display mechanism that presents on a screen the performance measurements collected by the results mechanism;
wherein the execution mechanism keeps track of available geographic regions, determines which regions are involved in a test, determines a number of workers needed for the test in each region, dynamically instantiates any workers in each region if they are not already available, and sends requests for test execution to the workers located in the regions involved in the test.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for testing the end-to-end performance of cloud based applications. Real workload is created for the cloud based applications using synthetic users. The load and length of demand may be adjusted to address different models allowing the measurement and analysis of user performance metrics under desired conditions. Web applications and other cloud services may be tested from multiple cloud-based concurrent geographic locations in the world. The method may include generating controlled and complex web load from multiple concurrent geographic locations. The method may also include splitting traffic among multiple geographic locations. The method may also include processing test results and generating performance metrics per location as well as comparing locations. The method may also be applicable to cloud services such as mobile apps and API endpoints.
59 Citations
11 Claims
-
1. A cloud based performance testing system comprising:
-
a test creation and management interface in a cloud; an execution mechanism on an application server which receives requests from the test creation and management interface in the cloud, processes the requests and generates load concurrently from multiple geographic locations in cooperation with an elastic load balancer based on parameters specified in the test creation and management interface and directed against a service under test in the cloud; a results mechanism hardware server that collects, processes and stores performance measurements of the service under test from the multiple geographic locations in response to the load generated by the execution mechanism; and a display mechanism that presents on a screen the performance measurements collected by the results mechanism; wherein the execution mechanism keeps track of available geographic regions, determines which regions are involved in a test, determines a number of workers needed for the test in each region, dynamically instantiates any workers in each region if they are not already available, and sends requests for test execution to the workers located in the regions involved in the test. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A cloud based performance testing system comprising:
-
a plurality of remotely distributed subscriber computers connected to an internet; a network interface to the plurality of remotely distributed subscriber computers; a plurality of application servers which receive requests sent by the remotely distributed subscriber computers to test a cloud service; a plurality of traffic generator computers located in multiple geographic regions which receive instructions from the plurality of application servers to generate synthetic user load concurrently in the multiple geographic regions; a service under test residing on one or more first computers connected to the internet against which the synthetic user load is directed; a master database residing on a second computer which receives, records and processes measurements of a performance of the service under test in response to the synthetic user load; and a user interface which displays data of the performance of the service under test; wherein the plurality of application servers emulate mobile network traffic; and wherein the mobile network traffic is emulated by any combination of uplink speed, downlink speed, and latency. - View Dependent Claims (8, 9, 10, 11)
-
Specification