Load test load modeling based on rates of user operations

• US 7,516,042 B2
• Filed: 01/11/2007
• Issued: 04/07/2009
• Est. Priority Date: 01/11/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Glas, Ed, Barnett, Bill
• Primary Examiner(s): Lau; Tung S
• Assistant Examiner(s): Kundu; Sujoy K
• Application Number:
  US11/652,465
• Publication Number:
  US 20080172581A1
• Time in Patent Office: 817 Days
• Field of Search: 702/186, 702/187, 702/57, 702/81, 702/84, 702/108, 702117-118, 702/176, 702/182, 455/405, 455/423, 709223-225, 714 24- 27
• US Class Current: 702/182
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Various technologies and techniques are disclosed for performing load tests based upon user pace. A load test application is provided. Load test settings are received from a user that includes a test mix based upon user pace. A test start interval is calculated using the text mix. A load test is performed based upon the text mix. For example, the tests are executed at a pace that is based upon the test start interval for the particular user profile that the test is contained within.

Claims

1. A method for performing a load test based upon user pace comprising the steps of:

providing a load testing application;

receiving a test mix matrix comprising a plurality of user profiles, a user profile corresponding to a type of user expected to use a system to be tested, each user profile comprising a different set of associated transactions to be performed by the system to be tested, where the transactions each have an associated respective user pace, the user paces comprising pre-determined frequencies of the respective transactions;

computing test start time intervals for the user profiles of the test mix matrix, respectively, the test start time interval of a user profile being based on total frequency of the pre-determined frequencies of the load test settings of the transactions in the user profile; and

performing a load test with the load testing application using the text mix, where the user profiles of the test mix matrix are executed in parallel, and where the transactions of a user profile are initiated for execution at a pace that is based on the test start time interval of the user profile, the transactions of the user interval starting at intervals based on the test start time interval of the user profile, whereby transactions of a user profile execute at time intervals based on the total transaction frequency of the user profile.

2. The method of claim 1, wherein the test mix is received from a user of the load testing application.

3. A computer-readable medium having computer-executable instructions for causing a computer to perform the steps recited in claim 1.

10. A method according to claim 1, wherein when a transaction of a user profile starts at a first point in time and finishes executing at a second point in time and the time between the first and second points in time is less time than the test start interval for the user profile, then a next transaction'"'"'s execution start time is based on a third point in time comprising the first point in time plus an amount of time based on the test start interval.

11. A method according to claim 10, wherein when a transaction of the user profile starts at a fourth point in time and ends at a fifth point in time and the time between the fourth and fifth points in time is greater than the test start interval, then a next transaction starts at the fifth point in time.

12. A method according to claim 10, wherein the amount of time comprises the test start interval adjusted by a random amount of time.

13. A method according to claim 1, wherein a first transaction of a user profile starts at a first point in time, and a second succeeding transaction of the user profile has a start time based on adding the test start interval to the first point in time and adding or subtracting a random amount of time that is chosen to be less than the test start interval.

4. A method for scheduling load tests using a pacing test mix comprising the steps of:

retrieving a test mix specified by a user of a load testing application, the test mix comprising a plurality of user profiles, each user profile comprising a plurality of transactions to be executed, each transaction having a respective pre-defined rate of execution;

calculating a test start interval for each user profile of the text mix, a test start interval of a user profile comprising a time interval for executing the transactions of the user profile such that the transactions of the user profile are executed at intervals of time according to the time interval, the test start interval of a user profile being computed in accordance with an overall rate of execution of the user profile'"'"'s transactions according to the pre-defined rates of execution of the transactions;

executing transactions of the plurality of the user profiles in parallel, where the transactions of a user profile are executed at succeeding intervals of time based on the test start interval of the corresponding user profile; and

computing an average time to complete the executed transactions of a user profile and comparing the average to the time interval of the corresponding user profile.

5. The method of claim 4, wherein a start time for a first transaction for each of the plurality of user profiles is determined by choosing a random number between zero and the test start interval.

6. The method of claim 5, wherein subsequent tests for each of the plurality of user profiles are started based on the test start intervals of the respective user profiles.

7. The method of claim 4, wherein average execution durations for the transactions in each of the respective plurality of user profiles is monitored determine if the a user profile'"'"'s average execution duration exceeds the corresponding test start interval.

8. The method of claim 4, wherein an average transaction duration for a user profile is compared with the test start interval for the corresponding user profile.

9. A computer-readable medium having computer-executable instructions for causing a computer to perform the steps recited in claim 4.