Load test system for a server and method of use

• US 20030182408A1
• Filed: 02/15/2002
• Published: 09/25/2003
• Est. Priority Date: 02/15/2002
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hu, Qinglong
• Application Number:
  US10/077,237
• Publication Number:
  US 20030182408A1
• Time in Patent Office: Days
• US Class Current: 709/223
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3457 Performance evaluation by simulation
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/342 between virtual entities, e.g. orchestrators, SDN or NFV entities
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A method and system for load testing a server is disclosed. The method and system includes providing at least one virtual user, each of which simulates one client device, a main thread to emulate a plurality of user sessions between the at least one virtual user and the server, wherein each user session includes at least one request/response pair, and generating a plurality of subthreads from the main thread, wherein each subthread emulates one of the plurality of user sessions. The method and system further includes, building in each virtual user a message that includes a request extracted from the at least one request/response pairs in the one user session, and transmitting that message to the server.

The method and system according to the preferred embodiment of the present invention easily creates a system load, quickly composes multi-user test scenarios, and automatically runs load testing. One aspect of the method and system of the present invention supports a stateful model, i.e., messages can be built based on previous synchronization user sessions with the server, because information that is to be used in subsequent messages or user sessions is stored and updated in a configuration file. Messages are then built to include information stored in the configuration file. In another aspect of the present invention, security information is also stored in the configuration file so that the subthread can emulate secure communications between the virtual user and the server.

Claims

1. A method for load testing a server, wherein the server is accessed by a plurality of client devices, the method comprising the steps of:

(a) providing at least one virtual user, wherein each of the at least one virtual users simulates one of the plurality of client devices;

(b) providing a main thread to emulate a plurality of user sessions between the at least one virtual user and the server, wherein each user session includes at least one request/response pair;

(c) generating a plurality of subthreads from the main thread, wherein each subthread emulates one of the plurality of user sessions;

(d) building in each virtual user a message, wherein the message includes a request extracted from the at least one request/response pair in the one user session; and

(e) transmitting the message to the server.

2. The method of claim 1 further including the step of:

(f) synchronizing each of the at least one virtual users to one another prior to the transmitting step (e).

5. The method of claim 1, wherein the building step (d) includes the steps of:

(d1) capturing data from a real time user session between a client device and the server, wherein the captured data includes the at least one request/response pair of the user session; and

(d2) composing the message from the captured data and information stored in a configuration file associated with the virtual user, wherein the stored information includes any combination of state related information, cookies, and security information.

6. The method of claim 5, wherein the capturing step (d1) further includes the step of:

(d1i) recording a server trace of the user session.

7. The method of claim 5, wherein the building step (d) further including the steps of:

(d3) storing the captured data in a message file;

(d4) parsing reusable data from the message file, wherein the reusable data includes the at least one request/response pair of the user session; and

(d5) providing authentication information for the virtual user including user identification and password;

wherein the message further includes the authentication information and a portion of the reusable data from the message file.

8. The method of claim 5, wherein the building step (d) further includes the step of:

(d3) creating a message linked list to store the at least one request/response pair of the user session.

9. The method of claim 1 further including the steps of:

(f) receiving a reply from the server;

(g) comparing the reply with an expected response; and

(h) recording a result of the comparison in a log file associated with the virtual user.

10. The method of claim 9, wherein the expected response is a recorded response from a trace of the user session.

11. The method of claim 9 further including the steps of:

(i) repeating steps (d) through (h) until each request in the user session is completed; and

(j) generating a report file, wherein the report file includes load testing information regarding server throughput and total response time.

12. The method of claim 1 further including the step of:

(f) inputting run-time settings to emulate behavior of a client device, wherein the run-time settings include, think time, time out, network speed, and stagger time.

3. The method of claim I further including the steps of:

(f) receiving a reply from the server;

(g) extracting, from the reply, information that is to be used in subsequent messages, wherein the information includes any combination of state related information, cookies, and security information; and

(h)storing the extracted information in a configuration file associated with the virtual user.

4. The method of claim 3 further including the steps of:

(i) repeating steps (d) through (h) until each request of the user session has been transmitted; and

(j) updating the stored information in the configuration file.

13. A computer readable medium containing programming instructions for load testing a server, wherein the server is accessed by a plurality of client devices, comprising the instructions for:

(a) providing at least one virtual user, wherein each of the at least one virtual users simulates one of the plurality of client devices;

(b) providing a main thread to emulate a plurality of user sessions between the at least one virtual user and the server, wherein each user session includes at least one request/response pair;

(c) generating a plurality of subthreads from the main thread, wherein each subthread emulates one of the plurality of user sessions;

(d) building in each virtual user a message, wherein the message includes a request extracted from the at least one request/response pair in the one user session; and

(e) transmitting the message to the server.

14. The computer readable medium of claim 13 further including the instructions for:

(f) synchronizing each of the at least one virtual users to one another prior to the transmitting instruction (e).

15. The computer readable medium of claim 13 further including the instructions for:

(f) receiving a reply from the server;

(g) extracting, from the reply, information that is to be used in subsequent messages, wherein the information includes any combination of state related information, cookies, and security information; and

(h) storing the extracted information in a configuration file associated with the virtual user.

16. The computer readable medium of claim 15 further including the instructions for:

(i) repeating steps (d) through (h) until each request of the user session has been transmitted; and

(j) updating the stored information in the configuration file.

17. The computer readable medium of claim 13, wherein the building instruction (d) includes the instructions for:

(d1) capturing data from a real time user session between a client device and the server, wherein the captured data includes the at least one request/response pair of the user session; and

(d2) composing the message from the captured data and information stored in a configuration file associated with the virtual user, wherein the stored information includes any combination of state related information, cookies, and security information.

18. The computer readable medium of claim 17, wherein the capturing instruction (d1) further includes the instruction for:

(d1i) recording a server trace of the user session.

19. The computer readable medium of claim 17, wherein the building instruction (d) further including the instructions for:

(d3) storing the captured data in a message file;

(d4) parsing reusable data from the message file, wherein the reusable data includes the at least one request/response pair of the user session; and

(d5) providing authentication information for the virtual user including user identification and password;

wherein the message further includes the authentication information and a portion of the reusable data from the message file.

20. The computer readable medium of claim 17, wherein the building instruction (d) further includes the instruction for:

(d3) creating a message linked list to store the at least one request/response pair of the user session.

21. The computer readable medium of claim 13 further including the instructions for:

(f) receiving a reply from the server;

(g) comparing the reply with an expected response; and

(h) recording a result of the comparison in a log file associated with the virtual user.

22. The computer readable medium of claim 21, wherein the expected response is a recorded response from a trace of the user session.

23. The computer readable medium of claim 21 further including the instructions for:

(i) repeating steps (d) through (h) until each request in the user session is completed; and

(j) generating a report file, wherein the report file includes load testing information regarding server throughput and total response time.

24. The computer readable medium of claim 13 further including the instruction for:

(f) inputting run-time settings to emulate behavior of a client device, wherein the run-time settings include, think time, time out, network speed, and stagger time.

25. A system for load testing a server, wherein the server is accessed by a plurality of client devices, the system comprising:

a computer system including a processor for executing a programming application; and

memory coupled to the processor;

wherein the programming application;

provides at least one virtual user, wherein each of the at least one virtual users simulates one of the plurality of client devices;

provides a main thread to emulate a plurality of user sessions between the at least one virtual user and the server, wherein each user session includes at least one request/response pair;

generates a plurality of subthreads from the main thread, wherein each subthread emulates one of the plurality of user sessions;

builds, in each virtual user, a message, wherein the message includes a request extracted from the at least one request/response pair in the one user session; and

transmits the message to the server.

26. The system of claim 25 further including means for synchronizing each of the at least one virtual users to one another prior to the transmitting the message.

27. The system of claim 25 further including:

means for receiving a reply from the server;

wherein the programming application further;

extracts, from the reply, information that is to be used in subsequent messages, wherein the information includes any combination of state related information, cookies, and security information;

stores in the memory the extracted information in a configuration file associated with the virtual user; and

updates the information stored in the configuration file.

28. The system of claim 25 further including:

means for capturing data from a real time user session between a client device and the server, wherein the captured data includes the at least one request/response pair of the user session, wherein the programming application composes the message from the captured data and information stored in a configuration file associated with the virtual user, wherein the information includes any combination of state related information, cookies, and security information.

29. The system of claim 25, wherein the programming application provides authentication information for the virtual user including user identification and password.

30. The system of claim 25 further including:

means for receiving a reply from the server;

wherein the programming application further compares the reply with an expected response and records a result of the comparison in memory in a log file associated with the virtual user.

31. The system of claim 25, wherein, after each user session has been emulated, the programming application further generates a report file , wherein the report file includes load testing information regarding server throughput and total response time.

32. The system of claim 25 further including:

means for inputting run-time settings to emulate behavior of a client device, wherein the run-time settings include, think time, time out, network speed, and stagger time.

33. A method for load testing a server, wherein the server is accessed by a plurality of client devices, the method comprising the steps of:

(a) providing at least one virtual user, wherein each of the at least one virtual users simulates one of the plurality of client devices;

(b) providing a main thread to emulate a plurality of user sessions between the at least one virtual user and the server, wherein each user session includes at least one request/response pair;

(c) generating a plurality of subthreads from the main thread, wherein each subthread emulates one of the plurality of user sessions;

(d) providing, in each virtual user, a configuration file for storing information that is to be used in subsequent and current messages;

(e) building, in each virtual user, a message, wherein the message includes a request extracted from the at least one request/response pair in the one user session and configuration file information; and

(f) transmitting the message to the server.

34. The method of claim 33 further including the steps of:

(g) receiving a reply from the server;

(h) extracting, from the reply, configuration file information, wherein the information includes any combination of state related information, cookies, and security information; and

(i) storing the extracted information in the configuration file associated with the virtual user.

35. The method of claim 34 further including the steps of:

(j) comparing the reply with an expected response;

(k) recording a result of the comparison in a log file associated with the virtual user;

(l) repeating steps (e) through (k) until each request in the user session is completed; and

(m) generating a report file based on the log file for each virtual user, wherein the report file includes load testing information regarding server throughput and total response time.

36. A computer readable medium containing programming instructions for load testing a server, wherein the server is accessed by a plurality of client devices, comprising the programming instructions for:

(a) providing at least one virtual user, wherein each of the at least one virtual users simulates one of the plurality of client devices;

(b) providing a main thread to emulate a plurality of user sessions between the at least one virtual user and the server, wherein each user session includes at least one request/response pair;

(c) generating a plurality of subthreads from the main thread, wherein each subthread emulates one of the plurality of user sessions;

(d) providing, in each virtual user, a configuration file for storing information that is to be used in subsequent and current messages;

(e) building, in each virtual user, a message, wherein the message includes a request extracted from the at least one request/response pair in the one user session and configuration file information; and

(f) transmitting the message to the server.

37. The computer readable medium of claim 36 further including the instructions for:

(g) receiving a reply from the server;

(h) extracting, from the reply, configuration file information, wherein the information includes any combination of state related information, cookies, and security information; and

(i) storing the extracted information in the configuration file associated with the virtual user.

38. The computer readable medium of claim 37 further including the instructions for:

(j) comparing the reply with an expected response;

(k) recording a result of the comparison in a log file associated with the virtual user;

(l) repeating steps (e) through (k) until each request in the user session is completed; and

(m) generating a report file based on the log file for each virtual user, wherein the report file includes load testing information regarding server throughput and total response time.