Response-time baselining and performance testing capability within a software product

• US 10,360,126 B2
• Filed: 02/02/2018
• Issued: 07/23/2019
• Est. Priority Date: 09/03/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Covell, Grant C., Schlegel, David J., Weiss, Paul W.
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Smith, Cheneca
• Application Number:
  US15/887,055
• Publication Number:
  US 20180157573A1
• Time in Patent Office: 536 Days
• Field of Search: None
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2201/865 Monitoring of software

Abstract

A method of measuring performance of a computerized system is provided. A test component integrated in a client application module is configured to generate an application specific workflow to be delivered to a computing environment of one or more computing devices for measuring the performance of the computerized system. The integrated test component of the client application module is executed to deliver the application specific workflow to a server system in the computing environment. Performance data is collected based on at least one response received from the computing environment to measure the performance of the computerized system.

Claims

1. A method of measuring performance of a computerized system comprising:

configuring a test component to generate an application specific workflow including a plurality of requests to be delivered to a computing environment of one or more computing devices to conduct a performance test for measuring the performance of the computerized system, wherein the computing environment operates in a live mode of operation and utilizes live processing to process requests from live workflows, wherein the test component is integrated in an application installed on the computing environment operating in the live mode of operation, and wherein configuring the test component comprises;

adjusting parameters to specify secure user IDs, simulated users, and configure a read-only test for the application specific workflow including an access restriction to production data for the application;

executing the integrated test component of the application to deliver the application specific workflow to the computing environment during the live mode of operation of the computing environment, wherein the plurality of requests of the application specific workflow from the integrated test component conduct the performance test and are processed as live requests along with requests from the live workflows by live processing of the computing environment to produce responses to the plurality of requests conducting the performance test; and

collecting performance data based on at least one response received from the computing environment as a result of the live processing of the application specific workflow from the integrated test component to measure the performance of the computerized system from execution of the application specific workflow during the live mode of operation.

2. The method of claim 1, wherein the one or more computing devices include a client system and a server system, and measuring the performance of the computerized system comprises:

generating the application specific workflow by sending the plurality of requests to the computing environment;

measuring response times for receiving responses to the plurality of requests from the computing environment and calculating the performance data; and

processing the performance data and sending the processed performance data to the server system.

3. The method of claim 2, further comprising:

authorizing the client system to enable execution of the integrated test component to measure the performance of the computerized system.

4. The method of claim 1, wherein configuring the test component comprises:

adjusting parameters of the application specific workflow for a desired performance measurement.

5. The method of claim 1, wherein configuring the test component comprises:

adjusting one or more parameters to alter at least one condition for execution of the application specific workflow.

6. The method of claim 5, wherein the at least one condition includes an access restriction to production data for the application.

7. The method of claim 1, wherein executing the integrated test component comprises:

executing the application specific workflow and measuring the performance of the computerized system in accordance with one or more from a group of a constant execution, a periodic time interval, and a time schedule.

8. The method of claim 1, wherein the application specific workflow is associated with a transaction, and measuring performance of the computerized system comprises:

measuring changes in performance of the transaction during a time interval.

9. The method of claim 1, further comprising:

resetting the one or more computing devices to a state occurring prior to execution of the application specific workflow.

10. The method of claim 1, further comprising:

monitoring execution of the application specific workflow to provide results of the measured performance of the computerized system.

11. A computer system for measuring performance of a computerized system comprising:

at least one processor configured to;

configure a test component to generate an application specific workflow including a plurality of requests to be delivered to a computing environment of one or more computing devices to conduct a performance test for measuring the performance of the computerized system, wherein the computing environment operates in a live mode of operation and utilizes live processing to process requests from live workflows, wherein the test component is integrated in an application installed on the computing environment operating in the live mode of operation, and wherein configuring the test component comprises;

adjusting parameters to specify secure user IDs, simulated users, and configure a read-only test for the application specific workflow including an access restriction to production data for the application;

execute the integrated test component of the application to deliver the application specific workflow to the computing environment during the live mode of operation of the computing environment, wherein the plurality of requests of the application specific workflow from the integrated test component conduct the performance test and are processed as live requests along with requests from the live workflows by live processing of the computing environment to produce responses to the plurality of requests conducting the performance test; and

collect performance data based on at least one response received from the computing environment as a result of the live processing of the application specific workflow from the integrated test component to measure the performance of the computerized system from execution of the application specific workflow during the live mode of operation.

12. The computer system of claim 11, wherein the one or more computing devices include a client system and a server system, and measuring the performance of the computerized system comprises:

generating the application specific workflow by sending the plurality of requests to the computing environment;

measuring response times for receiving responses to the plurality of requests from the computing environment and calculating the performance data; and

processing the performance data and sending the processed performance data to the server system.

13. The computer system of claim 12, wherein the at least one processor is further configured to:

authorize the client system to enable execution of the integrated test component to measure the performance of the computerized system.

14. The computer system of claim 11, wherein the at least one processor is further configured to:

adjust parameters of the application specific workflow for a desired performance measurement; and

adjust one or more parameters to alter at least one condition for execution of the application specific workflow, wherein the at least one condition includes an access restriction to production data for the application.

15. The computer system of claim 11, wherein the at least one processor is further configured to:

execute the application specific workflow and measure the performance of the computerized system in accordance with one or more from a group of a constant execution, a periodic time interval, and a time schedule.

16. The computer system of claim 11, wherein the application specific workflow is associated with a transaction, and

wherein the at least one processor is further configured to:

measure changes in performance of the transaction during a time interval;

reset the one or more computing devices to a state occurring prior to execution of the application specific workflow; and

monitor execution of the application specific workflow to provide results of the measured performance of the computerized system.

17. A computer program product for measuring performance of a computerized system comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising computer readable program code configured to;

configure a test component to generate an application specific workflow including a plurality of requests to be delivered to a computing environment of one or more computing devices to conduct a performance test for measuring the performance of the computerized system, wherein the computing environment operates in a live mode of operation and utilizes live processing to process requests from live workflows, wherein the test component is integrated in an application installed on the computing environment operating in the live mode of operation, and wherein configuring the test component comprises;

adjusting parameters to specify secure user IDs, simulated users, and configure a read-only test for the application specific workflow including an access restriction to production data for the application;

execute the integrated test component of the application to deliver the application specific workflow to the computing environment during the live mode of operation of the computing environment, wherein the plurality of requests of the application specific workflow from the integrated test component conduct the performance test and are processed as live requests along with requests from the live workflows by live processing of the computing environment to produce responses to the plurality of requests conducting the performance test; and

collect performance data based on at least one response received from the computing environment as a result of the live processing of the application specific workflow from the integrated test component to measure the performance of the computerized system from execution of the application specific workflow during the live mode of operation.

18. The computer program product of claim 17, wherein the one or more computing devices include a client system and a server system, and measuring the performance of the computerized system comprises:

generating the application specific workflow by sending the plurality of requests to the computing environment;

measuring response times for receiving responses to the plurality of requests from the computing environment and calculating the performance data; and

processing the performance data and sending the processed performance data to the server system.

19. The computer program product of claim 18, wherein the computer readable program code is further configured to:

authorize the client system to enable execution of the integrated test component to measure the performance of the computerized system;

adjust parameters of the application specific workflow for a desired performance measurement;

adjust one or more parameters to alter at least one condition for execution of the application specific workflow, wherein the at least one condition includes an access restriction to production data for the application; and

execute the application specific workflow and measure the performance of the computerized system in accordance with one or more from a group of a constant execution, a periodic time interval, and a time schedule.

20. The computer program product of claim 17, wherein the application specific workflow is associated with a transaction and the computer readable program code is further configured to:

measure changes in performance of the transaction during a time interval;

reset the one or more computing devices to a state occurring prior to execution of the application specific workflow; and

monitor execution of the application specific workflow to provide results of the measured performance of the computerized system.