Software test and performance monitoring system

• US 20060129992A1
• Filed: 11/10/2005
• Published: 06/15/2006
• Est. Priority Date: 11/10/2004
• Status: Abandoned Application

• Current Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Original Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Inventors: Lutz, Michael, Oberholtzer, Brian K.
• Application Number:
  US11/271,249
• Publication Number:
  US 20060129992A1
• Time in Patent Office: Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3428 Benchmarking
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: G06F 2201/88 Monitoring involving counting

Abstract

A quality assurance benchmark system tests a target executable application under load stress conditions over an extended period of time. The system has user-controlled parameters to benchmark performance, scalability, and regression testing before deploying the application to customers. The system includes a display processor and a test unit. The display processor generates data representing a display image enabling a user to select: input parameters to be provided to the target executable application, and output data items to be received from the target executable application and associated expected range values of the data items. The test unit provides multiple concurrently operating executable procedures for interfacing with the target executable application to provide the input parameters to the target executable application, and to determine whether data items received from the target executable application are within corresponding associated expected range values of the data items.

Claims

1. A system for testing an executable application, comprising:

a display processor for generating data representing a display image enabling a user to select,

input parameters to be provided to a target executable application; and

output data items to be received from the target executable application and associated expected range values of the output data items; and

a test unit providing a plurality of concurrently operating executable procedures for interfacing with the target executable application to provide the input parameters to the target executable application and to determine whether the output data items received from the target executable application are within corresponding associated expected range values of the output data items.

2. A system according to claim 1, wherein

the plurality of concurrently operating executable procedures simulate a plurality of users concurrently using the target executable application.

3. A system according to claim 1, further comprising:

a performance monitor for determining whether operational characteristics comprising at least one of, (a) response time, (b) processor utilization, and (c) memory utilization, of the target executable application are within acceptable predetermined thresholds.

4. A system according to claim 3, wherein the performance monitor further comprises:

a performance data helper (PDH) application programming interface (API).

5. A system according to claim 1, further comprising:

a log file for recording at least one of the following;

input parameters, output data items, and expected range values.

6. A system according to claim 1, wherein the input parameters further comprise:

at least one of the following;

a number of users simulated by the system, iterations providing a total number of calls per thread, call wait time between individual calls, and constant or random test frequency between individual calls.

7. A system according to claim 6, wherein the input parameters further comprise:

at least one of the following;

a total number of times that the system performs a plurality of tests, and a time delay between completion of the plurality of tests.

8. A system according to claim 1, wherein the executable procedures further comprise a plug-in.

9. A system according to claim 8, wherein a plurality of plug-ins are stored in a dynamic link library (DLL).

10. A system according to claim 1, wherein the input parameters further comprise:

custom configuration settings associated with at least one particular executable procedure of the plurality of concurrently operating executable procedures.

11. A system according to claim 1, wherein the executable procedures further comprise:

component object model (COM) objects.

12. A system according to claim 11, wherein the component object model (COM) objects are self-registering.

13. A system according to claim 1, wherein the plurality of concurrently operating executable procedures perform repeatable regression testing.

14. A method for testing an executable application, comprising the steps of:

providing a dynamic link library (DLL);

providing at least one plug-in, representing at least one executable procedure, for storage in the DLL;

providing at least one input parameter for the at least one plug-in; and

testing a target executable application in response to the plug-in.

15. A method according to claim 14 further comprising the steps of:

receiving at least one output data items from the target executable application.

16. A method according to claim 14 wherein the at least one plug-in simulates a plurality of users concurrently using the target executable application.

17. A method according to claim 14, wherein the input parameters further comprise:

at least one of the following;

a number of users simulated by the system, iterations providing a total number of calls per thread, call wait time between individual calls, and constant or random test frequency between individual calls.

18. A method according to claim 17, wherein the input parameters further comprise:

at least one of the following;

a total number of times that the system performs a plurality of tests, and a time delay between completion of the plurality of tests.

19. A method according to claim 14, wherein the input parameters further comprise:

custom configuration settings associated with at least one particular plug-in.

20. A method according to claim 14, wherein with the at least one plug-in further comprises:

a component object model (COM) object.