Computer system and computer implemented process for performing user-defined tests of a client-server system with run time compilation of test results

• US 6,249,886 B1
• Filed: 10/17/1997
• Issued: 06/19/2001
• Est. Priority Date: 10/17/1997
• Status: Expired due to Fees

• Current Assignee: Ramsesh S. Kalkunte
• Original Assignee: Ramsesh S. Kalkunte
• Inventors: Kalkunte, Ramsesh S.
• Primary Examiner(s): Wright, Norman M.
• Application Number:
  US08/953,582
• Time in Patent Office: 1,341 Days
• Field of Search: 714/47, 714/46, 714/39, 714/26, 714/25, 714/745, 714/741, 714/45, 714/4, 714/32, 714/38, 714/48
• US Class Current: 714/47.3
• CPC Class Codes: G06F 11/008 Reliability or availability analysis
• CPC Class Codes: G06F 11/32 with visual or acoustical indication of the functioning of the machine
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: G06F 2201/88 Monitoring involving counting

Abstract

The present invention provides a client application to measure the performance, reliability or security of a system under test, based on user-defined loads to be applied to the system under test. In the present invention, a test may be performed simultaneously on several servers and applications. As the test progresses, results are compiled during run time and visual feedback is provided. By allowing a user to define the test, and by providing run time compilation of results, the present invention can be used for capacity planning. Stopped or truncated tests still provide relevant results. The application also may allow acceptance criteria to be analyzed during the run time of test. Finally, the number of users simulated may be regulated by the application.

Claims

1. A process for externally testing a computer system, comprising steps of:

issuing, over a period of time, a plurality of requests to the computer system;

receiving, over the period of time, a plurality of responses from the computer system corresponding to each of the plurality of requests;

monitoring an elapsed time between issuance of at least one request and receipt of at least one response corresponding to the at least one request and whether the at least one response was successful;

generating, at first intervals during the period of time, performance and reliability metrics for each at least one response based upon the step of monitoring; and

compiling and displaying, at second intervals during the period of time, a summary of performance and reliability results based upon the performance and reliability metrics.

2. The process of claim 1, further comprising steps of:

establishing acceptance criteria related to the performance and reliability of results; and

notifying a user when the performance and reliability of results fails to meet the acceptance criteria.

3. The process of claim 2, wherein the step of issuing the plurality of requests includes a step of simulating a plurality of users, each of which issue a request;

and

wherein the process further comprises a step of terminating simulation of one of the plurality of users when certain conditions occur in connection with a response corresponding to the request issued by the one of the plurality of users.

4. The process of claim 1, wherein the computer system includes a client and a server, and wherein the step of issuing the plurality of requests includes a step of issuing the plurality of requests to the server from the client.

5. The process of claim 4, wherein the step of receiving the plurality of responses includes a step of receiving, on the client, the plurality of responses of the server to the plurality of requests.

6. The process of claim 5, wherein the step of monitoring includes a step of performing the monitoring on the client.

7. The process of claim 1, wherein the computer system includes a plurality of clients and a server, and wherein the step of issuing the plurality of requests includes simulating a plurality of users on different clients that each issue at least one of the plurality of requests to the server.

8. The process of claim 1, further comprising steps of:

establishing acceptance criteria related to the performance and reliability of results; and

automatically terminating the testing of the computer system when the step of generating performance and reliability metrics indicates that the performance and reliability results cannot meet the acceptance criteria.