Statistical method for estimating the performances of computer systems

• US 20030236878A1
• Filed: 08/28/2002
• Published: 12/25/2003
• Est. Priority Date: 06/19/2002
• Status: Abandoned Application

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Egi, Masashi
• Application Number:
  US10/229,117
• Publication Number:
  US 20030236878A1
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A statistical method is developed for efficiently evaluating the response performance of one or more applications, which run in a computer system, under various utilization conditions and within a limited number of experiments. When making multiple load tests corresponding to various application utilization conditions, the method uses a performance monitor tool or a network monitor tool appended to an operating system with a load being applied to the system to first determine the numerical amount of the utilization of applications, numerical amount of the response performance of applications, numerical amount of the utilization of hardware resources, and numerical amount of the response times of hardware resources. Then, estimation expressions are created which describe the dependence among numerical amounts to evaluate the response performance of applications using the estimation expressions.

Claims

1. A method for estimating response performance of NAs (Network Applications) for use in a computer system infrastructure composed of a plurality of servers and network-connected devices connecting the servers,

wherein, while allowing said plurality of NAs to share system resources, a plurality of server processes operating on the same or different servers perform operation on a plurality of NAs coordinating one another over a network to provide functions, said method comprising the steps of:

(a) obtaining numerical information by making a load test that assumes various utilization, said numerical information including;

numerical information T1 on end-to-end response times of the NAs;

numerical information U1 on utilization of the NAs;

numerical information T2 on response times of the server processes;

numerical information U2 on utilization of the server processes;

numerical information T3 on transmission times of the network-connected devices;

numerical information U3 on utilization of the network-connected devices;

numerical information T4 on processing times of system resources of the servers; and

numerical information U4 on utilization of system resources of the servers;

(b) creating mathematical models based on the numerical information obtained in said step (a), the mathematical models describing;

dependence among T1, T2, T3, and T4;

dependence among U1, U2, U3, and U4;

dependence between T4 and U4; and

dependence between T3 and U3; and

(c) estimating the response performance of any of the NAs under any utilization condition by combining the mathematical models created in said step (b).

2. The method for estimating response performance of NAs according to claim 1 wherein, in said step (a), a method of experimental design is used to optimize a number of experiments.

3. The method for estimating response performance of NAS according to claim 1 wherein, when at least one mathematical model describing dependence is known in said step (b), said known mathematical model is used.

4. The method for estimating response performance of NAs according to claim 1, further comprising the step of, when the response performance of the NAs does not satisfy a criterion as a result of said step (c), identifying a server process or a network-connected device using the mathematical models, said server process or network-connected device being a major cause of not satisfying the criterion.

5. A method for estimating response performance of NAs for use in a computer system infrastructure composed of a plurality of servers and network-connected devices connecting the servers,

wherein, while allowing said plurality of NAs to share system resources, a plurality of server processes operating on the same or different servers perform operation on a plurality of NAs coordinating one another over a network to provide functions, said method comprising the steps of:

(a) obtaining numerical information by making a load test that assumes various utilization, said numerical information including;

numerical information on end-to-end response times of the NAs;

numerical information on utilization of the NAs;

numerical information on response times of the server processes;

numerical information on utilization of the server processes;

numerical information on transmission times of the network-connected devices;

numerical information on utilization of the network-connected devices;

numerical information on processing times of system resources of the servers; and

numerical information on utilization of system resources of the servers;

(b) creating mathematical models based on the numerical information obtained in said step (a), the mathematical models describing dependence among the numerical information; and

(c) estimating the response performance of any of the NAs under any utilization condition using the mathematical models obtained in said step (b).

6. The method for estimating response performance of NAs according to claim 5 wherein, in said step (a), a method of experimental design is used to optimize a number of experiments.

7. The method for estimating response performance of NAs according to claim 5 wherein, when at least one mathematical model describing dependence is known in said step (b), said known mathematical model is used.

8. The method for estimating response performance of NAs according to claim 5, further comprising the step of, when the response performance of the NAs does not satisfy a criterion as a result of said step (c), identifying a server process or a network-connected device using the mathematical models, said server process or network-connected device being a major cause of not satisfying the criterion.