Measuring performance of an appliance

• US 9,811,080 B2
• Filed: 02/28/2013
• Issued: 11/07/2017
• Est. Priority Date: 12/30/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lin, Ta-Wei, Liu, Jeffrey C H, Hsiao, Lin Chan, Liang, Shu-Hao, Su, Chih-Wen
• Primary Examiner(s): Breene, John
• Assistant Examiner(s): Aiello, Jeffrey
• Application Number:
  US13/781,736
• Publication Number:
  US 20140081589A1
• Time in Patent Office: 1,713 Days
• Field of Search: 702186, 709203, 709224
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring

Abstract

A method that measures performance of an information appliance comprises a test module receiving, from a client, and recording a request for processing of a sample data by an information appliance. The test module sends the sample data received from the client to the information appliance for processing. If a request to a backend application is present, the test module also sends the request to the backend application for processing and receives and records a response from the backend application. The test module sends the response from the backend application to the information appliance for processing. A generated correlation ID is used to update a performance data table with start time and a stop time of a response for transaction sample data processed by the information appliance.

Claims

1. A method for measuring performance of an information appliance for a target environment of an external client device, the method comprising:

a test module of a standalone performance measurement system (SPMS) receiving, at a local area network adapter of the SPMS from an external client device associated with a client, a request including transaction sample data to be processed by the information appliance, wherein the SPMS is coupled to the external client device via the local area network adapter wherein the information appliance comprises a processor, a first memory, and a first input/output (I/O) unit, and wherein the SPMS is a system-on-card that comprises a dedicated processor, a second memory, and a second I/O unit that is coupled to a high-speed I/O serial bus of the information appliance;

in response to receiving the transaction sample data, the test module recording the transaction sample data in a traffic data table (TDT) of the test module;

the test module injecting the transaction sample data to the information appliance via the high-speed I/O serial bus to initiate a test of a performance of the information appliance;

during the testing of the information appliance, the test module locally simulating a physical infrastructure architecture and a network usage environment of the target environment of the external client device, wherein the simulated infrastructure architecture replaces the physical infrastructure architecture during the testing of the information appliance;

in response to testing the performance of the internet appliance, the test module receiving, via the high-speed I/O serial bus, response data associated with the processing of the transaction sample data by the information appliance;

the test module calculating, for the target environment and based on the response data, results of the performance test of a network device of the information appliance, wherein the results include a transaction quantity per second and a quantity of data processed per second; and

transmitting, to the external client device via the local area network adapter, the response data and a view of the results of the performance test which meet performance needs of the client.

2. The method of claim 1, wherein:

testing the performance of the internet appliance further comprises;

the test module generating a correlation ID and updating an entry of a performance data table (PDT) with the correlation ID; and

the method further comprises;

in response to receiving the response data;

the test module updating the entry of the PDT corresponding to the correlation ID, wherein the updates to the PDT include at least a start time of the transaction sample data and a stop time associated with the processing of the response data; and

the test module recording metadata related to the response data within the PDT according to the correlation ID, the metadata comprising one or more of a stop time and data size of the transaction sample data.

3. The method of claim 2, wherein the PDT includes transaction sample data size.

4. The method of claim 1, wherein the SPMS further comprises a local area network (LAN) adapter that is utilized to communicate with an external device via a network cable.

5. The method of claim 2, wherein:

the SPMS comprises program code that is executed by the processor to perform a performance testing of the information appliance, the program code providing;

a traffic loading module (TLM) for collecting and recording the traffic and for creating and storing the TDT;

a performance measurement module (PMM) for performing a performance test and that creates and stores the PDT;

a sending module; and

a receiving module.

6. The method of claim 5, further comprising:

the PMM retrieving transaction sample data from the TDT; and

the PMM injecting the retrieved transaction sample data into the information appliance.

7. The method of claim 6, wherein:

the transaction sample data is sent from the sending module of the test module via the high-speed I/O serial bus to the information appliance for processing; and

the method further comprises;

receiving a response related to the request; and

correlating the request with the related response.

8. The method of claim 2, further comprising:

recording a start time within the PDT associated with the correlation ID;

instructing the sending module to retrieve a test data from the TDT and to begin sending the test data to the information appliance; and

receiving, via the traffic receiving module, a response from the information appliance, after the information appliance has finished processing the test data;

wherein the metadata further comprises at least one of an injection rate, packet loss rate, or latency associated with the response data.

9. The method of claim 2, further comprising,

the test module sending the transaction sample data and the request for processing of the sample data to the information appliance for processing;

the test module determining whether a request to a backend application for processing is present; and

in response to determining a request to the backend application is present, the test module;

sending the request to the backend application for processing;

receiving and recording a response from the backend application to the TDT, wherein the transaction sample data includes the response from the backend application; and

sending the response from the backend application to the information appliance for processing.

10. The method of claim 4, wherein the system-on-card is connected to the information appliance by inserting the system-on-card into an expansion slot of the information appliance, and wherein inserting the system-on-card into an expansion slot of the information appliance interconnects the second I/O unit to the first I/O unit via the high-speed I/O serial bus.

11. The method of claim 1, wherein the SPMS is a built-in unit of the information appliance.

12. The method of claim 1, wherein the network usage environment is simulated based on network parameters established by a network controller of a network device of the information appliance, the network parameters comprising:

an injection rate of the transaction sample data, a packet loss rate of transaction sample data, and latency of the transaction sample data.

13. The method of claim 1, wherein the transaction quantity per second and a quantity of data processed per second are calculated based on a start time of the transaction sample data, a stop time associated with the processing of the response data, and a data size of the transaction sample data.

14. The method of claim 1, wherein the infrastructure architecture comprises a network having at least one network server.

15. The method of claim 1, wherein the high-speed I/O serial bus is a Peripheral Component Interconnect Express (PCIe) bus.

16. The method of claim 1, further comprising:

determining whether a next request has been received from the external client device, wherein the next request includes a next transaction sample data to be processed by the information appliance; and

in response to determining the next request has been received, reinitiating the performance test of the information appliance using the next transaction sample data.

17. The method of claim 1, wherein the high-speed I/O serial bus provides a greater communications bandwidth than the local area network adapter.