Measuring performance of an appliance

• US 9,541,921 B2
• Filed: 12/30/2012
• Issued: 01/10/2017
• Est. Priority Date: 12/30/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hsiao, Lin Chan, Lin, Ta-Wei, Liu, Jeffrey CH, Liang, Shu-Hao, Su, Chih-Wen
• Primary Examiner(s): Le, Toan
• Assistant Examiner(s): AIELLO, JEFFREY P
• Application Number:
  US13/731,093
• Publication Number:
  US 20130173219A1
• Time in Patent Office: 1,472 Days
• Field of Search: 702/186, 702/182, 702/61, 709/224, 709/203, 709/213, 707/E17.014, 707/E17.005
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring

Abstract

A computer program product and apparatus measure performance of an information appliance. The computer program product comprises code for: a test module receiving, from a client, and recording a request for processing of a sample data by an information appliance. The test module sends the sample data received from the client to the information appliance for processing. If a request to a backend application is present, the test module also sends the request to the backend application for processing and receives and records a response from the backend application. The test module sends the response from the backend application to the information appliance for processing. A generated correlation ID is used to update a performance data table with start time and a stop time of a response for transaction sample data processed by the information appliance.

Claims

1. A computer-readable storage apparatus having a plurality of instructions embodied therein, wherein the plurality of instructions, when executed by a processor of a standalone performance measurement system (SPMS), enables the SPMS to provide the functionality of:

receiving, at a local area network adapter of the SPMS, from an external client device, a request including transaction sample data to be processed by an information appliance, wherein the SPMS is coupled to the client via the local area network adapter, and wherein the SPMS is coupled to a high speed input/output (I/O) serial bus of the information appliance;

in response to receiving the request;

sending the transaction sample data to the information appliance via the high-speed I/O serial bus to initiate a test of a performance of the information appliance, wherein the SPMS simulates and replaces a physical infrastructure architecture and a network usage environment of a target environment of the external client device during the testing of the information appliance, wherein the transaction sample data includes the sample data and is stored in a traffic data table (TDT) of the SPMS;

in response to testing the performance of the information appliance, receiving, via the high speed I/O serial bus, response data associated with the processing of the transaction sample data by the information appliance;

calculating, based on the response data, results of the performance test of the information appliance, wherein the results include a transaction quantity per second and a quantity of data processed per second; and

transmitting, to the external client device via the local area network adapter, the response data and a view of the results of the performance test which meet performance needs of a client associated with the external client device.

2. The computer-readable storage apparatus of claim 1, the plurality of instructions further comprising instructions that enable the SPMS to provide the functionality of:

generating a correlation ID and update an entry of a performance data table according to the correlation ID, wherein the performance data table includes a transaction sample data size;

in response to receiving the response data;

updating the entry of the performance data table according to the correlation ID, wherein the updates to the performance data table include at least a start time of the transaction sample data and a stop time associated with the processing of the response data by the information appliance; and

recording metadata related to the response data within the performance data table according to the correlation ID, the metadata comprising one or more of a stop time and data size of the transaction sample data and an injection rate, packet loss rate, or latency associated with the response data.

3. The computer-readable storage apparatus of claim 1, wherein the information appliance comprises a processor, a first memory, and a first I/O unit, wherein the SPMS is a system-on-card that comprises a dedicated processor, a second memory, and a second I/O unit that is connected to the high speed I/O serial bus of the information appliance, wherein the system-on-card is connected to the information appliance by inserting the system-on-card into an expansion slot of the information appliance, wherein inserting the system-on-card into an expansion slot of the information appliance interconnects the second I/O unit to the first I/O unit via the high-speed I/O serial bus.

4. The computer-readable storage apparatus of claim 1, wherein the network usage environment is simulated based on network parameters established by a network controller of a network device of the information appliance, the network parameters comprising:

an injection rate of the transaction sample data, a packet loss rate of transaction sample data, and latency of the transaction sample data, and wherein the high-speed I/O serial bus is a Peripheral Component Interconnect Express (PCIe) bus.

5. The computer-readable storage apparatus of claim 1, the plurality of instructions further comprising instructions that enable the SPMS to provide the functionality of:

sending the sample data and the request for processing of the sample data to the information appliance for processing;

determining whether a request to a backend application for processing is present; and

in response to determining a request to the backend application is present;

sending the request to the backend application for processing;

receiving a response from the backend application;

recording the response from the backend application to the TDT, wherein the transaction sample data includes the response of the backend application; and

sending the response from the backend application to the information appliance for processing.

6. The computer-readable storage apparatus of claim 2, wherein the metadata further includes at least one of an injection rate, packet loss rate, and latency associated with the response data.

7. The computer-readable storage apparatus of claim 1, the plurality of instructions further comprising instructions that enable the SPMS to provide the functionality of:

determining whether a next request has been received from the external client device for the information appliance to process a next transaction sample data; and

in response to determining the next request has been received, reinitiating the performance test of the information appliance using the next transaction sample data;

wherein the transaction quantity per second and a quantity of data processed per second are calculated based on a start time of the transaction sample data, a stop time associated with the processing of the response data by the information appliance, and a data size of the transaction sample data.

8. An information appliance, comprising:

a first memory;

a high-speed input/output (I/O) serial bus;

a first I/O unit coupled to the high-speed I/O serial bus

a first processing unit coupled to the high-speed I/O serial bus; and

a standalone performance measurement system (SPMS) coupled to the high-speed I/O serial bus via a second I/O unit, the SPMS comprising a bus, a local area network adapter and a second memory coupled to the bus and a second processing unit having processing logic executing thereon that enables the SPMS to;

receive, at the local area network adapter from an external client device, a request including transaction sample data to be processed by an information appliance;

in response to receiving the request;

send the transaction sample data to the information appliance via the high-speed I/O serial bus to initiate a test of a performance of the information appliance, wherein the SPMS simulates and replaces a physical infrastructure architecture and a network usage environment of a target environment of the external client device during the testing of the information appliance, and wherein the transaction sample data includes the sample data and is stored in a traffic data table (TDT) of the SPMS;

in response to testing the performance of the information appliance, receive, via the high-speed I/O serial bus, response data associated with the processing of the transaction sample data by the information appliance;

calculate, based on the response data, results of the performance test of the information appliance, wherein the results include a transaction quantity per second and a quantity of data processed per second; and

transmit, to the external client device via the local area network adapter, the response data and a view of the results of the performance test which meet performance needs of a client associated with the external client device.

9. The information appliance of claim 8, wherein the SPMS is a built-in unit of the information appliance.

10. The information appliance of claim 8, the processing logic further comprising logic that enables the SPMS to:

generate a correlation ID and update an entry of a performance data table according to the correlation ID, wherein the performance data table includes a transaction sample data size;

retrieve the transaction sample data from the TDT and send the transaction sample data to the information appliance for processing;

in response to receiving the response data;

update the entry of the performance data table according to the correlation ID, wherein the updates to the performance data table include at least a start time of the transaction sample data and a stop time of response of the transaction sample data processed by the information appliance; and

record metadata related to the response data within the performance data table according to the correlation ID, the metadata comprising one or more of a stop time and data size of the transaction sample data.

11. The information appliance of claim 8, wherein the SPMS is a system-on-card that is connected to the information appliance by inserting the SPMS into an expansion slot of the information appliance, wherein inserting the SPMS into an expansion slot of the information appliance interconnects the second I/O unit to the first I/O unit via the high-speed I/O serial bus, and wherein the high-speed I/O serial bus is a Peripheral Component Interconnect Express (PCIe) bus.

12. The information appliance of claim 8, the processing logic further comprising logic that enables the SPMS to:

determine whether a next request has been received from the external client device for the information appliance to process a next transaction sample data; and

in response to determining the next request has been received, reinitiate the performance test of the information appliance using the next transaction sample data;

wherein;

the network usage environment is simulated based on network parameters established by a network controller of a network device of the information appliance, the network parameters comprising;

an injection rate of the transaction sample data, a packet loss rate of transaction sample data, and latency of the transaction sample data;

the transaction quantity per second and a quantity of data processed per second are calculated based on a start time of the transaction sample data, a stop time of response of the transaction sample data processed by the information appliance, and a data size of the transaction sample data; and

the metadata further includes at least one of an injection rate, packet loss rate, or latency associated with the response data.

13. The information appliance of claim 8, the processing logic further comprising logic that enables the SPMS to:

send the sample data and the request for processing of the sample data to the information appliance for processing;

determine whether a request to a backend application for processing is present; and

in response to determining a request to the backend application is present;

send the request to the backend application for processing;

receive and record a response from the backend application to the TDT, wherein the transaction sample data includes the response of the backend application; and

send the response from the backend application to the information appliance for processing.

14. A system-on-card, comprising:

a bus;

a memory connected to the bus;

a local area network adapter coupled to the bus;

an input/output (I/O) unit coupled to the bus;

a processing unit connected to the bus; and

processing logic executing on the processing unit that enables the system-on-card to;

receive, at the local area network adapter from an external client device, a request including transaction sample data to be processed by an information appliance, wherein the information appliance comprises a processor, a first memory, and an information appliance I/O unit coupled to a high-speed I/O serial bus;

record the transaction sample data to a traffic data table (TDT) of the system-on-card;

connect the I/O unit of the system-on-card to the high-speed I/O serial bus of the information appliance;

send transaction sample data to the information appliance via the high-speed I/O serial bus to initiate a test of a performance of the information appliance, wherein the system-on-card simulates and replaces a physical infrastructure architecture and a network usage environment of a target environment of the external client device during the testing of the information appliance, and wherein the transaction sample data includes the sample data;

in response to testing the performance of the information appliance, receive, via the high-speed I/O serial bus, response data associated with the processing of the transaction sample data by the information appliance;

calculate, based on the response data, results of the performance test the information appliance, wherein the results include a transaction quantity per second and a quantity of data processed per second; and

transmit, to the external client device via the local area network adapter, the response data and a view of the results of the performance test which meet performance needs of a client associated with the external client device.

15. The system-on-card of claim 14, wherein the system-on-card is connected to the high-speed input/output (I/O) serial bus of the information appliance by inserting an additional card for use with a network device of the information appliance into an expansion slot of the information appliance, wherein inserting the system-on-card into an expansion slot of the information appliance interconnects the I/O unit to the information appliance I/O unit via the high-speed I/O serial bus.

16. The system-on-card of claim 15, wherein the high-speed I/O serial bus is a Peripheral Component Interconnect Express (PCIe) bus.

17. The system-on-card of claim 14, wherein the system-on-card is a built-in unit of the information appliance.

18. The system-on-card of claim 14, the processing logic further comprising logic that enables the system-on-card to:

generate a correlation ID and update an entry of a performance data table according to the correlation ID, wherein the performance data table includes a transaction sample data size;

retrieve the transaction sample data from the TDT and send the transaction sample data to the information appliance for processing;

in response to receiving the response to the transaction sample data;

update the entry of the performance data table according to the correlation ID, wherein the updates to the performance data table include at least a start time of the transaction sample data and a stop time of response of the transaction sample data processed by the information appliance; and

record metadata related to the response data within the performance data table according to the correlation ID, the metadata comprising one or more of a stop time and data size of the transaction sample data and an injection rate, packet loss rate, or latency associated with the response data.

19. The system-on-card of claim 14, the processing logic further comprising logic that enables the system-on-card to:

determine whether a next request has been received from the external client device for the information appliance to process a next transaction sample data; and

in response to determining the next request has been received, reinitiate the performance test of the information appliance using the next transaction sample data;

wherein;

the network usage environment is simulated based on network parameters established by a network controller of a network device of the information appliance, the network parameters comprising;

an injection rate of the transaction sample data, a packet loss rate of transaction sample data, and latency of the transaction sample data;

the metadata further includes at least one of an injection rate, packet loss rate, and latency associated with the response data; and

the transaction quantity per second and a quantity of data processed per second are calculated based on a start time of the transaction sample data, a stop time associated with processing of the response data by the information appliance, and a data size of the transaction sample data.

20. The system-on-card of claim 14, the processing logic further comprising logic that enables the system-on-card to:

send the sample data and the request for processing of the sample data to the information appliance for processing;

determine whether a request to a backend application for processing is present; and

in response to determining a request to the backend application is present;

send the request to the backend application for processing;

receive and record a response from the backend application to the TDT, wherein the transaction sample data includes the response of the backend application; and

send the response from the backend application to the information appliance for processing.