Resource monitoring

• US 8,615,739 B2
• Filed: 04/23/2009
• Issued: 12/24/2013
• Est. Priority Date: 04/23/2009
• Status: Active Grant

• Current Assignee: Micro Focus LLC (Open Text Corporation)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Nir, Dor, Saaroni, Dror, Cohen, Ayal
• Primary Examiner(s): Wong, Don
• Assistant Examiner(s): Wu, Daxin
• Application Number:
  US12/428,733
• Publication Number:
  US 20100275184A1
• Time in Patent Office: 1,706 Days
• Field of Search: None
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

Monitoring resources of a computing device during testing of software applications provides useful feedback to developers and implementers of the software application. By periodically collecting system counter data during automated testing of the software application, and correlating the collected data to a state of the test, the actions of the test causing any undesirable resource issues can be readily identified.

Claims

1. A method of monitoring resources of a computing device, comprising:

performing an automated test on a software application, wherein the automated test comprises a sequence of steps to cause a processor of the computing device to provide input to the application under test;

periodically collecting system counter data for the application under test for a period of the automated test;

correlating the collected system counter data with a step of the automated test being performed at a time the system counter data was collected;

providing a graph comprising one or more traces of data values of system counters of the collected system counter data and comprising an index of results obtained during steps of the automated test;

in response to selecting a position within the one or more traces of data values, providing an indication in the index of results of a particular result corresponding to a step of the automated test that occurred at the selected position; and

in response to selecting a result within the index of results, providing an indication in the one or more traces of data values of where a step of the automated test corresponding to the selected result occurred.

2. The method of claim 1, further comprising selecting system counters for which data is to be periodically collected.

3. The method of claim 2, wherein selecting system counters for which data is to be periodically collected comprises selecting system counters from all system counters available in an operating system of the computing device.

4. The method of claim 1, further comprising displaying a data value for a system counter in response to placing a cursor over a trace of the data for that system counter.

5. The method of claim 1, further comprising:

defining a limit for at least one system counter for which data is being collected; and

deeming the automated test failed if the system counter data for the at least one system counter exceeds its limit while performing the automated test.

6. A method of monitoring resources of a computing device, comprising:

defining an automated test for a software application, wherein the automated test comprises a sequence of steps to cause a processor of the computing device to provide input to the software application;

selecting system counters for monitoring during the automated test;

performing the automated test on the software application;

periodically collecting selected system counter data for the application under test; and

providing output of the collected system counter data correlated to a step of the automated test being performed at a time the system counter data was collected;

in response to selecting data of the collected system counter data from the output, providing an indication of a particular step of the automated test that occurred when the selected data was collected; and

in response to selecting a step of the automated test from the output, providing an indication of data of the collected system counter data that was collected at a time of the selected step.

7. The method of claim 6, wherein defining an automated test for a software application comprises defining a sequence of steps to be performed on the software application to simulate user input to the software application.

8. The method of claim 6, wherein selecting system counters for monitoring comprises selecting system counters from a predefined list of system counters.

9. The method of claim 6, further comprising:

defining limits for one or more of the selected system counters; and

deeming the automated test failed in a collected data value for any system counter exceeds its limit during the automated test.

10. A computing device, comprising:

a processor; and

a storage media containing machine-readable instructions adapted to cause the processor to perform a method of testing a software application by the computing device, comprising;

selecting system counters for the software application for monitoring;

performing an automated test on the software application, wherein the automated test comprises a sequence of steps to cause the processor to provide input to the software application;

periodically collecting data from the selected system counters during the automated test;

providing output of the collected system counter data correlated to a step of the automated test being performed at a time the system counter data was collected;

in response to selecting data of the collected system counter data from the output, providing an indication of a particular step of the automated test that occurred when the selected data was collected; and

in response to selecting a step of the automated test from the output, providing an indication of data of the collected system counter data that was collected at a time of the selected step.

11. The computing device of claim 10, wherein the storage media further contains the software application to be tested.

12. The computing device of claim 10, wherein the method further comprises defining the automated test comprising a sequence of steps to simulate user input to the computing device while running the software application.

13. The computing device of claim 12, wherein providing output of the collected system counter data correlated to a step of the automated test comprises providing output of the collected system counter data correlated to a step of the automated test being performed at a time of data collection.

14. The computing device of claim 10, wherein providing output of the collected system counter data correlated to a step of the automated test comprises providing interactive output of the collected system counter data.

15. A computer system, comprising:

means for testing a software application by the computer system, wherein testing the software application comprises performing a sequence of steps to cause a processor of the computer system to provide input to the software application;

means for collecting system counter data for the application under test;

means for correlating the collected system counter data to a step of the test being performed at a time of data collection;

means for providing interactive output of the correlated system counter data;

means for providing an indication of a step of the test being performed when particular data of the collected system counter data was collected in response to selecting the particular data from the interactive output; and

means for providing an indication of data of the collected system counter data that was collected at a time of a particular step of the test being performed in response to selecting the particular step from the interactive output.

16. The computer system of claim 15, wherein the means for collecting system counter data for the application under test further comprises means for selecting which system counters of the computer system for the software application will be monitored.

17. The computer system of claim 15, further comprising means for defining limits for the collected system counter data and for providing an indication of failure if a limit is exceeded for any of the collected system counter data.

18. The computer system of claim 15, wherein the means for providing interactive output of the correlated system counter data comprises means for identifying a step of the test being performed at the time of data collection for the collected system counter data.