Testing usability of a software program

• US 7,673,287 B2
• Filed: 10/11/2005
• Issued: 03/02/2010
• Est. Priority Date: 10/11/2005
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Weber-Schaefer, Ute, Mayer-Ullmann, Dietrich, Held, Theo
• Primary Examiner(s): Bullock, Jr.; Lewis A
• Assistant Examiner(s): Pan; Hang
• Application Number:
  US11/247,971
• Publication Number:
  US 20070083854A1
• Time in Patent Office: 1,603 Days
• Field of Search: 717/124, 717/128, 703/22
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3696 Methods or tools to render software testable
• CPC Class Codes: G06F 8/73 Program documentation

Abstract

Usability of a software program can be tested by generating a first electronic record of input events that a user executes with at least one input device during a test session. The operations comprise applying the generated first electronic record to a predictive model to generate a prediction for performing the predefined task. Usability of a software program can be tested by registering input events that a user executes with at least one input device during a test session in which the user performs a predefined task of a software program. The operations comprise generating a first electronic record associated with the test session. The first electronic record includes at least one characteristic of the registered input events and a prediction for performing the predefined task. The prediction is generated by applying the registered input events to a predictive model.

Claims

1. A method for testing usability of a software program, the method comprising:

analyzing code of first and second versions of the software program for possible input events;

generating calibration data assigning an identical unique identifier of a predefined task to specific input events from among the possible input events in the first and second versions of the software program;

registering first input events from among the specific input events that a user executes with at least one input device during a test session in which the user performs the predefined task in the first version of the software program;

generating a first electronic output record associated with the test session for the first version of the software program, the first electronic record including at least one characteristic of the registered first input events and a first prediction for performing the predefined task generated by applying the registered first input events to a predictive model;

registering second input events from among the specific input events that a user executes with at least one input device during the test session in which the user performs the predefined task in the second version of the software program;

generating a second electronic output record associated with the test session for the second version of the software program, the second electronic record including the characteristic of the registered second input events and a second prediction for performing the predefined task generated by applying the registered second input events to the predictive model; and

comparing the first and second electronic output records using the identical unique identifiers of the first and second input events.

2. The method of claim 1, further comprising recording the calibration data in a configuration file.

3. The method of claim 1, further comprising displaying results from the comparison of the first and second electronic output records in a graph.

4. The method of claim 1, further comprising aggregating test results from the first and second input events from different users.

5. The method of claim 1, wherein the predictive model is a Goals, Operators, Methods, Selection rules (GOMS) model.

6. The method of claim 1, wherein the first and second predictions are predicted times for performing the predefined task, and wherein the characteristic of the registered first and second input events is an actual time the user takes to perform the predefined task.

7. The method of claim 6, further comprising determining that an amount of idle time has elapsed during the actual time that is greater than a maximum idle time and, in response to the determination, deducting the idle time from the actual time.

8. The method of claim 1, wherein the first and second predictions are predicted numbers of input events for performing the predefined task, and wherein the characteristic of the registered first and second input events is an actual number of the registered first and second input events.

9. The method of claim 1, wherein the predefined task is performed under guidance of a graphical user interface based on coding, and wherein the method further comprises analyzing the coding to determine the characteristic.

10. A computer program product tangibly embodied in a computer-readable medium, the computer program product including instructions that, when executed, cause a processor to perform operations comprising:

analyzing code of first and second versions of the software program for possible input events;

generating calibration data assigning an identical unique identifier of a predefined task to specific input events from among the possible input events in the first and second versions of the software program;

registering first input events from among the specific input events that a user executes with at least one input device during a test session in which the user performs the predefined task in the first version of the software program;

generating a first electronic output record associated with the test session for the first version of the software program, the first electronic record including at least one characteristic of the registered first input events and a first prediction for performing the predefined task generated by applying the registered first input events to a predictive model;

registering second input events from among the specific input events that a user executes with at least one input device during the test session in which the user performs the predefined task in the second version of the software program;

generating a second electronic output record associated with the test session for the second version of the software program, the second electronic record including the characteristic of the registered second input events and a second prediction for performing the predefined task generated by applying the registered second input events to the predictive model; and

comparing the first and second electronic output records using the identical unique identifiers of the first and second input events.

11. The computer program product of claim 10, wherein the operations further comprise recording the calibration data in a configuration file.

12. The computer program product of claim 10, wherein the operations further comprise displaying results from the comparison of the first and second electronic output records in a graph.

13. The computer program product of claim 10, wherein the operations further comprise aggregating test results from the first and second input events from different users.

14. The computer program product of claim 10, wherein the predictive model is a Goals, Operators, Methods, Selection rules (GOMS) model.

15. The computer program product of claim 10, wherein the first and second predictions are predicted times for performing the predefined task, and wherein the characteristic of the registered first and second input events is an actual time the user takes to perform the predefined task.

16. The computer program product of claim 10, wherein the operations further comprise determining that an amount of idle time has elapsed during the actual time that is greater than a maximum idle time and, in response to the determination, deducting the idle time from the actual time.

17. The computer program product of claim 10, wherein the first and second predictions are predicted numbers of input events for performing the predefined task, and wherein the characteristic of the registered first and second input events is an actual number of the registered first and second input events.

18. The computer program product of claim 10, wherein the predefined task is performed under guidance of a graphical user interface based on coding, and wherein the operations further comprise analyzing the coding to determine the characteristic.