Method, system and program for performing remote usability testing

• US 6,526,526 B1
• Filed: 11/09/1999
• Issued: 02/25/2003
• Est. Priority Date: 11/09/1999
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Tannenbaum, Alan Richard, Dong, Jianming, Mullaly, John Martin, Martin, Shirley Lynn
• Primary Examiner(s): BADERMAN, SCOTT T
• Application Number:
  US09/436,425
• Time in Patent Office: 1,204 Days
• Field of Search: 714/46, 345/748, 345/752, 345/808, 345/809, 709/224, 717/125
• US Class Current: 714/46
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet

Abstract

A method, system and program for performing remote automated usability testing of a software application utilizing a data processing system connected within a network. In accordance with the method, system and program of the present invention, a user is provided with an automated usability test for a particular software application, wherein the automated usability test is to be activated while the particular software application is running utilizing a data processing system connected within a network. The user is prompted to perform particular tasks, in response to activation of the automated usability test while the software application is running. Data indicating the usability of the software application is gathered through user responses to the promptings. The gathered data is automatically sent to a data collection location at a remote site within the network, such that usability test data from multiple data processing systems in multiple remote user environments is gathered at a location remote from the multiple data processing systems.

Claims

1. A method for performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said method comprising the steps of:

providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

gathering data indicating the usability of said software application through user responses to said promptings;

automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

activating said automated usability test while said software application is running, in response to a non-user input; and

utilizing a remote trigger input to activate said automated usability test while said software application is running, where said remote trigger is a data input received from said network.

2. The method of performing remote automated usability testing according to claim 1, said method further comprising the step of:

activating said automated usability test while said software application is running, in response to a user input.

3. The method for performing remote automated usability testing according to claim 1, said step of gathering data indicating the usability of said software application through user responses to said promptings, further comprising the step of:

recording indirect data detected in response to said user interacting with said software application into a textual format.

4. The method for performing remote automated usability testing according to claim 1, said step of automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems, further comprising the step of:

sending an electronic mail providing said gathered data to an electronic mail address representing said data collection location.

5. A method for performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said method comprising the steps of:

providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

gathering data indicating the usability of said software application through user responses to said promptings;

automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

activating said automated usability test while said software application is running, in response to a non-user input; and

utilizing a time trigger input to activate said automated usability test while said software application is running, where said time trigger is a data input received from said data processing system in response to a particular time expiring according to said data processing system.

6. A method for performing remote automated usability testing of a software application utilizing a data processing system connected with a network, said method comprising the steps of:

providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

gathering data indicating the usability of said software application through user responses to said promptings;

automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

activating said automated usability test while said software application is running, in response to a non-user input; and

utilizing an event trigger input to activate said automated usability test while said software application is running, where said event trigger is a data input received from said data processing system in response to a particular event occurring within said data processing system.

7. The method for performing remote automated usability testing according to claim 6, said step of providing a user with an automated usability test for a particular software applicable, further comprises the step of:

including a test wizard for controlling the functions of said automated usability test.

8. The method for performing remote automated usability testing according to claim 6, said step of prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running, further comprising the step of:

providing a graphical display window for said automated usability test within the same display as at least one graphical display window for said software application.

9. The method for performing remote automated usability testing according to claim 8, said step of gathering data indicating the usability of said software application through user responses to said promptings, further comprising the step of:

recording direct data entered by said user into a textual format.

10. A method for performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said method comprising the steps of:

providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

gathering data indicating the usability of said software application through user responses to said promptings;

automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

providing a graphical display window for said automated usability test within the same display as at least one graphical display window for said software application; and

providing a particular script of tasks within said graphical display window for said automated usability test dependent upon the type of input which activated said automated usability test.

11. A method for performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said method comprising the steps of:

providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

gathering data indicating the usability of said software application through user responses to said promptings;

automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems; and

receiving scripting data for said automated usability test via a network connection, where said scripting data prompts said user to perform particular tasks.

12. A system of performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said system comprising:

means for providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for gathering data indicating the usability of said software application through user responses to said promptings;

means for automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

means for activating said automated usability test while said software application is running, in response to a non-user input; and

means for utilizing a remote trigger input to activate said automated usability test while said software application is running, where said remote trigger is a data input received from said network.

13. The system of performing remote automated usability testing according to claim 12, said system further comprising:

means for activating said automated usability test while said software application is running, in response to a user input.

14. The system of performing remote automated usability testing according to claim 12, said means for gathering data indicating the usability of said software application through user responses to said promptings, further comprising:

means for recording indirect data detected in response to said user interacting with said software application into a textual format.

15. The system of performing remote automated usability testing according to claim 12, said means for automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems, further comprising:

means for sending an electronic mail providing said gathered data to an electronic mail address representing said data collection location.

16. A system of performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said system comprising:

means for providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for gathering data indicating the usability of said software application through user responses to said promptings;

means for automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

means for activating said automated usability test while said software application is running, in response to a non-user input; and

means for utilizing a time trigger input to activate said automated usability test while said software application is running, where said time trigger is a data input received from said data processing system in response to a particular time expiring according to said data processing system.

17. A system of performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said system comprising:

means for proving a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for gathering data indicating the usability of said software application through user responses to said promptings;

means for automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

means for activating said automated usability test while said software application is running, in response to a non-user input; and

means for utilizing an event trigger input to activate said automated usability test while said software application is running, where said event trigger is a data input received from said data processing system in response to a particular event occurring within said data processing system.

18. The system of performing remote automated usability testing according to claim 17, said means for proving a user with an automated usability test for a particular software application, further comprising:

means for including a test wizard for controlling the functions of said automated usability test.

19. The system of performing remote automated usability testing according to claim 17, said means for prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running, further comprising:

means for providing a graphical display window for said automated usability test within the same display as at least one graphical display window for said software application.

20. The system of performing remote automated usability testing according to claim 19, said means for gathering data indicating the usability of said software application through user responses to said promptings, further comprising:

means for recording direct data entered by said user into a textual format.

21. A system of performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said system comprising:

means for providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for gathering data indicating the usability of said software application through user responses to said promptings;

means for automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems;

means for providing a graphical display window for said automated usability test within the same display as at least one graphical display window for said software application; and

means for providing a particular script of tasks within said graphical display window for said automated usability test dependent upon the type of input which activated said automated usability test.

22. A system of performing remote automated usability testing of a software application utilizing a data processing system connected within a network, said system comprising:

means for providing a user with an automated usability test for a particular software application, wherein said automated usability test is to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for prompting said user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for gathering data indicating the usability of said software application through user responses to said promptings;

means for automatically sending said gathered data to a data collection location at a remote site within said network, such that usability test data from a plurality of data processing systems in a plurality of remote user environments is gathered at a location remote from said plurality of data processing systems; and

means for receiving scripting data for said automated usability test via a network connection, where said scripting data prompts said user to perform particular tasks.

23. A program, on a computer usable medium having computer readable program code means, said program comprising:

means for enabling the receipt of an automated usability test for a particular software application, wherein said automated usability test is enabled to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for generating a prompt for a user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for retrieving data indicating the usability of said software application through user responses to said promptings;

means for enabling automatic transmission of said retrieved data to a data collection location at a remote site within said network;

means for enabling the activation of said automated usability test while said software application is running, in response to a non-user input; and

means for enabling the receipt of a remote trigger input to activate said automated usability test while said software application is running, where said remote trigger is a data input received from said network.

24. The program according to claim 23, said program further comprising:

means for enabling the activation of said automated usability test while said software application is running, in response to a user input.

25. A program, on a computer usable medium having computer readable program code means, said program comprising:

means for enabling the receipt of an automated usability test for a particular software application, wherein said automated usability test is enabled to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for generating a prompt for a user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for retrieving data indicating the usability of said software application through user responses to said promptings;

means for enabling automatic transmission of said retrieved data to a data collection location at a remote site within said network;

means for enabling the activation of said automated usability test while said software application is running, in response to a non-user input; and

means for enabling the receipt of a time trigger input to activate said automated usability test while said software application is running, where said time trigger is a data input received from said data processing system in response to a particular time expiring according to said data processing system.

26. A program, on a computer usable medium having computer readable program code means, said program comprising:

means for enabling the receipt of an automated usability test for a particular software application, wherein said automated usability test is enabled to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for generating a prompt for a user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for retrieving data indicating the usability of said software application through user responses to said promptings;

means for enabling automatic transmission of said retrieved data to a data collection location at a remote site within said network;

means for enabling the activation of said automated usability test while said software application is running, in response to a non-user input; and

means for enabling the receipt of an event trigger input to activate said automated usability test while said software application is running, where said event trigger is a data input received from said data processing system in response in a particular event occurring within said data processing system.

27. The program according to claim 26, said program further comprising:

means for enabling a graphical display window for said automated usability test within the same display as at least one graphical display window for said software application.

28. A program, on a computer usable medium having computer readable program code means, said program comprising:

means for enabling the receipt of an automated usability test for a particular software application, wherein said automated usability test is enabled to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for generating a prompt for a user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for retrieving data indicating the usability of said software application through user responses to said promptings;

means for enabling automatic transmission of said retrieved data to a data collection location at a remote site within said network;

means for enabling a graphical display window for said automated usability test within the same display as at least one graphical display window for said software application; and

means for generating a particular script of tasks within said graphical display window for said automated usability test dependent upon the type of input which activated said automated usability test.

29. The program according to claim 28, said program further comprising:

means for retrieving indirect data detected in response to said user interacting with said software application into a textual format.

30. The program according to claim 28, said program further comprising:

means for enabling the transmission of an electronic mail providing said retrieved data to an electronic mail address representing said data collection location.

31. A program, on a computer usable medium having computer readable program code means, said program comprising:

means for enabling the receipt of an automated usability test for a particular software application, wherein said automated usability test is enabled to be activated while said particular software application is running utilizing a data processing system connected within a network;

means for generating a prompt for a user to perform particular tasks, in response to activation of said automated usability test while said software application is running;

means for retrieving data indicating the usability of said software application through user responses to said promptings;

means for enabling automatic transmission of said retrieved data to a data collection location at a remote site within said network; and

means for enabling the receipt of scripting data for said automated usability test via a network connection, where said scripting data prompts said user to perform particular tasks.