Automated system and method for conducting usability testing

• US 20050254775A1
• Filed: 03/31/2005
• Published: 11/17/2005
• Est. Priority Date: 04/01/2004
• Status: Active Grant

• Current Assignee: TechSmith Corporation
• Original Assignee: TechSmith Corporation
• Inventors: Craven, Dean, Dalton, Donald Allen, Hamilton, William
• Granted Patent: US 7,184,918 B2
• Time in Patent Office: Days
• US Class Current: 386/210
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

An automated system and method for conducting a usability test. The system conducts the usability test and records events that occur on the computer screen in sync with both the video and audio of the user and creates a complete chronicle of events that occur behind the scenes in the applications and the operating system. The system, depending upon the settings specified in the configuration, also captures other input streams and then saves the complete recording of the usability test, along with all the desired events and captures, in a file format. The system allows a remote viewer to observe, in real time, the recording of the usability test and to set markers at critical moments during the recording which are to be recorded. The system also allows the manager or administrator to configure the preferences, import and analyze the usability test and recording files, and prepare presentation videos of the usability test based upon the analyzed criteria.

Claims

1. A computer based method for recording computer activity, comprising the steps of:

(a) starting a recording on a recorder computer using a plurality of selected recording settings, the recorder computer providing a screen to display the recording;

(b) capturing a plurality of input streams from different input devices during the recording for creating a plurality of captured input streams;

(c) synchronizing the plurality of input streams;

(d) stopping the recording at a predetermined time; and

(e) saving a recording file of the plurality of captured input streams.

2. The method according to claim 1 and further comprising the step of configuring a plurality of recording settings for creating the plurality of selected recording settings.

3. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises a video of the screen of the recorder computer.

4. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises a plurality of text displayed on the screen of the recorder computer from a keyboard attached to the recorder computer.

5. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer.

6. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises a plurality of mouse clicks displayed on the screen of the recorder computer from a mouse attached to the recorder computer.

7. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises a plurality of system events occurring on the recorder computer.

8. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises a video of the user operating the recorder computer from a camera attached to the recorder computer.

9. The method according to claim 1 wherein one of the plurality of input streams from different input devices comprises an audio of the user operating the recorder computer from a microphone attached to the recorder computer.

10. A computer based method for recording computer activity, comprising the steps of:

(a) starting a recording on a recorder computer using a plurality of selected recording settings, the recorder computer providing a screen to display the recording;

(b) connecting the recorder computer to a remote computer;

(c) capturing a plurality of input streams from different input devices during the recording for creating a plurality of captured input streams;

(d) adding a plurality of information to the recording from the remote computer for creating a plurality of added information;

(e) stopping the recording at a predetermined time; and

(f) saving a recording file of the plurality of captured input streams and the plurality of added information.

11. The method according to claim 10 and further comprising the step of configuring a plurality of recording settings for creating the plurality of selected recording settings.

12. The method according to claim 11 and further comprising the step of testing the plurality of selected recording settings.

13. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises a video of the screen of the recorder computer.

14. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer from a keyboard attached to the recorder computer.

15. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer.

16. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises a plurality of mouse clicks displayed on the screen of the recorder computer from a mouse attached to the recorder computer.

17. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises a plurality of system events occurring on the recorder computer.

18. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises a video of the user operating the recorder computer from a camera attached to the recorder computer.

19. The method according to claim 10 wherein one of the plurality of input streams from different input devices comprises an audio of the user operating the recorder computer from a microphone attached to the recorder computer.

20. A computer based method for conducting and analyzing a usability test, comprising the steps of:

(a) starting the usability test on a recorder computer using a plurality of selected recording settings, the recorder computer providing a screen to display the usability test;

(b) capturing a plurality of input streams during the usability test for creating a plurality of captured input streams;

(c) synchronizing the plurality of input streams;

(d) stopping the usability test at a predetermined time; and

(e) saving a recording file of the video of the screen of the recorder computer and the plurality of captured input streams.

21. The method according to claim 20 and further comprising the step of configuring a plurality of recording settings for creating the plurality of selected recording settings.

22. The method according to claim 20 wherein one of the plurality of input streams from different input devices comprises a video of the screen of the recorder computer.

23. The method according to claim 20 wherein one of the plurality of input streams comprises a plurality of text information displayed on the screen of the recorder computer from a keyboard attached to the recorder computer.

24. The method according to claim 20 wherein one of the plurality of input streams comprises a plurality of text information displayed on the screen of the recorder computer from the usability test.

25. The method according to claim 20 wherein one of the plurality of input streams comprises a plurality of mouse clicks displayed on the screen of the recorder computer from a mouse attached to the recorder computer.

26. The method according to claim 20 wherein one of the plurality of input streams comprises a plurality of system events occurring on the recorder computer from the usability test.

27. The method according to claim 20 wherein one of the plurality of input streams comprises a video of the user operating the recorder computer from a camera attached to the recorder computer.

28. The method according to claim 20 wherein one of the plurality of input streams comprises an audio of the user operating the recorder computer from a microphone attached to the recorder computer.

29. The method according to claim 20 and further comprising the step of connecting the recorder computer to a remote computer.

30. The method according to claim 29 and further comprising the step of adding a plurality of markers to the usability test from the remote computer for creating a plurality of added markers.

31. The method according to claim 30 and further comprising the step of disconnecting the remote computer from the recorder computer.

32. The method according to claim 31 and further comprising the step of saving the recording file with the plurality of added markers.

33. A computer based method for conducting and analyzing a usability test, comprising the steps of:

(a) configuring a plurality of recording settings for creating a selected recording settings, the plurality of selected recording settings comprising a plurality of input streams from different input devices;

(b) testing the selected recording settings;

(c) starting the usability test on a recorder computer using the plurality of selected recording settings, the recorder computer providing a screen to display the usability test;

(d) connecting the recorder computer to a remote computer;

(e) capturing the plurality of input streams during the usability test for creating a plurality of captured input streams;

(f) adding a first set of plurality of markers to the usability test from the remote computer for creating a plurality of added markers;

(g) stopping the usability test at a predetermined time;

(h) disconnecting the remote computer from the recorder computer;

(i) saving a recording file of the plurality of captured input streams and the plurality of added markers;

(j) opening a project;

(k) importing a plurality of recording files into the opened project;

(l) analyzing the plurality of recording files for isolating a set of analyzed information;

(m) creating a highlight video of the analyzed information; and

(n) playing the highlight video.

34. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises a video of the screen of the recorder computer.

35. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer from a keyboard attached to the recorder computer.

36. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer from the usability test.

37. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises a plurality of mouse clicks displayed on the screen of the recorder computer from a mouse attached to the recorder computer.

38. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises a plurality of system events occurring on the recorder computer from the usability test.

39. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises a video of the user operating the recorder computer from a camera attached to the recorder computer.

40. The method according to claim 33 wherein one of the plurality of input streams from different input devices comprises an audio of the user operating the recorder computer from a microphone attached to the recorder computer.

41. The method according to claim 33 wherein testing the selected recording settings further comprises the step of starting a practice usability test using the selected recording settings.

42. The method according to claim 33 wherein testing the selected recording settings further comprises the step of capturing a plurality of practice input streams during the practice usability test.

43. The method according to claim 33 wherein testing the selected recording settings further comprises the step of correcting any problems encountered during the practice usability test.

44. The method according to claim 33 wherein testing the selected recording settings further comprises the step of stopping the practice usability test after a specified duration.

45. The method according to claim 33 wherein analyzing the plurality of recording files further comprises the step of searching the plurality of recording files for information contained within the plurality of captured input streams.

46. The method according to claim 33 wherein analyzing the plurality of recording files further comprises the step of creating a second set of plurality of markers into the project from the plurality of captured input streams searched.

47. The method according to claim 33 wherein analyzing the plurality of recording files further comprises the step of creating a first set of plurality of segments into the project from the plurality of captured input streams searched.

48. The method according to claim 33 and further comprising the step of creating a plurality of video clips from the set of analyzed information.

49. The method according to claim 33 and further comprising the step of creating a storyboard from the plurality of video clips.

50. The method according to claim 33 and further comprising the step of creating a plurality of title clips for the plurality of video clips.

51. The method according to claim 33 and further comprising the step of creating the highlight video from the storyboard.

52. A computer based method for conducting and analyzing a usability test, comprising the steps of:

if the recording settings are to be configured, then performing the following step (a);

(a) configuring a plurality of recording settings for creating a selected recording settings, the plurality of selected recording settings comprising a plurality of input streams from different input devices;

if the recording settings are not to be configured, then performing the following step (b);

(b) importing a plurality of previously recorded recording settings for creating a selected recording settings, the plurality of selected recording settings comprising a plurality of input streams from different input devices;

if the plurality of selected recording settings are to be tested, then performing the following step (c);

(c) testing the selected recording settings;

starting the usability test on a recorder computer using the plurality of selected recording settings, the recorder computer providing a screen to display the usability test;

if the recorder computer is to be connected to a remote computer, then performing the following steps (d)-(e);

(d) connecting the recorder computer to a remote computer;

(e) adding a first set of plurality of markers during the usability test from the remote computer for creating a plurality of added markers;

capturing the plurality of input streams during the usability test for creating a plurality of captured input streams;

synchronizing the plurality of input streams;

stopping the usability test at a predetermined time;

if the recorder computer is connected, then performing the following step (f);

(f) disconnecting the remote computer from the recorder computer;

saving a recording file of the plurality of captured input streams and the plurality of added markers;

if the usability test is to be analyzed, then performing the following steps (g)-(k);

(g) opening a project;

(h) importing a plurality of recording files into the opened project;

(i) analyzing the plurality of recording files for isolating a set of analyzed information,

(j) creating a highlight video of the analyzed information; and

(k) playing the highlight video.

53. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises a video of the screen of the recorder computer.

54. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer from a keyboard attached to the recorder computer.

55. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises a plurality of text information displayed on the screen of the recorder computer from the usability test.

56. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises a plurality of mouse clicks displayed on the screen of the recorder computer from a mouse attached to the recorder computer.

57. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises a plurality of system events occurring on the recorder computer from the usability test.

58. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises a video of the user operating the recorder computer from a camera attached to the recorder computer.

59. The method according to claim 52 wherein one of the plurality of input streams from different input devices comprises an audio of the user operating the recorder computer from a microphone attached to the recorder computer.

60. The method according to claim 52 wherein, if testing the selected recording settings is selected, then performing the following steps (l)-(o):

(l) starting a practice usability test using the selected recording settings;

(m) capturing a plurality of practice input streams during the practice usability test;

(n) correcting any problems encountered during the practice usability test;

(o) stopping the practice usability test after a specified duration.

61. The method according to claim 52 wherein, if the usability test is to be analyzed, then performing the following steps (p)-(r):

(p) searching the plurality of recording files for information contained within the plurality of captured input streams;

(q) creating a second set of plurality of markers into the project from the plurality of captured input streams searched;

(r) creating a first set of plurality of segments into the project from the plurality of captured input streams searched.

62. The method according to claim 52 and further comprising the step of creating a plurality of video clips from the set of analyzed information.

63. The method according to claim 52 and further comprising the step of creating a storyboard from the plurality of video clips.

64. The method according to claim 52 and further comprising the step of creating a plurality of title clips for the plurality of video clips.

65. The method according to claim 52 and further comprising the step of creating the highlight video from the storyboard.

66. A computer program product comprising a computer storage medium having a computer program code mechanism embedded in the computer storage medium for use with a receiving medium for recording computer activity, the computer program code mechanism comprising:

a first computer code device configured to start a recording on a recorder computer using a plurality of selected recording settings, the recorder computer providing a screen to display the recording;

a second computer code device configured to capture a video of the screen of the recorder computer;

a third computer code device configured to capture a video of the user operating the recorder computer;

a fourth computer code device configured to capture a plurality of input streams during the recording for creating a plurality of captured input streams;

a fifth computer code device configured to stop the recording at a predetermined time; and

a sixth computer code device configured to save a recording file of the video of the screen of the recorder computer, the video of the user operating the recorder computer, and the plurality of captured input streams.

67. The computer program according to claim 66 wherein one of the plurality of captured input streams comprises a plurality of text information displayed on the screen of the recorder computer from a keyboard attached to the recorder computer.

68. The computer program according to claim 66 wherein one of the plurality of input streams comprises a plurality of text information displayed on the screen of the recorder computer from the recording.

69. The computer program according to claim 66 wherein one of the plurality of input streams comprises a plurality of mouse clicks displayed on the screen of the recorder computer from a mouse attached to the recorder computer.

70. The computer program according to claim 66 wherein one of the plurality of input streams comprises a plurality of system events occurring on the recorder computer from the recording.

71. The computer program according to claim 66 wherein one of the plurality of input streams comprises an audio of the user operating the recorder computer from a microphone attached to the recorder computer.