RECORDING GUI DATA

• US 20170010953A1
• Filed: 09/22/2016
• Published: 01/12/2017
• Est. Priority Date: 12/17/2013
• Status: Active Grant

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Kyte, Adrian P., Winchester, Joseph R.
• Granted Patent: US 10,146,662 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 11/3461 Trace driven simulation
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3636 by tracing the execution of the program
• CPC Class Codes: G06F 11/366 using diagnostics G06F11/0703 takes precedence
• CPC Class Codes: G06F 2201/865 Monitoring of software

Abstract

A system for recording the interaction of a computer program via graphical user interface (GUI) is disclosed in which one or more operating system event queues are monitored and GUI interaction data logged.

Claims

1. An apparatus for recording graphical user interface (GUI) data for a computer program, the apparatus comprising one or more processors arranged to:

monitor an operating system event queue associated with a GUI for a program;

identify a first message on the operating system event queue defining a window of the GUI for the program;

log data representing the window in a log associated with the program, wherein the log is used to display a recorded GUI activity as a simulation of the program, and wherein the logging of the data is triggered in accordance with a predetermined logging period associated with time, message data content, or message data quantity;

identify one or more further messages on the operating system event queue defining one or more updates to the window;

identify a net change to the window defined in the further messages; and

log data representing the identified net change to the window in the log.

2. The apparatus according to claim 1 wherein the data representing the window comprises a serialization of the window.

3. The apparatus according to claim 1 wherein the data representing the net change to the window comprises a serialization of one or more changes to the window.

4. The apparatus according to claim 1 wherein the data representing the window and the data representing the net change to the window are derived from their respective identified messages on the operating system event queue.

5. The apparatus according to claim 1 wherein one or more messages on the operating system event queue define user input to the window of the GUI for the program.

6. The apparatus according to claim 1 wherein one or more predetermined sets of data are omitted from the log.

7. The apparatus according to claim 1 wherein the logged data comprises XML.

8. The apparatus according to claim 1 further operable to:

identify a log file for a selected application program; and

display the recorded GUI activity from the log file entries as a simulation of the selected application program GUI.

9. A method for recording graphical user interface (GUI) data for a computer program, the method comprising the steps of:

monitoring an operating system event queue associated with a GUI for a program;

identifying a first message on the operating system event queue defining a window of the GUI for the program;

logging data representing the window in a log associated with the program, wherein the log is used to display a recorded GUI activity as a simulation of the program, and wherein the logging of the data is triggered in accordance with a predetermined logging period associated with time, message data content, or message data quantity;

identifying one or more further messages on the operating system event queue defining one or more updates to the window;

identifying a net change to the window defined in the further messages; and

logging data representing the identified net change to the window in the log.

10. The method according to claim 9 wherein the data representing the window comprises a serialization of the window.

11. The method according to claim 9 wherein the data representing the net change to the window comprises a serialization of one or more changes to the window.

12. The method according to claim 9 wherein the data representing the window and the data representing the net change to the window are derived from their respective identified messages on the operating system event queue.

13. The method according to claim 9 wherein one or more messages on the operating system event queue define user input to the window of the GUI for the program.

14. The method according to claim 9 wherein one or more predetermined sets of data are omitted from the log.

15. The method according claim 9 wherein the logged data comprises XML.

16. The method according to claim 9 further comprising the steps of:

identifying a log file for a selected application program; and

displaying the recorded GUI activity from the log file entries as a simulation of the selected application program GUI.

17. A computer program product for recording GUI data for a computer program, the computer program product comprising a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to:

monitor an operating system event queue associated with a GUI for a program;

identify a first message on the operating system event queue defining a window of the GUI for the program;

log data representing the window in a log associated with the program, wherein the log is used to display a recorded GUI activity as a simulation of the program, and wherein the logging of the data is triggered in accordance with a predetermined logging period associated with time, message data content, or message data quantity;

identify one or more further messages on the operating system event queue defining one or more updates to the window;

identify a net change to the window defined in the further messages; and

log data representing the identified net change to the window in the log.

18. The computer program product according to claim 17 wherein the data representing the window comprises a serialization of the window.

19. The computer program product according to claim 17 wherein the data representing the net change to the window comprises a serialization of one or more changes to the window.

20. The computer program product according to claim 17 wherein the data representing the window and the data representing the net change to the window are derived from their respective identified messages on the operating system event queue.

21. The computer program product according to claim 17 wherein one or more messages on the operating system event queue define user input to the window of the GUI for the program.