System, method, and apparatus for automatic recording and replaying of application executions

• US 9,697,108 B2
• Filed: 08/12/2013
• Issued: 07/04/2017
• Est. Priority Date: 08/12/2013
• Status: Active Grant

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Pistoia, Marco, Thomas, Gegi, Ligman, Joseph W., Ponzo, John
• Primary Examiner(s): Rutten, James D
• Application Number:
  US13/964,296
• Publication Number:
  US 20150046909A1
• Time in Patent Office: 1,422 Days
• Field of Search: 717131, 717130
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A method comprises receiving data pertaining to a recorded interaction between a test device operating system and an application on a test device, the recorded interaction being based on a user input; compiling the data pertaining to the recorded interaction in a script compiler, the data comprising human-readable action-description language; sending the compiled data comprising human-readable action-description language from the script compiler of the server to a developer device; receiving modified data from the developer device; and sending the modified data from the developer device to the test device.

Claims

1. A method, comprising:

recording an interaction between a test device operating system and an application, the recording of the interaction being by an initiating of the recording of a template to capture a first screenshot of the test device, the interaction being based on a user input from a user;

wherein the recording of the interaction comprises intercepting at least one method invocation based on the user input, processing the method invocation using wrappered instantiated objects from a call stack, overriding at least one instantiated object with a category implementation, calling the category implementation, logging data using the called category implementation, the logged data pertaining to the interaction of the user with the test device operating system in an application recording phase, testing each of the at least one method invocations in a series of method invocations from the called category implementation, capturing a second screenshot of a result of the testing, visually comparing the first screenshot with the second screenshot, constructing verification points, aggregating the tested method invocations, and returning the data to the test device operating system to preserve the call stack;

wherein the instantiated objects are class implementations wrappered in the category implementations;

sending the recorded interaction between the test device operating system and the application to a server; and

testing an initiation of the application recording phase using a visible overlaid control set;

compiling data pertaining to the recorded interaction in a script compiler of the server, the data comprising human-readable action-description language;

sending the compiled data comprising human-readable action-description language from the script compiler of the server to a developer device;

returning modified data from the developer device to the server;

wherein data pertaining to the recorded interaction is compressed as a text-based standard that outlines captured events as objects, wherein the compressed data is formatted to obfuscate the recorded interaction.

2. The method of claim 1, further comprising intentionally disabling the application recording phase.

3. The method of claim 1, further comprising compiling a script from compiler templates based on encoded data pertaining to the recorded interaction.

4. The method of claim 1, further comprising re-executing the application based on the recorded interaction between the test device operating system and the application sent to the server to simulate the user input.

5. The method of claim 4, wherein re-executing the application comprises creating a network connection from the test device to a server, retrieving a script from the server, and parsing the script into executable commands.

6. The method of claim 1, wherein recording the interaction comprises overriding a class interface method with a category interface method by wrappering over the class interface method.

7. The method of claim 1, further comprising bytecode-injecting code to override a class loader and an instrumentation library post compile time by loading an instrumented class and instantiating an instrumented object.

8. The method of claim 1, further comprising creating a troubleshooting log to facilitate a troubleshooting application.

9. The method of claim 8, further comprising uploading the troubleshooting log to a help center for analysis.

10. The method of claim 1, wherein the interaction between the test device operating system and the application includes one or more of a deterministic event and a non-deterministic event.

11. The method of claim 1, wherein the recording is carried out through a testing library.

12. A method, comprising:

receiving, on a developer electronic device, data from a server, the data comprising human-readable action-description language from a script compiler of the server;

modifying the human-readable action-description language from the script compiler on the developer electronic device; and

returning a modified compiled script from the developer electronic device to the server;

wherein the data pertains to a test created by recording an interaction on a remotely-located testing electronic device by initiating a recording of a template to capture a first screenshot of the testing electronic device;

wherein the recording of the interaction comprises intercepting at least one method invocation based on a user input, processing the method invocation using wrappered instantiated objects from a call stack, overriding at least one instantiated object with a category implementation, calling the category implementation, logging data using the called category implementation, the logged data pertaining to the interaction, testing each of the at least one method invocations in a series of method invocations from the called category implementation using a visible overlaid control set, capturing a second screenshot of a result of the testing, visually comparing the first screenshot with the second screenshot, constructing verification points, aggregating the tested method invocations, and returning the logged data pertaining to the interaction to the remotely-located testing electronic device to preserve the call stack;

wherein the instantiated objects are class implementations wrappered in the category implementations;

wherein data pertaining to the interaction is compressed as a text-based standard that outlines captured events as objects, wherein the compressed data is formatted to obfuscate the recorded interaction.

13. The method of claim 12, further comprising monitoring an interaction on the remotely-located testing electronic device prior to receiving the human-readable action-description language on the developer electronic device.

14. The method of claim 12, wherein modifying the human-readable action-description language comprises creating test data pertaining to a second test.

15. The method of claim 12, further comprising transferring the modified compiled script from the server to the remotely-located testing electronic device.

16. A method, comprising:

compressing data pertaining to a recorded interaction as a text-based standard that outlines captured events as objects, wherein the compressed data is formatted to obfuscate the recorded interaction;

receiving data pertaining to the recorded interaction between a test device operating system and an application on a test device, the recording of the interaction being by an initiating of the recording of a template to capture a first screenshot of the test device, the recorded interaction being an invocation in a series of invocations based on a user input that is processed using wrappered instantiated objects from a call stack, wherein the recorded interaction further comprises an override of at least one instantiated object with a category implementation and a call based on the category implementation, and from which data using the called category implementation is logged, tested using a visible overlaid control set, and aggregated and returned to the test device to preserve the call stack, the instantiated objects being class implementations wrappered in the category implementations;

compiling the data pertaining to the recorded interaction in a script compiler of a server, the data comprising human-readable action-description language;

sending the compiled data comprising human-readable action-description language from the script compiler of the server to a developer device;

receiving modified data from the developer device; and

sending the modified data from the developer device to the test device;

wherein the tested data is captured using a second screenshot of a result of the testing, visually compared to the first screenshot, and verification points are constructed prior to aggregation of the tested data.

17. The method of claim 16, further comprising logging the recorded interaction in a recording log as line-by-line encoding of human-readable action-description language.