System, program product, and methods to enable visual recording and editing of test automation scenarios for web application

• US 8,392,886 B2
• Filed: 12/05/2008
• Issued: 03/05/2013
• Est. Priority Date: 10/17/2006
• Status: Active Grant

• Current Assignee: Progress Software Corporation
• Original Assignee: Artoftest, Inc.
• Inventors: Sweis, Faris A., Eyhorn, Christopher L.
• Primary Examiner(s): Zhen, Li B
• Assistant Examiner(s): COYER, RYAN D
• Application Number:
  US12/329,393
• Publication Number:
  US 20090133000A1
• Time in Patent Office: 1,551 Days
• Field of Search: 717/125
• US Class Current: 717/125
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 8/74 Reverse engineering; Extracting design information from source code

Abstract

Systems to provide automated testing of a markup software application, program product, and methods are provided. An example of a system can include a network, at least one computer including memory and a processor, and application testing program product stored in the memory of the at least one computer. The application testing program product can include instructions that when executed by the processor of the respective computer causes the respective computer to perform various operations to include receiving a user selection identifying a target element of an application; determining a command describing an action being performed; identifying a translator responsive to a captured command; and generating at least one of the following: an abstract script describing the action being performed by the target element, a context-sensitive verification available for the target element, or a context sensitive synchronization available for the target element.

Claims

1. A system to provide automated application testing of a markup software application, the system comprising:

a computer network;

a first database including a plurality of document object models having object characteristics and attributes;

a second database including a plurality of predefined translators, each translator translating between an element in at least one of the plurality of document object models and an abstract definition of an action, verification, and synchronization available to any element of any one of the plurality of document object models matching the element associated with the respective translator, at least portions of the plurality of translators interconnected to form a nested tree of translators;

a third database including a plurality of predefined descriptors objects each encapsulating operations to execute an associated task, logic to execute the task, and logic to generate a script for the task;

a first computer in communication with the computer network to execute server functions of software applications under test, the first computer including a processor and memory in communication with the processor;

a second computer in communication with the first computer through the computer network and each of the first, second, and third databases to execute client functions of software applications under test, the second computer including a processor and memory in communication with the processor; and

application testing program stored in the memory of at least one of the first or the second computers and including instructions that when executed by the processor of the respective computer causes the respective computer to perform the operations of;

providing a recording surface to functionally overlay a graphically displayed component of a markup application to capture graphical user inputs to a target element of the graphically displayed markup application component,

receiving a user selection identifying the target element of the graphically displayed component of the markup application responsive to the graphical user inputs,

determining a command describing an action being performed by the user on the target element through the recording surface,

generating a structure describing the action performed by the user on the target element and a location of the target element to define a captured command,

identifying a translator responsive to the captured command and the selected target element, and

generating an abstract script describing an action being performed by the target element responsive to the identified translator;

wherein the application testing program further comprises;

a translation manager configured to manage locating the translator associated with the captured command, when existing, the translation manager including a control locator interface configured to provide data to match the target element with the translator; and

a find parameter locator configured to match a translator locator element with the translator, the matched translator locator element containing the entire hierarchy of the graphically displayed component;

wherein the translation manager is further configured to pass the matched translator locator element to the translator to thereby allow the user to inspect and abstract actions into higher-level actions intrinsic to the graphically displayed component under the action.

2. A system as defined in claim 1, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform one or both of the following operations:

generating a context-sensitive sentence-based verification available for the target element responsive to the identified translator; and

generating a context sensitive synchronization available for the target element responsive to the identified translator.

3. A system as defined in claim 1, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

visually annotating the graphically displayed markup application component positioned under a user-controlled graphically displayed pointer and each parent markup application component containing the graphically displayed markup application component with a separate custom border color and a separate identification icon responsive to user movement of the graphically displayed pointer.

4. A system as defined in claim 1, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

performing a continuous visual annotation of target elements positioned under a user-controlled graphically displayed pointer responsive to user movement of the graphically displayed pointer, to include the operations of;

continuously inspecting attributes and nesting hierarchy of each element under the graphically displayed pointer, and

searching a plurality of custom markup application components and custom visual annotations associated therewith.

5. A system as defined in claim 1,

wherein the recording surface generates at least one custom task initialized responsive to at least one current value or state of the target element under a graphically displayed pointer to define a quick task;

and

wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of associating the target element of the graphically displayed markup application component with the generated quick task.

6. A system as defined in claim 1, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

generating a context-sensitive sentence-based verification available for the target element, the verification including a plurality of customizable word pieces initialized with context-sensitive default values.

7. A system as defined in claim 1, wherein the application testing program includes:

a recorder configured to provide the recording surface for a graphically displayed pointer to overlay the graphically displayed component of the markup application to capture the graphical user inputs to the target element and to generate the structure describing an action performed by the user on the target element and a location of the target element.

8. A system as defined in claim 7

wherein the find parameter locator is further configured to describe the location of the target element to thereby describe document object model elements of each of a plurality of document object models of interest to the translator associated with the target element to provide the translation manager data to select the translator associated with the target element from a plurality of translators;

and

wherein the application testing program further includes a container identifier configured to identify each document object model element found by the find parameter locator.

9. A system as defined in claim 8, wherein the application testing program includes:

an automation descriptor configured to provide data to execute a task, logic to execute the task, and logic to generate script for the task; and

a quick task interface configured to display natural language action, verification, and synchronization descriptors associated with the translator.

10. A system to provide automated application testing of a markup software application, the system comprising:

a first computer in communication with a computer network to execute server functions of software applications under test, the first computer including a processor and memory in communication with the processor;

a second computer in communication with the first computer through the computer network to execute client functions of software applications under test, the second computer including a processor and memory in communication with the processor; and

application testing program stored in the memory of at least one of the first or the second computers and including instructions that when executed by the processor of the respective computer causes the respective computer to perform the operations comprising;

providing a recording surface to functionally overlay a graphically displayed component of a markup application to capture graphical user inputs to a target markup element of the graphically displayed markup application component to thereby generate a structure describing an action performed by a user on the target markup element, and

identifying a translator responsive to the action performed by the user on the target markup element, the translator translating between the target markup element in at least one document object model and an abstract definition of an action, verification, and synchronization available to any element within the at least one document object model matching the target markup element associated with the respective translator, wherein the application testing program includes;

a translation manager configured to manage locating the translator associated with the action, when existing, the translation manager including a control locator interface configured to provide data to match the target element with the translator, and

a find parameter locator configured to match a translator locator element with the translator, the matched translator locator element containing the entire hierarchy of the graphically displayed component,

wherein the translation manager is further configured to pass the matched translator locator element to the translator to thereby allow the user to inspect and abstract actions into higher-level actions intrinsic to the graphically displayed component under the action, and

wherein the operations further comprise generating one or more of the following;

a customized abstract script describing an action being performed by the target markup element;

a context-sensitive sentence-based verification available for the target markup element, and a context sensitive synchronization available for the target markup element, responsive to a graphical user input.

11. A system as defined in claim 10, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

inspecting the target markup element in context of associated sibling markup elements, parent markup components, and child markup elements, when existing, responsive to the graphical user input, to thereby record the action performed by the target markup element.

12. A system as defined in claim 11, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operations of:

receiving a user selection identifying the target markup element of the graphically displayed component of the markup application responsive to the graphical user input;

determining a command describing an action being performed by the user on the target markup element through the recording surface;

generating the structure describing the action performed by the user on the target markup element and a location of the target markup element to define a captured command; and

identifying the translator responsive to the captured command and the selected target markup element.

13. A system as defined in claim 10, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

visually annotating the graphically displayed markup application component positioned under a user-controlled graphically displayed pointer and each parent markup application component containing the graphically displayed markup application component with at least one of a separate custom border color or a separate identification icon responsive to user movement of the graphically displayed pointer.

14. A system as defined in claim 10, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

performing a continuous visual annotation of target markup elements positioned under a user-controlled graphically displayed pointer responsive to user movement of the graphically displayed pointer, to include the operations of;

continuously inspecting attributes and nesting hierarchy of each element under the graphically displayed pointer, and

searching a plurality of custom markup application components and custom visual annotations associated therewith to thereby perform the continuous visual annotation of target markup elements.

15. A system as defined in claim 10,

wherein the recording surface generates at least one custom task initialized responsive to at least one current value or state of the target markup element under the graphically displayed pointer to define a quick task;

and

wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of associating the target markup element of the graphically displayed markup application component with the generated quick task.

16. A system as defined in claim 10, wherein the application testing program further includes instructions that when executed by the processor of the respective computer, causes the computer to perform the operation of:

generating a context-sensitive sentence-based verification available for the target markup element, the verification including a plurality of customizable word pieces initialized with context-sensitive default values.

17. A system as defined in claim 13, wherein the application testing program includes:

a recorder configured to provide the recording surface for a graphically displayed pointer to overlay the graphically displayed component of the markup application;

and

a container identifier configured to identify each document object model element found by the find parameter locator.

18. A system as defined in claim 17, wherein the application testing program includes:

an automation descriptor configured to provide data to execute a task, logic to execute the task, and logic to generate script for the task; and

a quick task interface configured to display natural language action, verification, and synchronization descriptors associated with the translator.

19. Application testing program to provide automated application testing of a markup software application, stored in a non-transitory computer readable medium, and comprising a set of instructions that, when executed by a computer, cause the computer to perform the operations comprising:

providing a recording surface to functionally overlay a graphically displayed component of a markup application to capture graphical user inputs to a target markup element of the graphically displayed markup application component to thereby generate a structure describing an action performed by the user on the target markup element; and

identifying a translator responsive to the action performed by the user on the target markup element, the translator translating between the target markup element in at least one document object model and an abstract definition of an action, verification, and synchronization available to any element within the at least one document object model matching the target markup element associated with the respective translator,

wherein the application testing program includes;

a translation manager configured to manage locating the translator associated with the action, when existing, the translation manager including a control locator interface configured to provide data to match the target element with the translator, and

a find parameter locator configured to match a translator locator element with the translator, the matched translator locator element containing the entire hierarchy of the graphically displayed component,

wherein the translation manager is further configured to pass the matched translator locator element to the translator to thereby allow the user to inspect and abstract actions into higher-level actions intrinsic to the graphically displayed component under the action, and

wherein the operations further comprise generating one or more of the following;

a customized abstract script describing the action being performed by the target markup element;

a context-sensitive sentence-based verification available for the target markup element, and a context sensitive synchronization available for the target markup element, responsive to a graphical user input.

20. The application testing program as defined in claim 19, wherein the operations further comprise:

inspecting the target markup element in context of associated sibling markup elements, parent components, and child markup elements, when existing, responsive to the graphical user input, to thereby record the action performed by the target markup element.

21. The application testing program as defined in claim 20, wherein the operations further comprise:

receiving a user selection identifying the target markup element of the graphically displayed component of the markup application responsive to the graphical user input;

determining a command describing an action being performed by the user on the target markup element through the recording surface;

generating the structure describing the action performed by the user on the target markup element and a location of the target markup element to define a captured command; and

identifying the translator responsive to the captured command and the selected target markup element.

22. The application testing program as defined in claim 19, wherein the operations further comprise:

visually annotating the graphically displayed markup application component positioned under a user-controlled graphically displayed pointer and each parent markup application component containing the graphically displayed markup application component with at least one of a separate custom border color or a separate identification icon responsive to user movement of the graphically displayed pointer.

23. The application testing program as defined in claim 19, wherein the operations further comprise:

performing a continuous visual annotation of target markup elements positioned under a user-controlled graphically displayed pointer responsive to user movement of the graphically displayed pointer, to include the operations of;

continuously inspecting attributes and nesting hierarchy of each element under the graphically displayed pointer, and

searching a plurality of custom markup application components and custom visual annotations associated therewith to thereby perform the continuous visual annotation of target markup elements.

24. The application testing program as defined in claim 19,

wherein the recording surface generates at least one custom task initialized responsive to at least one current value or state of the target markup element under the graphically displayed pointer to define a quick task;

and

wherein the operations further comprise associating the target markup element of the graphically displayed markup application component with the generated quick task.

25. The application testing program as defined in claim 19, wherein the operations further comprise:

generating a context-sensitive sentence-based verification available for the target markup element, the verification including a plurality of customizable word pieces initialized with context-sensitive default values.

26. The application testing program as defined in claim 21, including:

a recorder configured to provide the recording surface for a graphically displayed pointer to overlay the graphically displayed component of the markup application;

and

a container identifier configured to identify each document object model element found by the find parameter locator.

27. The application testing program as defined in claim 21, including:

an automation descriptor configured to provide data to execute a task, logic to execute the task, and logic to generate script for the task; and

a quick task interface configured to display natural language action, verification, and synchronization descriptors associated with the translator.

28. Application testing program to provide automated application testing of a markup software application, stored in a non-transitory computer readable medium, and comprising:

a recording surface for a graphically displayed pointer to overlay a graphically displayed component of a markup application to capture graphical user inputs to a target markup element and to generate a structure describing an action performed by the user on the target markup element and a location of the target markup element defining a captured command;

logic for identifying a translator responsive to the action performed by the user on the target markup element, the translator translating between the target markup element in at least one document object model and an abstract definition of an action, verification, and synchronization available to any element within the at least one document object model matching the target markup element associated with the respective translator;

a translation manager configured to manage locating the translator associated with the captured command, when existing, the translation manager including a control locator interface configured to provide data to match the target element with the translator;

a find parameter locator configured to match a translator locator element with the translator, the matched translator locator element containing the entire hierarchy of the graphically displayed component;

wherein the translation manager is further configured to pass the matched translator locator element to the translator to thereby allow the user to inspect and abstract actions into higher-level actions intrinsic to the graphically displayed component under the action; and

an automation descriptor configured to provide data to execute a task, logic to execute the task, and logic to generate script for the task responsive to the translator.

29. Program as defined in claim 28, further comprising:

a container identifier configured to identify each document object model element found by the find parameter locator.

30. The application testing program as defined in claim 28, further comprising:

a quick task interface configured to display natural language action, verification, and synchronization descriptors associated with the translator.

31. The application testing program as defined in claim 28, further comprising:

a visual annotator configured to provide a visual annotation associated with the translator including its associated custom identification icon and border color, and a custom visual annotation associated with any related parent translators.

32. A computer implemented method of providing automated application testing of a markup software application, the method comprising the steps of:

providing a recording surface to functionally overlay a graphically displayed component of a markup application being executed on and displayed by a computer to capture graphical user inputs to a target markup element of the graphically displayed markup application component;

receiving a user selection by a user identifying the target markup element of the graphically displayed component responsive to manipulation of a graphically displayed pointer displayed by the computer defining a graphical user input;

determining a command describing an action being performed by the user on the target markup element through the recording surface;

generating a structure describing the action performed by the user on the target markup element and a location of the target markup element to define a captured command;

identifying a translator responsive to the captured command and the selected target markup element, the translator between the target markup element in at least one document object model and an abstract definition of an action, verification, and synchronization available to an element within the at least one document object model matching the target markup element associated with the respective translator, and the translator being associated with the captured command, located when existing, to thereby translate the captured command to an automated descriptor;

providing, via a control locator interface, data to match the target markup element with the translator;

matching a translator locator element with the translator, the matched translator locator element containing the entire hierarchy of the graphically displayed component;

passing the matched translator locator element to the translator to thereby allow the user to inspect and abstract actions into higher-level actions intrinsic to the graphically displayed component under the action; and

generating script comprising one or more of the following;

a customized abstract script describing an action being performed by the target markup element, a context-sensitive sentence-based verification available for the target markup element, and a context sensitive synchronization available for the target markup element, responsive to the graphical user input and the automation descriptor.

33. A method as defined in claim 32, further comprising the step of:

inspecting the target markup element in context of associated sibling markup elements, child markup elements, or parent components, when existing, responsive to the graphical user input, to thereby record the action performed by the target markup element.

34. A method as defined in claim 32, further comprising the step of:

visually annotating the graphically displayed component with one or more of the following;

a custom border color and identification icon.

35. A method as defined in claim 34, wherein the target markup element is nested, the method further comprising the step of:

visually annotating at least one parent markup application component containing the graphically displayed component with a separate custom border color and a separate identification icon.

36. A method as defined in claim 32, further comprising the steps of:

determining a state or value of the target markup element;

generating a custom quick task initialized in response to a current value or state of the target markup element; and

associating the target markup element of the graphically displayed markup application component with the generated quick task.

37. A method as defined in claim 32, further comprising the steps of:

translating the captured command to an action descriptor; and

generating an abstract script describing an action being performed by the target markup element.

38. A method as defined in claim 32, further comprising the steps of:

translating the captured command to a verification descriptor; and

generating a context-sensitive sentence-based verification available for the target markup element.

39. A method as defined in claim 32, further comprising the steps of:

translating the captured command to a verification descriptor acting as a synchronizer; and

generating a context sensitive synchronization available for the target markup element.

40. A computer implemented method of providing automated application testing of a markup software application, the method comprising the steps of:

detecting a graphically displayed component of a markup application displayed by a markup application under test on a computer responsive to user graphical manipulation of a graphically displayed pointer over the component, the graphical manipulation comprising a command;

identifying the graphically displayed component using a document object model stored in a database and unique characteristics or attributes of the graphically displayed component including its hierarchal nesting responsive to the step of detecting;

searching for available tasks associated with the component from a library of objects responsive to the step of identifying the component;

identifying a translator responsive to the identified component and the command, the translator configured to translate between the identified component in the document object model and an abstract definition of an action, verification, and synchronization available to an element within the document object model matching the identified component associated with the respective translator, the translator being associated with the captured command, located when existing;

providing, via a control locator interface, data to match a target markup element with the translator;

matching a translator locator element with the translator, the matched translator locator element containing the entire hierarchy of the graphically displayed component;

passing the matched translator locator element to the translator to thereby allow the user to inspect and abstract actions into higher-level actions intrinsic to the graphically displayed component under the action;

generating, responsive to the identified translator, a script for one or more of the tasks; and

executing at least one available task multiple times as part of one or more of the following;

a test automation regression run and a software testing run.

41. A method as defined in claim 40,

wherein the tasks include action, verification, and synchronization tasks.

42. A method as defined in claim 41,

wherein the action tasks include identification of the action performed by a selected element within the graphically displayed component;

wherein the verification tasks include one or more of the following;

verification that the action performed is the action to be performed, and verification that a value returned is the value expected to be returned; and

wherein the synchronization tasks include identifying a temporal relationship to other tasks.