Automated testing of perceptible web page elements

• US 10,296,563 B2
• Filed: 05/09/2016
• Issued: 05/21/2019
• Est. Priority Date: 05/09/2016
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Shaath, Hilal
• Primary Examiner(s): Lau, Tung S
• Application Number:
  US15/149,953
• Publication Number:
  US 20170324803A1
• Time in Patent Office: 1,107 Days
• Field of Search: None
• CPC Class Codes: G06F 11/36 Preventing errors by testing or debugging software
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226

Abstract

Methods and systems are provided for testing graphical elements within a graphical user interface associated with a computer file, such as a web page. One exemplary method involves a computing device coupled to a communications network identifying a visible subset of graphical elements within a graphical user interface associated with a computer file available over the network and identifying a testable subset of the visible subset. To identify the testable subset the computing device obtains spatial display properties for each graphical element of the visible subset, performs a hit test for the respective graphical element using the spatial display properties, and retains the respective graphical element in the testable subset based on a result of the hit test corresponding to the respective graphical element. The testable subset thereby includes graphical elements that are perceptible to human users, and conversely, excludes imperceptible graphical elements.

Claims

1. A method of testing graphical elements associated with a web page file available over a communications network, the method comprising:

identifying, by a computing device coupled to the communications network, a visible subset comprising an initial set of actionable graphical web page elements within a graphical user interface associated with the web page file;

identifying, by the computing device, a testable subset of the initial set of actionable web page elements, the testable subset of the actionable web page elements being perceptible to a human user, wherein identifying the testable subset comprises, for each actionable graphical web page element of the initial set;

obtaining spatial display properties of the respective actionable graphical web page element;

performing a hit test for the respective actionable graphical web page element using the spatial display properties; and

retaining the respective actionable graphical web page element in the testable subset when a result of the hit test corresponds to the respective actionable graphical web page element;

generating, by the computing device, one or more tests for the web page file based on the testable subset of the actionable graphical web page elements; and

performing, by the computing device, the one or more tests on the web page file using the communications network.

2. The method of claim 1, wherein identifying the visible subset comprises identifying the initial set of actionable graphical web page elements having a visibility attribute value indicating each actionable graphical web page element of the initial set is visible.

3. The method of claim 1, wherein:

identifying the visible subset comprises identifying the initial set of actionable graphical web page elements from among the graphical elements within the graphical user interface based on a visibility attribute and an element type associated with the respective actionable graphical web page elements, wherein the visibility attribute associated with each actionable graphical web page element of the initial set indicates the respective actionable graphical web page element is visible; and

identifying the testable subset comprises identifying a second subset of the initial set, wherein each actionable graphical web page element of the second subset is perceptible to a human user or a parent of a perceptible child element.

4. The method of claim 1, the web page file comprising a web page available from a server coupled to the communications network, wherein:

identifying the visible subset comprises identifying a first subset of actionable graphical elements within the graphical user interface associated with the web page; and

identifying the testable subset comprises identifying a second subset of the first subset, wherein the second subset comprises actionable graphical elements perceptible within the graphical user interface.

5. The method of claim 1, further comprising:

determining, by the computing device, one or more performance metric values associated with the one or more tests based on the performing; and

storing, by the computing device, the one or more performance metric values in association with the one or more tests in a database.

6. A computer-readable medium having instructions stored thereon that are executable by a processing system of the computing device to perform the method of claim 1.

7. The method of claim 1, wherein performing the hit test comprises verifying the respective actionable graphical web page element is a hit test result at one or more locations within a display area of the graphical user interface associated with the web page file, wherein the spatial display properties indicate the respective actionable graphical web page element encompasses the one or more locations.

8. The method of claim 1, further comprising designating the respective actionable graphical web page element as a testable element when a result of performing the hit test corresponds to a child of the respective actionable graphical web page element.

9. The method of claim 2, wherein identifying the testable subset comprises identifying a second subset of the initial set of actionable graphical web page elements, wherein each actionable graphical web page element of the second subset comprises a testable element perceptible to a human user.

10. The method of claim 2, wherein identifying the testable subset comprises excluding one or more actionable graphical web page elements of the initial set, wherein the one or more actionable graphical web page elements are not perceptible to a human user.

11. The method of claim 4, wherein the server generates the web page associated with a virtual application generated by the server based at least in part on data from a database coupled to the server.

12. The method of claim 5, wherein generating the one or more tests comprises probabilistically determining an activation sequence involving one or more graphical elements of the testable subset.

13. A testing system comprising:

a database to store one or more tests for actionable graphical web page elements associated with a file type; and

a computing device coupled to the database to identify a visible subset of actionable graphical web page elements within a graphical user interface associated with a web page file having the file type, identify a testable subset of the visible subset of actionable graphical web page elements based on perceptibility of the actionable graphical web page elements of the testable subset, generate one or more test cases for the web page file based on the one or more tests and the testable subset of actionable graphical web page elements, perform the one or more tests on the web page file using a communications network, and store results of performing the one or more tests in the database, wherein identifying the testable subset comprises, for each actionable graphical web page element of the visible subset;

obtaining spatial display properties of the respective actionable graphical web page element;

performing a hit test for the respective actionable graphical web page element using the spatial display properties; and

retaining the respective actionable graphical web page element in the testable subset when a result of the hit test corresponds to the respective actionable graphical web page element.

14. The system of claim 13, wherein the computing device is coupled to a server over the communications network, the server hosting the web page file, wherein the computing device performs the one or more tests on the web page file hosted by the server via the communications network.

15. The system of claim 13, wherein each actionable graphical web page element of the visible subset has a visibility attribute value indicating visibility.

16. The system of claim 14, wherein the web page file comprises a web page associated with a virtual application generated by the server based at least in part on data from a second database coupled to the server.