Method and apparatus for performing automated user-interface layout testing

• US 9,213,625 B1
• Filed: 07/27/2010
• Issued: 12/15/2015
• Est. Priority Date: 07/27/2010
• Status: Active Grant

• Current Assignee: Intuit, Inc.
• Original Assignee: Intuit, Inc.
• Inventors: Schrage, Andrew J.
• Primary Examiner(s): Bhargava, Anil
• Application Number:
  US12/844,284
• Time in Patent Office: 1,967 Days
• Field of Search: 715/762, 717/124
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 8/658 Incremental updates; Differential updates

Abstract

The disclosed embodiments provide a system that performs automated user-interface layout testing. During operation, the system executes a pre-defined set of operations for a program. After these operations have executed, the system then stores a representation (e.g., a snapshot) of the program user interface. The system then compares this representation against a validated representation that was previously stored for the pre-defined set of operations to determine a difference between the representations. This process facilitates detecting changes to the program (and/or the environment in which the program executes) that affect the user interface that is presented to a user.

Claims

1. A computer-implemented method for performing automated user-interface layout testing, the method comprising:

executing a pre-defined set of operations for a program;

storing a first representation of a user interface for the program subsequent to executing the operations;

automatically tagging the first representation with a unique tag, wherein the tag identifies an environment, workflow, and time frame in which the first representation is obtained, which allows identification of multiple images of the same workflow for comparison;

automatically selecting, based on the unique tag, one or more previously stored valid representations tagged with the same workflow for comparison with the first representation; and

comparing the first representation against each of the one or more validated representations to determine a difference between the representations, thereby facilitating detecting changes that affect the user interface, wherein said comparing involves;

receiving a specification that describes an acceptable level of change between the first representation and a validated representation;

and

determining whether the difference between the first representation and any of the one or more validated representations exceeds the acceptable level of change.

2. The computer-implemented method of claim 1, wherein the method involves determining whether the difference between the first representation and any of the one or more validated representations will be noticeable to a user.

3. The computer-implemented method of claim 1, wherein comparing the first representation against each of the one or more validated representations further involves:

receiving a specification for a region of interest in the first representation and the validated representation; and

comparing only the region of interest in the first representation with a corresponding region of interest in the validated representation.

4. The computer-implemented method of claim 3, wherein determining the difference involves performing a per-pixel comparison of the first representation and the validated representation to determine the difference between the representations.

5. The computer-implemented method of claim 1, wherein the method further involves notifying a quality assurance tester upon determining the difference between the representations.

6. The computer-implemented method of claim 5, wherein notifying the quality assurance tester involves one or more of the following:

providing the first representation and the one or more validated representations to the quality assurance tester;

highlighting pixels in the first representation that differ from pixels in any of the plurality of validated representations; and

receiving an indication from the quality assurance tester that indicates that the first representation is visually substantially similar to each of the one or more validated representations.

7. The computer-implemented method of claim 6, wherein the method further involves comparing multiple representations associated with different operations during program development and testing to ensure that the user interface presented to the user remains consistent across changes to the program and execution environment.

8. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for performing automated user-interface layout testing, the method comprising:

executing a pre-defined set of operations for a program;

storing a first representation of a user interface for the program subsequent to executing the operations;

automatically tagging the first representation with a unique tag, wherein the tag identifies an environment, workflow, and time frame in which the first representation is obtained, which allows identification of multiple images of the same workflow for comparison;

automatically selecting, based on the unique tag, one or more previously stored valid representations tagged with the same workflow for comparison with the first representation; and

comparing the first representation against each of the one or more validated representations to determine a difference between the representations, thereby facilitating detecting changes that affect the user interface, wherein said comparing involves;

receiving a specification that describes an acceptable level of change between the first representation and a validated representation; and

determining whether the difference between the first representation and any of the one or more validated representations exceeds the acceptable level of change.

9. The non-transitory computer-readable storage medium of claim 8, wherein the method involves determining whether the difference between the first representation and any of the one or more validated representations will be noticeable to a user.

10. The non-transitory computer-readable storage medium of claim 8, wherein comparing the first representation against each of the one or more validated representations further involves:

receiving a specification for a region of interest in the first representation and the validated representation; and

comparing only the region of interest in the first representation with a corresponding region of interest in the validated representation.

11. The non-transitory computer-readable storage medium of claim 10, wherein determining the difference involves performing a per-pixel comparison of the first representation and the validated representation to determine the difference between the representations.

12. The non-transitory computer-readable storage medium of claim 8, wherein the method further involves notifying a quality assurance tester upon determining the difference between the representations.

13. The non-transitory computer-readable storage medium of claim 12, wherein notifying the quality assurance tester involves one or more of the following:

providing the first representation and the one or more validated representations to the quality assurance tester;

highlighting pixels in the first representation that differ from pixels in any of the one or more validated representations;

and

receiving an indication from the quality assurance tester that indicates that the first representation is visually substantially similar to each of the one or more validated representations.

14. The non-transitory computer-readable storage medium of claim 13, wherein the method further involves comparing multiple representations associated with different operations during program development and testing to ensure that the user interface presented to the user remains consistent across program changes.

15. An apparatus configured for performing automated user-interface layout testing, comprising:

a processor;

a memory;

an execution mechanism configured to execute a pre-defined set of operations for a program;

a storage mechanism configured to store a first representation of a user interface for the program subsequent to executing the operations;

an association mechanism configured to automatically tag the first representation with a unique tag, wherein the tag identifies the first representation with a unique tag, wherein the tag identifies an environment, workflow, and time frame in which the first representation is obtained, which allows identification of multiple images of the same workflow for comparison;

a selection mechanism configured to automatically select, based on the unique tag, one or more previously stored valid representations tagged with the same workflow for comparison with the first representation; and

a comparison mechanism configured to compare the first representation against each of the one or more validated representations to determine a difference between the representations, thereby facilitating detecting changes that affect the user interface, wherein said comparing involves;

receiving a specification that describes an acceptable level of change between the first representation and a validated representation; and

determining whether the difference between the first representation and any of the one or more validated representations exceeds the acceptable level of change.

16. The apparatus of claim 15, wherein the comparison mechanism is further configured to:

receive a specification for a region of interest in the first representation and the validated representation; and

compare only the region of interest in the first representation with a corresponding region of interest in the validated representation.