COMPUTING SYSTEM WITH GUI TESTING DEVICE AND RELATED METHODS

• US 20200133824A1
• Filed: 10/26/2018
• Published: 04/30/2020
• Est. Priority Date: 10/26/2018
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: WANG, YANG, LUO, WEI
• Granted Patent: US 10,990,508 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/3612 by runtime analysis performance monitoring G06F11/3466
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 2009/45587 Isolation or security of virtual machine instances
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/153 using recognition of characters or words
• CPC Class Codes: G06V 30/1983 Syntactic or structural pattern recognition, e.g. symbolic string recognition

Abstract

A computing system may include a client computing device configured to execute a software application with an associated GUI. The GUI includes fields, and each field is to hold a text string. The computing system may include a GUI testing device in communication with the client computing device and configured to execute a testing framework for interacting with the software application to generate versions of the GUI, each of the versions being in a different language, and defining expected text strings in the fields. The GUI testing device may be configured to extract the fields from the versions of the GUI, perform OCR processing on the fields to generate actual text strings, and compare the actual text strings with the expected text strings.

Claims

1. A computing system comprising:

a client computing device configured to execute a software application with an associated graphical user interface (GUI), the GUI comprising a plurality of fields, each field to hold a text string; and

a GUI testing device in communication with said client computing device and configured to

execute a testing framework for interacting with the software application to generate a plurality of versions of the GUI, each of the plurality of versions being in a different language, and defining a plurality of expected text strings in the plurality of fields,

extract the plurality of fields from the plurality of versions of the GUI,

perform optical character recognition (OCR) processing on the plurality of fields to generate a plurality of actual text strings, and

compare the plurality of actual text strings with the plurality of expected text strings.

2. The computing system of claim 1 wherein said GUI testing device is configured to flag a given field when a given actual text string is greater than a given expected text string by a first threshold percentage, or when the given actual text string is less than the given expected text string by a second threshold percentage.

3. The computing system of claim 1 wherein said GUI testing device is configured to, for each version of the GUI, extract, and perform OCR processing on each actual text string sequentially.

4. The computing system of claim 1 wherein said GUI testing device is configured to, for each version of the GUI, extract, and perform OCR processing concurrently on the plurality of actual text strings in the plurality of fields.

5. The computing system of claim 4 wherein said GUI testing device is configured to, for each version of the GUI, generate a screenshot of a respective version of the GUI.

6. The computing system of claim 1 wherein said GUI testing device is configured to perform image pre-processing on the extracted plurality of fields from the plurality of versions of the GUI.

7. The computing system of claim 6 wherein the image pre-processing comprises at least one of a resizing process, a deblurring process, a gray processing, and a border setting process.

8. The computing system of claim 1 wherein said GUI testing device comprises a first computing device, and a second computing device separate from and in communication with said first computing device;

wherein said first computing device is configured to execute the testing framework, extract the plurality of fields, and compare plurality of actual text strings with the plurality of expected text strings; and

wherein said second computing device is configured to perform the OCR processing on the plurality of fields.

9. The computing system of claim 1 wherein the testing framework comprises at least one of XCUITest, UIAutomator, and Selenium.

10. A graphical user interface (GUI) testing device in communication with a software application with an associated GUI, the GUI comprising a plurality of fields, each field to hold a text string, the GUI testing device comprising:

a processor and a memory cooperating therewith and configured to

execute a testing framework for interacting with the software application to generate a plurality of versions of the GUI, each of the plurality of versions being in a different language, and defining a plurality of expected text strings in the plurality of fields,

extract the plurality of fields from the plurality of versions of the GUI,

perform optical character recognition (OCR) processing on the plurality of fields to generate a plurality of actual text strings, and

compare the plurality of actual text strings with the plurality of expected text strings.

11. The GUI testing device of claim 10 wherein said processor and memory are configured to flag a given field when a given actual text string is greater than a given expected text string by a first threshold percentage, or when the given actual text string is less than the given expected text string by a second threshold percentage.

12. The GUI testing device of claim 10 wherein said processor and memory are configured to, for each version of the GUI, extract, and perform OCR processing on each actual text string sequentially.

13. The GUI testing device of claim 10 wherein said processor and memory are configured to, for each version of the GUI, extract, and perform OCR processing concurrently on the plurality of actual text strings in the plurality of fields.

14. A non-transitory computer-readable medium for a graphical user interface (GUI) testing device in communication with a software application being executed with an associated GUI, the GUI comprising a plurality of fields, each field to hold a text string, the non-transitory computer-readable medium having computer-executable instructions for causing the GUI testing device to perform steps comprising:

executing a testing framework for interacting with the software application to generate a plurality of versions of the GUI, each of the plurality of versions being in a different language, and defining a plurality of expected text strings in the plurality of fields;

extracting the plurality of fields from the plurality of versions of the GUI;

performing optical character recognition (OCR) processing on the plurality of fields to generate a plurality of actual text strings; and

comparing the plurality of actual text strings with the plurality of expected text strings.

15. The non-transitory computer-readable medium of claim 14 wherein the steps include flagging a given field when a given actual text string is greater than a given expected text string by a first threshold percentage, or when the given actual text string is less than the given expected text string by a second threshold percentage.

16. The non-transitory computer-readable medium of claim 14 wherein the steps include, for each version of the GUI, extracting, and performing OCR processing on each actual text string sequentially.

17. The non-transitory computer-readable medium of claim 14 wherein the steps include, for each version of the GUI, extracting, and performing OCR processing concurrently on the plurality of actual text strings in the plurality of fields.

18. The non-transitory computer-readable medium of claim 17 wherein the steps include, for each version of the GUI, generating a screenshot of a respective version of the GUI.

19. The non-transitory computer-readable medium of claim 14 wherein the steps include performing image pre-processing on the extracted plurality of fields from the plurality of versions of the GUI.

20. The non-transitory computer-readable medium of claim 19 wherein the image pre-processing comprises at least one of a resizing process, a deblurring process, a gray processing, and a border setting process.

21. The non-transitory computer-readable medium of claim 14 wherein said GUI testing device comprises a first computing device, and a second computing device separate from and in communication with said first computing device;

wherein said first computing device is configured to execute the testing framework, extract the plurality of fields, and compare plurality of actual text strings with the plurality of expected text strings; and

wherein said second computing device is configured to perform the OCR processing on the plurality of fields.

22. A method for operating a graphical user interface (GUI) testing device communicating with a software application being executed with an associated GUI, the GUI comprising a plurality of fields, each field to hold a text string, the method comprising:

executing a testing framework for interacting with the software application to generate a plurality of versions of the GUI, each of the plurality of versions being in a different language, and defining a plurality of expected text strings in the plurality of fields;

extracting the plurality of fields from the plurality of versions of the GUI;

performing optical character recognition (OCR) processing on the plurality of fields to generate a plurality of actual text strings; and

comparing the plurality of actual text strings with the plurality of expected text strings.

23. The method of claim 22 further comprising flagging a given field when a given actual text string is greater than a given expected text string by a first threshold percentage, or when the given actual text string is less than the given expected text string by a second threshold percentage.

24. The method of claim 22 further comprising, for each version of the GUI, extracting, and performing OCR processing on each actual text string sequentially.