Method for creating a label

• US 9,317,403 B2
• Filed: 10/11/2013
• Issued: 04/19/2016
• Est. Priority Date: 04/25/2013
• Status: Active Grant

• Current Assignee: Eggplant Ltd. (The Carlyle Group LP (Corporate Private Equity))
• Original Assignee: Testplant, Inc.
• Inventors: Simons, Douglas Paul, Gillaspie, Jonathan David
• Primary Examiner(s): Carter, Aaron W
• Application Number:
  US14/052,151
• Publication Number:
  US 20140325482A1
• Time in Patent Office: 921 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3604 Software analysis for verifying properties of programs byte-code verification G06F9/44589
• CPC Class Codes: G06F 11/366 using diagnostics G06F11/0703 takes precedence
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases

Abstract

A method for creating a text label for a first digital image includes a portion of a second digital image. The first digital image includes a plurality of pixels selected from the second digital image. The first digital image also includes at least one non-text string element. A computer processor is configured to search the first or second digital images for a text string and identify whether the text string is a candidate text string based on at least one first criteria associated with the said text string. Upon determining the text string is a candidate text string, the method creates a text label for the first digital image based upon the candidate text string.

Claims

1. A method for generating a portion of a test description for testing a graphical user interface (GUI) of a remote system under test, the method being operable to create a text label for a reference digital image utilized in the test description, the reference digital image comprising a group of pixels selected from and comprising a portion of a digital image of the GUI of the system under test and including at least one image object, the method comprising the step of using a computer processor to:

search at least one of the reference image or the digital image of the GUI for a text string;

identify whether the text string is a candidate text string based on at least one first criteria associated with the said text string;

create a text label for the reference digital image based upon an identified candidate text string; and

insert the text label corresponding to the image object into the test description.

2. The method as claimed in claim 1 wherein identifying a text string as a candidate text string comprises:

comparing the said at least one first criteria to a first threshold value associated with the said first criteria; and

,

identifying the text string as a candidate text string if the said first criteria exceeds the associated first threshold value.

3. The method as claimed in claim 1 wherein the at least one first criteria is any one or more of:

the percentage of alphanumeric characters in the text string;

or,

the number of characters in the text string.

4. The method as claimed in claim 1 comprising the steps of:

creating a rating for a candidate text string based upon at least one second criteria associated with the respective candidate text string;

comparing the said rating to a second threshold value; and

,

creating the text label based upon the candidate text string if the rating exceeds the second threshold value.

5. The method as claimed in claim 4 wherein the said at least one second criteria is based upon any of:

a comparison based upon any one or more of;

the distance from the candidate text string to the group of pixels;

or,

a spatial image noise level between the candidate text string and the image object;

or,

the direction of the candidate text string from the edge of the group of pixels;

or,

the language of the candidate text string.

6. The method as claimed in claim 1 further comprising the steps of:

searching for one or more further text strings in the reference image or the digital image of the GUI; and

,

identifying whether each of the one or more further text strings is a candidate string based on at least one first criteria associated with each said text string.

7. The method as claimed in claim 6 comprising the steps of:

searching for a first text string; and

,

searching for a further text string if the said first text string is not a candidate test string comprising a rating exceeding a first threshold value.

8. The method as claimed in claim 6 wherein searching for the said text strings comprises searching only within a first search area;

the first search area comprising a portion of the digital image of the GUI.

9. The method as claimed in claim 6 comprising the steps of:

identifying whether each said text string is a candidate text string,

creating a rating for each identified candidate text string.

10. The method as claimed in claim 9 comprising the step of:

modifying at least one of the said ratings by comparing said at least one rating to at least another of the said ratings of the plurality of candidate test strings.

11. The method as claimed in claim 9 comprising the steps of:

identifying the candidate text string comprising the highest rating;

comparing the said highest rating with a second threshold value;

determining whether to create the label based upon the said comparison.

12. The method as claimed in claim 11 comprising the step of:

creating the label based upon the candidate text string with the highest rating if the said rating exceeds the second threshold value.

13. The method as claimed in claim 11 comprising the step of:

defining a further search area within the digital image of the GUI if the said highest rating does not exceed the second threshold value.

14. The method as claimed in claim 1 comprising the steps of:

searching for further text strings within a further search area within the digital image of the GUI; and

,

creating a text label according to the method of claim 1.

15. The method as claimed in claim 1 wherein the reference image is associated with one or more event pixels in the digital image of the GUI;

the one or more event pixels being associated with a computer application event.

16. The method as claimed in claim 15 wherein the reference digital image is associated with position data providing the relative location of:

the one or more pixels in the digital image of the GUI that are associated with a computer application event;

with respect to;

a point within the group of pixels of the reference digital image.

17. The method as claimed in claim 16 comprising the steps of:

creating a command line in a computer script;

the command line;

comprising the label; and

,

being associated with the reference digital image.

18. The method as claimed in claim 17 wherein the command line comprises instructions to:

search a further digital image for the group of pixels corresponding to the reference digital image; and

,

execute a computer application event associated with one or more pixels in the further digital image using the position data.

19. The method as claimed in claim 1 wherein the step of searching for a text string comprises:

identifying a text string; and

,

truncating the text string up to a predetermined number of characters.

20. A non-transitory computer-readable medium comprising instructions that, when executed by a processor, are configured to carry out a method of generating a portion of a test description for testing a graphical user interface (GUI) of a remote system under test, the method being operable to create a text label for a reference digital image comprising a group of pixels selected from and comprising a portion of a digital image of the GUI of the system under test and including at least one image object, the instructions further configured to cause the processor to:

search at least one of the reference image or the digital image of the GUI for a text string;

identify whether the text string is a candidate text string based on at least one first criteria associated with the said text string;

create a text label for the reference digital image based upon an identified candidate text string; and

insert the text label corresponding to the image object into the test description.

21. A computing device comprising:

a processor; and

a memory device comprising instructions configured to cause the processor to perform a method of generating a portion of a test description for to test a graphical user interface (GUI) of a remote system under test, the method being operable to create a text label for a reference digital image utilized in the test description the reference digital image comprising a group of pixels selected from and comprising a portion of a digital image of the GUI of the system under test and including at least one image object, the instructions configured to cause the processor to;

search at least one of the reference image or the digital image of the GUI for a text string;

identify whether the text string is a candidate text string based on at least one first criteria associated with the said text string;

create a text label for the reference digital image based upon an identified candidate text string; and

insert the text label corresponding to the image object into the test description.