Triangular method for hypotheses filtration in a cognitive control framework
First Claim
1. A method of reducing the number of hypotheses for locations of an active object in a saved image generated by a graphical user interface (GUI) of an application program comprising:
- determining possible triangles for the saved image, wherein vertices of the triangles are points where the active object and any two additional objects of the saved image are located;
determining possible pairs of hypotheses corresponding to the two additional objects from a current playback image corresponding to the saved image;
determining triangles corresponding to the possible pairs of hypotheses and filtering the detected triangles;
determining vertices with weights for similar triangles of the current playback image; and
calculating, at a processor, a weight for every hypothesis of the active object and filtering hypotheses of the active object on the current playback image based on a weight bound.
1 Assignment
0 Petitions
Accused Products
Abstract
Reducing the number of hypotheses for locations of an active object in a saved image generated by a graphical user interface (GUI) of an application program may be accomplished by determining possible triangles for the saved image, wherein vertices of the triangles are points where the active object and any two additional objects of the saved image are located, determining possible pairs of hypotheses corresponding to the two additional objects from a current playback image corresponding to the saved image, determining triangles corresponding to the possible pairs of hypotheses and filtering the detected triangles, determining vertices with weights for similar triangles of the current playback image, and calculating a weight for every hypothesis of the active object and filtering hypotheses of the active object on the current playback image based on a weight bound.
-
Citations
24 Claims
-
1. A method of reducing the number of hypotheses for locations of an active object in a saved image generated by a graphical user interface (GUI) of an application program comprising:
-
determining possible triangles for the saved image, wherein vertices of the triangles are points where the active object and any two additional objects of the saved image are located; determining possible pairs of hypotheses corresponding to the two additional objects from a current playback image corresponding to the saved image; determining triangles corresponding to the possible pairs of hypotheses and filtering the detected triangles; determining vertices with weights for similar triangles of the current playback image; and calculating, at a processor, a weight for every hypothesis of the active object and filtering hypotheses of the active object on the current playback image based on a weight bound. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An article comprising:
- a storage medium readable by a processor, the storage medium having store thereon instructions, which when executed, result in reducing the number of hypotheses for locations of an active object in a saved image generated by a graphical user interface (GUI) of an application program by
determining possible triangles for the saved image, wherein vertices of the triangles are points where the active object and any two additional objects of the saved image are located; determining possible pairs of hypotheses corresponding to the two additional objects from a current playback image corresponding to the saved image; determining triangles corresponding to the possible pairs of hypotheses and filtering the detected triangles; determining vertices with weights for similar triangles of the current playback image; and calculating a weight for every hypothesis of the active object and filtering hypotheses of the active object on the current playback image based on a weight bound. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
- a storage medium readable by a processor, the storage medium having store thereon instructions, which when executed, result in reducing the number of hypotheses for locations of an active object in a saved image generated by a graphical user interface (GUI) of an application program by
-
17. A cognitive control framework system for automatically controlling execution of an application program having a graphical user interface comprising:
-
a recording component comprising hardware, adapted to capture user input data and images displayed by the graphical user interface during a recording phase of execution of the application program, and to analyze the captured user input data and displayed images to generate an execution scenario during the recording phase; and a playback component adapted to perform image analysis on images displayed by the graphical user interface as a result of processing the simulated user input data during the playback phase and captured displayed images from the recording phase by, the playback component being adapted to reduce the number of hypotheses for locations of an active object in a saved image generated by a graphical user interface (GUI) of an application program by, at a processor; determining possible triangles for the saved image, wherein vertices of the triangles are points where the active object and any two additional objects of the saved image are located; determining possible pairs of hypotheses corresponding to the two additional objects from a current playback image corresponding to the saved image; determining triangles corresponding to the possible pairs of hypotheses and filtering the detected triangles; determining vertices with weights for similar triangles of the current playback image; and calculating a weight for every hypothesis of the active object and filtering hypotheses of the active object on the current playback image based on a weight bound. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification