Automating interactions with software user interfaces
First Claim
Patent Images
1. One or more computer-readable storage media comprising instructions configured to cause a computer to perform a method, the method comprising:
- reading signature information for a target component in a graphical user interface (GUI);
attempting to locate the target component in the GUI based at least in part on parent information for the target component, wherein the signature information comprises the parent information;
making a first determination by determining that the parent information is insufficient to locate the target component in the GUI;
as a result of the first determination, attempting to locate the target component in the GUI based at least in part on component description information;
making a second determination by determining that the component description information is insufficient to locate the target component in the GUI;
as a result of the second determination, attempting to locate the target component in the GUI based at least in part on peer component information, wherein the peer component information comprises a description of one or more components in the GUI having a same component type as the target component;
making a third determination by determining that the peer component information is insufficient to locate the target component in the GUI; and
as a result of the third determination, attempting to locate the target component based at least in part on a description of a label component associated with the target component, wherein the label component is configured to be displayed in the GUI.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus applies an action to a software application by determining a target object for the input action. The determination of the target object is performed by identifying the target object through socially identifying object information relative to a reference object. Then, the input action is applied to the target object.
-
Citations
12 Claims
-
1. One or more computer-readable storage media comprising instructions configured to cause a computer to perform a method, the method comprising:
-
reading signature information for a target component in a graphical user interface (GUI); attempting to locate the target component in the GUI based at least in part on parent information for the target component, wherein the signature information comprises the parent information; making a first determination by determining that the parent information is insufficient to locate the target component in the GUI; as a result of the first determination, attempting to locate the target component in the GUI based at least in part on component description information; making a second determination by determining that the component description information is insufficient to locate the target component in the GUI; as a result of the second determination, attempting to locate the target component in the GUI based at least in part on peer component information, wherein the peer component information comprises a description of one or more components in the GUI having a same component type as the target component; making a third determination by determining that the peer component information is insufficient to locate the target component in the GUI; and as a result of the third determination, attempting to locate the target component based at least in part on a description of a label component associated with the target component, wherein the label component is configured to be displayed in the GUI. - View Dependent Claims (2, 3, 4)
-
-
5. A method comprising:
-
reading, using a computer, signature information for a target component in a graphical user interface (GUI); attempting, using the computer, to locate the target component in the GUI based at least in part on parent information for the target component, wherein the signature information comprises the parent information; making, using the computer, a first determination by determining that the parent information is insufficient to locate the target component in the GUI; as a result of the first determination, attempting, using the computer, to locate the target component in the GUI based at least in part on component description information; making, using the computer, a second determination by determining that the component description information is insufficient to locate the target component in the GUI; as a result of the second determination, attempting, using the computer, to locate the target component in the GUI based at least in part on peer component information, wherein the peer component information comprises a description of one or more components in the GUI having a same component type as the target component; making, using the computer, a third determination by determining that the peer component information is insufficient to locate the target component in the GUI; and as a result of the third determination, attempting, using the computer, to locate the target component based at least in part on a description of a label component associated with the target component, wherein the label component is configured to be displayed in the GUI. - View Dependent Claims (6, 7, 8)
-
-
9. A system comprising:
-
a processor; and one or more computer-readable storage media comprising instructions configured to cause the processor to perform a method, the method comprising, reading signature information for a target component in a graphical user interface (GUI), attempting to locate the target component in the GUI based at least in part on parent information for the target component, wherein the signature information comprises the parent information, making a first determination by determining that the parent information is insufficient to locate the target component in the GUI, as a result of the first determination, attempting to locate the target component in the GUI based at least in part on component description information, making a second determination by determining that the component description information is insufficient to locate the target component in the GUI, as a result of the second determination, attempting to locate the target component in the GUI based at least in part on peer component information, wherein the peer component information comprises a description of one or more components in the GUI having a same component type as the target component, making a third determination by determining that the peer component information is insufficient to locate the target component in the GUI, and as a result of the third determination, attempting to locate the target component based at least in part on a description of a label component associated with the target component, wherein the label component is configured to be displayed in the GUI. - View Dependent Claims (10, 11, 12)
-
Specification