Method for recording and replaying mouse commands by recording the commands and the identities of elements affected by the commands
First Claim
1. In a computing system which includes a viewer screen and a user interface which enables a user to select and move images displayed on the viewing screen, a computer implemented method for recording in a data file user commands for later playback, the recording of user commands requiring syntactic analysis to determine an identity of an entity, the user commands being made by the user via selection and movement of images on the viewing screen and the user commands being executable by a first application process, the computer implemented method comprising the steps, performed by the computing system, of:
- (a) translating, by the fits application process, selection and movement of images on the viewing screen into semantic commands, the translation including performance of syntactic analysis of the selection and movement of images;
(b) concurrent with step (a) when syntactic analysis of selection and movement of images on the viewing screen indicate an entity on the computing system is to be operated upon by a semantic command and the first application process does not know the identity of the entity, performing the following substeps(b.1) generating, by the first application process, an interrogation message to identify the entity that is to be operated upon, and,(b.2) returning to the first application process, a response message identifying the entity; and
,(c) recording the semantic commands translated in step (a) including the identity of any entity identified in step (b) in the data file.
2 Assignments
0 Petitions
Accused Products
Abstract
An application program includes an action processor which receives messages containing user syntactic actions. These actions are translated into semantic commands. The semantic commands are sent to a command processor for execution.
The preferred embodiment of the computing system additionally includes an agent engine. The agent engine may be used to perform many functions. It may be used to receive semantic commands from an application, and to record the semantic commands for later playback. It may be used to send semantic commands from a task language file to an application program for execution by the command processor. It may be used to intercept semantic commands sent from action processor to the command processor. After the command is intercepted, the agent engine may be used to allow the semantic command to be executed, to prevent the semantic command from being executed.
48 Citations
15 Claims
-
1. In a computing system which includes a viewer screen and a user interface which enables a user to select and move images displayed on the viewing screen, a computer implemented method for recording in a data file user commands for later playback, the recording of user commands requiring syntactic analysis to determine an identity of an entity, the user commands being made by the user via selection and movement of images on the viewing screen and the user commands being executable by a first application process, the computer implemented method comprising the steps, performed by the computing system, of:
-
(a) translating, by the fits application process, selection and movement of images on the viewing screen into semantic commands, the translation including performance of syntactic analysis of the selection and movement of images; (b) concurrent with step (a) when syntactic analysis of selection and movement of images on the viewing screen indicate an entity on the computing system is to be operated upon by a semantic command and the first application process does not know the identity of the entity, performing the following substeps (b.1) generating, by the first application process, an interrogation message to identify the entity that is to be operated upon, and, (b.2) returning to the first application process, a response message identifying the entity; and
,(c) recording the semantic commands translated in step (a) including the identity of any entity identified in step (b) in the data file. - View Dependent Claims (2, 3, 4, 5)
-
-
6. In a computing system which includes a viewer screen and a user interface which enables a user to select and move images displayed on the viewing screen, semantic commands being generated by selecting and moving images on the viewing screen, a computer implemented method for playback of a plurality of stored semantic commands which are executable by an application process, the computer implemented method comprising the steps, performed by the computing system, of:
-
(a) reading from a data file, a first semantic command from the plurality of semantic commands; (b) receiving, by the application process, the first semantic command; (c) when an entity on the computing system, represented by a first image on the viewing screen, is to be operated upon by the computing system while executing the first semantic command performing the following substeps, (c.1) generating, by the application process, an interrogation message to identify the location of the first image on the viewing screen, and (c.2) returning to the application process a response message identifying the location of the first image on the viewing screen; and
,(d) executing the first semantic command, by the application process, while selecting and moving images on the viewing screen to identify to the user the first semantic command. - View Dependent Claims (7, 8, 9, 10)
-
-
11. In a computing system which includes a viewer screen and a user interface which enables a user to select and move images displayed on the viewing screen, a computer implemented method for recording user commands for later playback the recording of user commands requiring synmtactic analysis to determine an identity of an entity, the user commands being made by the user via selection and movement of images on the viewing screen and the user commands being executable by a first application process, the first application process controlling images in a first portion of the viewing screen, the computer implemented method comprising the steps, performed by the computing system, of:
-
(a) translating, by the first application process, selection and movement of images on the viewing screen into semantic commands, the translating including performing syntactic analysis upon the selection and movement of images; (b) concurrent with step (a) when syntactic analysis of selection and movement of images on the viewing screen indicate at least part of an operation is performed in a second portion of the viewing screen controlled by a second application process, performing the following substeps, (b.1) generating, by the first application process, a first interrogation message, sent to the second application process, requesting the second application process to identify itself to the first application process, and (b.2) returning, by the second application process to the first application process, a first response message which identifies the second application process to the first application process; and
,(c) recording, in a data file, the semantic command and the identity of the second application process when the second application process is identified in step (b.2). - View Dependent Claims (12)
-
-
13. In a computing system which includes a plurality of application processes running on the computing system and which includes a viewer screen and a user interface which enables a user to select and move images displayed on the viewing screen, semantic commands being generated by selecting and moving images on the viewing screen, a computer implemented method for playback of stored semantic commands which are executable by a first application process, the first application process controlling images in a first portion of the viewing screen, the computer implemented method comprising the steps, performed by the computing system, of:
-
(a) when at least part of an operation is to be performed in a second portion of the viewing screen controlled by a second application process, performing the following substeps, (a.1) generating, by the first application process, a first interrogation message asking application processes from the plurality of application processes which control portions of the viewing screen to identify themselves, (a.2) transmitting the first interrogation message to the application processes, and (a.3) after the transmitting in step (a.2), returning by each application process controlling a portion of the viewing screen, a response message identifying itself; and
,(b) after step (a), executing the semantic command by the first application. - View Dependent Claims (14, 15)
-
Specification