Internal window object tree method for representing graphical user interface applications for speech navigation
First Claim
1. Method for representing a target software application program to a voice recognition navigator program on a computer system, said method comprising:
- analyzing an application program to determine a plurality of application states, each of said application states being comprised of a plurality of window objects;
organizing each of said application states in the form of a sub-context tree, each of said sub-context trees being comprised of a plurality of sub-context objects defining the hierarchical relationship among each of said sub-context objects;
determining a set of attributes associated with each of said window objects, and assigning a matching set of attributes to each of the sub-context objects;
storing the sub-context trees in a memory device of said computer system as a context data file;
executing said voice recognition navigator program on said computer system concurrently with said target application program;
analyzing said target application with said voice navigator program to determine a current target application state of said target application program and matching said current target application state to a corresponding sub-context tree by comparing a window object from the current target application state to at least one of said sub-context objects stored as part of said context data file;
defining an active vocabulary set for the current target application state by retrieving from said context data file at least one sub-context object vocabulary set.
1 Assignment
0 Petitions
Accused Products
Abstract
Method for representing a target software application program to a voice recognition navigator program on a computer system. The method requires analyzing an application program to determine a plurality of application states. Each of the application states is defined as a set of window objects within the application for performing a specific user task. According to the invention, each of the application states is preferably represented by a sub-context tree, comprised of a plurality of sub-context objects. The tree allows the navigator to associate decoded spoken commands to specific window objects.
-
Citations
17 Claims
-
1. Method for representing a target software application program to a voice recognition navigator program on a computer system, said method comprising:
-
analyzing an application program to determine a plurality of application states, each of said application states being comprised of a plurality of window objects; organizing each of said application states in the form of a sub-context tree, each of said sub-context trees being comprised of a plurality of sub-context objects defining the hierarchical relationship among each of said sub-context objects; determining a set of attributes associated with each of said window objects, and assigning a matching set of attributes to each of the sub-context objects; storing the sub-context trees in a memory device of said computer system as a context data file; executing said voice recognition navigator program on said computer system concurrently with said target application program; analyzing said target application with said voice navigator program to determine a current target application state of said target application program and matching said current target application state to a corresponding sub-context tree by comparing a window object from the current target application state to at least one of said sub-context objects stored as part of said context data file; defining an active vocabulary set for the current target application state by retrieving from said context data file at least one sub-context object vocabulary set. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
Specification