Multi-action voice macro method

• US 5,873,064 A
• Filed: 11/08/1996
• Issued: 02/16/1999
• Est. Priority Date: 11/08/1996
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ruback, Harvey M., De Armas, Mario E.
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): RICHARDSON, SCO
• Application Number:
  US08/746,426
• Time in Patent Office: 830 Days
• Field of Search: 704/275, 704/243, 704/231, 345/120, 345/145, 345/339, 345/326, 345/340
• US Class Current: 704/275
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 9/45512 Command shells
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context

Abstract

Method for implementing a multi-action voice macro (140) for a voice recognition navigator program (102) on a computer system. The method involves analyzing a target application program (22) to determine a plurality of target application states (24). Each of the target application states (24) is comprised of a plurality of window objects. The target application states are arranged in the form of one or more sub-context trees, with each of the sub-context trees comprised of a plurality of sub-context objects (50, 52, 54, 56, 58, 60, 62, 64, 66, 68). A set of user inputs is determined to which each of the window objects will be responsive. Each user input is assigned a corresponding voice macro (140) which simulates the user inputs in response to a spoken utterance. The voice macro (140) includes a link field (148), which identifies at least one linked macro to be executed by the navigator program (102) when a specific vocabulary phrase for the voice macro (140) is spoken by a user.

Claims

1. A method for implementing a multi-action voice macro for a voice recognition navigator program on a computer system, said method comprising the steps of:

scanning a target application program to determine a plurality of target application states, each of said target application states being comprised of a plurality of window objects;

organizing each of said target application states in the form of a sub-context tree, each of said sub-context trees being comprised of a plurality of sub-context objects, said sub-context tree defining a hierarchical relationship among said sub-context objects;

determining a set of user inputs to which each of said window objects will be responsive, and assigning a corresponding set of said voice macros to each of the sub-context objects for simulating each of said user inputs in response to a spoken utterance;

defining each of said voice macros to include a vocabulary phrase, said vocabulary phrase defining the spoken utterance to which each of said voice macros is responsive;

further defining at least one of said voice macros to include a link field, said link field identifying at least one linked macro to be executed by said navigator program when the vocabulary phrase for said voice macro is spoken by a user, said link field comprising a sub-context object path from the root of said sub-context tree, to the sub-context object containing said linked macro;

storing the sub-context trees in an electronic memory device as a context data file;

executing said voice recognition navigator program on said computer system simultaneously with said target application program so that a spoken utterance corresponding to said vocabulary phrase will cause said linked macro to be executed.

2. The method according to claim 1 wherein each of said voice macros is further defined to include a direct action field, said direct action field determining a direct action to be performed in response to a spoken utterance corresponding to the vocabulary phrase for said voice macro.

3. The method according to claim 1 further comprising the steps of:

determining a set of attributes associated with each of said window objects, and assigning a matching set of attributes to each of the sub-context objects; and

matching a current target application state to a corresponding sub-context tree to determine an active vocabulary set for the current target application state, said active vocabulary set comprised of a plurality of said voice macros.

4. The method according to claim 1 wherein said sub-context object path is defined by a series of digits in said link field which identify the ordinal value assigned to each sub-context object, relative to the sub-context object'"'"'s parent, at each level along the path.

5. The method according to claim 1 wherein said link field is further defined to include a sub-context object level for identifying the level within said sub-context tree at which the sub-context object containing said linked macro can be found.

6. The method according to claim 1 wherein said link field is further defined to include a sub-context action command for identifying the location of said linked macro within the sub-context object containing said linked macro.

7. The method according to claim 6 wherein said sub-context action command is defined to include a major function value which identifies a vocabulary set containing said linked macro.

8. The method according of claim 7 wherein said sub-context action command is further defined to include a minor function value, said minor function value indicating the ordinal value of said linked macro within said vocabulary set.

9. The method according to claim 6 further comprising the step of executing said direct action represented by the decoded phrase.

10. The method according to claim 9 wherein said step of executing said desired action represented by the decoded phrase is performed by said navigator program by matching said target sub-context object to a target window object of the current target application state.

11. The method according to claim 9 further comprising the step of executing said linked macro.

12. The method according to claim 11 wherein said step of executing said linked macro is performed by said navigator program by the steps of:

locating said linked macro in said sub-context tree based upon said sub-context object path, sub-context object level, and sub-context object action command;

matching the sub-context object containing said linked macro to a target window object of the current target application state.

13. The method according to claim 1, wherein each of said target application states is defined as a set of window objects for performing a specific user task.

14. The method of claim 1, wherein said target application sub-context tree is organized in a tree structure wherein the parent-child relationships between sub-context objects is the same as the parent-child relationships between the corresponding target application window objects.