Method for integrating computer processes with an interface controlled by voice actuated grammars

• US 6,208,972 B1
• Filed: 12/23/1998
• Issued: 03/27/2001
• Est. Priority Date: 12/23/1998
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Totally Voice, Inc.
• Inventors: Grant, Richard, McGregor, Pedro E.
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): CHAWAN, VIJAY B
• Application Number:
  US09/219,916
• Time in Patent Office: 825 Days
• Field of Search: 704/270, 704/275, 704/231, 704/209, 704/257, 704/236, 704/243, 704/244, 704/245
• US Class Current: 704/275
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 2015/228 of application context

Abstract

According to the present invention, a method for integrating processes with a multi-faceted human centered interface is provided. The interface is facilitated to implement a hands free, voice driven environment to control processes and applications. A natural language model is used to parse voice initiated commands and data, and to route those voice initiated inputs to the required applications or processes. The use of an intelligent context based parser allows the system to intelligently determine what processes are required to complete a task which is initiated using natural language. A single window environment provides an interface which is comfortable to the user by preventing the occurrence of distracting windows from appearing. The single window has a plurality of facets which allow distinct viewing areas. Each facet has an independent process routing its outputs thereto. As other processes are activated, each facet can reshape itself to bring a new process into one of the viewing areas. All activated processes are executed simultaneously to provide true multitasking.

Claims

1. A method for controlling a plurality of processes by voice actuated grammars initiated by a user, each grammar having at least one phoneme, the steps comprising:

receiving an initial grammar from a process in response to said user initiating an utterance;

setting a command mode of operation when said initial grammar from said step of receiving is determined to be a command activation statement;

cycling through a first loop when in said command mode of operation;

under control of said first loop,

receiving a data stream from said process, said data stream containing at least one grammar, storing said data stream in a data storage location such that each said at least one grammar is in a separate location of said data storage location,

searching said data storage location for a valid command statement,

setting an error condition when said step of searching does not find said valid command statement,

processing said valid command statement when said step of searching finds said valid command statement, said valid command statement corresponding to at least one of said plurality of processes, and

setting said mode of operation to a wait mode of operation when said step of processing said valid command statement is completed.

2. A method for controlling a plurality of processes as in claim 1, wherein said step of receiving a grammar from a process is a step of receiving a grammar from a speech-to-text processor.

3. A method for controlling a plurality of processes as in claim 2, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table.

4. A method for controlling a plurality of processes as in claim 2, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table.

5. A method for controlling a plurality of processes as in claim 2, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands which are registered in a process registration database.

6. A method for controlling a plurality of processes as in claim 1, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table.

7. A method for controlling a plurality of processes as in claim 6, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands.

8. A method for controlling a plurality of processes as in claim 6, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands which are registered in a process registration database.

9. A method for controlling a plurality of processes as in claim 1, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands.

10. A method for controlling a plurality of processes as in claim 9, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands.

11. A method for controlling a plurality of processes as in claim 1, wherein said step of searching said data storage location for a valid command statement is a step of comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands which are registered in a process registration database.

12. A method for controlling a plurality of processes by voice actuated grammars initiated by a user, each grammar having at least one phoneme, the steps comprising:

receiving an initial grammar from a process in response to said user initiating an utterance, said process including a speech-to-text processor;

setting a command mode of operation when said initial grammar from said step of receiving is determined to be a command activation statement;

cycling through a first loop when in said command mode of operation;

under control of said first loop,

receiving a data stream from said process, said data stream containing at least one grammar,

storing said data stream in a data storage location such that each said at least one grammar is in a separate location of said data storage location,

searching said data storage location for a valid command statement, said step of searching includes comparing each said at least one grammar to a known vocabulary table, said vocabulary table containing a list of system commands and application commands which are registered in a process registration database;

setting an error condition when said step of searching does not find said valid command statement,

processing said valid command statement when said step of searching finds said valid command statement, said valid command statement corresponding to at least one of said plurality of processes, and

setting said mode of operation to a wait mode of operation when said step of processing said valid command statement is completed.