Speech recognition system and method

• US 8,175,883 B2
• Filed: 07/08/2011
• Issued: 05/08/2012
• Est. Priority Date: 12/23/1998
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Grant, Richard, McGregor, Pedro E.
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/179,034
• Publication Number:
  US 20120029921A1
• Time in Patent Office: 305 Days
• Field of Search: 704/270, 704/275, 704/270.1, 704/249, 704/254, 704/231, 704/251, 704/257, 704/9, 704/277, 704/260, 370/261, 370/342, 379/114.2, 379/11.28, 379/112.01, 455/557, 455/412.1
• US Class Current: 704/270
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 2015/228 of application context

Abstract

According to the present invention, a method for integrating processes with a multi-faceted human centered interface is provided. The interface is facilitated to implement a hands free, voice driven environment to control processes and applications. A natural language model is used to parse voice initiated commands and data, and to route those voice initiated inputs to the required applications or processes. The use of an intelligent context based parser allows the system to intelligently determine what processes are required to complete a task which is initiated using natural language. A single window environment provides an interface which is comfortable to the user by preventing the occurrence of distracting windows from appearing. The single window has a plurality of facets which allow distinct viewing areas. Each facet has an independent process routing its outputs thereto. As other processes are activated, each facet can reshape itself to bring a new process into one of the viewing areas. All activated processes are executed simultaneously to provide true multitasking.

Claims

1. A method for integrating processes within a voice command human interface, comprising:

electronically receiving a voice signal comprising a contextually defined command sequence;

processing the voice signal to generate a data stream;

using at least one processor, parsing executable commands from the data stream;

determining a set of computer-implemented processes appropriate for execution of the parsed commands; and

routing the parsed commands to the set of computer-implemented processes for execution.

2. The method of claim 1, wherein said processing comprises processing the voice signal using a context-dependent natural language model.

3. The method of claim 1, wherein the data stream comprises a text representation.

4. The method of claim 1, wherein said parsing comprises comparing a set of text representation grammars to a known vocabulary table.

5. The method of claim 1, further comprising concurrently executing the parsed commands.

6. The method of claim 1, further comprising rendering a graphical user interface comprising first and second windows, the first window presenting an output from a first process in the set of computer-implemented processes and the second window presenting an output from a second process in the set of computer-implemented processes.

7. The method of claim 1, further comprising rendering a graphical user interface comprising first and second facets, the first facet presenting an output from a first process in the set of computer-implemented processes and the second facet presenting an output from a second process in the set of computer-implemented processes.

8. A system method for integrating processes within a voice command human interface, the system comprising:

a communication interface;

at least one memory to store processor-executable instructions; and

at least one processor coupled to the communication interface and the at least one memory, wherein upon execution of the processor-executable instructions by the at least one processor, the at least one processor;

A) controls the communication interface so as to electronically receive a voice signal comprising a contextually defined command sequence;

B) processes the voice signal to generate a data stream;

C) parses executable commands from the data stream;

D) determines a set of computer-implemented processes appropriate for execution of the parsed commands; and

E) routes the parsed commands to the set of computer-implemented processes for execution.

9. The system of claim 8, wherein in B) the at least one processor processes the voice signal using a context-dependent natural language model.

10. The system of claim 8, wherein the data stream comprises a text representation.

11. The system of claim 8, wherein in C) the at least one processor compares a set of text representation grammars to a known vocabulary table.

12. The system of claim 8, wherein the at least one processor further concurrently executes the parsed commands.

13. The system of claim 8, wherein the at least one processor further renders a graphical user interface comprising first and second windows, the first window presenting an output from a first process in the set of computer-implemented processes and the second window presenting an output from a second process in the set of computer-implemented processes.

14. The system of claim 8, wherein the at least one processor further renders a graphical user interface comprising first and second facets, the first facet presenting an output from a first process of the computer-implemented processes and the second facet presenting an output from a second process of the computer-implemented processes.

15. A computer-readable storage medium encoded with instructions that, when executed by at least one processor, perform a method for integrating processes within a voice command human interface, comprising:

electronically receiving a voice signal comprising a contextually defined command sequence;

processing the voice signal to generate a data stream;

using at least one processor, parsing executable commands from the data stream;

determining a set of computer-implemented processes appropriate for execution of the parsed commands; and

routing the parsed commands to the set of computer-implemented processes for execution.

16. The computer-readable storage medium of claim 15, wherein said processing comprises processing the voice signal using a context-dependent natural language model.

17. The computer-readable storage medium of claim 15, wherein the data stream comprises a text representation.

18. The computer-readable storage medium of claim 15, wherein said parsing comprises comparing a set of text representation grammars to a known vocabulary table.

19. The computer-readable storage medium of claim 15, wherein the method further comprises concurrently executing the parsed commands.

20. The computer-readable storage medium of claim 15, wherein the method further comprises rendering a graphical user interface comprising first and second windows, the first window presenting an output from a first process in the set of computer-implemented processes and the second window presenting an output from a second process in the set of computer-implemented processes.