Systems And Methods For Managing Multiple Grammars in a Speech Recognition System

• US 20100191529A1
• Filed: 03/31/2010
• Published: 07/29/2010
• Est. Priority Date: 02/04/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Yip, Clement Chun Pong, Falcon, Stephen Russell, Miller, David Michael, Banay, Dan
• Granted Patent: US 8,447,616 B2
• Time in Patent Office: Days
• US Class Current: 704/231
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context

Abstract

Systems and methods are described for a speech system that manages multiple grammars from one or more speech-enabled applications. The speech system includes a speech server that supports different grammars and different types of grammars by exposing several methods to the speech-enabled applications. The speech server supports static grammars that do not change and dynamic grammars that may change after a commit. The speech server provides persistence by supporting persistent grammars that enable a user to issue a command to an application even when the application is not loaded. In such a circumstance, the application is automatically launched and the command is processed. The speech server may enable or disable a grammar in order to limit confusion between grammars. Global and yielding grammars are also supported by the speech server. Global grammars are always active (e.g., “call 9-1-1”) while yielding grammars may be deactivated when an interaction whose grammar requires priority is active.

Claims

1. A computer system, comprising:

memory;

a processor coupled to the memory for managing multiple applications;

a speech engine configured to recognize commands from a user and make announcements to the user;

an interaction manager having an interface through which multiple applications communicate through a speech server, and a speech application programming interface through which the speech server communicates with the speech engine;

wherein the interaction manager manages concurrent processing of interactions submitted by the applications;

a master grammar table comprising a speech recognition grammar that is registered with the speech server by the applications;

the speech server passing a recognition of a grammar upon receiving an indication that the recognition of the grammar occurred in an interaction to a corresponding application that registered the grammar;

wherein when the corresponding application is unloaded and not running, the speech server automatically loads the unloaded application in response to receiving a command included in the grammar used by the unloaded application; and

the interaction manager moves interactions that are considered a high priority to a beginning of an order to be processed, receiving a high priority interaction and interrupting an interaction that is being processed when the high priority interaction is received, while other interactions are processed as submitted, on a first-in-first-out basis, wherein the order to be processed is maintained in an interaction list by the interaction manager.

2. The computer system as recited in claim 1, wherein the computer system is a server.

3. The computer system as recited in claim 1, wherein the computer system is a hand-held device, the handheld device is a phone.

4. The computer system as recited in claim 1, wherein the interaction manager establishes a chain of interactions that constitutes a conversation, wherein the interaction manager waits during a pre-determined grace period or time out for a submission of a subsequent interaction in the conversation before processing a next interaction in the interaction list.

5. The computer system as recited in claim 1, wherein the speech server is further configured to:

support yielding grammars and global grammars for the applications; and

activate the global grammars and continuously monitor for recognitions in the global grammars.

6. The computer system as recited in claim 1, further comprising a grammar table for each grammar used by the applications, each grammar table containing one or more grammar attributes for the grammar with which it associated.

7. The computer system as recited in claim 6, wherein a grammar attribute in each grammar table is a grammar identifier that uniquely identifies the grammar associated with the grammar table.

8. The computer system as recited in claim 6, wherein a grammar attribute in each grammar table is a global flag that, if set, indicates that the grammar associated with the grammar table is a global grammar that may not be deactivated by the speech server.

9. The computer system as recited in claim 6, wherein:

a grammar attribute in each grammar table is a persistent flag that, if set, indicates that the grammar associated with the grammar table is a persistent grammar that may be launched by the speech server when the speech server recognizes a command belonging to the grammar; and

an application associated with the persistent grammar is launched by the speech server when the speech server recognizes a command belonging to the grammar.

10. The computer system as recited in claim 6, wherein a grammar attribute in each grammar table is an active flag that, if set, indicates that the grammar associated with the grammar is currently active.

11. A method, having computer-executable instructions to be executed by a computing device, the method comprising:

managing multiple applications;

registering a grammar by the multiple applications in a master grammar table;

receiving a first interaction from a first application that utilizes a first grammar, wherein a recognition of the first grammar is passed to the first application that registered the first grammar in a master grammar table;

identifying the first grammar associated with the first interaction;

processing the first interaction according to properties attributable to the identified first grammar;

receiving a second interaction from a second application that utilizes a second grammar, the second interaction being received while the first interaction is processing;

processing the second interaction according to properties attributable to the second grammar;

wherein the processing of the first interaction is interrupted and the processing of the second interaction is immediately commenced when an indication is detected directing that the second interaction be processed immediately; and

if the second application that registered the second grammar in the master grammar table is not loaded, then automatically loading the second application to execute one or more commands associated with the second interaction.

12. The method as recited in claim 11, wherein the computing device is a hand-held device, a phone.

13. The method as recited in claim 11, wherein the computing device is a server.

14. The method as recited in claim 11, further comprising:

moving the interaction that is considered a high priority to a beginning of an order to be processed, while other interactions are processed in the order in which the interactions are submitted, on a first-in-first-out basis, wherein the order to be processed is maintained in an interaction list; and

establishing a chain of interactions that constitutes a conversation, wherein a subsequent interaction in the conversation is waited for during a pre-determined grace period or time out before processing a next interaction in the interaction list.

15. The method as recited in claim 11, wherein the processing the second interaction further comprises processing the second interaction after the first interaction has concluded processing when a grammar attribute in the master grammar table corresponding to the second grammar indicates that the second grammar is a yielding grammar.

16. The method as recited in claim 11, wherein a grammar attribute included in the grammar table in the master grammar table is a grammar identifier that uniquely identifies a speech grammar associated with the grammar table.

17. The method as recited in claim 11, wherein a grammar attribute included in the grammar table in the master grammar table is an executable command that, when executed, launches a speech recognition application associated with the grammar table.

18. The method as recited in claim 11, wherein a grammar attribute included in the grammar table in the master grammar table is a global flag that, when set, indicates that a speech grammar associated with the grammar table is a global grammar that may only be deactivated by a speech-enabled application that submitted the interaction and, when not set, indicates that the speech grammar associated with the grammar table is a yielding grammar.

19. One or more computer-readable storage media containing computer-executable instructions that, when executed on a computer, perform the following acts:

managing multiple applications;

registering a grammar by the multiple applications in a master grammar table;

receiving a first interaction from a first application that utilizes a first grammar, wherein a recognition of the first grammar is passed to the first application that registered the first grammar in the master grammar table;

processing the first interaction according to properties attributable to the first grammar;

receiving a second interaction from a second application that utilizes a second grammar, the second interaction being received while the first interaction is processing; and

processing the second interaction according to properties attributable to the second grammar;

wherein the processing of the first interaction is interrupted and processing of the second interaction is immediately commenced if an indication is detected directing that the second interaction be processed immediately;

20. The one or more computer-readable storage media as recited in claim 19, further comprising:

moving the interaction that is considered a high priority to a beginning of an order, while other interactions are processed in the order submitted, on a first-in-first-out basis order; and

if the second application that registered the second grammar in the master grammar table is not loaded, then automatically loading the second application to execute one or more commands associated with the second interaction.