Method and apparatus utilizing speech grammar rules written in a markup language

• US 7,389,234 B2
• Filed: 01/12/2001
• Issued: 06/17/2008
• Est. Priority Date: 07/20/2000
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chambers, Robert L., Ellerman, Erik C., Schmid, Philipp H., Lipe, Ralph
• Primary Examiner(s): OPSASNICK, MICHAEL N
• Application Number:
  US09/759,474
• Publication Number:
  US 20020143529A1
• Time in Patent Office: 2,713 Days
• Field of Search: 704/2, 704/4, 704/10, 704/270.1
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 15/197 Probabilistic grammars, e.g. word n-grams
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: H04L 65/1101 Session protocols

Abstract

The present invention provides a method and apparatus that utilize a context-free grammar written in a markup language format. The markup language format provides a hierarchical format in which grammar structures are delimited within and defined by a set of tags. The markup language format also provides grammar switch tags that indicate a transitions from the context-free grammar to a dictation grammar or a text buffer grammar. In addition, the markup language format provides for the designation of code to be executed when particular grammar structures are recognized from a speech signal.

Claims

1. A computer-readable storage medium encoded with a speech recognition interface for a speech recognition engine, causing a computer to operate as elements comprising:

a compiler that produces a binary grammar from a markup language grammar written in a markup language, the markup language grammar comprising rule tags that delimit a grammar structure that may be referenced by other grammar structures within the markup language grammar by a name attribute of the rule tags wherein the name attribute is set within one of the rule tags;

a grammar engine that provides the binary grammar to the speech recognition engine.

2. The computer-readable storage medium of claim 1 wherein the markup language grammar is written in an extensible markup language.

3. The computer-readable storage medium of claim 1 wherein the markup language grammar represents a context-free grammar.

4. The computer-readable storage medium of claim 1 wherein the markup language grammar further comprises a script tag that delimits script code to be interpreted when the grammar structure delimited by a rule tag is recognized by the speech recognition engine.

5. The computer-readable storage medium of claim 1 wherein the rule tag further comprises an interpreter attribute that indicates that code is to be executed when the grammar structure delimited by the rule tag is recognized by the speech recognition engine.

6. The computer-readable storage medium of claim 5 wherein the markup language grammar further comprises a resource tag indicating at least one resource to be provided to the code associated with the interpreter attribute.

7. The computer-readable storage medium of claim 1 wherein the markup language grammar comprises a switch grammar tag that indicates to the speech recognition engine to switch to a different grammar during the recognition of at least one word.

8. The computer-readable storage medium of claim 7 wherein grammar switch tag is a dictation tag that indicates to the speech recognition engine to switch to a dictation grammar.

9. The computer-readable storage medium of claim 8 wherein the dictation tag indicates to the speech recognition engine to switch to the dictation grammar during the recognition of more than one word.

10. The computer-readable storage medium of claim 7 wherein the switch grammar tag is a text buffer tag that indicates to the speech recognition engine to switch to a grammar stored in a text buffer.

11. The computer-readable storage medium of claim 10 wherein the text buffer comprises a sequence of words and wherein the speech recognition engine identifies a sub-sequence of the words in the sequence of words from an input speech signal.

12. A computer-readable storage medium encoded with computer-executable instructions comprising:

an application providing a speech interface that expects to receive speech from the user as possible input; and

a speech grammar associated with the application and defining valid word patterns for the user'"'"'s speech, the speech grammar written in a markup language such that a start tag and an end tag having a first tag name that delimit a set of elements of the grammar are located between a second start tag and a second end tag that have a second tag name, the speech grammar comprising rule tags that delimit a valid grammar structure for the grammar and that comprise a name attribute set within a rule tag that is set equal to a name by which the grammar structure can be referenced within the speech grammar.

13. The computer-readable storage medium of claim 12 wherein the speech grammar comprises grammar tags representing the outermost tags of the grammar.

14. The computer-readable storage medium of claim 12 wherein the speech grammar further comprises rule reference tags that provide a reference to one grammar structure from within a second grammar structure.

15. The computer-readable storage medium of claim 12 wherein the speech grammar further comprises script tags delimiting script code that is to be interpreted when the grammar structure delimited by a pair of rule tags is recognized from a speech signal.

16. The computer-readable storage medium of claim 12 wherein the rule tags comprise a semantic property name attribute and a semantic property value attribute such that the semantic property represented by the semantic property name is set equal to the semantic property value when the grammar structure delimited by the rule tags is recognized from a speech signal.

17. The computer-readable storage medium of claim 12 wherein the grammar comprises optional tags that delimit a grammar structure that can be but does not have to be recognized from a speech signal in order for a grammar structure that contains the optional tag to be recognized from the speech signal.

18. The computer-readable storage medium of claim 12 wherein the speech grammar further comprises phrase tags that delimit at least one word in a grammar structure.

19. The computer-readable storage medium of claim 18 wherein the phrase tags comprise a semantic property name attribute and a semantic property value attribute such that the semantic property represented by the semantic property name is set equal to the semantic property value when the at least one word delimited by the phrase tags is recognized from a speech signal.

20. The computer-readable storage medium of claim 12 wherein the speech grammar further comprises list tags that delimit a list of alternative grammar structures.

21. The computer-readable storage medium of claim 20 wherein the list tags comprise a semantic property name attribute and a semantic property value attribute such that the semantic property represented by the semantic property name is set equal to the semantic property value when at least one of the alternative grammar structures delimited by the list tags is recognized from a speech signal.

22. The computer-readable storage medium of claim 12 wherein the rule tags further comprise an interpreter attribute that indicates whether code associated with the rule tags should be invoked when the grammar structure delimited by the rule tags is recognized as from a speech signal.

23. The computer-readable storage medium of claim 22 wherein the speech grammar further comprises resource tags that delimit the identity of a resource that is to be provided to the code associated with a rule tag.

24. The computer-readable storage medium of claim 22 wherein the code associated with rule tags receives values of semantic properties that have been set because the grammar structure delimited by the rule tags has been recognized from the speech signal.

25. The computer-readable storage medium of claim 12 wherein the speech grammar further comprises grammar switch tags that indicate that a different grammar should be used during a part of the speech recognition.

26. The computer-readable storage medium of claim 25 wherein the grammar switch tags comprise dictation tags that indicate that a dictation grammar should be used for the recognition of at least one word in the grammar structure.

27. The computer-readable storage medium of claim 25 wherein the grammar switch tags comprise text buffer tags that indicate that sub-sequences of words in a sequence of words should be used as a grammar for the recognition of at least one word in the grammar structure.