System and method for relating syntax and semantics for a conversational speech application

• US 7,249,018 B2
• Filed: 10/25/2001
• Issued: 07/24/2007
• Est. Priority Date: 01/12/2001
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Ross, Steven I., Brownholtz, Elizabeth A., MacAllister, Jeffrey G., Alweis, Julie F., Armes, Robert C.
• Primary Examiner(s): HARPER, V PAUL
• Application Number:
  US10/004,289
• Publication Number:
  US 20020095286A1
• Time in Patent Office: 2,098 Days
• Field of Search: 704/251, 704/235, 704/255, 704/257
• US Class Current: 704/257
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A conversation manager processes spoken utterances from a user of a computer. The conversation manager includes a semantics analysis module and a syntax manager. A domain model that is used in processing the spoken utterances includes an ontology (i.e., world view for the relevant domain of the spoken utterances), lexicon, and syntax definitions. The syntax manager combines the ontology, lexicon, and syntax definitions to generate a grammatic specification. The semantics module uses the grammatic specification and the domain model to develop a set of frames (i.e., internal representation of the spoken utterance). The semantics module then develops a set of propositions from the set of frames. The conversation manager then uses the set of propositions in further processing to provide a reply to the spoken utterance.

Claims

1. A computer method for analyzing spoken utterances comprising common language words in a speech-enabled environment, comprising the steps of:

generating a grammatic specification suitable for processing the spoken utterances based on a domain model for a speech-enabled application and based on a syntax template for the domain model, the domain model providing the grammatic specification with built-in meaning, said step of generating including, through the syntax template, applying a general syntax to an ontological model such that an annotated grammar is formed, the grammatic specification including the annotated grammar;

processing a recognition message, based on one of the spoken utterances recognized by a speech engine, to produce an initial semantic representation of the recognized spoken utterance based on the grammatic specification and the domain model; and

providing a set of propositions that represent the recognized spoken utterance, the set of propositions based on the initial semantic representation and the domain model.

2. The computer method of claim 1, wherein the step of generating a grammatic specification comprises the steps of:

receiving an ontological description of the domain model based on entities, classes, and attributes;

receiving syntax templates for the domain model specifying legal word sequences based on the ontological description; and

combining the ontological description, a lexicon, and the syntax templates to generate the grammatic specification.

3. The computer method of claim 2, wherein the domain model comprises a lexicon of words associated with the speech-enabled application, said lexicon providing synonyms and parts of speech information for elements of the ontological description, and wherein the grammatic specification is based on said lexicon.

4. The computer method of claim 1, wherein the domain model comprises an ontological description based on entities, classes, and attributes.

5. The computer method of claim 1, wherein the domain model comprises a syntax specification and the grammatic specification is based on the syntax specification.

6. The computer method of claim 1, wherein the grammatic specification is a Backus Naur Form grammar.

7. The computer method of claim 1, wherein the initial semantic representation is based on a frame structure representing the recognized spoken utterance.

8. A system for analyzing spoken utterances comprising common language words, comprising:

a syntax manager for generating a grammatic specification suitable for processing the spoken utterances recognized by a speech engine based on a domain model for a speech-enabled application and based on a syntax template for the domain model, the domain model providing the grammatic specification with built-in meaning, the syntax manager applying a general syntax through the syntax template to an ontological model such that an annotated grammar is formed, the grammatic specification including the annotated grammar; and

a semantics analysis module for processing a recognition message based on one of the spoken utterances recognized by a speech engine to produce an initial semantic representation of the recognized spoken utterance based on the grammatic specification and the domain model; and

the semantic analysis module providing a set of propositions that represent the recognized spoken utterance, the set of propositions based on the initial semantic representation and the domain model.

9. The system of claim 8, wherein the syntax manager receives an ontological description of the domain model based on entities, classes, and attributes;

and receives syntax templates for the domain model specifying legal word sequences based on the ontological description; and

wherein the syntax manager combines the ontological description and the syntax templates to generate the grammatic specification.

10. The system of claim 9, wherein the domain model comprises a lexicon of words associated with the speech-enabled application, the lexicon providing synonyms and parts of speech information for elements of the ontological description, and wherein the grammatic specification is based on the lexicon.

11. The system of claim 8, wherein the domain model comprises an ontological data structure based on entities, classes, and attributes.

12. The system of claim 8, wherein the domain model comprises a syntax specification and the grammatic specification is based on the syntax specification.

13. The system of claim 8, wherein the grammatic specification is a Backus Naur Form grammar.

14. The system of claim 8, wherein the initial semantic representation is based on a frame structure representing the recognized spoken utterance.

15. A computer program product comprising:

a computer usable medium for analyzing spoken utterances comprising common language words in a speech-enabled environment; and

a set of computer program instructions embodied on the computer useable medium, including instructions to;

generate a grammatic specification suitable for processing the spoken utterances based on a domain model for a speech-enabled application and based on a syntax template for the domain model, the domain model providing the grammatic specification with built-in meaning, wherein, through the syntax template, a general syntax is applied to an ontological model to form an annotated grammar, the grammatic specification including the annotated grammar;

process a recognition message, based on one of the spoken utterances recognized by a speech engine, to produce an initial semantic representation of the recognized spoken utterance based on the grammatic specification and the domain model; and

provide a set of propositions that represent the recognized spoken utterance, the set of propositions based on the initial semantic representation and the domain model.

16. The computer program product of claim 15, wherein the step of generating a grammatic specification comprises the steps of:

receiving an ontological description of the domain model based on entities, classes, and attributes;

receiving syntax templates for the domain model specifying legal word sequences based on the ontological description; and

combining the ontological description, a lexicon, and the syntax templates to generate the grammatic specification.

17. The computer program product of claim 16, wherein the domain model comprises a lexicon of words associated with the speech-enabled application, said lexicon providing synonyms and parts of speech information for elements of the ontological description of the domain model, and wherein the grammatic specification is based on said lexicon.

18. The computer program product of claim 15, wherein the domain model comprises an ontological data structure based on entities, classes, and attributes.

19. The computer program product of claim 15, wherein the domain model comprises a syntax specification and the grammatic specification is based on the syntax specification.

20. The computer program product of claim 15, wherein the grammatic specification is a Backus Naur Form grammar.

21. The computer program product of claim 15, wherein the initial semantic representation is based on a frame structure representing the recognized spoken utterance.

22. A system for analyzing spoken utterances comprising common language words in a speech-enabled environment, comprising:

means for generating a grammatic specification suitable for processing the spoken utterances based on a domain model for a speech-enabled application and based on a syntax template for the domain model, the domain model providing the grammatic specification with built-in meaning, the generating means a in general syntax through the syntax template to an ontological model such that an annotated grammar results the grammatic specification being formed of the annotated grammar;

means for processing a recognition message, based on one of the spoken utterances recognized by a speech engine, to produce an initial semantic representation of the recognized spoken utterance based on the grammatic specification and the domain model; and

means for providing a set of propositions that represent the recognized spoken utterance, the set of propositions based on the initial semantic representation and the domain model.