Semantic object synchronous understanding implemented with speech application language tags

• US 7,200,559 B2
• Filed: 05/29/2003
• Issued: 04/03/2007
• Est. Priority Date: 05/29/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Kuansan
• Primary Examiner(s): Azad; Abul K.
• Application Number:
  US10/448,018
• Publication Number:
  US 20040243393A1
• Time in Patent Office: 1,405 Days
• Field of Search: 704/9, 704/257, 704/270, 704/275
• US Class Current: 704/257
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A speech understanding system includes a language model comprising a combination of an N-gram language model and a context-free grammar language model. The language model stores information related to words and semantic information to be recognized. A module is adapted to receive input from a user and capture the input for processing. The module is further adapted to receive SALT application program interfaces pertaining to recognition of the input. The module is configured to process the SALT application program interfaces and the input to ascertain semantic information pertaining to a first portion of the input and output a semantic object comprising text and semantic information for the first portion by accessing the language model, wherein performing recognition and outputting the semantic object are performed while capturing continues for subsequent portions of the input.

Claims

1. A speech understanding system comprising:

a language model comprising a combination of an N-gram language model and a context-free grammar language model, the language model storing information related to words and semantic information to be recognized;

a module adapted to receive input from a user and capture the input for processing, the module being further adapted to receive SALT application program interfaces pertaining to recognition of the input, the module configured to process the SALT application program interfaces and the input to ascertain semantic information pertaining to a first portion of the input and output a semantic object comprising text and semantic information for the first portion by accessing the language model, wherein performing recognition and outputting the semantic object are performed while capturing continues for subsequent portions of the input.

2. The system of claim 1 wherein the language model comprises a unified language model.

3. The system of claim 1 wherein the language model comprises a semantic language model.

4. The system of claim 1 wherein the module is adapted to identify a listen object of SALT in a multiple mode in order to perform recognition and output the semantic object, while capturing continues for subsequent portions of the input.

5. The system of claim 4 wherein module is adapted to identify grammar objects to define a search space of the language model.

6. The system of claim 1 wherein module is adapted to identify grammar objects to define a search space of the language model.

7. A computer readable media including instructions readable by a computing device which, when implemented, cause the computing device to handle information by performing steps comprising:

receiving input from a user and capturing the input for processing;

receiving SALT application program interfaces to identify a language model to perform recognition and understanding, the language model adapted to provide text of input recognized and semantic information for the input received;

processing the input by accessing the language model to perform recognition on the input to ascertain semantic information pertaining to a first portion of the input and outputting a semantic object comprising text of the recognized input and semantic information for the first portion, wherein performing recognition and outputting the semantic object are performed while capturing continues for subsequent portions of the input.

8. The computer readable media of claim 7 wherein processing includes identifying a listen object of SALT in a multiple mode in order to perform recognition and output the semantic object, while capturing continues for subsequent portions of the input.

9. The computer readable media of claim 8 wherein receiving SALT application program interfaces includes identifying grammar objects to define a search space of the language model.

10. The computer readable media of claim 9 wherein receiving SALT application program interfaces includes identifying grammar objects to define a search space of the language model.