System and method of spoken language understanding in human computer dialogs

• US 9,263,031 B2
• Filed: 11/15/2013
• Issued: 02/16/2016
• Est. Priority Date: 12/07/2001
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Bangalore, Srinivas, Gupta, Narendra K., Rahim, Mazin G.
• Primary Examiner(s): PULLIAS, JESSE SCOTT
• Application Number:
  US14/081,166
• Publication Number:
  US 20140074477A1
• Time in Patent Office: 823 Days
• Field of Search: 704/1, 704/9, 704/251, 704/257, 704/231, 704/270.1, 704/275
• US Class Current: 1/1
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A system and method are disclosed that improve automatic speech recognition in a spoken dialog system. The method comprises partitioning speech recognizer output into self-contained clauses, identifying a dialog act in each of the self-contained clauses, qualifying dialog acts by identifying a current domain object and/or a current domain action, and determining whether further qualification is possible for the current domain object and/or current domain action. If further qualification is possible, then the method comprises identifying another domain action and/or another domain object associated with the current domain object and/or current domain action, reassigning the another domain action and/or another domain object as the current domain action and/or current domain object and then recursively qualifying the new current domain action and/or current object. This process continues until nothing is left to qualify.

Claims

1. A method comprising:

identifying, in a domain-independent manner, a dialog act for an independent clause of a speech recognizer output;

identifying, in a domain-dependent manner, an object within the independent clause; and

recursively generating, via a processor, for each sub-independent clause within the independent clause, a semantic representation using the dialog act and the object of the independent clause.

2. The method of claim 1, wherein the semantic representation is used by a dialog manager in a spoken dialog system to determine a response to a user input.

3. The method of claim 1, further comprising:

identifying, in the domain-dependent manner, an action within each of the independent clause, wherein recursively generating the semantic representation further comprises using the action.

4. The method of claim 1, wherein while recursively generating the semantic representation, additional objects are extracted from the independent clause.

5. The method of claim 1, wherein identifying the object comprises using a domain specific classifier.

6. The method of claim 1, wherein recursively generating the semantic representation further comprises identifying relationships between the dialog act and the object.

7. The method of claim 1, wherein recursively generating the semantic representation further comprises filling in a data structure associated with the dialog act.

8. A system comprising:

a processor; and

a computer-readable storage device having instructions stored which, when executed by the processor, cause the processor to perform operations comprising;

identifying, in a domain-independent manner, a dialog act for an independent clause of a speech recognizer output;

identifying, in a domain-dependent manner, an object within the independent clause; and

recursively generating, for each sub-independent clause within the independent clause, a semantic representation using the dialog act and the object of the independent clause.

9. The system of claim 8, wherein the semantic representation is used by a dialog manager in a spoken dialog system to determine a response to a user input.

10. The system of claim 8, the computer-readable storage device having additional instructions stored which result in the operations further comprising:

identifying, in the domain-dependent manner, an action within the independent clause, wherein recursively generating the semantic representation further comprises using the action.

11. The system of claim 8, wherein while recursively generating the semantic representation, additional objects are extracted from the independent clause.

12. The system of claim 8, wherein identifying the object comprises using a domain specific classifier.

13. The system of claim 8, wherein recursively generating the semantic representation further comprises identifying relationships between the dialog act and the object.

14. The system of claim 8, wherein recursively generating the semantic representation further comprises filling in a data structure associated with the dialog act.

15. A non-transitory computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

identifying, in a domain-independent manner, a dialog act for an independent clause of a speech recognizer output;

identifying, in a domain-dependent manner, an object within the independent clause; and

recursively generating, for each sub-independent clause within the independent clause, a semantic representation using the dialog act and the object of the independent clause.

16. The non-transitory computer-readable storage device of claim 15, wherein the semantic representation is used by a dialog manager in a spoken dialog system to determine a response to a user input.

17. The non-transitory computer-readable storage device of claim 15, the computer-readable storage device having additional instructions stored which result in the operations further comprising:

identifying, in the domain-dependent manner, an action within the independent clause, wherein recursively generating the semantic representation further comprises using the action.

18. The non-transitory computer-readable storage device of claim 15, wherein while recursively generating the semantic representation, additional objects are extracted from the independent clause.

19. The non-transitory computer-readable storage device of claim 15, wherein identifying the object comprises using a domain specific classifier.

20. The non-transitory computer-readable storage device of claim 15, wherein recursively generating the semantic representation further comprises identifying relationships between the dialog act and the object.