DISCRIMINATING AMBIGUOUS EXPRESSIONS TO ENHANCE USER EXPERIENCE

• US 20160188565A1
• Filed: 12/30/2014
• Published: 06/30/2016
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Robichaud, Jean-Philippe, Sarikaya, Ruhi
• Granted Patent: US 9,836,452 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3325 Reformulation based on results of preceding query
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/3335 Syntactic pre-processing, e.g. stopword elimination, stemming
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 16/3349 Reuse of stored results of previous queries
• CPC Class Codes: G06F 40/295 Named entity recognition
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

Methods and systems are provided for discriminating ambiguous expressions to enhance user experience. For example, a natural language expression may be received by a speech recognition component. The natural language expression may include at least one of words, terms, and phrases of text. A dialog hypothesis set from the natural language expression may be created by using contextual information. In some cases, the dialog hypothesis set has at least two dialog hypotheses. A plurality of dialog responses may be generated for the dialog hypothesis set. The dialog hypothesis set may be ranked based on an analysis of the plurality of the dialog responses. An action may be performed based on ranking the dialog hypothesis set.

Claims

1. A system comprising:

at least one processor; and

memory encoding computer executable instructions that, when executed by at least one processor, perform a method for discriminating ambiguous requests comprising;

receiving a natural language expression, wherein the natural language expression includes at least one of words, terms, and phrases of text;

creating a dialog hypothesis set from the natural language expression by using contextual information, wherein the dialog hypothesis set has at least two dialog hypotheses;

generating a plurality of dialog responses for the dialog hypothesis set;

ranking the dialog hypothesis set based on an analysis of the plurality of the dialog responses; and

performing an action based on ranking the dialog hypothesis set.

2. The system of claim 1, wherein the natural language expression is at least one of a spoken language input and a textual input.

3. The system of claim 1, wherein the contextual information includes at least one of information extracted from a previously received natural language expression, a response to a previously received natural language expression, client context, and knowledge content.

4. The system of claim 3, wherein the information extracted from the previously received natural language expression includes at least a domain prediction, an intent prediction, and a slot type.

5. The system of claim 1, wherein creating the dialog hypothesis set comprises:

extracting at least one feature from the natural language expression; and

generating at least two dialog hypotheses, where each dialog hypothesis of the dialog hypothesis set includes a different natural language expression having at least one extracted feature.

6. The system of claim 1, wherein generating a plurality of dialog responses for the dialog hypothesis set comprises generating a plurality of responses for each dialog hypothesis of the dialog hypothesis set.

7. The system of claim 1, wherein generating a plurality of dialog responses for the dialog hypothesis set comprises at least one of sending the dialog hypotheses to a web backend engine and sending the dialog hypotheses to a domain specific component.

8. The system of claim 1, wherein ranking the dialog hypothesis set based on an analysis of the plurality of the dialog responses comprises:

extracting features from the at least two dialog hypotheses in the dialog hypothesis set; and

calculating a score for the extracted features, wherein the calculated score is indicative of the dialog hypothesis rank within the dialog hypothesis set.

9. The system of claim 1, wherein ranking the dialog hypothesis set based on an analysis of the plurality of the dialog responses comprises comparing the plurality of the dialog responses with a plurality of logged dialog responses.

10. The system of claim 1, wherein performing an action based on ranking the dialog hypothesis set comprises:

using a highest ranked dialog hypothesis to query a web backend engine for results; and

sending the results to a user of a client computing device.

11. A system comprising:

a speech recognition component for receiving a plurality of natural language expressions, wherein the plurality of natural language expressions include at least one of words, terms, and phrases of text; and

a dialog component for;

creating a first fallback query from the plurality of natural language expressions, wherein creating the first fallback query comprises concatenating the plurality of natural language expressions; and

sending the at least one fallback query to a backend engine for generating search results from the at least one fallback query.

12. The system of claim 11, further comprising the dialog component for receiving the search results from the backend engine.

13. The system of claim 11, further comprising the dialog component for performing a stop-word removal analysis on the plurality of natural language expressions.

14. The system of claim 13, further comprising the dialog component for creating a second fallback query from the plurality of natural language expressions, wherein creating the second fallback query comprises concatenating the stop-word removal analysis performed on the plurality of natural language expressions.

15. The system of claim 11, further comprising the dialog component for extracting semantic entities from the plurality of natural language expressions.

16. The system of claim 15, further comprising the dialog component for creating a third fallback query from the plurality of natural language expressions, wherein creating the third fallback query comprises concatenating the semantic entities extracted from the plurality of natural language expressions.

17. One or more computer-readable storage media, having computer-executable instructions that, when executed by at least one processor, perform a method for training a dialog component to discriminate ambiguous requests, the method comprising:

creating a dialog hypothesis set from a natural language expression by using contextual information, wherein the dialog hypothesis set has at least two dialog hypotheses;

generating a plurality of dialog responses for the dialog hypothesis set;

comparing the plurality of dialog responses with a plurality of logged dialog responses;

determining whether at least one of the plurality of dialog responses matches at least one of the logged dialog responses; and

when it is determined that at least one of the plurality of dialog responses matches at least one of the logged dialog responses, labeling at least one of the two dialog hypotheses in the dialog hypothesis set corresponding to the at least one dialog response that matches the at least one logged dialog response.

18. The computer-readable storage media of claim 17, wherein the plurality of logged dialog responses includes a plurality of responses generated from the natural language expression.

19. The computer-readable storage media of claim 17, wherein creating the dialog hypothesis set comprises:

extracting at least one feature from the natural language expression; and

generating at least two dialog hypotheses, where each dialog hypothesis of the dialog hypothesis set includes a different natural language expression having at least one extracted feature.

20. The computer-readable storage media of claim 19, wherein labeling at least one of the two dialog hypotheses in the dialog hypothesis set corresponding to the at least one dialog response that matches the at least one logged dialog response indicates that the natural language expression having the at least one extracted feature can be used to generate relevant responses.