Training Statistical Dialog Managers in Spoken Dialog Systems With Web Data

• US 20120290509A1
• Filed: 09/16/2011
• Published: 11/15/2012
• Est. Priority Date: 05/13/2011
• Status: Active Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Heck, Larry Paul, Hakkani-Tur, Dilek, Iyer, Rukmini, Tur, Gokhan
• Application Number:
  US13/234,186
• Publication Number:
  US 20120290509A1
• Time in Patent Office: Days
• US Class Current: 706/11
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

Training for a statistical dialog manager may be provided. A plurality of log data associated with an intent may be received, and at least one step associated with completing the intent according to the plurality of log data may be identified. An understanding model associated with the intent may be created, including a plurality of queries mapped to the intent. In response to receiving a natural language query from a user that is associated with the intent a response to the user may be provided according to the understanding model.

Claims

1. A method for providing statistical dialog manager training, the method comprising:

receiving a spoken query from a user;

creating a belief state according to the spoken query, wherein the belief state comprises an estimated intent of the user;

determining whether at least one of a plurality of log data is associated with the estimated intent; and

in response to determining that the at least one of the plurality of log data is associated with the estimated intent;

updating the belief state according to at least one element of the at least one of the plurality of log data, and

providing a response to the user according to the updated belief state.

2. The method of claim 1, wherein the plurality of log data is associated with a plurality of web searches.

3. The method of claim 2, wherein the plurality of web searches are each associated with a common intent.

4. The method of claim 1, further comprising:

in response to determining that the at least one of the plurality of log data is not associated with the estimated intent;

querying the user for at least one additional cue,

receiving a response to the query from the user, and

updating the believe state according to the received response.

5. The method of claim 1, wherein the response provided to the user comprises a link to a web page.

6. The method of claim 1, wherein the response provided to the user comprises a suggested next action.

7. The method of claim 1, further comprising updating the belief state with the provided response.

8. The method of claim 7, further comprising:

receiving a second spoken query from the user;

determining whether the second spoken query is associated with the estimated intent; and

in response to determining that the second spoken query is associated with the estimated intent;

updating the belief state according to the second spoken query, and

providing a second response to the user according to the updated belief state.

9. The method of claim 8, further comprising:

determining whether the second spoken query is associated with a transition to a second intent; and

in response to determining that the second spoken query is associated with the transition;

creating a second belief state according to the second spoken query,

populating at least one element of the second belief state according to the previously created belief state, and

providing a third response to the user according to the second belief state.

10. The method of claim 9, wherein the belief state comprises at least one intent element, at least one domain element, and a plurality of slot elements.

11. The method of claim 10, wherein the plurality of slot elements each comprise qualifying data associated with achieving the estimated intent.

12. A system for providing statistical dialog manager training, the system comprising:

a memory storage; and

a processing unit coupled to the memory storage, wherein the processing unit is operable to;

receive a plurality of log data associated with an intent,

identify at least one step associated with completing the intent according to the plurality of log data,

create an understanding model associated with the intent,

map a plurality of queries to the intent,

in response to receiving a natural language query from a user, determine whether the natural language query is associated with the intent, and

in response to determining that the natural language query is associated with the intent, provide a response to the user according to the understanding model.

13. The system of claim 12, wherein the processing unit is further operative to:

identify at least one transition cue according to the plurality of log data; and

incorporate the at least one transition cue into the understanding model.

14. The system of claim 13, wherein the transition cue is associated with at least one of the following:

a new task associated with completing the intent and a second intent.

15. The system of claim 12, wherein the plurality of log data comprises a subset of a plurality of search log data associated with a plurality of users performing a plurality of searches associated with a plurality of intents.

16. The system of claim 15, wherein the plurality of log data is selected as being associated with the intent by identifying at least one web page known to be associated with the intent within the plurality of search log data.

17. The system of claim 15, wherein the plurality of log data is selected as being associated with the intent by identifying at least one search term known to be associated with the intent within the plurality of search log data.

18. The system of claim 12, wherein the processing unit is further operative to determine, for each of the plurality of log data, whether the intent was successfully accomplished.

19. The system of claim 12, wherein the processing unit is further operative to refine a belief state associated with the intent in response to receiving at least one additional natural language query from the user.

20. A computer-readable medium which stores a set of instructions which when executed performs a method for providing training for a statistical dialog manager, the method executed by the set of instructions comprising:

selecting a subset of a plurality of log data as being associated with an intent, wherein each of the subset of the plurality of log data comprises a session log associated with at least one of the following;

a keyword and a website;

determining whether at least one of the subset of log data is associated with a successful completion of the intent;

in response to determining that the at least one of the subset of log data is not associated with the successful completion of the intent, discarding the at least one of the subset of log data;

identifying a plurality of transition cues within the subset of log data, wherein each of the transition cues is associated with at least one of the following;

a new task associated with completing the intent and a second intent;

mapping a plurality of query terms to the intent according the subset of log data;

creating an understanding model associated with completing the intent according to the subset of log data;

receiving a natural language query from a user;

determining, according to the mapped plurality of query terms, whether the natural language query is associated with the intent; and

in response to determining that the natural language query is associated with the intent;

establishing a belief state associated with the natural language query,

populating the belief state according to the understanding model, and

providing a response to the user according to the belief state.