Method and system for predicting understanding errors in automated dialog systems
First Claim
1. A method of monitoring language understanding of a user'"'"'s input communication in an automated dialog system, comprising:
- determining whether a probability of understanding the user'"'"'s input communication exceeds a first threshold, wherein if the first threshold is exceeded, further dialog is conducted with the user and if the first threshold is not exceeded, the user is routed to a human for assistance; and
determining whether a probability of understanding the user'"'"'s input communication exceeds a second threshold, the second threshold being greater than the first threshold, wherein if the second threshold is exceeded, further dialog is conducted with the user using a current dialog strategy and if the second threshold is not exceeds, further dialog is conducted with the user using an adapted dialog strategy.
7 Assignments
0 Petitions
Accused Products
Abstract
This invention concerns a method and system for monitoring an automated dialog system for the automatic recognition of language understanding errors based on a user'"'"'s input communications. The method includes determining whether a probability of understanding the user'"'"'s input communication exceeds a first thresholds, where if the first threshold is exceeded, further dialog is conducted with the user. Otherwise, the user may be directed to a human for assistance. In another possible embodiment, the method operates as above except that if the probability also exceeds a second threshold, the second threshold being higher than the first, then further dialog is conducted with the user using the current dialog strategy. However, if the probability falls between a first threshold and a second threshold, the dialog strategy may be adapted in order to improve the chances of conducting a successful dialog with the user.
-
Citations
21 Claims
-
1. A method of monitoring language understanding of a user'"'"'s input communication in an automated dialog system, comprising:
-
determining whether a probability of understanding the user'"'"'s input communication exceeds a first threshold, wherein if the first threshold is exceeded, further dialog is conducted with the user and if the first threshold is not exceeded, the user is routed to a human for assistance; and determining whether a probability of understanding the user'"'"'s input communication exceeds a second threshold, the second threshold being greater than the first threshold, wherein if the second threshold is exceeded, further dialog is conducted with the user using a current dialog strategy and if the second threshold is not exceeds, further dialog is conducted with the user using an adapted dialog strategy. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A language understanding monitoring system that operates in an automated dialog system, comprising:
-
a dialog manager that outputs dialog to the user, a language understanding monitor that determines whether a probability of understanding the user'"'"'s input communication exceeds a first threshold, wherein if the first threshold is exceeded, the language understanding monitor prompts the dialog manager to conduct further dialog with the user, and if the first threshold is not exceeded, the language understanding monitor prompts the dialog manager to route the user to a human for assistance and further determines whether a probability of understanding the user'"'"'s input communication exceeds a second threshold, the second threshold being greater than the first threshold, and if the second threshold is exceeded, the language understanding monitor prompts the dialog manager to conduct further dialog with the user using a current dialog strategy, and if the second threshold is riot exceeded, the language understanding monitor prompts the dialog manager to conduct further dialog with the user using an adaptive dialog strategy. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
Specification