Method and system for predicting understanding errors in a task classification system
First Claim
1. A language understanding monitoring system that operates in a task classification system, comprisinga task classification processor that is adapted to determine whether a task classification decision can be made based on an understanding of a user'"'"'s input communication;
- a dialog manager that is adapted to conduct a dialog with the user; and
a language understanding monitor that is adapted to determine whether a probability of understanding the users input communication exceeds a first threshold in the cases where a task classification decision cannot be made and, if the first threshold is exceeded, to prompt the dialog manager to conduct further dialog with the user,wherein the language understanding monitor is further adapted to determine whether a probability of understanding the user'"'"'s input communication exceeds a second threshold, the second threshold being greater than the first threshold, and if the second threshold is exceeded, to prompt the dialog manager to conduct further dialog with the user using a current dialog strategy, andwherein at least one of said task classification processor, said dialog manager and said language understanding monitor performs that which it is adapted to do using a programmed processor.
8 Assignments
0 Petitions
Accused Products
Abstract
A method and system for monitoring an automated dialog system for the automatic recognition of language understanding errors based on a user'"'"'s input communications in a task classification system. If the user'"'"'s input communication cannot be understood and a task classification decision cannot be made, then further dialog may be conducted with the user if a probability of understanding the user'"'"'s input communication exceeds a first threshold. Otherwise, the user may be directed to a human for assistance. In another possible embodiment, the method operates as above except that if the probability exceeds a second threshold, then further dialog may be conducted with the user using the current dialog strategy. However, if the probability falls between a first threshold and a second threshold, the dialog strategy may be adapted in order to improve the chances of conducting a successful dialog with the user.
18 Citations
12 Claims
-
1. A language understanding monitoring system that operates in a task classification system, comprising
a task classification processor that is adapted to determine whether a task classification decision can be made based on an understanding of a user'"'"'s input communication; -
a dialog manager that is adapted to conduct a dialog with the user; and a language understanding monitor that is adapted to determine whether a probability of understanding the users input communication exceeds a first threshold in the cases where a task classification decision cannot be made and, if the first threshold is exceeded, to prompt the dialog manager to conduct further dialog with the user, wherein the language understanding monitor is further adapted to determine whether a probability of understanding the user'"'"'s input communication exceeds a second threshold, the second threshold being greater than the first threshold, and if the second threshold is exceeded, to prompt the dialog manager to conduct further dialog with the user using a current dialog strategy, and wherein at least one of said task classification processor, said dialog manager and said language understanding monitor performs that which it is adapted to do using a programmed processor. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
Specification