Apparatus and method for monitoring performance of an automated response system
First Claim
1. A method of monitoring performance of an interactive voice response (IVR) system used by an automated call processing center, a call from a caller to the call processing center including an initial IVR portion of the call, and, at the caller'"'"'s option, an agent-caller dialog portion of the call, said method comprising:
- generating logs of call activity within the IVR system for a plurality of calls;
determining, from the logs of call activity, routing information related to the plurality of calls within the IVR system, including routing of calls out of the IVR system to an agent;
noting, in the logs of call activity, predetermined significant activity in agent-caller dialog portions of calls routed to an agent;
determining at least one effectiveness quantity by comparing a reason for a call implied from the routing information related to the call to a true intention of the caller determined from the agent-call dialog portion of the caller;
generating a performance model of the IVR system from the logs of call activity; and
analyzing the logs of call activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the IVR system, wherein the performance value is used to monitor the IVR system.
14 Assignments
0 Petitions
Accused Products
Abstract
An apparatus and method for monitoring the performance of an interactive voice response (IVR) system used by an automated call processing center generates logs of call activity, determines routing information from the logs, notes predetermined significant activity in agent-caller dialog portions of calls routed to an agent in the logs, and determines at least one quantity correlated to a true intention of callers. A performance model of the IVR system is generated from the logs. The logs, the routing information, the quantity correlated to the true intention of the callers, and the performance model are analyzed to determine a performance value of the IVR system, which is used to monitor the IVR system.
-
Citations
30 Claims
-
1. A method of monitoring performance of an interactive voice response (IVR) system used by an automated call processing center, a call from a caller to the call processing center including an initial IVR portion of the call, and, at the caller'"'"'s option, an agent-caller dialog portion of the call, said method comprising:
-
generating logs of call activity within the IVR system for a plurality of calls; determining, from the logs of call activity, routing information related to the plurality of calls within the IVR system, including routing of calls out of the IVR system to an agent; noting, in the logs of call activity, predetermined significant activity in agent-caller dialog portions of calls routed to an agent; determining at least one effectiveness quantity by comparing a reason for a call implied from the routing information related to the call to a true intention of the caller determined from the agent-call dialog portion of the caller; generating a performance model of the IVR system from the logs of call activity; and analyzing the logs of call activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the IVR system, wherein the performance value is used to monitor the IVR system. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. An apparatus for monitoring performance of an interactive voice response (IVR) system used by an automated call processing center, a call from a caller to the call processing center including an initial IVR portion of the call, and, at the caller'"'"'s option, an agent-caller dialog portion of the call, said apparatus comprising:
-
means for generating logs of call activity within the IVR system for a plurality of calls; means for determining, from the logs of call activity, routing information related to the plurality of calls within the IVR system, including routing of calls out of the IVR system to an agent; means for noting, in the logs of call activity, predetermined significant activity in agent-caller dialog portions of calls routed to an agent; means for determining at least one effectiveness quantity by comparing a reason for a call implied from the routing information related to the call to a true intention of the call determined from the agent-caller dialog portion of the callers; means for generating a performance model of the IVR system from the logs of call activity; and means for analyzing the logs of call activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the IVR system, wherein the performance value is used to monitor the IVR system. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. An apparatus for monitoring performance of an interactive voice response (IVR) system used by an automated call processing center, a call from a caller to the call processing centering including an initial IVR portion of the call, and, at the caller'"'"'s option, an agent-caller dialog portion of the call, said apparatus comprising:
-
a log generation unit adapted to generate logs of call activity within the IVR system for a plurality of calls; a routing information determination unit adapted to determine, from the logs of call activity, routing information related to the plurality of calls within the IVR system, including routing of calls out of the IVR system to an agent; a significant activity notation unit adapted to note, in the logs of call activity, predetermined significant activity in agent-caller dialog portions of calls routed to an agent; an effectiveness determination unit adapted to determine at least one effectiveness quantity by comparing a reason for a call implied from the routing information related to the call to a true intention of the caller determined from the agent-caller dialog portion of the caller; a performance model generation unit adapted to generate a performance model of the IVR system from the logs of call activity; and an analysis unit adapted to analyze the logs of call activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the IVR system, wherein the performance value is used to monitor the IVR system.
-
-
14. A system for monitoring performance of an interactive voice response (IVR) system used by an automated call processing center, a call from a caller to the call processing center including an initial IVR portion of the call, and, at the caller'"'"'s option, an agent-caller dialog portion of the call, said system being operable to:
-
generate logs of call activity within the IVR system for a plurality of calls; determine, from the logs of call activity, routing information related to the plurality of calls within the IVR system, including routing of calls out of the IVR system to an agent; note, in the logs of call activity, predetermined significant activity in agent-caller dialog portions of calls routed to an agent; determine at least one effectiveness quantity by comparing a reason for a call implied from the routing information related to the call to a true intention of the caller determined from the agent-call dialog portion of the callers; generate a performance model of the IVR system from the logs of call activity; and analyze the logs of call activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the IVR system, wherein the performance value is used to monitor the IVR system. - View Dependent Claims (15, 16, 17, 18, 19)
-
-
20. A computer program product embodying a program for implementing a method of monitoring performance of an interactive voice response (IVR) system used by an automated call processing center, a call from a caller to the call processing centering including an initial IVR portion of the call, and, at the caller'"'"'s option, an agent-caller dialog portion of the call, said program product comprising:
-
code for generating logs of call activity within the IVR system for a plurality of calls; code for determining, from the logs of call activity, routing information related to the plurality of calls within the IVR system, including routing of calls out of the IVR system to an agent; code for noting, in the logs of call activity, predetermined significant activity in agent-caller dialog portions of calls routed to an agent; code for determining at least one effectiveness quantity by comparing a reason for a call implied from the routing information related to the call to a true intention of the caller determined from the agent-caller dialog portion of the callers utilizing the IVR system; code for generating a performance model of the IVR system from the logs of call activity; and code for analyzing the logs of call activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the IVR system, wherein the performance value is used to monitor the IVR system. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A method of monitoring performance of an automated response system used by an automated contact processing center, a contact from a contactor to the contact processing centering including an initial automated portion of the contact, and, at the contactor'"'"'s option, an agent-contactor dialog portion of the contact, said method comprising:
-
generating logs of contact activity within the automated response system for a plurality of contacts; determining, from the logs of contact activity, routing information related to the plurality of contacts within the automated response system, including routing of contacts out of the automated response system to an agent; noting, in the logs of contact activity, predetermined significant activity in agent-contactor dialog portions of contacts routed to an agent; determining at least one effectiveness quantity by comparing a reason for a contact implied from the routing information related to the contact to a true intention of the contactor determined from the agent-caller dialog portion of the contact; generating a performance model of the automated response system from the logs of contact activity; and analyzing the logs of contact activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the automated response system, wherein the performance value is used to monitor the automated response system.
-
-
27. An apparatus for monitoring performance of an automated response system used by an automated contact processing center, a contact from a contactor to the contact processing center including an initial automated portion of the contact, and, at the contactor'"'"'s option, an agent-contactor dialog portion of the contact, said apparatus comprising:
-
means for generating logs of contact activity within the automated response system for a plurality of contacts; means for determining, from the logs of contact activity, routing information related to the plurality of contacts within the automated response system, including routing of contacts out of the automated response system to an agent; means for noting, in the logs of contact activity, predetermined significant activity in agent-contactor dialog portions of contacts routed to an agent; means for determining at least one effectiveness quantity by comparing a reason for a contact implied from the routing information related to the contact to a true intention the contactor determined from the agent-caller dialog portion of the of contact; means for generating a performance model of the automated response system from the logs of contact activity; and means for analyzing the logs of contact activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the automated response system, wherein the performance value is used to monitor the automated response system.
-
-
28. An apparatus for monitoring performance of an automated response system used by an automated contact processing center, a contact from a contactor to the contact processing center including an initial automated portion of the contact, and, at the contactor'"'"'s option, an agent-contactor dialog portion of the contact, said apparatus comprising:
-
a log generation unit adapted to generate logs of contact activity within the automated response system for a plurality of contacts; a routing information determination unit adapted to determine, from the logs of contact activity, routing information related to the plurality of contacts within the automated response system, including routing of contacts out of the automated response system to an agent; a significant activity notation unit adapted to note, in the logs of contact activity, predetermined significant activity in agent-contactor dialog portions of contacts routed to an agent; an effectiveness determination unit adapted to determine at least one effectiveness quantity by a reason for a contact implied from the routing information related to the contact to a true intention of the contactor determined from the agent-caller dialog portion of the contact; a performance model generation unit adapted to generate a performance model of the automated response system from the logs of contact activity; and an analysis unit adapted to analyze the logs of contact activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the automated response system, wherein the performance value is used to monitor the automated response system.
-
-
29. A system for monitoring performance of an automated response system used by an automated response processing center, a contact from a contactor to the contact processing center including an initial automated portion of the contact, and, at the contactor'"'"'s option, an agent-contactor dialog portion of the contact, said system being operable to:
-
generate logs of contact activity within the automated response system for a plurality of contacts; determine, from the logs of contact activity, routing information related to the plurality of contacts within the automated response system, including routing of contacts out of the automated response system to an agent; note, in the logs of contact activity, predetermined significant activity in agent-contactor dialog portions of contacts routed to an agent; determine at least one effectiveness quantity by comparing a reason for a contactor implied from the routing information related to the contact to a true intention of the contactor determined from the agent-caller dialog portion of the contact; generate a performance model of the automated response system from the logs of contact activity; and analyze the logs of contact activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the automated response system, wherein the performance value is used to monitor the automated response system.
-
-
30. A computer program product stored in a computer readable medium embodying a program for implementing a method of monitoring performance of an automated response system used by an automated contact processing center, a contact from a contactor to the contact processing center including an initial automated portion of the contact, and, at the contactor'"'"'s option, an agent-contactor dialog portion of the contact, said program product comprising:
-
code for generating logs of contact activity within the automated response system for a plurality of contacts; code for determining, from the logs of contact activity, routing information related to the plurality of contacts within the automated response system, including routing of contacts out of the automated response system to an agent; code for noting, in the logs of contact activity, predetermined significant activity in agent-contactor dialog portions of contacts routed to an agent; code for determining at least one effectiveness quantity by comparing a reason for a contact implied from the routing information related to the contact to a true intention of the contactor determined from the agent-caller dialog portion of the contact; code for generating a performance model of the automated response system from the logs of contact activity; and code for analyzing the logs of contact activity, the determined routing information, the at least one effectiveness quantity, and the performance model to determine a performance value of the automated response system, wherein the performance value is used to monitor the automated response system.
-
Specification