System and Method of Dialog Trajectory Analysis
First Claim
1. A method comprising:
- receiving call-logs associated with a plurality of dialogs between a dialog system and a user;
extracting a first portion of turn-by-turn details of dialogs from the call-logs;
inferring a second portion of the turn-by-turn details based on the first portion of the turn-by-turn details using a call-flow specification, wherein the second portion is unavailable in the call-logs; and
generating an empirical call-flow representation of one of the dialogs between the dialog system and the user based at least in part on the first portion and the second portion.
4 Assignments
0 Petitions
Accused Products
Abstract
The invention comprises computer-readable media, methods and systems for performing a dialog analysis and using that analysis to release an updated spoken dialog system. The method embodiment of the invention comprises receiving data associated with dialogs, extracting turn by turn details of the dialog and generating from the extracted details an empirical call-flow representation of the dialog. The call data may be call-logs and user audio. The empirical call-flow representation may be a finite-state machine with nodes that represent call-states and the arcs between nodes represent user responses. Nodes may also represent sub-dialogs. The call-flow representation is presented graphically to a user for easier analysis and understanding. Significant changes in the dialog can be identified as hot-spots for improvement in the next release of the spoken dialog system.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving call-logs associated with a plurality of dialogs between a dialog system and a user; extracting a first portion of turn-by-turn details of dialogs from the call-logs; inferring a second portion of the turn-by-turn details based on the first portion of the turn-by-turn details using a call-flow specification, wherein the second portion is unavailable in the call-logs; and generating an empirical call-flow representation of one of the dialogs between the dialog system and the user based at least in part on the first portion and the second portion. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform a method comprising; receiving call-logs associated with a plurality of dialogs between a dialog system and a user; extracting a first portion of turn-by-turn details of dialogs from the call-logs; inferring a second portion of the turn-by-turn details based on the first portion of the turn-by-turn details using a call-flow specification, wherein the second portion is unavailable in the call-logs; and generating an empirical call-flow representation of one of the dialogs between the dialog system and the user based at least in part on the first portion and the second portion. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer-readable storage medium having instructions stored which, when executed by a computing device, cause the computing device to perform a method comprising:
-
receiving call-logs associated with a plurality of dialogs between a dialog system and a user; extracting a first portion of turn-by-turn details of dialogs from the call-logs; inferring a second portion of the turn-by-turn details based on the first portion of the turn-by-turn details using a call-flow specification, wherein the second portion is unavailable in the call-logs; and generating an empirical call-flow representation of one of the dialogs between the dialog system and the user based at least in part on the first portion and the second portion. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification