Automatic identification of dialog timing problems for an interactive speech dialog application using speech log data indicative of cases of barge-in and timing problems
First Claim
1. A computer implemented method of analyzing dialog between a user and an interactive application having dialog turns, wherein a turn comprises a prompt from the application and a response received from the user, the method comprising:
- accessing stored information indicative of audible responses to prompts received from the at least one user during a plurality of dialog turns between the application and at least one user;
identifying, using a processor of the computer, instances from the accessed information where the application determined a response was received from the at least one user before an associated prompt had completed, wherein the accessed information comprises information related to operation of the application with a first grammar to recognize the response;
identifying whether the response was received in a particular limited time period from when the associated prompt began; and
if the response was received in the limited time period, determining whether the response included one or more terms from the associated prompt by performing recognition on the response using a second grammar having more information related to grammar of a language than the first grammar, wherein terms from the associated prompt are added to the second grammar.
3 Assignments
0 Petitions
Accused Products
Abstract
A method of analyzing dialog between a user and an interactive application having dialog turns is provided. The method includes accessing information indicative of a plurality of dialog turns between the application and at least one user and identifying instances where the application determined a response was received before an associated prompt had completed. The accessed information includes information related to operation of the application with a first grammar to recognize the response. The method includes identifying whether the response was received in a particular limited time period from when the associated prompt began. If the response was received in the limited time period, the method determines whether the response included one or more terms from the associated prompt by performing recognition on the response using a second grammar having more information related to grammar of a language than the first grammar.
302 Citations
18 Claims
-
1. A computer implemented method of analyzing dialog between a user and an interactive application having dialog turns, wherein a turn comprises a prompt from the application and a response received from the user, the method comprising:
-
accessing stored information indicative of audible responses to prompts received from the at least one user during a plurality of dialog turns between the application and at least one user; identifying, using a processor of the computer, instances from the accessed information where the application determined a response was received from the at least one user before an associated prompt had completed, wherein the accessed information comprises information related to operation of the application with a first grammar to recognize the response; identifying whether the response was received in a particular limited time period from when the associated prompt began; and if the response was received in the limited time period, determining whether the response included one or more terms from the associated prompt by performing recognition on the response using a second grammar having more information related to grammar of a language than the first grammar, wherein terms from the associated prompt are added to the second grammar. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer implemented method of analyzing dialog between a user and an interactive application having dialog turns, wherein a turn comprises a prompt from the application and a response received from the user, the method comprising:
-
accessing stored log data including information indicative of a plurality of dialog turns between the application and at least one user, the stored log data comprising recorded audio; identifying at least one failed recognition situation from the information indicative of the plurality of dialog turns between the application and at least one user; based on identifying the at least one failed recognition situation, accessing the recorded audio to identify a portion of expected audio that was received by the application when the application was expecting a response from the at least one user for a prompt that was given, the prompt being associated with the at least one failed recognition situation; accessing the recorded audio to identify a portion of unexpected audio that was received by the application when the application was not expecting a response from the at least one user for the prompt that was given; isolating the portion of expected audio and the portion of unexpected audio to form an actual response provided by the user, the actual response including both the expected audio and the unexpected audio; and performing recognition on the actual response using a processor of the computer. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A system for analyzing dialog between a user and an interactive application having dialog turns, wherein a turn comprises a prompt from the application and a response received from the user, the system comprising:
-
a database storing log data including information that is related to operation of the application using a first grammar and is indicative of a plurality of dialog turns between the application and at least one user, wherein the stored log data pertains to a plurality of instances where the application determined responses were received from the at least one user before prompts associated with the responses had completed; an identification module adapted to access the log data and identify failed recognitions from the information stored in the database where the application determined a response to an associated prompt was received from the at least one user before the associated prompt had completed, wherein the information includes recorded audio related to expected audio that was received by the application when the application was expecting a response and unexpected audio that was received by the application when the application was not expecting a response; and a recognizer implemented on a processor of a computer to perform recognition on the response, wherein the recognizer utilizes a second grammar to perform recognition on the response and determine if terms from the associated prompt are in the response, the second grammar having more information related to grammar of a language than the first grammar and including information related to the associated prompt. - View Dependent Claims (15, 16, 17, 18)
-
Specification