Human-to-human conversation analysis
First Claim
1. A method comprising:
- accessing one or more log files of a corpus of human-to-human conversations;
performing textual analysis on the one or more log files, the textual analysis including identifying carriage returns, tabs, changes in font, and/or changes in text color;
based at least in part on the textual analysis, converting each of the one or more log files into a different file format that indicates dialogue turns and an individual associated with each dialogue turn, each dialogue turn representing input from the respective individual;
identifying, from the dialogue turns of a first conversation in the corpus, a particular dialog turn that includes a question from a particular individual;
representing the dialog turns of the particular individual as a series of indicia, positions in the series including either a first indicia indicating that a corresponding dialogue turn includes a question or a second indicia indicating that a corresponding dialog turn does not include a question;
comparing the series of indicia to a predefined sequence of indicia;
determining, based at least in part on comparing the series of indicia to the predefined sequence of indicia, that the first conversation has workflow-like features;
determining, using one or more processing units, a first metric and a second metric for the first conversation in the corpus, the first metric for the first conversation indicating a complexity of the first conversation and the second metric for the first conversation indicating a degree to which the first conversation is deemed to have the workflow-like features, the work-flow like features indicating that at least a portion of the first conversation comprises an algorithmic series of communications between two humans to accomplish a task;
determining a score for the first conversation based at least in part on the first metric for the first conversation and the second metric for the first conversation;
determining, using the one or more processing units, a first metric and a second metric for a second conversation in the corpus, the first metric for the second conversation indicating a complexity of the second conversation and the second metric for the second conversation indicating a degree to which the second conversation is deemed to have workflow-like features;
determining a score for the second conversation based at least in part on the first metric for the second conversation and the second metric for the second conversation;
combining the score for the first conversation and the score for the second conversation to generate a representative value, the representative value being indicative of difficulty in creating a virtual agent to replace a human associated with the corpus; and
displaying, via a graphical user interface, information that is based at least in part on the representative value.
5 Assignments
0 Petitions
Accused Products
Abstract
Customer support, and other types of activities in which there is a dialog between two humans can generate large volumes of conversation records. Automated analysis of these records can provide information about high-level features of, for example, the workings of a customer service department. Analysis of these conversations between a customer and a customer-support agent may also allow identification of customer support activities that can be provided by virtual agents instead of actual human agents. The analysis may evaluate conversations in terms of complexity, duration, and sentiment of the participants. Additionally, the conversations may also be analyzed to identify the existence of selected concepts or keywords. Workflow characteristics, the extent to which the conversation represents a multi-step process intended to accomplish a task, may also be determined for the conversations. Characteristics of individual conversations may be combined to obtain generalized or representative features for a set of a conversation records.
-
Citations
30 Claims
-
1. A method comprising:
-
accessing one or more log files of a corpus of human-to-human conversations; performing textual analysis on the one or more log files, the textual analysis including identifying carriage returns, tabs, changes in font, and/or changes in text color; based at least in part on the textual analysis, converting each of the one or more log files into a different file format that indicates dialogue turns and an individual associated with each dialogue turn, each dialogue turn representing input from the respective individual; identifying, from the dialogue turns of a first conversation in the corpus, a particular dialog turn that includes a question from a particular individual; representing the dialog turns of the particular individual as a series of indicia, positions in the series including either a first indicia indicating that a corresponding dialogue turn includes a question or a second indicia indicating that a corresponding dialog turn does not include a question; comparing the series of indicia to a predefined sequence of indicia; determining, based at least in part on comparing the series of indicia to the predefined sequence of indicia, that the first conversation has workflow-like features; determining, using one or more processing units, a first metric and a second metric for the first conversation in the corpus, the first metric for the first conversation indicating a complexity of the first conversation and the second metric for the first conversation indicating a degree to which the first conversation is deemed to have the workflow-like features, the work-flow like features indicating that at least a portion of the first conversation comprises an algorithmic series of communications between two humans to accomplish a task; determining a score for the first conversation based at least in part on the first metric for the first conversation and the second metric for the first conversation; determining, using the one or more processing units, a first metric and a second metric for a second conversation in the corpus, the first metric for the second conversation indicating a complexity of the second conversation and the second metric for the second conversation indicating a degree to which the second conversation is deemed to have workflow-like features; determining a score for the second conversation based at least in part on the first metric for the second conversation and the second metric for the second conversation; combining the score for the first conversation and the score for the second conversation to generate a representative value, the representative value being indicative of difficulty in creating a virtual agent to replace a human associated with the corpus; and displaying, via a graphical user interface, information that is based at least in part on the representative value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. One or more non-transitory computer-readable storage media, configured to store computer-executable instructions that, when executed on one or more processors, cause the one or more processors to perform acts comprising:
-
obtaining a recording of a spoken communication between a first individual and a second individual; performing speaker recognition on the recording to identify first audio characteristics of the first individual and second audio characteristics of the second individual; identifying, based at least in part on the first audio characteristics, first dialogue turns representing first input from the first individual; identifying, based at least in part on the second audio characteristics, second dialog turns representing second input from the second individual; generating one or more log files including indications of the first dialog turns and the second dialog turns; storing the one or more log files as a first conversation in a corpus of human-to-human conversations; determining a first metric and a second metric for the first conversation in the corpus, the first metric for the first conversation indicating a complexity of the first conversation and the second metric for the first conversation indicating a degree to which the first conversation is deemed to have workflow-like features, the workflow-like features indicating that at least a portion of the first conversation comprises an algorithmic series of communications between two humans to accomplish a task; determining a score for the first conversation based at least in part on the first metric for the first conversation and the second metric for the first conversation; determining a first metric and a second metric for a second conversation in the corpus, the first metric for the second conversation indicating a complexity of the second conversation and the second metric for the second conversation indicating a degree to which the second conversation is deemed to have workflow-like features; determining a score for the second conversation based at least in part on the first metric for the second conversation and the second metric for the second conversation; combining the score for the first conversation and the score for the second conversation to generate a representative value, the representative value being indicative of difficulty in replacing a human associated with the corpus with a virtual agent; and providing, via a graphical user interface, information that is based at least in part on the representative value. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A system comprising:
-
one or more processors; and memory storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising; obtaining first data representing a first conversation, the first data being in a first data format; obtaining second data representing a second conversation, the second data being in a second data format that is different than the first format; converting the first data from the first data format to a third data format; converting the second data from the second data format to the third data format, wherein the computer-executable instructions are configured to perform textual analysis on data in the third data format; performing textual analysis on the first data of the first conversation and the second data of the second conversation; based at least in part on the textual analysis, identifying dialogue turns and an individual associated with each dialogue turn, each dialogue turn representing input from the respective individual; determining a first metric and a second metric for the first conversation, the first metric for the first conversation indicating a complexity of the first conversation and the second metric for the first conversation indicating a degree to which the first conversation is deemed to have workflow-like features, the workflow-like features indicating that at least a portion of the first conversation comprises an algorithmic series of communications between two humans to accomplish a task; determining a score for the first conversation based at least in part on the first metric for the first conversation and the second metric for the first conversation; determining a first metric and a second metric for the second conversation, the first metric for the second conversation indicating a complexity of the second conversation and the second metric for the second conversation indicating a degree to which the second conversation is deemed to have workflow-like features; determining a score for the second conversation based at least in part on the first metric for the second conversation and the second metric for the second conversation; combining the score for the first conversation and the score for the second conversation to generate a representative value, the representative value being indicative of difficulty in replacing a human associated with the first conversation or the second conversation with a virtual agent; and providing, via a graphical user interface, information that is based at least in part on the representative value. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25)
-
-
26. A system comprising:
-
one or more processors; and memory storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising; performing textual analysis on data of a first conversation and data of a second conversation; based at least in part on the textual analysis, identifying dialogue turns and an individual associated with each dialogue turn, each dialogue turn representing input from the respective individual; determining a first metric and a second metric for the first conversation, the first metric for the first conversation indicating a complexity of the first conversation and the second metric for the first conversation indicating a degree to which the first conversation is deemed to have workflow-like features, the workflow-like features indicating that at least a portion of the first conversation comprises an algorithmic series of communications between two humans to accomplish a task; determining a score for the first conversation based at least in part on the first metric for the first conversation and the second metric for the first conversation; determining a first metric and a second metric for the second conversation, the first metric for the second conversation indicating a complexity of the second conversation and the second metric for the second conversation indicating a degree to which the second conversation is deemed to have workflow-like features; determining a score for the second conversation based at least in part on the first metric for the second conversation and the second metric for the second conversation; combining the score for the first conversation and the score for the second conversation to generate a representative value, the representative value being indicative of difficulty in replacing a human with a virtual agent; and providing, via a graphical user interface, information that is based at least in part on the representative value. - View Dependent Claims (27, 28, 29)
-
-
30. A method comprising:
-
accessing one or more log files of a corpus of human-to-human conversations; performing textual analysis on the one or more log files, the textual analysis including identifying carriage returns, tabs, changes in font, and/or changes in text color; based at least in part on the textual analysis, converting each of the one or more log files into a different file format that indicates dialogue turns and an individual associated with each dialogue turn, each dialogue turn representing input from the respective individual; determining, using one or more processing units, a first metric and a second metric for a first conversation in the corpus, the first metric for the first conversation indicating a complexity of the first conversation and the second metric for the first conversation indicating a degree to which the first conversation is deemed to have workflow-like features, the work-flow like features indicating that at least a portion of the first conversation comprises an algorithmic series of communications between two humans to accomplish a task; determining a score for the first conversation based at least in part on the first metric for the first conversation and the second metric for the first conversation; determining, using the one or more processing units, a first metric and a second metric for a second conversation in the corpus, the first metric for the second conversation indicating a complexity of the second conversation and the second metric for the second conversation indicating a degree to which the second conversation is deemed to have workflow-like features; determining a score for the second conversation based at least in part on the first metric for the second conversation and the second metric for the second conversation; combining the score for the first conversation and the score for the second conversation to generate a representative value, the representative value being indicative of difficulty in creating a virtual agent to replace a human associated with the corpus; and displaying, via a graphical user interface, information that is based at least in part on the representative value; based at least in part on the representative value, providing a suggestion to replace the human with the virtual agent.
-
Specification