Predicting outcomes for events based on voice characteristics and content of a voice sample of a contact center communication

• US 9,779,729 B1
• Filed: 12/14/2016
• Issued: 10/03/2017
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: Alvaria Cayman
• Original Assignee: Noble Systems Corporation
• Inventors: Ouimette, Jason P., Haggerty, Christopher S.
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US15/378,152
• Time in Patent Office: 293 Days
• Field of Search: 704244
• CPC Class Codes: G06F 40/216 using statistical methods
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 20/10 using kernel methods, e.g. support vector machines [SVM]
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06Q 10/04 Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" market predictions or forecasting for commercial activities G06Q30/0202
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G10L 25/87 Detection of discrete points within a voice signal
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals

Abstract

Various embodiments of the invention provide methods, systems, and computer-program products for predicting an outcome for an event of interest associated with a contact center communication. That is to say, various embodiments of the invention involve predicting an outcome for an event of interest associated with a party involved in a contact center communication based on characteristics and content of the communication conducted with the party by utilizing one or more classifier models.

Claims

1. A method for determining whether to conduct a follow-up action with a party based on predicting an outcome for the follow-up action with the party, the method comprising:

applying a first classifier model to one or more voice characteristics extracted from a voice sample of the party by at least one computer processor to provide a first predicted outcome of whether the follow-up action with the party will result in an event of interest occurring;

applying a second classifier model to a set of words spoken by the party in the voice sample by the at least one computer processor to provide a second predicted outcome of whether the follow-up action with the party will result in the event of interest occurring;

determining by the at least one computer processor whether the first predicted outcome and the second predicted outcome match;

in response to the first predicted outcome and the second predicted outcome matching, predicting the outcome to the follow-up action with the party as being the first predicted outcome; and

conducting the follow-up action with the party in response to predicting the outcome to the follow-up action with the party will result in the event of interest occurring.

2. The method of claim 1 further comprising, in response to the first predicted outcome and the second predicted outcome not matching, predicting the outcome to the follow-up action with the party as being (1) the first predicted outcome if the first classifier model is historically more accurate than the second classifier model at providing predicted outcomes or (2) the second predicted outcome if the second classifier model is historically more accurate than the first classifier model at providing predicted outcomes.

3. The method of claim 1 further comprising performing analytics on the voice sample by the at least one computer processor to detect the set of words being spoken by the party in the voice sample.

4. The method of claim 3 further comprising, prior to applying the second classifier model to the set of words:

performing lemmatization on the set of words to map inflected words in the set of words to lemma forms;

eliminating common words from the set of words, the common words comprising words that solely fulfill a grammatical function as opposed to a content function that carries meaning; and

determining a frequency of occurrence of each remaining word in the set of words following the elimination of the common words, wherein at least one of the frequencies of occurrence is provided as an input to the second classifier model.

5. The method of claim 1, wherein the follow-up action has more than two possible outcomes and the first classifier model is one of a first set of classifier models comprising a classifier model for predicting each possible outcome based on the voice characteristics and the second classifier model is one of a second set of classifier models comprising a classifier model for predicting each possible outcome based on the set of words.

6. The method of claim 1, wherein the voice characteristics comprise one or more of accent shape, average pitch, contour slope, final lowering, pitch range, speech rate, stress frequency, breathiness, brilliance, loudness, pause discontinuity, and pitch discontinuity.

7. A non-transitory, computer-readable medium comprising computer-executable instructions for determining whether to conduct a follow-up action with a party based on predicting an outcome for the follow-up action with the party that when executed by at least one computer processor are configured to cause the at least one computer processor to:

apply a first classifier model to one or more voice characteristics extracted from a voice sample of the party to provide a first predicted outcome of whether the follow-up action with the party will result in an event of interest occurring;

apply a second classifier model to a set of words spoken by the party in the voice sample to provide a second predicted outcome of whether the follow-up action with the party will result in the event of interest occurring;

determine whether the first predicted outcome and the second predicted outcome match; and

in response to the first predicted outcome and the second predicted outcome matching, predict the outcome to the follow-up action with the party as being the first predicted outcome, wherein the follow-up action is conducted with the party in response to predicting the outcome to the follow-up action with the party will result in the event of interest occurring.

8. The non-transitory, computer-readable medium of claim 7, wherein the computer-executable instructions, when executed by the at least one computer processor, are configured to cause the at least one computer processor to, in response to the first predicted outcome and the second predicted outcome not matching, predict the outcome to the follow-up action with the party as being (1) the first predicted outcome if the first classifier model is historically more accurate than the second classifier model at providing predicted outcomes or (2) the second predicted outcome if the second classifier model is historically more accurate than the first classifier model at providing predicted outcomes.

9. The non-transitory, computer-readable medium of claim 7, wherein the computer-executable instructions, when executed by the at least one computer processor, are configured to cause the at least one computer processor to perform analytics on the voice sample to detect the set of words being spoken by the party in the voice sample.

10. The non-transitory, computer-readable medium of claim 9, wherein the computer-executable instructions, when executed by the at least one computer processor, are configured to cause the at least one computer processor to, prior to applying the second classifier model to the set of words:

perform lemmatization on the set of words to map inflected words in the set of words to lemma forms;

eliminate common words from the set of words, the common words comprising words that solely fulfill a grammatical function as opposed to a content function that carries meaning; and

determine a frequency of occurrence of each remaining word in the set of words following the elimination of the common words, wherein at least one of the frequencies of occurrence is provided as an input to the second classifier model.

11. The non-transitory, computer-readable medium of claim 7, wherein the follow-up action has more than two possible outcomes and the first classifier model is one of a first set of classifier models comprising a classifier model for predicting each possible outcome based on the voice characteristics and the second classifier model is one of a second set of classifier models comprising a classifier model for predicting each possible outcome based on the set of words.

12. The non-transitory, computer-readable medium of claim 7, wherein the voice characteristics comprise one or more of accent shape, average pitch, contour slope, final lowering, pitch range, speech rate, stress frequency, breathiness, brilliance, loudness, pause discontinuity, and pitch discontinuity.

13. A system for determining whether to conduct a follow-up action with a party based on predicting an outcome for the follow-up action with the party, the system comprising:

at least one computer processor configured to;

apply a first classifier model to one or more voice characteristics extracted from a voice sample of the party to provide a first predicted outcome of whether the follow-up action with the party will result in an event of interest occurring;

apply a second classifier model to a set of words spoken by the party in the voice sample to provide a second predicted outcome of whether the follow-up action with the party will result in the event of interest occurring;

determine whether the first predicted outcome and the second predicted outcome match; and

in response to the first predicted outcome and the second predicted outcome matching, predict the outcome to the follow-up action with the party as being the first predicted outcome, wherein the follow-up action is conducted with the party in response to predicting the outcome to the follow-up action with the party will result in the event of interest occurring.

14. The system of claim 13, wherein the at least one computer processor configured to, in response to the first predicted outcome and the second predicted outcome not matching, predict the outcome to the follow-up action with the party as being (1) the first predicted outcome if the first classifier model is historically more accurate than the second classifier model at providing predicted outcomes or (2) the second predicted outcome if the second classifier model is historically more accurate than the first classifier model at providing predicted outcomes.

15. The system of claim 13, wherein the at least one computer processor configured to perform analytics on the voice sample to detect the set of words being spoken by the party in the voice sample.

16. The system of claim 15, wherein the at least one computer processor configured to, prior to applying the second classifier model to the set of words:

perform lemmatization on the set of words to map inflected words in the set of words to lemma forms;

eliminate common words from the set of words, the common words comprising words that solely fulfill a grammatical function as opposed to a content function that carries meaning; and

determine a frequency of occurrence of each remaining word in the set of words following the elimination of the common words, wherein at least one of the frequencies of occurrence is provided as an input to the second classifier model.

17. The system of claim 13, wherein the follow-up action has more than two possible outcomes and the first classifier model is one of a first set of classifier models comprising a classifier model for predicting each possible outcome based on the voice characteristics and the second classifier model is one of a second set of classifier models comprising a classifier model for predicting each possible outcome based on the set of words.

18. The system of claim 13, wherein the voice characteristics comprise one or more of accent shape, average pitch, contour slope, final lowering, pitch range, speech rate, stress frequency, breathiness, brilliance, loudness, pause discontinuity, and pitch discontinuity.