Systems and methods to utilize text representations of conversations

• US 10,418,035 B1
• Filed: 10/18/2018
• Issued: 09/17/2019
• Est. Priority Date: 09/17/2014
• Status: Active Grant

• Current Assignee: United Services Automobile Association
• Original Assignee: United Services Automobile Association
• Inventors: Johnson, Zakery L., Neuse, Jonathan E.
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US16/164,379
• Time in Patent Office: 334 Days
• CPC Class Codes: G06F 16/36 Creation of semantic tools, e.g. ontology or thesauri
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G06Q 30/016 After-sales
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/54 for retrieval
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

A method for electronically utilizing content in a communication between a customer and a customer representative is provided. An audible conversation between a customer and a service representative is captured. At least a portion of the audible conversation is converted into computer searchable data. The computer searchable data is analyzed during the audible conversation to identify relevant meta tags previously stored in a data repository or generated during the audible conversation. Each meta tag is associated with the customer. Each meta tag provides a contextual item determined from at least a portion of one of a current or previous conversation with the customer. A meta tag determined to be relevant to the current conversation between the service representative and the customer is displayed in real time to the service representative currently conversing with the customer.

Claims

1. A method for electronically utilizing content in an electronic communication, the method comprising the steps of:

capturing, by a processor, an audible conversation between first and second users;

converting, by the processor, the audible conversation into computer searchable text data;

storing, by the processor, the audible conversation in an audio repository and the searchable text data representative of the audio conversation in an text repository;

analyzing iteratively in real time, by a processor, the computer searchable text data during the audible conversation to identify one or more meta tags previously stored in the text repository or generated during the audible conversation determined relevant to a current conversation between the first and second users, wherein each of the one or more meta tags are associated with the second user and wherein each meta tag provides a contextual item determined from at least a portion of one of the current or previous conversations with the second user; and

determine sentiment toward the contextual item associated with the meta tag by detecting one or more words having a sentiment polarity using a sentiment dictionary containing sentiment related words having a particular polarity whereby once polarity has been determined, a number of positive and negative sentiment words spoken the customer in relation to identified contextual items are countered.

2. The method of claim 1, further including displaying to the first user, a meta tag and the one or more recommendations determined to be relevant to the current conversation between the first user and the second user.

3. The method of claim 1, further including generating one or more recommendations of product offerings tailored to the second user based on the one or more meta tags, wherein the contextual item associated with the meta tag represents one or more topics discussed during one or more communication sessions and each contextual item includes one or more contextual keys.

4. The method of claim 1, further comprising:

analyzing, by the processor, the computer searchable data to generate one or more meta tags wherein each meta tag relates to at least a portion of the searchable data and wherein each meta tag is associated with a contextual item; and

storing the computer searchable data and each said meta tag in the data repository in association with the second user.

5. The method of claim 4, wherein the computer searchable data comprises text data converted from at least a portion of the one or more audible conversations.

6. The method of claim 4, wherein storing one or more meta tags in a data repository further comprises storing at least a portion of an audible conversation as a voice data with each said meta tag in the data repository in association with the second user.

7. The method of claim 1, wherein analyzing the computer searchable data comprises analyzing, by a processor, the computer searchable data during the audible conversation to determine likely existing and future needs of the second user.

8. The method of claim 1, wherein analyzing, by a processor, the stored computer searchable data representing previous audible conversations with the second user and simultaneously analyzing the computer searchable data converted from the captured current audible conversation comprises searching combined computer searchable data to identify one or more sentiment-related keywords associated with the contextual item.

9. The method of claim 1, wherein analyzing, by a processor, the stored voice data representing previous audible conversations with the second user and simultaneously analyzing at least a portion of the captured current audible conversation with the second user comprises searching combined voice data to identify the second user'"'"'s emotional states associated with the contextual item.

10. A computer program product for electronically utilizing content in an electronic communication between first and second users, the computer program product comprising:

one or more non-transitory computer-readable storage devices and a plurality of program instructions stored on at least one of the one or more computer-readable storage devices, the plurality of program instructions comprising;

program instructions to capture an audible conversation between the first and second users;

program instructions to convert the audible conversation into computer searchable text data;

program instructions to store the audible conversation in an audio repository and the searchable text data representative of the audio conversation in a text repository;

program instructions to analyze the computer searchable text data during the audible conversation to identify one or more meta tags previously stored in the text repository or generated during the audible conversation determined relevant to a current conversation between the first and second users, wherein each of the one or more meta tags are associated with the second user and wherein each meta tag provides a contextual item determined from at least a portion of one of the current or previous conversation with the second user; and

program instructions to determine sentiment toward the contextual item associated with the meta tag by detecting one or more words having a sentiment polarity using a sentiment dictionary containing sentiment related words having a particular polarity whereby once polarity has been determined, a number of positive and negative sentiment words spoken by the second user in relation to identified contextual items are countered.

11. The computer program product of claim 10, wherein the program instructions to store one or more meta tags in a data repository further comprise:

program instructions to analyze the computer searchable data representing previous conversations between the first and second users in order to generate one or more meta tags, wherein each meta tag relates to at least a portion of the searchable data and wherein each meta tag is associated with a contextual item; and

program instructions to store the computer searchable data and each said meta tag in the data repository in association with the second user.

12. The computer program product of claim 11, wherein the computer searchable data comprises text data converted from at least a portion of the one or more audible conversations.

13. The computer program product of claim 11, wherein program instructions to store one or more meta tags further comprise program instructions to store at least a portion of an audible conversation as voice data with each said meta tag in the data repository in association with the second user.

14. The computer program product of claim 10, wherein program instructions to analyze the computer searchable data comprise program instructions to analyze the computer searchable data during the audible conversation to determine likely existing and future needs of the second user.

15. The computer program product of claim 10, wherein the program instructions to analyze the stored computer searchable data representing previous audible conversations with the second user and to simultaneously analyze the computer searchable data converted from the captured current audible conversation comprise program instructions to search combined computer searchable data to identify one or more sentiment-related keywords associated with the contextual item.

16. The computer program product of claim 10, wherein the program instructions to analyze the stored voice data representing previous audible conversations with the second user and to simultaneously analyze at least a portion of the captured current audible conversation with the second user comprise program instructions to search combined voice data to identify the second user'"'"'s emotional states associated with the contextual item.

17. A computer system for electronically utilizing content in a communication between first and second users, the computer system comprising:

one or more processors, one or more computer-readable storage devices, and a plurality of program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors, the plurality of program instructions comprising;

program instructions to capture an audible conversation between the first and second users;

program instructions to convert the audible conversation into computer searchable text data;

program instructions to store the audible conversation in an audio repository and the searchable text data representative of the audio conversation in a text repository;

program instructions to analyze the computer searchable text data during the audible conversation to identify one or more meta tags previously stored in the text repository or generated during the audible conversation determined relevant to a current conversation between the first and second users, wherein each of the one or more meta tags are associated with the second user and wherein each meta tag provides a contextual item determined from at least a portion of one of the current or previous conversation with the second user;

program instructions to determine sentiment toward the contextual item associated with the meta tag by detecting one or more words having a sentiment polarity using a sentiment dictionary containing sentiment related words having a particular polarity whereby once polarity has been determined, a number of positive and negative sentiment words spoken by the second user in relation to identified contextual items are countered.

18. The computer system of claim 17, wherein the program instructions to store one or more meta tags in a data repository further comprise:

program instructions to analyze the computer searchable data representing previous conversations between the first and second users in order to generate one or more meta tags, wherein each meta tag relates to at least a portion of the searchable data and wherein each meta tag is associated with a contextual item; and

program instructions to store the computer searchable data and each said meta tag in the data repository in association with the second user.

19. The computer system of claim 18, wherein the computer searchable data comprises text data converted from at least a portion of the one or more audible conversations.