Method and apparatus for automatically identifying and annotating auditory signals from one or more parties
First Claim
Patent Images
1. A telecommunication system comprising:
- one or more processors; and
a computer readable memory storing program code which, when executed by the one or more processors, causes the one or more processors to at least;
after a communication is established by a first electronic communication device and a second electronic communication device, receive, at the telecommunication system, from the first electronic communication device, digital auditory data corresponding to an ongoing conversation between a first person using the first electronic communication device and the second person using a second electronic communication device, the conversation including a plurality of words spoken by the first person and the second person during the ongoing conversation;
while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, process the digital auditory data to identify mention of specific entities including one or more of telephone numbers, email addresses, dates, times, locations and proper names, the processing of the digital auditory data including;
identifying high priority of the specific entities;
facilitating disambiguation of the identified high priority specific entities;
identifying an utterance of a first entity in the plurality of words, and determining one or more actions possible to perform with respect to the identified first entity, the one or more actions determined based on context and relevance of the identified first entity with respect to the plurality of words of the conversation;
annotate the identified first entity to create an annotated entity with text listing the one or more actions possible to perform with respect to the identified first entity; and
while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, cause a display device of the first electronic communication device to display the annotated entity such that the first electronic communication device,while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, obtains, via an input device of the first electronic communication device, a user interaction from the first person, the user interaction is associated with a selection of an action included in the displayed annotated entity; and
responsive to the user interaction, perform the selected action with respect to the identified entity.
1 Assignment
0 Petitions
Accused Products
Abstract
In one embodiment, a mobile device application automatically identifies and annotates auditory data of a conversation between two or more parties. Digital auditory data is processed to identify mention of specific entities. An identified entity is annotated, based on context and relevance, to list one or more actions possible to perform with or on the identified entity, and the identified entity displayed while the conversation is ongoing. An action is selected by signals from an input interface.
16 Citations
6 Claims
-
1. A telecommunication system comprising:
-
one or more processors; and a computer readable memory storing program code which, when executed by the one or more processors, causes the one or more processors to at least; after a communication is established by a first electronic communication device and a second electronic communication device, receive, at the telecommunication system, from the first electronic communication device, digital auditory data corresponding to an ongoing conversation between a first person using the first electronic communication device and the second person using a second electronic communication device, the conversation including a plurality of words spoken by the first person and the second person during the ongoing conversation; while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, process the digital auditory data to identify mention of specific entities including one or more of telephone numbers, email addresses, dates, times, locations and proper names, the processing of the digital auditory data including; identifying high priority of the specific entities; facilitating disambiguation of the identified high priority specific entities; identifying an utterance of a first entity in the plurality of words, and determining one or more actions possible to perform with respect to the identified first entity, the one or more actions determined based on context and relevance of the identified first entity with respect to the plurality of words of the conversation; annotate the identified first entity to create an annotated entity with text listing the one or more actions possible to perform with respect to the identified first entity; and while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, cause a display device of the first electronic communication device to display the annotated entity such that the first electronic communication device, while the conversation is ongoing between the first person using the first electronic communication device and the second person using the second electronic communication device, obtains, via an input device of the first electronic communication device, a user interaction from the first person, the user interaction is associated with a selection of an action included in the displayed annotated entity; and responsive to the user interaction, perform the selected action with respect to the identified entity. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A telecommunication system comprising:
-
one or more processors; and a computer readable memory, coupled to the one or more processors, storing program code which, when executed by the one or more processors, causes the one or more processors to at least; after a communication is established by a first electronic communication device and a second electronic communication device, receive, at the telecommunication system, from the first electronic communication device, digital auditory data corresponding to an ongoing conversation between a first party using the first electronic communication device and a second party using the second electronic communication device during an interview, wherein the conversation includes a plurality of words spoken by the first party and the second party, and wherein the first party is an interviewer and the second party is an interviewee; while the conversation is ongoing between the first party using the first electronic communication device and the second party using the second electronic communication device, cause a display device of the first electronic communication device to display initial prompts to the interviewer with initial lines of inquiry about high priority entities and relationships in an information model; while the conversation is ongoing between the first party using the first electronic communication device and the second party using the second electronic communication device, process the digital auditory data to identify mention of high priority entities and relationships spoken by the first party and the second party during the interview, the processing of the digital auditory data including; identifying an utterance of a first entity in the plurality of words, determining subsequent lines of inquiry with respect to the identified first entity, and causing the display device to display subsequent prompts to the interviewer to facilitate disambiguation of identified high priority entities, the subsequent lines of inquiry based on context and relevance of the identified first entity with respect to the plurality of words of the conversation; and while the conversation is ongoing between the first party using the first electronic communication device and the second party using the second electronic communication device, cause the display device of the first electronic communication device to display subsequent prompts to the interviewer with the subsequent lines of inquiry with respect to the identified first entity.
-
Specification