Generating call context metadata from speech, contacts, and common names in a geographic area

• US 9,570,079 B1
• Filed: 07/05/2016
• Issued: 02/14/2017
• Est. Priority Date: 11/23/2015
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Gorthi, Ramakrishna J., Joshi, Chandrajit G., Shah, Romil J.
• Primary Examiner(s): Lerner, Martin
• Application Number:
  US15/201,937
• Time in Patent Office: 224 Days
• Field of Search: 704/246, 704/250, 379/88.01, 379/88.03, 379/88.11, 379/142.06, 379/88.02, 455/414.2, 455/456.3
• US Class Current: 1/1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/02 Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/16 Hidden Markov models [HMM]
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04M 1/27453 Directories allowing storage of additional subscriber data, e.g. metadata
• CPC Class Codes: H04M 1/573 Line monitoring circuits for detecting caller identification
• CPC Class Codes: H04M 1/645 with speech synthesis
• CPC Class Codes: H04M 1/656 for recording conversations
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 2201/41 using speaker recognition
• CPC Class Codes: H04M 2250/60 logging of communication history, e.g. outgoing or incoming calls, missed calls, messages or URLs
• CPC Class Codes: H04M 2250/68 with means for recording information, e.g. telephone number during a conversation
• CPC Class Codes: H04M 2250/74 with voice recognition means
• CPC Class Codes: H04M 3/42025 Calling or Called party identification service
• CPC Class Codes: H04M 3/42059 Making use of the calling party identifier
• CPC Class Codes: H04M 3/42102 Making use of the called party identifier
• CPC Class Codes: H04M 3/42221 : Conversation recording systems at the subscriber's set H04M1/656
• CPC Class Codes: H04M 3/42357 : where the information is provided to a monitoring entity such as a potential calling party or a call processing server

Abstract

A computer detects a connected voice or video call between participants and records a brief media sample. Speech recognition is utilized to determine when the call is connected as well as to transcribe the content of the audio portion of the media sample. The recorded media sample and transcribed content is associated with the connected voice or video call such that a user may reference it at a later point. The computer additionally suggests creating or editing contact information associated with the participants of the connected voice or video call based on the transcribed content.

Claims

1. A computer program product for generating call context metadata, the computer program product comprising:

one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the program instructions comprising;

program instructions to detect that a call is connected, wherein the call is connected based on speech being detected;

program instructions to record a media sample corresponding to the connected call, wherein the media sample includes an audio recording of at least a portion of the detected speech;

program instructions to identify one or more words contained within the at least a portion of the detected speech, wherein identifying the one or more words further comprises;

program instructions to identify a first portion of the one or more words by comparing a voiceprint associated with the first portion with a voiceprint database and program instructions to identify a second portion of the one or more words by comparing a voiceprint associated with the second portion with the voiceprint database, and wherein the first portion of the one or more words corresponds to a first speaker and the second portion of the one or more words corresponds to a second speaker;

program instructions to determine whether a phone number associated with the connected call is associated with one or more contacts detailed by a contact list of a user;

based on determining that the phone number associated with the connected call is not associated with the one or more contacts detailed by the contact list of the user, program instructions to store the recorded media sample and the identified one or more words in association with the connected call;

program instructions to determine a location of the user based on analyzing Global Positioning System (GPS) information associated with a device of the user;

program instructions to reference a common name list, wherein the common name list details a set of commonly used names associated with a geographic area, and wherein the geographic area is an area within a distance of the location of the user;

program instructions to determine whether at least one of the identified one or more words matches at least one of one or more names detailed by the common name list;

based on determining that at least one of the identified one or more words matches at least one of the one or more names detailed by the common name list, program instructions to present an option to the user to add the at least one of the identified one or more words to the contact list of the user in association with the phone number associated with the connected call;

based on the user selecting the option to add the at least one of the identified one or more words to the contact list of the user in association with the phone number associated with the connected call, program instructions to add the at least one of the identified one or more words to the contact list of the user in association with the phone number associated with the connected call; and

program instructions to delete the recorded media sample and the identified one or more words stored in association with the connected call,

wherein one or more steps of the above method are performed using one or more computers.