System and method for multi-modal audio mining of telephone conversations
First Claim
1. A system for data-mining a monitored telephone conversation, the system comprising:
- one or more microprocessors;
a memory;
a speech recognition processor configured to transcribe the monitored telephone conversation and associate a plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation;
an event detection processor configured to analyze the transcript of the monitored telephone conversation to detect one or more events within the monitored telephone conversation following the transcription of the monitored telephone conversation;
a topic database configured to include a slang term associated with both a major topic and a minor topic;
a topic detection processor configured to determine a topic of the monitored telephone conversation based upon querying the topic database with one or more extracted phrases from the transcript;
a tagging processor configured to associate metadata information indicative of the detected one or more events with the transcript of the monitored telephone conversation; and
a multimedia data warehouse configured to store at least the transcript of the monitored telephone conversation and the metadata information and characteristics associated therewith as a data record for the monitored telephone conversation.
18 Assignments
0 Petitions
Accused Products
Abstract
A system and method for the automated monitoring of inmate telephone calls as well as multi-modal search, retrieval and playback capabilities for said calls. A general term for such capabilities is multi-modal audio mining. The invention is designed to provide an efficient means for organizations such as correctional facilities to identify and monitor the contents of telephone conversations and to provide evidence of possible inappropriate conduct and/or criminal activity of inmates by analyzing monitored telephone conversations for events, including, but not limited to, the addition of third parties, the discussion of particular topics, and the mention of certain entities.
269 Citations
27 Claims
-
1. A system for data-mining a monitored telephone conversation, the system comprising:
-
one or more microprocessors; a memory; a speech recognition processor configured to transcribe the monitored telephone conversation and associate a plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation; an event detection processor configured to analyze the transcript of the monitored telephone conversation to detect one or more events within the monitored telephone conversation following the transcription of the monitored telephone conversation; a topic database configured to include a slang term associated with both a major topic and a minor topic; a topic detection processor configured to determine a topic of the monitored telephone conversation based upon querying the topic database with one or more extracted phrases from the transcript; a tagging processor configured to associate metadata information indicative of the detected one or more events with the transcript of the monitored telephone conversation; and a multimedia data warehouse configured to store at least the transcript of the monitored telephone conversation and the metadata information and characteristics associated therewith as a data record for the monitored telephone conversation. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A method of data-mining a monitored telephone conversation, the method comprising:
-
transcribing a monitored telephone conversation; extracting a plurality of characteristics of the monitored telephone conversation; associating the extracted plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation; analyzing the transcript of the monitored telephone conversation to detect one or more events within the monitored telephone conversation on a computing device following the transcription of the monitored telephone conversation; determining a topic of the monitored telephone conversation based upon querying a topic database with one or more extracted phrases from the transcript, wherein the topic database includes a slang term associated with both a major topic and a minor topic; associating metadata information indicative of the detected one or more events with the transcript of the monitored telephone conversation on a computing device; and storing at least the transcript of the monitored telephone conversation and the characteristics and metadata information associated therewith in a multimedia data warehouse as a data record for the monitored telephone conversation. - View Dependent Claims (22, 23, 24, 25, 26, 27)
-
Specification