SYSTEM AND METHOD FOR MULTI-MODAL AUDIO MINING OF TELEPHONE CONVERSATIONS
First Claim
1. A system for data-mining a monitored telephone conversation, the system comprising:
- a speech recognition processor configured to transcribe the monitored telephone conversation and associate a plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation;
an event detection processor configured to analyze the monitored telephone conversation to detect one or more events within the monitored telephone conversation;
a tagging processor configured to associate metadata information indicative of the detected one or more events with the transcript of the monitored telephone conversation; and
a multimedia data warehouse configured to store at least the transcript of the monitored telephone conversation and the metadata information and characteristics associated therewith as a data record for the monitored telephone conversation.
18 Assignments
0 Petitions
Accused Products
Abstract
A system and method for the automated monitoring of inmate telephone calls as well as multi-modal search, retrieval and playback capabilities for said calls. A general term for such capabilities is multi-modal audio mining. The invention is designed to provide an efficient means for organizations such as correctional facilities to identify and monitor the contents of telephone conversations and to provide evidence of possible inappropriate conduct and/or criminal activity of inmates by analyzing monitored telephone conversations for events, including, but not limited to, the addition of third parties, the discussion of particular topics, and the mention of certain entities.
212 Citations
39 Claims
-
1. A system for data-mining a monitored telephone conversation, the system comprising:
-
a speech recognition processor configured to transcribe the monitored telephone conversation and associate a plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation; an event detection processor configured to analyze the monitored telephone conversation to detect one or more events within the monitored telephone conversation; a tagging processor configured to associate metadata information indicative of the detected one or more events with the transcript of the monitored telephone conversation; and a multimedia data warehouse configured to store at least the transcript of the monitored telephone conversation and the metadata information and characteristics associated therewith as a data record for the monitored telephone conversation. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A system for data-mining a monitored telephone conversation, the system comprising:
-
a multimedia data warehouse configured to store a plurality of data records, each of the data records associated with a monitored telephone conversation; a data transformation processor configured to receive data from at least one data source, the received data including at least audio of a monitored telephone conversation and metadata information regarding the monitored telephone conversation; a data augmentation processor configured to augment the received data with data retrieved from one or more of a telephone subscriber database and a spatial information database; a speech recognition processor configured to transcribe the monitored telephone conversation and associate a plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation; and a data mapping processor configured to store a data record for the monitored telephone conversation to the multimedia data warehouse, the data record including at least the transcript of the monitored telephone conversation, the plurality of characteristics of the monitored telephone conversation, the metadata information regarding the monitored telephone conversation, and the retrieved data. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
-
32. A method of data-mining a monitored telephone conversation, the method comprising:
-
transcribing a monitored telephone conversation; extracting a plurality of characteristics of the monitored telephone conversation; associating the extracted plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation; analyzing the monitored telephone conversation to detect one or more events within the monitored telephone conversation; associating metadata information indicative of the detected one or more events with the transcript of the monitored telephone conversation; and storing at least the transcript of the monitored telephone conversation and the characteristics and metadata information associated therewith in a multimedia data warehouse as a data record for the monitored telephone conversation. - View Dependent Claims (33, 34, 35, 36, 37, 38)
-
-
39. A method of data-mining a monitored telephone conversation, the method comprising:
-
receiving data from at least one data source, the received data including at least audio of a monitored telephone conversation and metadata information regarding the monitored telephone conversation; retrieving data from one or more of a telephone subscriber database and a spatial information database based upon the metadata information regarding the monitored telephone conversation; associating the retrieved data with the received data; transcribing the monitored telephone conversation; extracting a plurality of characteristics of the monitored telephone conversation; associating the extracted plurality of characteristics of the monitored telephone conversation with a transcript of the monitored telephone conversation; generating a data record for the monitored telephone conversation, the data record including at least the transcript of the monitored telephone conversation, the plurality of characteristics of the monitored telephone conversation, the metadata information regarding the monitored telephone conversation, and the retrieved data; and storing the data record for the monitored telephone conversation to a multimedia data warehouse.
-
Specification