AUDIO-BASED EVENT INTERACTION ANALYTICS

• US 20170169816A1
• Filed: 12/09/2015
• Published: 06/15/2017
• Est. Priority Date: 12/09/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Blandin, Sebastien, Nandakumar, Karthik, Wynter, Laura
• Granted Patent: US 10,043,517 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

In an approach for audio based event analytics, a processor receives a recording of audio from an event. A processor collects information about the event and a list of participants. A processor segments the recording into, at least, a plurality of utterances. A processor analyzes the segmented recording. A processor summarizes the recording based on the segmentation and the analysis. A processor generates insights about interactions patterns of the event based on the segmentation and the analysis.

Claims

1. A method for audio based event analytics, the method comprising:

segmenting, by one or more processors, an audio recording from an event into, at least, a plurality of utterances;

analyzing, by one or more processors, the plurality of utterances to identify at least a first keyword based, at least in part, on;

mining, by one or more processors, at least the first keyword from a plurality of information about the event; and

matching a phoneme sequence corresponding to the audio recording with the phoneme sequence corresponding to at least the first keyword; and

generating, by one or more processors, insights about interactions patterns of the event based on the segmentation and the analysis.

2. The method of claim 1, further comprising:

extracting, by one or more processors, speech prosody characteristics from the plurality of utterances; and

analyzing, by one or more processors, the speech prosody characteristics and at least the first keyword to determine conversation characteristics associated with the plurality of utterances.

3. The method of claim 1, further comprising:

grouping, by one or more processors, at least a first utterance and a second utterance, of the plurality of utterances, into a snippet.

4. The method of claim 3, wherein analyzing the plurality of utterances comprises:

determining, by one or more processors, relevance of the snippet based on the information about the event and the list of participants; and

associating, by one or more processors, a topic with the snippet based on the information about the event.

5. The method of claim 1, wherein generating insights about interactions patterns of the event comprises:

mapping, by one or more processors, an utterance in the plurality of utterances to at least a first participant; and

identifying, by one or more processors, a type of interaction pattern between the first participant and at least a second participant based on, at least, the utterance.

7. The method of claim 1, wherein the information about the event is one or more documents containing text to be referenced during the event.

21. The method of claim 1, further comprising:

summarizing, by one or more processors, the audio recording based on the segmentation and the analysis; and

producing, by one or more processors, an audio summary of the audio recording, wherein the audio summary includes at least the snippet associated with the topic.

6. (canceled)

8. A computer program product for audio based event analytics, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising;

program instructions to segment an audio recording from an event into, at least, a plurality of utterances;

program instructions to analyze the plurality of utterances to identify at least a first keyword based, at least in part, on;

program instructions to mine at least the first keyword from a plurality of information about the event; and

matching a phoneme sequence corresponding to the audio recording with the phoneme sequence corresponding to at least the first keyword; and

program instructions to generate insights about interactions patterns of the event based on the segmentation and the analysis.

9. The computer program product of claim 8, wherein program instructions to analyze the segmented recording further comprise:

program instructions to extract speech prosody characteristics from the plurality of utterances; and

program instructions to analyze the speech prosody characteristics and at least the first keyword to determine conversation characteristics associated with the plurality of utterances.

10. The computer program product of claim 8, further comprising:

program instructions, stored on the one or more computer readable storage media, to group at least a first utterance and a second utterance, of the plurality of utterances, into a snippet.

11. The computer program product of claim 10, wherein program instructions to analyze the segmented recording comprises:

program instructions to determine relevance of the snippet based on the information about the event and the list of participants; and

program instructions to associate a topic with the snippet based on the information about the event.

12. The computer program product of claim 8, wherein program instructions to generate insights about interactions patterns of the event comprise:

program instructions to map an utterance in the plurality of utterances to at least a first participant; and

program instructions to identify a type of interaction pattern between the first participant and at least a second participant based on, at least, the utterance.

14. The computer program product of claim 8, wherein the information about the event is one or more documents containing text to be referenced during the event.

22. The computer program product of claim 8, further comprising:

program instructions to summarize the audio recording based on the segmentation and the analysis; and

program instructions to produce an audio summary of the audio recording, wherein the audio summary includes at least the snippet associated with the topic.

13. (canceled)

15. A computer system for audio based event analytics, the computer system comprising:

one or more computer processors, one or more computer readable storage media, and program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to segment an audio recording from an event into, at least, a plurality of utterances;

program instructions to analyze the plurality of utterances to identify at least a first keyword based, at least in part, on;

program instructions to mine at least the first keyword from a plurality of information about the event; and

matching a phoneme sequence corresponding to the audio recording with the phoneme sequence corresponding to at least the first keyword; and

program instructions to generate insights about interactions patterns of the event based on the segmentation and the analysis.

16. The computer system of claim 15, wherein program instructions to analyze the segmented recording further comprise:

program instructions to extract speech prosody characteristics from the plurality of utterances; and

program instructions to analyze the speech prosody characteristics and at least the first keyword to determine conversation characteristics associated with the plurality of utterances.

17. The computer system of claim 15, further comprising:

program instructions, stored on the one or more computer readable storage media for execution by at least one of the one or more processors, to group at least a first utterance and a second utterance, of the plurality of utterances, into a snippet.

18. The computer system of claim 17, wherein program instructions to analyze the segmented recording comprises:

program instructions to determine relevance of the snippet based on the information about the event and the list of participants; and

program instructions to associate a topic with the snippet based on the information about the event.

19. The computer system of claim 15, wherein program instructions to generate insights about interactions patterns of the event comprise:

program instructions to map an utterance in the plurality of utterances to at least a first participant; and

program instructions to identify a type of interaction pattern between the first participant and at least a second participant based on, at least, the utterance.

23. The computer system of claim 15, further comprising:

program instructions to summarize the audio recording based on the segmentation and the analysis; and

program instructions to produce an audio summary of the audio recording, wherein the audio summary includes at least the snippet associated with the topic.

20. (canceled)