VISUALIZATION INTERFACE OF CONTINUOUS WAVEFORM MULTI-SPEAKER IDENTIFICATION

• US 20140343941A1
• Filed: 08/01/2014
• Published: 11/20/2014
• Est. Priority Date: 10/17/2008
• Status: Active Grant

• Current Assignee: GlobalFoundries, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Harrington, Nathan J.
• Granted Patent: US 9,412,371 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A method implemented in a computer infrastructure having computer executable code having programming instructions tangibly embodied on a computer readable storage medium. The programming instructions are operable to receive a current waveform of a communication between a plurality of participants. Additionally, the programming instructions are operable to create a voiceprint from the current waveform if the current waveform is of a human voice. Furthermore, the programming instructions are operable to determine one of whether a match exists between the voiceprint and one library waveform of one or more library waveforms, whether a correlation exists between the voiceprint and a number of library waveforms of the one or more library waveforms and whether the voiceprint is unique. Additionally, the programming instructions are operable to transcribe the current waveform into text and provide a match indication display (MID) indicating an association between the current waveform and the one or more library waveforms based on the determining.

Claims

1. A method implemented in a computer infrastructure having computer executable code tangibly embodied on a computer readable storage medium having programming instructions operable to:

receive a current waveform of a communication between a plurality of participants;

create a voiceprint from the current waveform if the current waveform is of a human voice;

transcribe the current waveform into text; and

display a match indication display (MID) comprising the current waveform, one or more library waveforms, and the text with its associated library waveform.

2. The method of claim 1, wherein the creating the voiceprint from the current waveform comprises:

dividing the current waveform into equal lengths of frequency range;

determining an average amplitude of the current waveform for each of the equal lengths of frequency range;

storing the average amplitude of the current waveform for each of the equal lengths of frequency range as the voiceprint in a storage system; and

updating the average amplitude of the current waveform for each of the equal lengths of frequency range.

3. The method of claim 2, wherein a degree of a correlation between the voiceprint and the number of library waveforms is displayed as a match percentage for each of the number of library waveforms.

4. The method of claim 3, further comprising:

determining a library waveform of the number of library waveforms having a highest match percentage;

determining a ratio of remaining match percentages for each of the number of library waveforms to the match percentage of the library waveform having the highest match percentage; and

if the ratio for each of the number of library waveforms do not exceed a relative weight threshold, associatively displaying the current waveform with the library waveform having the highest match percentage.

5. The method of claim 4, wherein the MID further provides an unassigned transcribed text window;

and

if the ratio for any of the number of library waveforms exceed the relative weight threshold, displaying the transcribed text of the current waveform in the unassigned transcribed text window.

6. The method of claim 1, wherein the MID displays at least one of a match percentage and an indicator arrow.

7. The method of claim 1, further comprising verifying whether the received current waveform is of a human voice, wherein the verifying whether the received current waveform is of the human voice comprises determining whether approximately ninety percent or more of frequencies of the current waveform occur in a frequency band from approximately 200 Hz-800 Hz.

8. The method of claim 1, further comprising:

adding the voiceprint to the one or more library waveforms if the voiceprint is unique; and

averaging the voiceprint with the one library waveform if the match exists between the voiceprint and the one library waveform of the one or more library waveforms.

9. The method of claim 1, wherein the MID further provides a temporal indication for the text, wherein the temporal indication for the text comprises at least one of:

indicator arrows which change colors based on temporal proximity to current time;

indicator arrows which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.

10. A method, comprising:

verifying whether a received current waveform is of a human voice;

creating a voiceprint from the received current waveform when the received current waveform is of the human voice;

transcribing the received current waveform into text; and

providing a match indication display (MID) that associatively displays the text with its associated library waveform.

11. The method of claim 10, further comprising displaying the received current waveform and one or more library waveforms.

12. The method of claim 11, wherein the MID indicates an association between the current waveform and its associated text, and the one or more library waveforms based on the matching, wherein the indicating the association comprises displaying at least one of a match percentage and an indicator arrow.

13. The method of claim 12, wherein the MID provides a temporal indication for the text comprising at least one of:

an indicator arrow which change colors based on temporal proximity to current time;

an indicator arrow which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.

14. A computer program product comprising a computer usable storage medium having readable program code embodied in the usable storage medium, the readable program code readable/executable by a computing device to cause the computing device to:

verify whether a received current waveform is of a human voice;

create a voiceprint from the received current waveform when the received current waveform is of the human voice;

transcribe the received current waveform into text;

provide a match indication display (MID) based on the determining; and

display the current waveform, one or more library waveforms, and the text with its associated library waveform.

15. The computer program product of claim 14, wherein the MID provides a temporal indication for the text comprising at least one of:

an indicator arrow which change colors based on temporal proximity to current time;

an indicator arrow which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.