VISUALIZATION INTERFACE OF CONTINUOUS WAVEFORM MULTI-SPEAKER IDENTIFICATION

• US 20130046538A1
• Filed: 10/19/2012
• Published: 02/21/2013
• Est. Priority Date: 10/17/2008
• Status: Active Grant

• Current Assignee: Globalfoundries US Incorporated (GlobalFoundries, Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Harrington, Nathan J.
• Granted Patent: US 8,826,210 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A method implemented in a computer infrastructure having computer executable code having programming instructions tangibly embodied on a computer readable storage medium. The programming instructions are operable to receive a current waveform of a communication between a plurality of participants. Additionally, the programming instructions are operable to create a voiceprint from the current waveform if the current waveform is of a human voice. Furthermore, the programming instructions are operable to determine one of whether a match exists between the voiceprint and one library waveform of one or more library waveforms, whether a correlation exists between the voiceprint and a number of library waveforms of the one or more library waveforms and whether the voiceprint is unique. Additionally, the programming instructions are operable to transcribe the current waveform into text and provide a match indication display (MID) indicating an association between the current waveform and the one or more library waveforms based on the determining.

Claims

1. A method implemented in a computer infrastructure having computer executable code tangibly embodied on a computer readable storage medium having programming instructions operable to:

receive a current waveform of a communication between a plurality of participants;

create a voiceprint from the current waveform if the current waveform is of a human voice;

determine one of;

whether a match exists between the voiceprint and one library waveform of one or more library waveforms;

whether a correlation exists between the voiceprint and a number of library waveforms of the one or more library waveforms; and

whether the voiceprint is unique;

transcribe the current waveform into text; and

provide a match indication display (MID) based on the determining.

2. The method of claim 1, further comprising displaying the current waveform and the one or more library waveforms.

3. The method of claim 2, further comprising associatively displaying the text with its associated library waveform.

4. The method of claim 1, wherein the MID displays at least one of a match percentage and an indicator arrow.

5. The method of claim 1, further comprising verifying whether the current waveform is of a human voice, wherein the verifying whether the received current waveform is of the human voice comprises determining whether approximately ninety percent or more of frequencies of the current waveform occur in a frequency band from approximately 200 Hz-800 Hz.

6. The method of claim 1, further comprising:

adding the voiceprint to the one or more library waveforms if the voiceprint is unique; and

averaging the voiceprint with the one library waveform if the match exists between the voiceprint and the one library waveform of the one or more library waveforms.

7. The method of claim 1, wherein the creating the voiceprint from the current waveform comprises:

dividing the current waveform into equal lengths of frequency range;

determining an average amplitude of the current waveform for each of the equal lengths of frequency range;

storing the average amplitude of the current waveform for each of the equal lengths of frequency range as the voiceprint in a storage system; and

updating the average amplitude of the current waveform for each of the equal lengths of frequency range.

8. The method of claim 7, wherein the determining whether the match or the correlation exists or whether the voiceprint is unique comprises:

determining an integer difference between the average amplitude of the current waveform and the one or more library waveforms for each of the equal lengths of frequency range;

if the integer difference for each of the equal lengths of frequency range for the one library waveform of the one or more library waveforms is less than a match threshold, determining that the match exists between the voiceprint and the one library waveform of the one or more library waveforms;

if the integer difference for at least one of the equal lengths of frequency range for each of the library waveforms is more than a unique threshold, determining that the voiceprint is unique; and

if the voiceprint does not meet the match threshold and does not meet the unique threshold, determining that the correlation exists between the voiceprint and the number of library waveforms of the one or more library waveforms based on the integer difference for each of the equal lengths of frequency range.

9. The method of claim 8, wherein a degree of the correlation between the voiceprint and the number of library waveforms is displayed as a match percentage for each of the number of library waveforms.

10. The method of claim 9, further comprising

determining a library waveform of the number of waveforms having a highest match percentage;

determining the ratio of remaining match percentages for each of the number of library waveforms to the match percentage of the library waveform having the highest match percentage; and

if the ratio for each of the number of library waveforms do not exceed a relative weight threshold, associatively displaying the current waveform with the library waveform having the highest match percentage.

11. The method of claim 10, wherein the MID further provides an unassigned transcribed text window;

and

if the ratio for any of the number of library waveforms do exceed the relative weight threshold, displaying the transcribed text of the current waveform in the unassigned transcribed text window.

12. The method of claim 1, wherein the MID further provides a temporal indication for the text, wherein the temporal indication for the text comprises at least one of:

indicator arrows which change colors based on temporal proximity to current time;

indicator arrows which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.

13. A method, comprising:

verifying whether a received current waveform is of a human voice;

creating a voiceprint from the received current waveform when the received current waveform is of the human voice;

determining one of;

whether a match exists between the voiceprint and one library waveform of one or more library waveforms;

whether a correlation exists between the voiceprint and a number of library waveforms of the one or more library waveforms; and

whether the voiceprint is unique; and

transcribing the received current waveform into text; and

providing a match indication display (MID) based on the determining.

14. The method of claim 13, wherein the MID:

displays the received current waveform and the one or more library waveforms; and

associatively displays the text with its associated library waveform.

15. The method of claim 13, wherein the MID indicates an association between the current waveform and its associated text, and the one or more library waveforms based on the determining, wherein wherein the indicating the association comprises displaying at least one of a match percentage and an indicator arrow.

16. The method of claim 13, wherein the MID provides a temporal indication for the text comprising at least one of:

an indicator arrow which change colors based on temporal proximity to current time;

an indicator arrow which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.

17. A computer program product comprising a computer usable storage medium having readable program code embodied in the storage medium, the computer program product includes at least one component operable to:

verify whether a received current waveform is of a human voice;

create a voiceprint from the received current waveform when the received current waveform is of the human voice;

determine one of;

whether a match exists between the voiceprint and one library waveform of one or more library waveforms;

whether a correlation exists between the voiceprint and a number of library waveforms of the one or more library waveforms; and

whether the voiceprint is unique; and

transcribe the received current waveform into text; and

provide a match indication display (MID) based on the determining.

18. The computer program product of claim 17, wherein the MID:

display the received current waveform and the one or more library waveforms; and

associatively display the text with its associated library waveform.

19. The method of claim 17, wherein the MID indicates an association between the current waveform and its associated text, and the one or more library waveforms based on the determining, wherein wherein the indicating the association comprises displaying at least one of a match percentage and an indicator arrow.

20. The method of claim 17, wherein the MID provides a temporal indication for the text comprising at least one of:

an indicator arrow which change colors based on temporal proximity to current time;

an indicator arrow which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.