Visualization interface of continuous waveform multi-speaker identification

• US 9,412,371 B2
• Filed: 08/01/2014
• Issued: 08/09/2016
• Est. Priority Date: 10/17/2008
• Status: Expired due to Fees

• Current Assignee: GlobalFoundries, Inc.
• Original Assignee: GlobalFoundries, Inc.
• Inventors: Harrington, Nathan J.
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US14/449,592
• Publication Number:
  US 20140343941A1
• Time in Patent Office: 739 Days
• Field of Search: 704/215, 704/249, 704/238, 704/233, 704/250, 704/270, 379/202.01, 711/108, 706/14
• US Class Current: 1/1
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A method implemented in a computer infrastructure having computer executable code having programming instructions tangibly embodied on a computer readable storage medium. The programming instructions are operable to receive a current waveform of a communication between a plurality of participants. Additionally, the programming instructions are operable to create a voiceprint from the current waveform if the current waveform is of a human voice. Furthermore, the programming instructions are operable to determine one of whether a match exists between the voiceprint and one library waveform of one or more library waveforms, whether a correlation exists between the voiceprint and a number of library waveforms of the one or more library waveforms and whether the voiceprint is unique. Additionally, the programming instructions are operable to transcribe the current waveform into text and provide a match indication display (MID) indicating an association between the current waveform and the one or more library waveforms based on the determining.

Claims

1. A method implemented in a computer infrastructure having computer executable code tangibly embodied on a non-transitory computer readable storage medium having programming instructions operable to:

receive a current waveform of a communication between a plurality of participants;

determining if the current waveform is of a human voice based on a frequency band of the current waveform;

create a voiceprint from the current waveform if the current waveform is of the human voice;

transcribe the current waveform into text; and

display a match indication display (MID) comprising the current waveform, one or more library waveforms, and the text with its associated library waveform,

wherein a degree of a correlation between the voiceprint and the one or more library waveforms is displayed as a match percentage for each of the one or more library waveforms.

2. The method of claim 1, wherein the creating the voiceprint from the current waveform comprises:

dividing the current waveform into equal lengths of frequency range;

determining an average amplitude of the current waveform for each of the equal lengths of frequency range;

storing the average amplitude of the current waveform for each of the equal lengths of frequency range as the voiceprint in a storage system; and

updating the average amplitude of the current waveform for each of the equal lengths of frequency range.

3. The method of claim 1, further comprising:

determining a library waveform of the number of library waveforms having a highest match percentage;

determining a ratio of remaining match percentages for each of the number of library waveforms to the match percentage of the library waveform having the highest match percentage; and

if the ratio for each of the number of library waveforms do not exceed a relative weight threshold, associatively displaying the current waveform with the library waveform having the highest match percentage.

4. The method of claim 3, wherein the MID further provides an unassigned transcribed text window;

and

if the ratio for any of the number of library waveforms exceed the relative weight threshold, displaying the transcribed text of the current waveform in the unassigned transcribed text window.

5. The method of claim 1, wherein the MID further displays an indicator arrow.

6. The method of claim 1, wherein the determining if the current waveform is of the human voice comprises determining whether approximately ninety percent or more of frequencies of the current waveform occur in the frequency band from approximately 200 Hz-800 Hz.

7. The method of claim 1, further comprising:

adding the voiceprint to the one or more library waveforms if the voiceprint is unique; and

averaging the voiceprint with the one library waveform if the match exists between the voiceprint and the one library waveform of the one or more library waveforms.

8. The method of claim 1, wherein the MID further provides a temporal indication for the text, wherein the temporal indication for the text comprises at least one of:

indicator arrows which change colors based on temporal proximity to current time;

indicator arrows which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.

15. The method of claim 1, further comprising removing the current waveform from the match indication display (MID) if the current waveform is not of the human voice.

16. The method of claim 15, wherein the transcribing the current waveform into the text occurs in real time.

17. The method of claim 16, wherein the match percentage indicates a percentage of a match relative to a match threshold.

18. The method of claim 17, wherein the match indication display (MID) further displays at least one indicator arrow between the current waveform and the one or more library waveforms, and a width of the at least one indicator arrow indicates the percentage of the match relative to the match threshold such that a larger width of the at least one indicator arrow indicates a larger numerical percentage of the match relative to the match threshold and a smaller width of the at least one indicator arrow indicates a smaller numerical percentage of the match relative to the match threshold.

9. A method, comprising:

verifying whether a received current waveform is of a human voice based on a frequency band of the current waveform;

creating a voiceprint from the received current waveform when the received current waveform is of the human voice;

transcribing the received current waveform into text; and

providing a match indication display (MID) that associatively displays the text with its associated library waveform,

wherein a degree of a correlation between the voiceprint and the associated library waveforms s displayed as a match percentage for the associated library waveforms.

10. The method of claim 9, further comprising displaying the received current waveform and one or more library waveforms.

11. The method of claim 10, wherein the MID indicates an association between the current waveform and its associated text, and the one or more library waveforms based on the matching, wherein the indicating the association comprises further displaying an indicator arrow.

12. The method of claim 11, wherein the MID provides a temporal indication for the text comprising at least one of:

an indicator arrow which change colors based on temporal proximity to current time;

an indicator arrow which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.

13. A computer program product comprising a non-transitory computer usable storage medium having readable program code embodied in the non-transitory computer usable storage medium, the readable program code readable/executable by a computing device to cause the computing device to:

verify whether a received current waveform is of a human voice based on a frequency hand of the current waveform;

create a voiceprint from the received current waveform when the received current waveform is of the human voice;

transcribe the received current waveform into text;

provide a match indication display (MID) based on the determining; and

display the current waveform, one or more library waveforms, and the text with its associated library waveform,

wherein a degree of a correlation between the voiceprint and the associated library waveforms is displayed as a match percentage for the associated library waveforms.

14. The computer program product of claim 13, wherein the MID provides a temporal indication for the text comprising at least one of:

an indicator arrow which change colors based on temporal proximity to current time;

an indicator arrow which fade or become translucent based on temporal proximity to current time; and

sequential numbers associatively displayed with the text.