Method of assessing degree of acoustic confusability, and system therefor

• US 20030069729A1
• Filed: 10/05/2001
• Published: 04/10/2003
• Est. Priority Date: 10/05/2001
• Status: Active Grant

• Current Assignee: Mavenir Systems Incorporated (Mavenir Group Holdings Ltd.)
• Original Assignee: Comverse Incorporated (Mavenir Group Holdings Ltd.)
• Inventors: Bickley, Corine A, Denenberg, Lawrence A.
• Granted Patent: US 7,013,276 B2
• Time in Patent Office: Days
• US Class Current: 704/236
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/10 using distance or distortion measures between unknown speech and reference templates

Abstract

Predicting speech recognizer confusion where utterances can be represented by any combination of text form and audio file. The utterances are represented with an intermediate representation that directly reflects the acoustic characteristics of the utterances. Text representations of the utterances can be directly used for predicting confusability without access to audio file examples of the utterances. First embodiment: two text utterances are represented with strings of phonemes and one of the strings of phonemes is transformed into the other strings of phonemes for a least cost as a confusability measure. Second embodiment: two utterances are represented with an intermediate representation of sequences of acoustic events based on phonetic capabilities of speakers obtained from acoustic signals of the utterances and the acoustic events are compared. Predicting confusability of the utterances according to a formula 2K/(T), K is a number of matched acoustic events and T is a total number of acoustic events.

Claims

1. A process, comprising:

predicting when a speech recognizer will confuse two spoken phrases by directly using text forms of the spoken phrases.

2. The process according to claim 1, further comprising:

representing each text form with a first and second strings of phonemes, respectively; and

calculating an acoustic confusability measure as a least cost to transform the first string of phonemes to the second string of phonemes.

3. The process according to claim 2, wherein a dynamic programming minimum string edit distance algorithm computes the least cost.

4. The process according to claim 2, further comprising using different cost values for each operation to transform depending on the characteristics of phonemes in the strings.

5. The process according to claim 4, further comprising comparing the least cost to a threshold value to predict whether the speech recognizer will confuse the spoken phrases corresponding to the text forms.

6. A process, comprising:

representing text phrases with corresponding strings of phonemes;

calculating an acoustic confusability measure as a least cost to transform one of the strings of phonemes into another of the strings of phonemes; and

comparing the least cost to a threshold value to determine acoustic confusability of the text phrases when spoken to a speech recognizer.

7. The process according to claim 6, further comprising determining confusability of example pairs of spoken phrases represented as audio files using a speech recognizer to determine and adjust the threshold.

8. A process, comprising:

representing text phrases with corresponding strings of phonemes;

calculating a distance between the strings of phonemes using a string edit distance algorithm as a least cost to transform one of the strings of phonemes into another of the strings of phonemes; and

comparing the least cost to a threshold value to predict when a speech recognizer will confuse spoken phrases of the text phrases.

9. A process, comprising:

representing text phrases with corresponding strings of phonemes;

calculating a distance between the strings of phonemes using a string edit distance algorithm as a least cost to transform according to a series of transformations one of the strings of phonemes into another of the strings of phonemes, each transformation assigned a cost depending on characteristics of phonemes; and

comparing the least cost to a threshold value to predict when a speech recognizer will confuse spoken phrases of the text phrases.

10. The process according to claim 9, wherein the transformations comprise insertion of a phoneme, substitution of a phoneme with another phoneme and/or deletion of a phoneme.

11. The process according to claim 9, further comprising determining confusability of example pairs of audio files using a speech recognizer to determine and adjust the threshold.

12. A process, comprising:

determining acoustic similarity of phoneme pairs using a speech recognizer, and

assigning a cost based upon the determined similarity to each transformation from a first string of phonemes into a second string of phonemes.

13. A process according to claim 12, wherein the transformations comprises specifying insertion of a phoneme, substitution of a phoneme with another phoneme and/or deletion of a phoneme.

14. A process comprising calculating an acoustic confusability measure as a least cost to transform a first string of phonemes corresponding to a first text phrase to a second string of phonemes corresponding to a second text phrase, the process further comprising:

determining confusability of example pairs of audio files using a speech recognizer;

calculating a confusability threshold value based upon the determined confusability, the threshold value compared to the least cost to determine when a speech recognizer will confuse spoken phrases of the two text phrases.

15. A process, comprising:

predicting when a speech recognizer will confuse spoken phrases by directly using text representations of the spoken phrases without access to audio file examples of the spoken phrases.

16. A computer system, comprising:

a processor programmed to predict when a speech recognizer will confuse two spoken phrases by directly using text representations of the spoken phrases.

17. A computer system, comprising:

a processor programmed to represent text phrases with corresponding strings of phonemes, to calculate an acoustic confusability measure as a least cost to transform one of the strings of phonemes into another of the strings of phonemes, and to compare the least cost to a threshold value to determine acoustic confusability of the text phrases when spoken to a speech recognizer.

18. A computer system, comprising:

a processor programmed to represent text phrases with corresponding strings of phonemes, to calculate a distance between the strings of phonemes using a string edit distance algorithm as a least cost to transform one of the strings of phonemes into another of the strings of phonemes, and to compare the least cost to a threshold value to predict when a speech recognizer will confuse spoken forms of the text phrases.

19. A computer system, comprising:

a processor programmed to represent text phrases with corresponding strings of phonemes, to calculate a distance between the strings of phonemes using a string edit distance algorithm as a least cost to transform according to a series of transformations one of the strings of phonemes into another of the strings of phonemes, each transformation assigned a cost depending on characteristics of phonemes, and to compare the least cost to a threshold value to predict when a speech recognizer will confuse spoken forms of the text phrases.

20. A computer system, comprising:

a processor programmed to determine acoustic similarity of phoneme pairs using a speech recognizer, and to assign a cost based upon the determined similarity to each transformation from a first string of phonemes into a second phoneme string.

21. A computer system programmed to calculate an acoustic confusability measure as a least cost to transform a first string of phonemes corresponding to a first text phrase to a second string of phonemes corresponding to a second text phrase, the system further comprising:

a processor programmed to determine confusability of example pairs of audio files using a speech recognizer, and to calculate a confusability threshold value based upon the determined confusability, the threshold value compared to the least cost to determine when a speech recognizer will confuse spoken form of the two text phrases.

22. A computer system, comprising:

a processor programmed to predict when a speech recognizer will confuse spoken phrases by directly using text representations of the spoken phrases without access to audio files examples of the spoken phrases.

23. A process, comprising:

predicting when a speech recognizer will confuse spoken phrases where one text phrase and one spoken phrase are available to a confusability prediction algorithm.

24. A process, comprising:

predicting when a speech recognizer will confuse spoken phrases in a telephony application where one text phrase and one spoken phrase are available to a confusability prediction algorithm.

25. A process, comprising:

predicting when a speech recognizer will confuse two spoken phrases where two utterances corresponding to the spoken phrases in any combination of text and audio file are available to a confusability prediction algorithm.

26. The process according to claim 25, wherein the prediction algorithm comprises:

representing each utterance with corresponding sequences of acoustic characteristics based on phonetic capabilities of speakers obtained from acoustic signals of the utterances;

aligning the sequences of acoustic characteristics;

comparing the sequences of acoustic characteristics; and

calculating a metric of acoustic confusability according to the comparing.

27. The process according to claim 26, wherein the calculating is according to a formula 2K/(T), wherein K is a number of acoustic characteristics that match from the comparing and T is a total number of acoustic characteristics in the sequences of acoustic characteristics for both utterances.

28. The process according to claim 27, wherein the spoken phrases are in any language.

29. The process according to claim 28, wherein the metric of acoustic confusability is used in telephony applications.

30. A process, comprising:

representing two utterances with corresponding sequences of acoustic characteristics based on phonetic capabilities of speakers obtained from acoustic signals of the utterances;

aligning the sequences of acoustic characteristics;

comparing the sequences of acoustic characteristics; and

calculating a metric of acoustic confusability according to the comparing.

31. The process according to claim 30, wherein the utterances are any combination of a text form and an audio file.

32. The process according to claim 30, wherein the utterances are in any language.

33. The process according to claim 30, wherein the calculating is according to a formula 2K/(T), wherein K is a number of acoustic characteristics that match from the comparing and T is a total number of acoustic characteristics in the sequences of acoustic characteristics for both utterances.

34. A process, comprising:

representing a first phrase and a second phrase, respectively, with a corresponding sequence of acoustic features and acoustic measures obtained from a dictionary of acoustic features and a database of prerecorded audio files;

aligning the sequence of acoustic features and acoustic measures of the first phrase with the sequence of acoustic features and acoustic measures of the second phrase;

comparing the aligned first phrase and second phrase sequences; and

calculating a metric of acoustic confusability according to the comparing according to a formula 2K/(N+M), wherein K is a number of acoustic features and acoustic measures that match from the comparing and N is a number of acoustic features and acoustic measures in the first phrase and M is a number of acoustic features and acoustic measures in the second phrase.

35. A computer system, comprising:

a processor programmed to predict when a speech recognizer will confuse spoken phrases where one text phrase and one audio file are available to a confusability prediction algorithm.

36. A computer system, comprising:

a processor programmed to predict when a speech recognizer will confuse spoken phrases in a telephony application where one text phrase and one audio file are available to a confusability prediction algorithm.

37. A computer system, comprising:

a processor programmed to predict when a speech recognizer will confuse two spoken phrases where two phrases in any combination of text and spoken form are available to a confusability prediction algorithm.

38. The process according to claim 37, wherein the prediction algorithm comprises:

representing each phrase with corresponding sequences of acoustic characteristics based on phonetic capabilities of speakers obtained from acoustic signals of the phrases;

aligning the sequences of acoustic characteristics;

comparing the sequences of acoustic characteristics; and

calculating a metric of acoustic confusability according to the comparing.

39. The process according to claim 38, wherein the calculating is according to a formula 2K/(T), wherein K is a number of acoustic characteristics that match from the comparing and T is a total number of acoustic characteristics in the sequences of acoustic characteristics for both phrases.

40. The process according to claim 39, wherein the phrases are in any language.

41. The process according to claim 40, wherein the metric of acoustic confusability is used in telephony applications.

42. A computer system, comprising:

a processor programmed to represent two phrases with corresponding sequences of acoustic characteristics based on phonetic capabilities of speakers obtained from acoustic signals of the phrases, to align the sequences of acoustic characteristics, to compare the sequences of acoustic characteristics, and to calculate a metric of acoustic confusability according to the comparing.

43. A computer system, comprising:

a processor programmed to represent a first phrase and a second phrase, respectively, with a corresponding sequence of acoustic features and acoustic measures obtained from a dictionary of acoustic features and a database of prerecorded audio files, to align the sequence of acoustic features and acoustic measures of the first phrase with the sequence of acoustic features and acoustic measures of the second phrase, to compare the aligned first phrase and second phrase sequences, and to calculate a metric of acoustic confusability according to the comparing according to a formula 2K/(N+M), wherein K is a number of acoustic features and acoustic measures that match from the comparing and N is a number of acoustic features and acoustic measures in the first phrase and M is a number of acoustic features and acoustic measures in the second phrase.

44. A process, comprising:

predicting when a speech recognizer will confuse two spoken phrases in any language where two phrases in any combination of a text form and an audio file in any language are available to a confusability prediction algorithm.

45. A computer system, comprising:

a processor programmed to predict when a speech recognizer will confuse two spoken phrases in any language where two phrases in any combination of a text form and an audio file in any language are available to a confusability prediction algorithm.

46. A process, comprising:

receiving two utterances in any combination of a text form and an audio file, the audio file having a speech signal recorded by any speaker and under any acoustic condition;

representing the two utterances with an intermediate representation that directly reflects the salient acoustic characteristics of the two utterances when spoken; and

predicting when a speech recognizer will confuse the two utterances when spoken by using the intermediate representation of the two utterances.

47. The process according to claim 46, wherein results from the predicting is used in a telephony application.

48. A computer system, comprising:

a processor programmed to receive two phrases in any combination of text and spoken form, the spoken form spoken by any speaker and under any acoustic condition, to represent the two phrases with an intermediate representation that directly reflects the salient acoustic characteristics of the two phrases when spoken, and to predict when a speech recognizer will confuse the two phrases when spoken by using the intermediate representation of the two phrases.

49. The system according to claim 48, wherein results from the prediction is used in a telephony application.

50. A computer program, embodied on a computer-readable medium, comprising:

an input segment receiving two utterances in any combination of a text form and an audio file, the audio file having speech signals recorded by any speaker and under any acoustic condition;

a transformation segment representing the two utterances with an intermediate representation that directly reflects the salient acoustic characteristics of the two utterances when spoken; and

a predicting segment predicting acoustic confusability of the two utterances when spoken to a speech recognizer using the intermediate representation of the two utterances.