DETECTING SPEECH INPUT PHRASE CONFUSION RISK

• US 20150127347A1
• Filed: 11/06/2013
• Published: 05/07/2015
• Est. Priority Date: 11/06/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Tjalve, Michael, Karnam, Pavan, Mooney, Dennis
• Granted Patent: US 9,384,731 B2
• Time in Patent Office: Days
• US Class Current: 704/257
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 2015/0635 updating or merging of old and new templates; Mean values; Weighting
• CPC Class Codes: G10L 2025/786 Adaptive threshold
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

Embodiments are disclosed that relate to identifying phonetically similar speech grammar terms during computer program development. For example, one disclosed embodiment provides a method including providing a speech grammar development tool configured to receive input of a text representation of each of a plurality of proposed speech grammar terms, convert each text representation to a phonetic representation of the speech grammar term, compare the phonetic representation of the speech grammar term to the phonetic representations of other speech grammar terms using a weighted similarity matrix, and provide an output regarding risk of confusion between two proposed speech grammar terms based upon a comparison of the phonetic representations of the two proposed speech grammar terms. The method further includes receiving data regarding incorrect speech grammar term identification, and modifying one or more weights in the weighted similarity matrix based upon the data.

Claims

1. On a computing device, a method of detecting phrase confusion risk in a proposed speech grammar for a computer program, the method comprising:

providing a speech grammar development tool configured to

receive input of a text representation of each of a plurality of proposed speech grammar terms,

for each proposed speech grammar term, convert the text representation to a phonetic representation of the speech grammar term and compare the phonetic representation of the speech grammar term to the phonetic representations of other speech grammar terms using a weighted similarity matrix, and

provide an output regarding risk of confusion between two proposed speech grammar terms based upon a comparison of the phonetic representations of the two proposed speech grammar terms;

receiving data regarding incorrect speech grammar term identification; and

modifying one or more weights in the weighted similarity matrix based upon the data.

2. The method of claim 1, wherein the weighted similarity matrix comprises, for each phoneme of a plurality of phonemes, a weight for each phonetic feature of a plurality of phonetic features.

3. The method of claim 2, wherein modifying the one or more weights in the weighted similarity matrix comprises manually adjusting the one or more weights based upon the data.

4. The method of claim 2, wherein modifying the one or more weights in the weighted similarity matrix comprises algorithmically adjusting the one or more weights based upon the data.

5. The method of claim 1, further comprising, for a selected speech grammar term, determining that a portion of the selected speech grammar term has a spoken duration below a threshold duration, and omitting the portion from the phonetic representation of the selected speech grammar term before comparing the phonetic representation of the selected speech grammar term to the phonetic representations of other speech grammar terms.

6. The method of claim 5, wherein determining that the portion of the selected speech grammar term has a spoken duration below a threshold duration comprises force aligning one or more audio samples of the selected speech grammar term to the text representation of the selected speech grammar term and determining that a time stamp of the portion has a value below the threshold duration.

7. The method of claim 6, further comprising receiving the one or more audio samples from end users.

8. The method of claim 1, wherein providing the output comprises providing one of three or more possible outputs regarding a relative risk of confusion between the two proposed speech grammar terms.

9. The method of claim 1, wherein the data regarding incorrect speech grammar term identification comprises data regarding an actual pronunciation for a selected speech grammar term that is different than the expected pronunciation of the selected speech grammar term;

and

further comprising storing a phonetic representation of the actual pronunciation of the selected speech grammar term.

10. On a computing device, a method of detecting phrase confusion risk in proposed speech grammar for a computer program, the method comprising:

receiving an input of a text representation of a speech grammar term;

determining a phonetic representation of the speech grammar term from the text representation;

if a portion of the speech grammar term comprises a duration below a threshold duration, then omitting the portion of the phonetic representation of the speech grammar term;

comparing the phonetic representation of the speech grammar term to a phonetic representation of another speech grammar term; and

outputting a representation of a risk of confusion between the speech grammar term and the other speech grammar term.

11. The method of claim 10, further comprising determining that the portion of the selected speech grammar term has a spoken duration below a threshold duration by force aligning one or more audio samples of the selected speech grammar term to the text representation of the selected speech grammar term and determining that a time stamp of the portion has a value lower than the threshold duration.

12. The method of claim 11, further comprising receiving the one or more audio samples from end users via telemetry.

13. The method of claim 10, wherein comparing the phonetic representation of the speech grammar term to a phonetic representation of another speech grammar term comprises using a weighted similarity matrix.

14. The method of claim 13, further comprising receiving data regarding incorrect speech grammar term identification, and modifying one or more weights in the weighted similarity matrix based upon the data.

15. The method of claim 10, wherein outputting the representation of a risk of confusion comprises providing one of three or more possible outputs to indicate a relative risk of confusion between the two proposed speech grammar terms.

16. A computing system, comprising:

a logic subsystem; and

a data holding subsystem storing instructions executable by the logic subsystem to;

provide a speech grammar development tool configured to

receive input of a text representation of each of a plurality of proposed speech grammar terms,

for each proposed speech grammar term, convert the text representation to a phonetic representation of the speech grammar term and compare the phonetic representation of the speech grammar term to the phonetic representations of other speech grammar terms using a weighted similarity matrix, the weighted similarity matrix comprising, for each phoneme of a plurality of phonemes, a weight for each phonetic feature of a plurality of phonetic features, and

provide an output regarding risk of confusion between two proposed speech grammar terms based upon a comparison of the phonetic representations of the two proposed speech grammar terms;

receive data regarding one or more incorrect speech grammar term identifications, the data comprising an actual pronunciation for a selected speech grammar term that is different from the expected pronunciation of the selected speech grammar term; and

store a phonetic representation of the actual pronunciation of the selected speech grammar term.

17. The computing system of claim 16, wherein the instructions are further executable to, for a selected speech grammar term, determine that a portion of the selected speech grammar term has a spoken duration below a threshold duration, and omit the portion from the phonetic representation of the selected speech grammar term before comparing the phonetic representation of the selected speech grammar term to the phonetic representations of other speech grammar terms.

18. The computing system of claim 17, wherein the instructions are executable to determine that the portion of the selected speech grammar term has a spoken duration below a threshold duration by force aligning one or more audio samples of the selected speech grammar term to the text representation of the selected speech grammar term and determining that a time stamp of the portion has a value lower than the threshold duration.

19. The computing system of claim 18, wherein the instructions are executable to receive the one or more audio samples from end users.

20. The computing system of claim 16, wherein the instructions are executable to output three or more possible outputs to indicate of a relative risk of confusion between the two proposed speech grammar terms.