Continuous speech transcription performance indication

• US 8,868,420 B1
• Filed: 08/26/2013
• Issued: 10/21/2014
• Est. Priority Date: 08/22/2007
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Canyon IP Holdings LLC (Intellectual Ventures LLC)
• Inventors: Terrell, James Richard II, White, Marc, Jablokov, Igor Roditis
• Primary Examiner(s): Abebe, Daniel D
• Application Number:
  US14/010,433
• Time in Patent Office: 421 Days
• Field of Search: 704/235
• US Class Current: 704/235
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/221 Announcement of recognition results

Abstract

A method of providing speech transcription performance indication includes receiving, at a user device data representing text transcribed from an audio stream by an ASR system, and data representing a metric associated with the audio stream; displaying, via the user device, said text; and via the user device, providing, in user-perceptible form, an indicator of said metric. Another method includes displaying, by a user device, text transcribed from an audio stream by an ASR system; and via the user device, providing, in user-perceptible form, an indicator of a level of background noise of the audio stream. Another method includes receiving data representing an audio stream; converting said data representing an audio stream to text via an ASR system; determining a metric associated with the audio stream; transmitting data representing said text to a user device; and transmitting data representing said metric to the user device.

Claims

1. A computer-implemented method comprising:

receiving a first transcription comprising first text and second text, wherein the first transcription was created by transcribing first audio data using a speech recognition engine configured to filter the first transcription by automatically replacing one or more words with corresponding numbers or digits formatted as a telephone number;

receiving a first value associated with the first text and a second value associated with the second text; and

causing presentation of the first text with a first graphical element indicating the first value and presentation of the second text with a second graphical element indicating the second value.

2. The computer-implemented method of claim 1, wherein the first value indicates a volume level of a portion of the first audio data corresponding to the first text, a level of background noise in the portion of the first audio data, or a confidence level associated with the first text as determined by the speech recognition engine.

3. The computer-implemented method of claim 1, wherein the first graphical element comprises font color, font grayscale, font weight, font size, or underlining.

4. The computer-implemented method of claim 1, wherein the first audio data comprises at least part of a voicemail message.

5. The computer-implemented method of claim 1, further comprising causing the telephone number to be presented as a hyperlink.

6. The computer-implemented method of claim 1, further comprising:

receiving a second transcription comprising third text, wherein the third text comprises a modified version of the first text; and

causing presentation of the third text.

7. A system comprising:

an electronic data store configured to store transcription information; and

one or more computing devices in communication with the electronic data store, the one or more computing systems configured to at least;

receive a first transcription comprising first text and second text, wherein the first transcription was created by transcribing first audio data using a speech recognition engine configured to filter the first transcription by automatically replacing one or more words with corresponding numbers or digits formatted as a telephone number;

receive a first value associated with the first text and a second value associated with the second text; and

cause presentation of the first text with a first graphical element indicating the first value and a second graphical element indicating the second value.

8. The system of claim 7, wherein the first graphical element comprises a lighter color if the first value is in a lower range, or a darker color if the first value is in a higher range.

9. The system of claim 8, wherein the lighter color is gray and the darker color is black.

10. The system of claim 7, wherein the first audio data comprises at least part of a voicemail message.

11. The system of claim 7, wherein the one or more computing devices are further configured to cause the telephone number to be presented as a hyperlink.

12. The system of claim 7, wherein the second value indicates a volume level of a portion of the first audio data corresponding to the second text, a level of background noise in the portion of the first audio data, or a confidence level associated with the second text as determined by the speech recognition engine.

13. The system of claim 7, wherein the one or more computing devices are further configured to:

receive a second transcription comprising third text, wherein the third text comprises a modified version of the first text; and

cause presentation of the third text.

14. A non-transitory computer-readable medium storing instructions that, when executed by a processor on a computing device, cause the computing device to at least:

receive a first transcription comprising first text and second text, wherein the first transcription was created by transcribing first audio data using a speech recognition engine configured to filter the first transcription by automatically replacing one or more words with corresponding numbers or digits formatted as a telephone number;

receive a first value associated with the first text and a second confidence value associated with the second text; and

cause presentation of the first text with a first graphical element indicating the first value and presentation of the second text with a second graphical element indicating the second value.

15. The non-transitory computer-readable medium of claim 14, wherein the first graphical element indicates a volume level associated with a portion of the first audio data corresponding to the first text and is presented substantially simultaneously with the presentation of the first text.

16. The non-transitory computer-readable medium of claim 14, wherein the first graphical element comprises font color, font grayscale, font weight, font size, or underlining.

17. The non-transitory computer-readable medium of claim 14, wherein the first audio data comprises at least part of a voicemail message.

18. The non-transitory computer-readable medium of claim 14, further comprising instructions to present the telephone number as a hyperlink.

19. The non-transitory computer-readable medium of claim 14, wherein the first audio data is captured at a first device and the first text is presented at a second device.

20. The non-transitory computer-readable medium of claim 14, further comprising instructions to:

receive a second transcription comprising third text, wherein the third text is a modified version of the first text; and

cause presentation of the third text.