USER-PROVIDED TRANSCRIPTION FEEDBACK AND CORRECTION

• US 20190035385A1
• Filed: 10/01/2018
• Published: 01/31/2019
• Est. Priority Date: 04/26/2017
• Status: Abandoned Application

• Current Assignee: Soundhound AI IP LLC
• Original Assignee: SoundHound Incorporated
• Inventors: LAWSON, Stephanie, MOHAJER, Kamyar, MOSLEY, Glenda, LEEB, Rainer
• Application Number:
  US16/147,889
• Publication Number:
  US 20190035385A1
• Time in Patent Office: Days
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 2015/0631 Creating reference templates; Clustering
• CPC Class Codes: G10L 2015/0638 Interactive procedures

Abstract

A system, method, and non-transitory computer readable medium provide for a visual display of a user interface for a voice-based virtual assistant system. After displaying a transcription of user speech and performing requested actions, the system allows the user to provide, by speech or manual input, an indication of satisfaction or dissatisfaction. For transcription errors, the user is presented an opportunity to correct the transcription text. The system can present several transcription hypotheses to the user, and allow the user to choose among them, or to edit one of them, as the intended transcription. A back-end server system uses the corrected transcription to train a machine learning model to perform more accurate speech recognition or provide more useful actions for future users. A system can save one or more speech recognition transcription hypotheses and check corrected results against the other transcriptions to further improve models.

Claims

1. An arrangement of at least one non-transitory computer readable medium comprising code that, if executed by at least one computer processor comprised by a virtual assistant, would cause the virtual assistant to:

visually display a transcription word sequence of recognized speech;

accept input from a user about whether the word sequence is a correct transcription;

responsive to the input being negative, ask the user to correct the transcription;

accept input from the user correcting the transcription; and

use the corrected transcription to improve speech recognition accuracy.

2. The arrangement of claim 1 wherein the code, if executed by the at least one computer processor, would further cause the virtual assistant to provide the user with a text box for inputting the correct transcription, the text box being populated with the displayed word sequence before accepting text entered by the user.

3. The arrangement of claim 1 wherein the code, if executed by the at least one computer processor, would further cause the virtual assistant to provide the user with a list of the most highly scored word sequence hypotheses as selectable choices.

4. A method of collecting user feedback and correction of transcription errors, the method comprising:

visually displaying a transcription word sequence of recognized speech;

accepting input from a user about whether the word sequence is a correct transcription;

responsive to the input being negative, asking the user to correct the transcription;

accepting input from the user correcting the transcription; and

using the corrected transcription to improve speech recognition accuracy.

5. The method of claim 4 further comprising providing the user with a text box for inputting the correct transcription, the text box being populated with the displayed word sequence before accepting text entered by the user.

6. The method of claim 4 further comprising providing the user with a list of the most highly scored word sequence hypotheses as selectable choices.

7. A system for collecting user feedback and correction of transcription errors, the system comprising:

means to visually display a transcription word sequence of recognized speech;

means to accept input from a user about whether the word sequence is a correct transcription;

means to, responsive to the input being negative, ask the user to correct the transcription;

means to accept input from the user correcting the transcription; and

means to use the corrected transcription to improve speech recognition accuracy.

8. The system of claim 7 further comprising means to provide the user with a text box for inputting the correct transcription, the text box being populated with the displayed word sequence before accepting text entered by the user.

9. The system of claim 7 further comprising means to provide the user with a list of the most highly scored word sequence hypotheses as selectable choices.