System and method for report level confidence

• US 7,818,175 B2
• Filed: 07/28/2005
• Issued: 10/19/2010
• Est. Priority Date: 07/30/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Dictaphone Corporation (Microsoft Corporation)
• Inventors: Lovance, Elizabeth M., Lapshina, Larissa, Carus, Alwin B.
• Primary Examiner(s): Armstrong; Angela A
• Application Number:
  US11/191,814
• Publication Number:
  US 20060026003A1
• Time in Patent Office: 1,909 Days
• Field of Search: 704/235, 704/270
• US Class Current: 704/270
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A system and method is disclosed for Report Confidence Modeling (RCM) including automatic adaptive classification of ASR output documents to determine the most efficient document edit workflow to convert dictation into finished output. The RCM according to the present invention may include a mechanism to predict recognition accuracy of a document generated by an ASR engine. Predicted accuracy of the document allows an ASR application to sort recognized documents based on their estimated accuracy or quality and route them appropriately for further processing, editing and/or formatting.

Claims

1. A computer implemented method of transforming a dictation into text comprising steps of:

receiving said dictation by a computer;

automatically transcribing said dictation into recognized text by automatic speech recognition;

determining a document level confidence score measurement from said recognized text, said document level confidence measurement determination based, at least in part, on word-level recognition accuracy in said automatic transcription and at least one document-level feature affecting how easily the document may be edited or transcribed;

establishing a predetermined confidence measurement threshold value;

submitting said recognized text for editing if said confidence measurement exceeds said predetermined confidence measurement threshold value; and

manually transcribing said dictation into text if said confidence measurement does not exceed said predetermined confidence measurement threshold value.

2. The method of claim 1 wherein the confidence measurement is determined by modeling.

3. The method of claim 2 wherein the modeling has a threshold component and a scoring strictness component.

4. The method of claim 3 wherein the threshold component is based on the level of accuracy of the recognized text.

5. The method of claim 3 wherein the scoring strictness component provides an acceptable range of confidence scores for the recognized text.

6. The method of claim 3 wherein the modeling also includes a cost effectiveness component.

7. The method of claim 1 wherein the dictation and recognized text are routed to an adaptation modeling module for final editing.

8. The method of claim 7 wherein automatic speech recognition software performs the editing.

9. The method of claim 1 wherein the dictation and recognized text are routed to a transcriptionist for editing.

10. The method of claim 1 wherein the dictation and recognized text also are routed based on predetermined filter settings.

11. The method of claim 1 further comprising the step of providing a report confidence model.

12. The method of claim 11 wherein the confidence score is determined from the report confidence model.

13. The method of claim 11 further comprising the step of customizing the report confidence model based on collected reports, automatic speech recognizes documents, and/or descriptive information corresponding to the corrected reports and automatic speech recognizer documents.