Method and device for the rapid, pattern-recognition-supported transcription of spoken and written utterances

• US 20060167685A1
• Filed: 01/30/2003
• Published: 07/27/2006
• Est. Priority Date: 02/07/2002
• Status: Abandoned Application

• Current Assignee: Nuance Communications Austria Gmbh (Microsoft Corporation)
• Original Assignee: Nuance Communications Austria Gmbh (Microsoft Corporation)
• Inventors: Reisinger, Josef, Waibel, Ulrich, Klakow, Dietrich, Thelen, Eric, Scholl, Holger R.
• Application Number:
  US10/503,420
• Publication Number:
  US 20060167685A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features

Abstract

The invention relates to a method and a device for the transcription of spoken and written utterances. To this end, the utterances undergo speech or text recognition, and the recognition result (ME) is combined with a manually created transcription (MT) of the utterances in order to obtain the transcription. The additional information rendered usable by the combination as a result of the recognition result (ME) enables the transcriber to work relatively roughly and therefore quickly on the manual transcription. When using a keyboard (25), he can, for example, restrict himself to hitting the keys of only one row and/or can omit some keystrokes completely. In addition, the manual transcribing can also be accelerated by the suggestion of continuations (31) to the text input so far (30), which continuations are anticipated by virtue of the recognition result (ME).

Claims

1. A method of transcribing a spoken utterance, of which a manually transcribed text (MT) and a speech-recognition result (ME) exist, through combination of the manually transcribed text (MT) and the speech-recognition result (ME).

3. A method as claimed in claim 1, characterized in that the combination of the manually transcribed text (MT) and the speech-recognition result (ME) consists in determining the transcription for the spoken utterance that is most probable according to stochastic models for the processes of manual transcription and speech recognition.

4. A method as claimed in claim 1, characterized in that:

the speech-recognition result (ME) is a scored N-best list or a scored word graph (ME), and

the combination of the manually transcribed text (MT) and the speech-recognition result (ME) consists in a re-scoring of the N-best list or the word graph (ME) taking account of the manually transcribed text (MT).

6. A method as claimed in claim 1, characterized in that the manually transcribed text (MT) exists in handwritten form and/or in the form of shorthand.

7. A method as claimed in claim 1, characterized in that the manually transcribed text (MT) has been created by keyboard input in a manner in which the time required for its creation has been shortened by the omission of keystrokes and/or by hitting different keys in order to reduce the extent of the finger and/or hand movements as compared with the creation of a generally applicable manual transcription.

11. The use of a method as claimed in claim 1 for creating an SMS communication or a video subtitle.

2. A method of transcribing a spoken utterance of which a manually transcribed text (MT) exists, which method includes the following steps:

speech recognition of the spoken utterance, taking account of the manually transcribed text (MT), and

creation of the transcription of the spoken utterance through combination of the manually transcribed text (MT) and the speech-recognition result (ME) or through adoption of the speech-recognition result (ME) for the transcription.

5. A method as claimed in claim 2, characterized in that the taking into account of the manually transcribed text (MT) in the speech recognition of the spoken utterance consists in the selection of the speech-recognition vocabulary and/or the speech-recognition language model.

8. A device for the transcription of a spoken utterance of which a speech-recognition result (ME) exists, which device includes the following components:

components (20, 21, 23, 25, 26, 27) for the manual transcription of the spoken utterance, and

a component (20) for creation of the transcription of the spoken utterance by combination of the manually transcribed text (MT) and of the speech-recognition result (ME).

9. A device for the speech-recognition-supported manual transcription of a spoken utterance of which a speech-recognition result (ME) exists, which device includes the following components:

components (25, 26) for the continuous input of the manual transcription (MT, 30) of the spoken utterance,

component (20) for the continuous combination of the manual input (30) and the speech-recognition result (ME),

components (20, 27) for suggesting a continuation (31) of the text input so far (30) as anticipated by virtue of the continuous combination and the speech-recognition result (ME), and

components (25, 26) for accepting or rejecting the suggested text continuation (31).

10. A method for transcribing a written utterance, of which a manually transcribed text (MT) and a text-recognition result (ME) exist, by combination of the manually transcribed text (MT) and the text-recognition result (ME).