Synchronise an audio cursor and a text cursor during editing

• US 8,117,034 B2
• Filed: 03/26/2002
• Issued: 02/14/2012
• Est. Priority Date: 03/29/2001
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications Austria Gmbh (Microsoft Corporation)
• Inventors: Gschwendtner, Wolfgang
• Primary Examiner(s): Smits, Talivaldis Ivars
• Assistant Examiner(s): Kazeminezhad, Farzad
• Application Number:
  US10/106,981
• Publication Number:
  US 20020143544A1
• Time in Patent Office: 3,612 Days
• Field of Search: 704/231, 704/531, 704/235
• US Class Current: 704/260
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

A speech recognition device (1) processes speech data (SD) of a dictation and thus establishes recognized text information (ETI) and link information (LI) of the dictation. In a synchronous playback mode of the speech recognition device (1), during the acoustic playback of the dictation a correction device (10) synchronously marks the word of the recognized text information (ETI) which word relates to the speech data (SD) just played back marked by the link information (LI) is marked synchronously, the just marked word featuring the position of an audio cursor (AC). When a user of the speech recognition device (1) recognizes an incorrect word, he positions a text cursor (TC) at the incorrect word and corrects it. Cursor synchronization means (15) now make it possible to synchronize the text cursor (TC) with the audio cursor (AC) or the audio cursor (AC) with the text cursor (TC) so that the positioning of the respective cursor (AC, TC) is simplified considerably.

Claims

1. A correction device for correcting incorrect words in text information recognized by a speech recognition device from speech information, comprising:

reception means for receiving the speech information, the text information recognized from the speech information and link information that associates portions of the text information with portions of the speech information from which the portions of the text information was recognized by the speech recognition device;

editing means for providing a text cursor for display, the text cursor indicating a position in the text information where at least one edit will be performed upon receiving editing information entered by a user;

audio playback means to provide an audio cursor for display during acoustic playback of the speech information, the audio cursor highlighting portions of the text information synchronous with the playback of the speech information according to associations provided by the link information such that, when displayed to the user, the audio cursor highlights the portions of the text information as the associated portions of the speech information are being acoustically played back; and

cursor synchronization means for automatically synchronizing the text cursor and the audio cursor, wherein the cursor synchronization means comprises means for automatically positioning the text cursor at a predetermined position relative to a location of the audio cursor and automatically moving the location of the text cursor synchronous with the movement of the audio cursor during the acoustic playback until an editing operation is performed.

2. The correction device of claim 1, wherein after an editing operation is performed, the cursor synchronization means automatically synchronizes the text cursor with the audio cursor upon receiving a first keyboard input from the user and automatically synchronizes the audio cursor with the text cursor upon receiving a second keyboard input from the user.

3. The correction device of claim 2, wherein the cursor synchronization means includes a continuous synchronous playback mode and wherein the cursor synchronization means continuously automatically synchronizes the cursors when the continuous synchronous playback mode is active and wherein the continuous synchronous playback mode is deactivated upon receiving at least one first keyboard input from the user, wherein the cursor synchronization means uncouples the text cursor from the audio cursor upon deactivation, and wherein the continuous synchronous playback mode is activated upon receiving at least one second keyboard input from the user, wherein the cursor synchronization means resumes continuous synchronous playback upon activation.

4. The correction device of claim 1, wherein after an editing operation is performed the cursor synchronization means automatically synchronizes the text cursor and the audio cursor upon receiving at least one keyboard input, wherein, upon receiving a first keyboard input, the cursor synchronization means determines which of the text cursor and the audio cursor is positioned nearer an end of the text information and automatically synchronizes the text cursor and the audio cursor at a location proximate the cursor positioned nearer the end of the text information, and wherein, upon receiving a second keyboard input, the cursor synchronization means determines which of the text cursor and the audio cursor is positioned nearer a beginning of the text information and automatically synchronizes the text cursor and the audio cursor at a location proximate the cursor positioned nearer the beginning of the text information.

5. The correction device of claim 4, wherein the first keyboard input includes the “

Right arrow”

key, and wherein the second keyboard input includes the “

Left arrow”

key.

6. The correction device of claim 1, wherein the cursor synchronization means position the text cursor at a location in the text information a predefined number of words before the audio cursor when the continuous synchronous playback mode is active.

7. The correction device of claim 6, wherein the predefined number of words can be set by the user.

8. A method of assisting in correcting text information recognized by a speech recognition device from speech information, the method comprising:

receiving the speech information, the text information recognized from the speech information, and link information that associates portions of the text information with portions of the speech information from which the portions of the text information were recognized by the speech recognition device;

providing an audio cursor for display during acoustic playback of the speech information, the audio cursor highlighting portions of the text information synchronous with the playback of the speech information according to associations provided by the link information such that, when displayed to the user, the audio cursor highlights the portions of the text information as the associated portions of the speech information are being acoustically played back; and

providing a text cursor for display to facilitate editing the text information, the text cursor indicating a position in the text information where at least one edit will be performed upon receiving editing information entered by the user; and

automatically synchronizing the text cursor and the audio cursor, wherein automatically synchronizing the text cursor and the audio cursor comprises automatically positioning the text cursor at a predetermined position relative to a location of the audio cursor and automatically moving the location of the text cursor synchronous with the movement of the audio cursor during the acoustic playback until an editing operation is performed.

9. The method of claim 8, wherein automatically synchronizing includes automatically positioning the text cursor a predefined number of words before the audio cursor in the text information.

10. The method of claim 9, in which the predefined number of words can be set by the user.

11. The method of claim 8, wherein after an editing operation is performed automatically synchronizing includes automatically synchronizing the text cursor with the audio cursor upon receiving a first keyboard input from the user and automatically synchronizing the audio cursor with the text cursor upon receiving a second keyboard input from the user.

12. The method of claim 8, wherein automatically synchronizing includes, upon receiving a first keyboard input, determining which of the text cursor and the audio cursor is positioned nearer an end of the text information and automatically synchronizing the text cursor and the audio cursor at a location proximate the cursor positioned nearer the end of the text information, and upon receiving a second keyboard input, determining which of the text cursor and the audio cursor is positioned nearer a beginning of the text information and automatically synchronizing the text cursor and the audio cursor at a location proximate the cursor positioned nearer the beginning of the text information.

13. The method of claim 8, wherein automatically synchronizing includes continuously automatically synchronizing the text cursor and the audio cursor when a continuous synchronous playback mode is activated, the method further comprising:

deactivating continuously automatically synchronizing upon receiving at least one first keyboard input from the user, the deactivating including uncoupling the text cursor from the audio cursor; and

activating the continuous synchronous playback mode upon receiving at least one second keyboard input from the user to resume continuously automatically synchronizing the text cursor and the audio cursor.

14. At least one non-transitory computer readable medium encoded with instructions that, when executed by at least one computer, perform a method of assisting in correcting text information recognized from speech by a speech recognition device, the method comprising:

receiving the speech information, the text information recognized from the speech information, and link information that associates portions of the text information with portions of the speech information from which the portions of the text information were recognized by the speech recognition device;

providing an audio cursor for display during acoustic playback of the speech information, the audio cursor highlighting portions of the text information synchronous with the playback of the speech information according to associations provided by the link information such that, when displayed to the user, the audio cursor highlights the portions of the text information as the associated portions of the speech information are being acoustically played back;

providing a text cursor for display to facilitate editing the text information, the text cursor indicating a position in the text information where at least one edit will be performed upon receiving editing information entered by the user; and

automatically synchronizing the text cursor and the audio cursor, wherein automatically synchronizing the text cursor and the audio cursor comprises automatically positioning the text cursor at a predetermined position relative to a location of the audio cursor and automatically moving the location of the text cursor synchronous with the movement of the audio cursor during the acoustic playback until an editing operation is performed.

15. The at least one non-transitory computer readable medium of claim 14, wherein automatically synchronizing includes automatically positioning the text cursor a predefined number of words before the audio cursor in the text information.

16. The at least one non-transitory computer readable medium of claim 15, in which the predefined number of words can be set by the user.

17. The at least one non-transitory computer readable medium of claim 14, wherein automatically synchronizing includes automatically synchronizing the text cursor with the audio cursor upon receiving a first keyboard input from the user and automatically synchronizing the audio cursor with the text cursor upon receiving a second keyboard input from the user.

18. The at least one non-transitory computer readable medium of claim 14, wherein automatically synchronizing includes, upon receiving a first keyboard input, determining which of the text cursor and the audio cursor is positioned nearer an end of the text information and automatically synchronizing the text cursor and the audio cursor at a location proximate the cursor positioned nearer the end of the text information, and upon receiving a second keyboard input, determining which of the text cursor and the audio cursor is positioned nearer a beginning of the text information and automatically synchronizing the text cursor and the audio cursor at a location proximate the cursor positioned nearer the beginning of the text information.

19. The at least one non-transitory computer readable medium of claim 14, wherein automatically synchronizing includes continuously automatically synchronizing the text cursor and the audio cursor when a continuous synchronous playback mode is activated, the method further comprising:

deactivating continuously automatically synchronizing upon receiving at least one first keyboard input from the user, the deactivating including uncoupling the text cursor from the audio cursor; and

activating the continuous synchronous playback mode upon receiving at least one second keyboard input from the user to resume continuously automatically synchronizing the text cursor and the audio cursor.

20. A correction device for correcting incorrect words in text information recognized by a speech recognition device from speech information, the correction device comprising:

at least one computer programmed to;

receive the speech information, the text information recognized from the speech information and link information that associates portions of the text information with portions of the speech information from which the portions of the text information was recognized by the speech recognition device;

provide a text cursor for display, the text cursor indicating a position in the text information where at least one edit will be performed upon receiving editing information entered by a user;

provide an audio cursor for display during acoustic playback of the speech information, the audio cursor highlighting portions of the text information synchronous with the playback of the speech information according to associations provided by the link information such that, when displayed to the user, the audio cursor highlights the portions of the text information as the associated portions of the speech information are being acoustically played back; and

automatically synchronize the text cursor and the audio cursor, wherein the at least one computer is programmed to automatically position the text cursor at a predetermined position relative to a location of the audio cursor and automatically move the location of the text cursor synchronous with the movement of the audio cursor during the acoustic playback until an editing operation is performed.

21. The correction device of claim 20, wherein the at least one computer is programmed to automatically synchronize a position of the text cursor to a position of the audio cursor upon receiving a first keyboard input from the user and to automatically synchronize a position of the audio cursor to a position of the text cursor upon receiving a second keyboard input from the user.

22. The correction device of claim 21, wherein the at least one computer is programmed to implement a continuous synchronous playback mode, wherein when the continuous synchronous playback mode is active the cursors are synchronized, wherein the continuous synchronous playback mode is deactivated upon receiving at least one first keyboard input from the user, wherein the at least computer is programmed to uncouple the text cursor from the audio cursor upon deactivation of the continuous synchronous playback mode, wherein the continuous synchronous playback mode is activated upon receiving at least one second keyboard input from the user, and wherein the at least one computer is programmed to resume continuous synchronous playback upon activation.

23. The correction device of claim 20, wherein the at least one computer is programmed to implement a continuous playback mode wherein the text cursor is positioned at a location in the text information a predefined number of words before the audio cursor when the continuous synchronous playback mode is active.

24. The correction device of claim 23, wherein the predefined number of words can be set by the user.

25. The correction device of claim 20, wherein the at least one computer is programmed to automatically synchronize the text cursor and the audio cursor upon receiving at least one keyboard input, wherein, upon receiving a first keyboard input, the at least one computer determines which of the text cursor and the audio cursor is positioned nearer an end of the text information and automatically synchronizes the text cursor and the audio cursor at a location proximate the cursor positioned nearer the end of the text information, and wherein, upon receiving a second keyboard input, the at least one computer determines which of the text cursor and the audio cursor is positioned nearer a beginning of the text information and automatically synchronizes the text cursor and the audio cursor at a location proximate the cursor positioned nearer the beginning of the text information.