Speech-enabled language translation system and method enabling interactive user supervision of translation and speech recognition accuracy
First Claim
1. A system providing cross-linguistic communication, comprising:
- a client component capturing speech and tactile inputs, the client component providing a user interface configured to display and correct the inputs and meanings for the inputs, a translation of the input term into a different language than an input language, and a back translation of the translation, i.e., a retranslation from the target language back into the source language, intended to help the user to judge the translation quality; and
a server component providing the meanings, the translation and the back translation to the client component based upon the input term, the server component including,an interaction manager requesting the translation of the inputs, the interaction manager accessing a database of Meaning Cues corresponding to the inputs, the corresponding Meaning Cues being displayed through the client component to facilitate word sense selection for the inputs.
3 Assignments
0 Petitions
Accused Products
Abstract
A system and method for a highly interactive style of speech-to-speech translation is provided. The interactive procedures enable a user to recognize, and if necessary correct, errors in both speech recognition and translation, thus providing robust translation output than would otherwise be possible. The interactive techniques for monitoring and correcting word ambiguity errors during automatic translation, search, or other natural language processing tasks depend upon the correlation of Meaning Cues and their alignment with, or mapping into, the word senses of third party lexical resources, such as those of a machine translation or search lexicon. This correlation and mapping can be carried out through the creation and use of a database of Meaning Cues, i.e., SELECT. Embodiments described above permit the intelligent building and application of this database, which can be viewed as an interlingua, or language-neutral set of meaning symbols, applicable for many purposes. Innovative techniques for interactive correction of server-based speech recognition are also described.
452 Citations
14 Claims
-
1. A system providing cross-linguistic communication, comprising:
-
a client component capturing speech and tactile inputs, the client component providing a user interface configured to display and correct the inputs and meanings for the inputs, a translation of the input term into a different language than an input language, and a back translation of the translation, i.e., a retranslation from the target language back into the source language, intended to help the user to judge the translation quality; and a server component providing the meanings, the translation and the back translation to the client component based upon the input term, the server component including, an interaction manager requesting the translation of the inputs, the interaction manager accessing a database of Meaning Cues corresponding to the inputs, the corresponding Meaning Cues being displayed through the client component to facilitate word sense selection for the inputs. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 10, 11)
-
-
9. A cross linguistic communication system, comprising:
-
a client component including a multi-modal user interface; and a server component including an interaction manager in communication with the multi-modal user interface, the interaction manager providing semantic cross indexing or mapping between a term output from a translation engine accessible to the server component and a database comprised of Meaning Cues designed to clarify for users word sense options for the term, wherein the Meaning Cues are returned to the interaction manager for display through the multi-modal user interface to enable interactive user modification of the translation. - View Dependent Claims (12)
-
-
13. A computer-readable storage medium having computer-executable instructions stored thereon that, when executed, display a graphical user interface (GUI) enabling computer mediated communication, the GUI comprising:
-
a first section of the GUI displaying input terms in a first language; a second section of the GUI displaying Meaning Cues for each of the input terms; a third section of the GUI displaying a translation of the input terms in a second language; and a fourth section of the GUI displaying a back translation in the first language, the back translation based upon the translation. - View Dependent Claims (14)
-
Specification