Translation training with cross-lingual multi-media support
First Claim
Patent Images
1. A method comprising:
- receiving, by an interface of a translation system, speech by a speaker in a first language;
recognizing, by an automatic speech recognition module of the translation system, the received speech;
transcribing the recognized speech in the first language;
translating, by a machine translation module of the translation system, the speech transcription into a second language, the translated speech transcription stored in a file of a database of the translation system;
receiving, by the interface of the translation system, presentation materials associated with the speech in the first language;
extracting text in the first language from the presentation materials;
translating, by the machine translation module, the extracted text into the second language;
generating translated presentation materials in the second language based on the text in the second language;
modifying the file storing the translated speech transcription by importing at least one formatting feature from the original or translated presentation materials into the translated speech transcription; and
displaying, by a display device, the modified translated speech transcription.
2 Assignments
0 Petitions
Accused Products
Abstract
An improved lecture support system integrates multi-media presentation materials with spoken content so that the listener can follow with both the speech and the supporting materials that accompany the presentation to provide additional understanding. Computer-based systems and methods are disclosed for translation of a spoken presentation (e.g., a lecture, a video) along with the accompanying presentation materials. The content of the presentation materials can be used to improve presentation translation, as it extracts supportive material from the presentation materials as they relate to the speech.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving, by an interface of a translation system, speech by a speaker in a first language; recognizing, by an automatic speech recognition module of the translation system, the received speech; transcribing the recognized speech in the first language; translating, by a machine translation module of the translation system, the speech transcription into a second language, the translated speech transcription stored in a file of a database of the translation system; receiving, by the interface of the translation system, presentation materials associated with the speech in the first language; extracting text in the first language from the presentation materials; translating, by the machine translation module, the extracted text into the second language; generating translated presentation materials in the second language based on the text in the second language; modifying the file storing the translated speech transcription by importing at least one formatting feature from the original or translated presentation materials into the translated speech transcription; and displaying, by a display device, the modified translated speech transcription. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer program product for translating a multimedia presentation, the computer program product comprising a non-transitory computer-readable storage medium containing computer program code for:
-
receiving, by an interface of a translation system, speech by a speaker in a first language; recognizing, by an automatic speech recognition module of the translation system, the received speech transcribing the recognized speech in the first language; translating, by a machine translation module of the translation system, the speech transcription into a second language, the translated speech transcription stored in a file of a database of the translation system; receiving presentation materials associated with the speech in the first language; extracting text in the first language from the presentation materials; translating, by the machine translation module, the extracted text into the second language; generating translated presentation materials in the second language based on the text in the second language; modifying the file storing the translated speech transcription by importing at least one formatting feature from the original or translated presentation materials into the translated speech transcription; and displaying, by a display device, the modified translated speech transcription. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification