TRANSLATION AND INTEGRATION OF PRESENTATION MATERIALS IN CROSS-LINGUAL LECTURE SUPPORT
First Claim
Patent Images
1. A method comprising:
- recognizing, by an automatic speech recognition module of a translation system, speech by a speaker in a first language, the automatic speech recognition module comprising a language model;
translating, by a machine translation module of the translation system, the recognized speech into a second language, the machine translation module comprising a language model;
transcribing the translated speech in the second language;
receiving presentation materials associated with the speech in the first language;
extracting a portion of text in the first language from the presentation materials;
translating, by the machine translation module, the extracted text into the second language;
generating translated presentation materials in the second language based on the text in the second language; and
modifying, based on the extracted text, at least one selected from the group consisting of the automatic speech recognition language model, the machine translation language model, and the transcription of the speech in the second language.
2 Assignments
0 Petitions
Accused Products
Abstract
An improved lecture support system integrates presentation materials with spoken content so that the listener can follow with both the speech and the supporting materials that accompany the lecture to provide additional understanding. Computer-based systems and methods are disclosed for translation of a spoken presentation (e.g., a lecture) along with the accompanying presentation materials. The content of the presentation materials can be used to improve lecture translation and transcription, as it extracts supportive material from the presentation materials as they relate to the lecturer'"'"'s speech.
39 Citations
20 Claims
-
1. A method comprising:
-
recognizing, by an automatic speech recognition module of a translation system, speech by a speaker in a first language, the automatic speech recognition module comprising a language model; translating, by a machine translation module of the translation system, the recognized speech into a second language, the machine translation module comprising a language model; transcribing the translated speech in the second language; receiving presentation materials associated with the speech in the first language; extracting a portion of text in the first language from the presentation materials; translating, by the machine translation module, the extracted text into the second language; generating translated presentation materials in the second language based on the text in the second language; and modifying, based on the extracted text, at least one selected from the group consisting of the automatic speech recognition language model, the machine translation language model, and the transcription of the speech in the second language. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method comprising:
-
recognizing, by an automatic speech recognition module of a translation system, speech by a speaker in a first language; transcribing, by a transcription module of the translation system, the translated speech in the second language; receiving presentation materials associated with the speech in the first language; extracting a portion of text in the first language from the presentation materials; modifying, based on the extracted text, at least one selected from the group consisting of the automatic speech recognition language model and the transcription of the speech in the second language.
-
-
12. A computer program product for translating a multimedia translation, the computer program product comprising a computer-readable storage medium containing computer program code for:
-
recognizing, by an automatic speech recognition module of a translation system, speech by a speaker in a first language, the automatic speech recognition module comprising a language model; translating, by a machine translation module of the translation system, the recognized speech into a second language, the machine translation module comprising a language model; transcribing the translated speech in the second language; receiving presentation materials associated with the speech in the first language; extracting a portion of text in the first language from the presentation materials; translating, by the machine translation module, the extracted text into the second language; generating translated presentation materials in the second language based on the text in the second language; and modifying, based on the extracted text, at least one selected from the group consisting of the automatic speech recognition language model, the machine translation language model, and the transcription of the speech in the second language. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20)
-
Specification