Translation and integration of presentation materials with cross-lingual multi-media support
First Claim
Patent Images
1. A method comprising:
- recognizing speech by a speaker in a first language, the speech stored in a first file of a database of a translation system;
generating a first marker for the first file storing the speech, the first marker associated with delivery of a portion of the speech,translating, by the translation system, the speech into a second language, the translated speech stored in a second file of the database;
generating a second marker for the second file storing the translated speech, the second marker corresponding to delivery of a portion of the translated speech, the portion of the translated speech being a translation of the portion of the speech;
receiving original presentation materials presented with the speech;
extracting text in the first language from the original presentation materials;
generating a third marker for a third file of the database storing a presentation of the original presentation materials, the third marker associated with presentation of a portion of the extracted text, the portion of the extracted text corresponding to the portion of the speech;
translating, by the translation system, the extracted text into the second language;
generating translated presentation materials in the second language based on the translated text;
generating a fourth marker at for a fourth file of the database storing a presentation of the translated presentation materials, the fourth marker associated with presentation of a portion of the translated text, the portion of the translated text being a translation of the portion of the extracted text; and
aligning the translated speech and the translated presentation materials by synchronizing the second and fourth markers.
3 Assignments
0 Petitions
Accused Products
Abstract
Computer-based systems and methods are disclosed for translation of a multi-media presentation (e.g., a lecture) along with the accompanying presentation materials. Translation and delivery of text-based presentation materials to a listener is annotated and aligned with audio, so that the listener can follow both the audio and the presentation material. The content of the presentation materials can be used to improve presentation translation, as it extracts supportive material from the presentation materials as they relate to the speech.
18 Citations
19 Claims
-
1. A method comprising:
-
recognizing speech by a speaker in a first language, the speech stored in a first file of a database of a translation system; generating a first marker for the first file storing the speech, the first marker associated with delivery of a portion of the speech, translating, by the translation system, the speech into a second language, the translated speech stored in a second file of the database; generating a second marker for the second file storing the translated speech, the second marker corresponding to delivery of a portion of the translated speech, the portion of the translated speech being a translation of the portion of the speech; receiving original presentation materials presented with the speech; extracting text in the first language from the original presentation materials; generating a third marker for a third file of the database storing a presentation of the original presentation materials, the third marker associated with presentation of a portion of the extracted text, the portion of the extracted text corresponding to the portion of the speech; translating, by the translation system, the extracted text into the second language; generating translated presentation materials in the second language based on the translated text; generating a fourth marker at for a fourth file of the database storing a presentation of the translated presentation materials, the fourth marker associated with presentation of a portion of the translated text, the portion of the translated text being a translation of the portion of the extracted text; and aligning the translated speech and the translated presentation materials by synchronizing the second and fourth markers. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 18, 19)
-
-
12. A computer program product for translating multimedia presentations, the computer program product comprising a non-transitory computer-readable storage medium containing computer program code for:
-
recognizing speech by a speaker in a first language, the speech stored in a first file of a database of a translation system; generating a first marker for the first file storing the speech, the first marker associated with delivery of a portion of the speech; translating, by the translation system, the speech into a second language, the translated speech stored in a second file of the database; generating a second marker for the second file storing the translated speech, the second marker corresponding to a delivery of a portion of the translated speech, the portion of the translated speech being a translation of the portion of the speech; receiving original presentation materials presented with the speech; extracting text in the first language from the original presentation materials; generating a third marker for a third file of the database storing a presentation of the original presentation materials, the third marker associated with presentation of a portion of the extracted text, the portion of the extracted text corresponding to the portion of the speech; translating, by the translation system, the extracted text into the second language; generating translated presentation materials in the second language based on the translated text; generating a fourth marker for a fourth file of the database storing a presentation of the translated presentation materials, the fourth marker associated with presentation of a portion of the translated text, the portion of the translated text being a translation of the portion of the extracted text; and aligning the translated speech and the translated presentation materials by synchronizing the second and fourth markers. - View Dependent Claims (13, 14, 15, 16, 17)
-
Specification