COMPUTERIZED STATISTICAL MACHINE TRANSLATION WITH PHRASAL DECODER

• US 20100076746A1
• Filed: 09/25/2008
• Published: 03/25/2010
• Est. Priority Date: 09/25/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ruopp, Achim, Aikawa, Takako
• Granted Patent: US 9,176,952 B2
• Time in Patent Office: Days
• US Class Current: 704/3
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/44 Statistical methods, e.g. probability models
• CPC Class Codes: G06F 40/45 Example-based machine translation; Alignment
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Abstract

A computerized system for performing statistical machine translation with a phrasal decoder is provided. The system may include a phrasal decoder trained prior to run-time on a monolingual parallel corpus, the monolingual parallel corpus including a machine translation output of source language documents of a bilingual parallel corpus and a corresponding target human translation output of the source language documents, to thereby learn mappings between the machine translation output and the target human translation output. The system may further include a statistical machine translation engine configured to receive a translation input and to produce a raw machine translation output, at run-time. The phrasal decoder may be configured to process the raw machine translation output, and to produce a corrected translation output based on the learned mappings for display on a display associated with the system.

Claims

1. A computerized system for performing statistical machine translation, the system comprising:

a phrasal decoder trained prior to run-time on a monolingual parallel corpus, the monolingual parallel corpus including a machine translation output of source language documents of a bilingual parallel corpus and a corresponding target human translation output of the source language documents, to thereby learn mappings between the machine translation output and the target human translation output; and

a statistical machine translation engine configured to receive a translation input and to produce a raw machine translation output, at run-time;

wherein the phrasal decoder is configured to process the raw machine translation output, and to produce a corrected translation output based on the learned mappings for display on a display associated with the system.

2. The computerized system of claim 1, wherein the phrasal decoder is configured to determine the learned mappings by applying a word alignment algorithm.

3. The computerized system of claim 2, wherein the word alignment algorithm is selected from the group consisting of a hidden markov model (HMM), an expectation-maximization (EM) model, a discriminative model, and a syntax-based model.

4. The computerized system of claim 1, wherein the bilingual parallel corpus includes bi-text training data for one or more language pairs, the bi-text training data including source language documents and target human translation output for each language pair.

5. The computerized system of claim 1, wherein the statistical machine translation engine is configured to translate between each of a plurality of language pairs, each language pair having a source language and a target language;

wherein the monolingual parallel corpus is one of a plurality of monolingual parallel corpora that the phrasal decoder is trained on, each of the monolingual parallel corpora being for a target language in one of the language pairs, and each of the monolingual parallel corpora including a machine translation output and a corresponding target human translation output; and

wherein the target human translation output for each monolingual parallel corpora is from a corresponding bilingual parallel corpus for one of the language pairs.

6. The computerized system of claim 5, wherein the language pairs are typologically different language pairs.

7. The computerized system of claim 2, wherein the phrasal decoder is trained prior to run-time on a developer computing device on which the bilingual parallel corpus is stored;

and

wherein the statistical machine translation engine is configured to produce the raw machine translation output and the phrasal decoder is configured to process the raw machine translation output, at run-time on a user computing device.

8. The computerized system of claim 1, wherein the statistical machine translation engine includes a syntax-based statistical machine translation engine;

and

wherein the phrasal decoder includes a phrase-based statistical machine translation engine.

9. The computerized system of claim 1, wherein the phrasal decoder is configured to produce the corrected translation output without prompting a user for a correction input.

10. A computerized method of statistical machine translation, the method comprising:

training a phrasal decoder on a monolingual parallel corpus, the monolingual parallel corpus including a machine translation output of source language documents of a bilingual parallel corpus and a corresponding target human translation output of the source language documents, to thereby learn mappings between the machine translation output and the target human translation output; and

performing statistical machine translation of a translation input to thereby produce a raw machine translation output; and

processing the raw machine translation output to thereby produce a corrected translation output based on the learned mappings.

11. The computerized method of claim 10, wherein learning mappings between the machine translation output and the target human translation output includes applying a word alignment algorithm.

12. The computerized method of claim 11, wherein the word alignment algorithm is selected from the group consisting of a hidden markov model (HMM), an expectation-maximization (EM) model, a discriminative model, and a syntax-based model.

13. The computerized method of claim 10, the monolingual parallel corpus including a machine translation output of a bilingual parallel corpus, wherein the bilingual parallel corpus includes bi-text training data for one or more language pairs, the bi-text training data including source language documents and target human translation output for each language pair.

14. The computerized method of claim 10, wherein performing statistical machine translation of a translation input includes translating between each of a plurality of language pairs, each language pair having a source language and a target language;

wherein the monolingual parallel corpus is one of a plurality of monolingual parallel corpora that the phrasal decoder is trained on, each of the monolingual parallel corpora being for a target language in one of the language pairs, and each of the monolingual parallel corpora including a machine translation output and a corresponding target human translation output; and

wherein the target human translation output for each monolingual parallel corpora is from a corresponding bilingual parallel corpus for one of the language pairs.

15. The computerized method of claim 14, wherein translating between each of the language pairs includes translating between each of a plurality of typologically different language pairs.

16. The computerized method of claim 10, wherein training the phrasal decoder occurs on a developer computing device on which the bilingual parallel corpus is stored;

wherein performing statistical machine translation of a translation input to thereby produce a raw machine translation output and processing the raw machine translation output to thereby produce a corrected translation output occurs on a user computing device.

17. The computerized method of claim 10, wherein performing statistical machine translation of a translation input is accomplished at least in part by a syntax-based statistical machine translation engine;

and

wherein processing the raw machine translation output to thereby produce a corrected translation output is accomplished at least in part by a phrase-based statistical machine translation engine.

18. The computerized method of claim 10, wherein processing the raw machine translation output to thereby produce a corrected translation output occurs without prompting a user for a correction input.

19. A computerized system for performing statistical machine translation, the system comprising:

a statistical machine translation engine configured to receive a translation input and to produce a raw machine translation output, at run-time; and

a phrasal decoder configured to process the raw machine translation output, and to produce a corrected translation output for display on a display associated with the system.

20. The computerized system of claim 19, wherein the phrasal decoder is trained prior to run-time on a monolingual parallel corpus, the monolingual parallel corpus including a machine translation output of a bilingual parallel corpus and a corresponding target human translation output included within the bilingual parallel corpus, to thereby learn mappings between the machine translation output and the target human translation output, and the corrected translation output is produced based on a plurality of learned mappings.