Chunk-based statistical machine translation system

• US 20080154577A1
• Filed: 12/26/2006
• Published: 06/26/2008
• Est. Priority Date: 12/26/2006
• Status: Abandoned Application

• Current Assignee: Fluential, LLC
• Original Assignee: Sehda, Inc.
• Inventors: Huang, Jun, Billawala, Youssef, Kim, Yookyung
• Application Number:
  US11/645,926
• Publication Number:
  US 20080154577A1
• Time in Patent Office: Days
• US Class Current: 704/2
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/45 Example-based machine translation; Alignment

Abstract

Traditional statistical machine translation systems learn all information from a sentence aligned parallel text and are known to have problems translating between structurally diverse languages. To overcome this limitation, the present invention introduces two-level training, which incorporates syntactic chunking into statistical translation. A chunk-alignment step is inserted between the sentence-level and word-level training, which allows differing training for these two sources of information in order to learn lexical properties from the aligned chunks and learn structural properties from chunk sequences. The system consists of a linguistic processing step, two level training, and a decoding step which combines chunk translations of multiple sources and multiple language models.

Claims

1. A translation method, comprising the steps of:

receiving an input sentence;

chunking the input sentence into one or more chunks;

translating the chunks; and

decoding the translated chunks to generate an output sentence.

2. The translation method of claim 1 wherein in the translating step, a direct chunk translation table is used for translating the chunks.

3. The translation method of claim 1 wherein in the translating step, a statistical translation model is used for translating the chunks.

4. The translation method of claim 2 wherein in the translating step, a statistical translation model is used for translating the chunks.

5. The translation method of claim 1 wherein in the decoding step, the translated chunks are reordered.

6. The translation method Qf claim 5 wherein in the reordering step, multiple language models are used for reordering the chunks.

7. The translation method of claim 5 wherein in the reordering step, one or more search methods can be used for reordering the chunks.

8. The translation method of claim 5 wherein in the reordering step, a chunk head language model is used for reordering the chunks.

9. The translation method of claim 6 wherein in the reordering step, a chunk head language model is used for reordering the chunks.

10. The translation method of claim 1 wherein in the decoding step, multiple language models are used for decoding the chunks.

11. The translation method of claim 1 wherein in the decoding step, a chunk head language model is used for decoding the chunks.

12. The translation method of claim 10 wherein in the decoding step, a chunk head language model is used for decoding the chunks.

13. The translation method of claim 1 wherein in the decoding step, translated chunks generated from two or more independent methods are normalized and merged.

14. The translation method of claim 1 wherein in the chunking step, input sentences are chunked by chunk rules.

15. The translation method of claim 1, wherein training models are generated for use in this translation method, comprising the steps of:

chunking a source language sentence from a corpus to generate source language chunks;

chunking a corresponding target language sentence from a corpus to generate target language chunks; and

aligning the source language chunks with the target language chunks.

16. The translation method of claim 15, further comprising the step of generating a direct chunk translation table using aligned chunks.

17. The translation method of claim 15, further comprising the step of generating one or more translation models using aligned chunks.

18. The translation method of claim 15, further comprising the step of extracting chunk heads.

19. The translation method of claim 18, further comprising the step of generating one or more chunk head language models using extracted chunk heads.

20. The translation method of claim 15, further comprising the step of generating word alignment information using lexical constraints from source and target sentences.

21. The translation method of claim 15, wherein in the aligning step, chunks are aligned with word alignment and part-of-speech constraints.

22. A translation method, comprising the steps of:

receiving an input sentence;

chunking the input sentence into one or more chunks using chunk rules;

translating the chunks using a direct chunk translation table and statistical translation model;

reordering the chunks using multiple language models, one or more search methods, and a chunk head language model; and

decoding the reordered chunks to generate an output sentence, using multiple language models and a chunk head language model.