Confidence-driven rewriting of source texts for improved translation

• US 20140358519A1
• Filed: 06/03/2013
• Published: 12/04/2014
• Est. Priority Date: 06/03/2013
• Status: Abandoned Application

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Mirkin, Shachar, Venkatapathy, Sriram, Dymetman, Marc
• Application Number:
  US13/908,157
• Publication Number:
  US 20140358519A1
• Time in Patent Office: Days
• US Class Current: 704/3
• CPC Class Codes: G06F 40/44 Statistical methods, e.g. probability models
• CPC Class Codes: G06F 40/47 Machine-assisted translation, e.g. using translation memory
• CPC Class Codes: G06F 40/51 Translation evaluation

Abstract

A method for rewriting source text includes receiving source text including a source text string in a first natural language. The source text string is translated with a machine translation system to generate a first target text string in a second natural language. A translation confidence for the source text string is computed, based on the first target text string. At least one alternative text string is generated, where possible, in the first natural language by automatically rewriting the source string. Each alternative string is translated to generate a second target text string in the second natural language. A translation confidence is computed for the alternative text string based on the second target string. Based on the computed translation confidences, one of the alternative text strings may be selected as a candidate replacement for the source text string and may be proposed to a user on a graphical user interface.

Claims

1. A method for rewriting source text, comprising:

receiving source text comprising at least one source text string in a first natural language;

with a processor, for each of the at least one source text string;

translating the source text string with a machine translation system to generate a first target text string in a second natural language;

computing a first translation confidence for the source text string based on at least one feature that is based on at least one of the source text string and the first target text string;

providing for generating at least one alternative text string in the first natural language, the generating comprising automatically rewriting the source text string; and

for each of the at least one alternative text string;

translating the alternative text string with the machine translation system to generate a second target text string in the second natural language; and

computing a second translation confidence for the alternative text string based on at least one feature that is based on at least one of the alternative text string and the second target text string; and

based on the computed first and second translation confidences, providing for selecting one of the at least one alternative text strings as a replacement for the source text string in the source text.

2. The method of claim 1, further comprising providing for outputting at least one of modified source text comprising the selected alternative text string and a translation of the modified source text.

3. The method of claim 1, wherein the providing for selecting the alternative text string as a replacement for the source text string in the source text comprises providing for displaying the alternative text string on a graphical user interface and for receiving a user'"'"'s selection of the alternative text string.

4. The method of claim 1, further comprising comparing the first translation confidence and second translation confidence and wherein the providing for selecting at least one of the at least one alternative text strings comprises providing for selection of at least one of the at least one alternative text strings for which the second translation confidence is at least higher than the first translation confidence.

5. The method of claim 1, wherein the generating at least one alternative text string comprises generating a plurality of alternative text strings and the providing for selecting one of the plurality of alternative text strings as a replacement for the source text string comprises at least one of:

filtering the plurality of alternative text strings to remove those for which the second computed translation confidence does not exceed the first computed translation confidence; and

ranking at least some of the plurality of alternative text strings based on their respective computed second translation confidences.

6. The method of claim 1, wherein the computed first translation confidence is based on at least one feature that is based on the first target string and the computed second translation confidence is based on at least one feature that is based on the second target text string.

7. The method of claim 6, wherein the computed first translation confidence for the source text string is based on at least one feature that is based on the source text string and the computed second translation confidence for the source text string is based on at least one feature that is based on the alternative text string.

8. The method of claim 1 wherein the computed first and second translation confidences are based on at least one feature selected from the group consisting of:

a. a number of tokens in the respective one of the source text string and the alternative text string;

b. a number of tokens in the respective one of the first target text string and the second target string;

c. an average length of tokens in the respective one of the source text string and the alternative text string;

d. a Language Model probability computed for the respective one of the source text string and the alternative text string;

e. a Language Model probability computed for the respective one of the first target text string and the second target string;

f. a number of occurrences of each target word within the respective one of the first target text string and the second target string;

g. an average number of translations per source word in the respective one of the source text string and the alternative text string;

h. an average number of translations per source word in the respective one of the source text string and the alternative text string weighted by the inverse frequency of each word in a source language corpus;

i. a percentage of n-grams in the respective one of the source text string and the alternative text string that are determined to be lower frequency words in a corpus of the source language, where n is a number which is at least one;

j. a percentage of n-grams in the respective one of the source text string and the alternative text string that are determined to be higher frequency words in the corpus of the source language, where n is a number which is at least one;

k. a percentage of unigrams in the respective one of the source text string and the alternative text string observed in a source language corpus;

l. a number of punctuation marks in the respective one of the source text string and the alternative text string;

m. a number of punctuation marks in the respective one of the first target text string and the second target string; and

n. an SMT model score for the target string.

9. The method of claim 8, wherein the computed first and second translation confidences are based on a plurality of features selected from the group of features.

10. The method of claim 1, wherein the generating at least one alternative text string in the first natural language comprises applying at least one rewriting method selected from the group consisting of text simplification and textual entailment rewriting.

11. The method of claim 10, wherein the text simplification method is selected from:

a sentence-level rewriting method which translates the source text string to a simplified source text string in the first natural language using a translation model which has been trained on a parallel corpus of complex source text strings and corresponding simplified source text strings in the first natural language; and

lexical simplification in which a lexicon of complex source words and respective simplified source words is accessed to identify a simplified source word corresponding to a source word in the source string.

12. The method of claim 10, wherein the textual entailment rewriting comprises applying at least one of a set of rewriting rules that are configured for generating an alternative source string which entails the source text string or is entailed by the source text string.

13. The method of claim 1, further comprising providing for a user to edit at least one of the source text string and one of the at least one alternative text strings.

14. The method of claim 1, wherein the translating of the source text string to generate the first target text string in the second natural language comprises, for each of a plurality of second languages, translating the source text string to generate a respective first target text string in the respective second natural language and wherein the providing for selecting one of the at least one alternative text strings as a replacement for the source text string in the source text is based on a computed second translation confidence for the at least one alternative text string for each of the plurality of second languages.

15. The method of claim 1, wherein the method further comprises comparing the first translation confidence to a threshold confidence and retaining the source string without generating any alternative text strings when the first translation confidence meets the threshold confidence, otherwise, generating the at least one alternative text string.

16. The method of claim 1, wherein the method further comprises filtering

17. A computer program product comprising a non-transitory storage medium which stores instructions, which when executed by a computer, perform the method of claim 1.

18. A system comprising memory which stores instructions for performing the method of claim 1 and a processor in communication with the memory for executing the instructions.

19. A system for rewriting source text, comprising:

a rewriting component configured for receiving source text comprising a source text string in a first natural language and generating at least one alternative text string in the first natural language by rewriting the source text string;

a translation requester configured for requesting a first machine translation of the source text string and a second machine translation of the alternative text string;

a confidence estimator for estimating a translation confidence for the source text string and alternative text string;

a selection component for selecting alternative text strings as replacements for source text strings or selecting candidates for replacement of source text strings, based on the translation confidences; and

a processor which implements at least one of the translation requester, confidence estimator, and selection component.

20. The system of claim 19, further comprising a graphical user interface generator which generates a graphical user interface for user selection and editing of source text strings and alternative text strings.

21. An interactive translation method comprising:

receiving source text comprising at least one source text string in a first natural language;

with a processor, for each of the at least one source text string;

translating the source text string with a machine translation system to generate a first target text string in a second natural language;

computing a first translation confidence for the source text string;

providing for retaining the source text string in the source text where the first translation confidence meets a confidence threshold and for the source text string in the source text and for generating at least one alternative text string in the first natural language based on the source text string where the first translation confidence does not meet the threshold; and

for each of the at least one alternative text string;

translating the alternative text string with the machine translation system to generate a second target text string in the second natural language; and

computing a second translation confidence for the alternative text string; and

providing for retaining the source text string in the source text where the first translation confidence at least meets the second translation confidence of each of the at least one alternative text strings and for presenting at least one of the at least one alternative text strings to a user as a candidate for replacement of the source string in the source text otherwise; and

outputting a translation of the source text based on the source text strings that have been retained and the presented alternative source strings that have been selected by a user for replacement of a respective source string.