INTRA-LANGUAGE STATISTICAL MACHINE TRANSLATION

• US 20090248422A1
• Filed: 03/28/2008
• Published: 10/01/2009
• Est. Priority Date: 03/28/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ju, Yun-Cheng, Li, Xiao, Zweig, Geoffrey, Acero, Alex
• Granted Patent: US 8,615,388 B2
• Time in Patent Office: Days
• US Class Current: 704/277
• CPC Class Codes: G06F 40/44 Statistical methods, e.g. probability models
• CPC Class Codes: G06F 40/45 Example-based machine translation; Alignment

Abstract

Training data may be provided, the training data including pairs of source phrases and target phrases. The pairs may be used to train an intra-language statistical machine translation model, where the intra-language statistical machine translation model, when given an input phrase of text in the human language, can compute probabilities of semantic equivalence of the input phrase to possible translations of the input phrase in the human language. The statistical machine translation model may be used to translate between queries and listings. The queries may be text strings in the human language submitted to a search engine. The listing strings may be text strings of formal names of real world entities that are to be searched by the search engine to find matches for the query strings.

Claims

1. A computer implemented method for intra-language machine translation of phrases in a human language, the method comprising:

receiving training data, the training data comprising pairings of source phrases and target phrases;

using the pairs of training data to train an intra-language statistical machine translation model, where the intra-language statistical machine translation model, when given an input phrase of text in the human language, can compute probabilities of semantic equivalence of the input phrase to possible translations of the input phrase in the human language; and

using the statistical machine translation model to translate between queries and listings, where the queries comprise text strings in the human language submitted to a search engine, where the listing strings comprise text strings of formal names of real world entities that are to be searched by the search engine to find matches for the query strings.

2. A method according to claim 1, wherein the using the intra-language statistical translation model comprises:

receiving from the search engine listings that the search engine matched to the user'"'"'s query;

generating query forms of one of the listings by using the translation model to translate the one of the listings to the query forms;

using the translation model to compute similarities of the query forms to the user'"'"'s query, and determining that the listing does not match the user'"'"'s query based on the computed similarities.

3. A method according to claim 1, wherein the using the intra-language statistical translation model comprises:

receiving from the search engine a listing that the search engine matched to the user'"'"'s query;

using the model to find a probability that the listing is a translation of the user'"'"'s query; and

determining whether the listing matches the user'"'"'s query based on the probability.

4. A method according to claim 1, wherein the intra-language statistical translation model comprises an n-gram based translation model.

5. A method according to claim 4, wherein the training comprises rearranging either the source and/or target phrase of a training pair so that semantically equivalent words of the source and target phrases are aligned;

and

iteratively updating the alignment and parameters of the n-gram based translation model.

6. A method according to claim 1, further comprising using the intra-language statistical translation model to generate a language model of the human language, the language model being capable of determining a likelihood of strings in the human language.

7. A method according to claim 6, wherein the using the intra-language statistical translation model to generate the language model comprises including with the language model translations from the intra-language statistical translation model.

8. A method according to claim 6, further comprising performing automatic speech recognition with the language model.

9. One or more computer readable media storing information to enable a computing device to perform a process for translating phrases of a human language to other phrases of the language, the process comprising:

accessing training pairs comprising pairs of phrases in the human language;

training a statistical machine translation model with the training pairs, the statistical machine translation model being capable of computing probabilities that a target string in the human language is a valid translation of a given source string in the human language;

receiving a text phrase in the human language, decoding the text phrase to different candidate translations of the text phrase, and using the statistical machine translation model to compute probabilities that the candidate translations are translations of the text phrase; and

based on the probabilities, storing and/or displaying, by computer, one or more of the candidate translations.

10. One or more computer readable media according to claim 9, wherein the training pairs comprise query strings submitted by users paired with listings that a search engine matched with the query strings.

11. One or more computer readable media according to claim 9, wherein the received text phrase comprises a query string inputted by a user, the query string comprising text in the human language, and the process further comprises using the statistical machine translation model to identify a plurality of probable potential translations of the query string, the potential translations comprising text in the human language.

12. One or more computer readable media according to claim 9, wherein the received text phrase comprises a name of an organization or business entity obtained from a search engine for searching listings of business/organization names, the name having been obtained from the search engine according to a user-inputted query, and wherein the process further comprises using the statistical machine translation model to determine a probability that the name is a valid translation of the query string and determining relevancy of the listing to the query based on the probability.

13. One or more computer readable media according to claim 9, further comprising using the statistical machine translation model to build a statistical language model of the human language, where the statistical language model provides probabilities of phrases in the human language.

14. One or more computer readable media according to claim 9, the process further comprising using the statistical machine translation model to translate text queries recognized by a speech recognizer into display forms.

15. A method performed by one or more computers, the method comprising:

providing a statistical machine translation model configured to compute probabilities of translations of phrases of a same human language; and

using the statistical machine translation model to translate between query forms and listing forms of organizations and/or businesses, where the query forms comprise phrases, in the human language, submitted to a search engine, and where the listing forms comprise formal names, in the human language, of organizations and/or businesses searchable by the search engine.

16. A method according to claim 15, wherein the using the statistical machine translation model comprises computing similarity between a query form and a listing form.

17. A method according to claim 15, wherein, given a user query inputted by a user in the human language, given a corresponding listing in the human language that was found by the search engine, and given a set of candidate translations of the listing, the candidate translations also in the human language, the using the statistical machine translation model comprises computing probabilities of the candidate translations.

18. A method according to claim 17, further comprising generating a search result for the given user query based on the computed probabilities.

19. A method according to claim 15, further comprising generating or modifying a search result of the search engine based on probabilities computed by the statistical machine translation model, the search result corresponding to a user-inputted query form.

20. A method according to claim 19, further comprising using the probabilities to rank or eliminate search result.