System and method for multi-lingual information retrieval

• US 8,346,536 B2
• Filed: 11/11/2008
• Issued: 01/01/2013
• Est. Priority Date: 05/12/2006
• Status: Active Grant

• Current Assignee: EIJ Group LLC
• Original Assignee: EIJ Group LLC
• Inventors: Jiang, Johnson, Chan, Diane
• Primary Examiner(s): Vo, Huyen X.
• Application Number:
  US12/268,489
• Publication Number:
  US 20090125497A1
• Time in Patent Office: 1,512 Days
• Field of Search: 704 1- 10, 704/235, 704/257, 704/255, 704/277, 704/251
• US Class Current: 704/2
• CPC Class Codes: G06F 16/3337 Translation of the query language, e.g. Chinese to English

Abstract

Multi-lingual information retrieval methods and systems are described.

Claims

1. A system for searching a set of documents in one or more target languages when search terms in a source language different from said one or more target languages are supplied, said system comprising:

a document base storing a plurality of target language documents with corresponding language codes and/or tags representing respective target languages;

a translation engine configured to translate a search query in the source language into a plurality of search queries in said one or more target languages;

a search part configured to search the plurality of target language documents in the document base using each of the plurality of target language search queries, to return a plurality of matched documents in the target language,

wherein the translation engine translates the plurality of matched documents in the target language into corresponding translated documents in the source language, and

wherein said translation engine translates a source language term to plurality of target language translation options, translates the plurality of target language translation options to respective source language translation results, and stores the collection of source language translation results in a synonym database as synonyms for the source language term.

2. The system of claim 1, wherein a translated document in the source language returned by the translation engine includes multiple translation results for one or more terms.

3. The system of claim 1, further comprising one or more local servers, wherein the translated documents are uploaded to the one or more local servers, prior to retrieval by a user.

4. The system of claim 3, wherein said translated documents and corresponding target language documents are saved by said one or more local servers in a multi-lingual base.

5. The system of claim 4, wherein each of the documents in the multi-lingual base is saved with one or more corresponding language codes and/or tags representing the plurality of target languages configured in connection with the document.

6. The system of claim 5, wherein the one or more language codes and/or tags saved with the document are associated with the corresponding address and/or URI of the document on the World Wide Web.

7. The system of claim 4, wherein in said multi-lingual base, a target language term in a target language document is associated with one or more source language terms in the corresponding translated document.

8. The system of claim 4, further comprising:

a multi-lingual search tool configured to search said multi-lingual base utilizing any one of target language queries and source language queries.

9. The system of claim 8, wherein said translation engine selects one of multiple translation results of a term, uses the selected translation result in a body of the translated document, and stores remaining translation results of the term as meta-data and/or hidden field in the translated document.

10. The system of claim 9, wherein said multi-lingual search tool searches said meta-data and hidden field in the translated document.

11. The system of claim 1, further comprising:

a user interface configured to display synonyms for one or more terms in the query.

12. The system of claim 11, wherein the user interface is further configured to enable the user to select one of the displayed synonyms, and the search part finds documents matching the selected synonym, and returns said documents matching the selected synonym in the search results.

13. The system of claim 1, further comprising:

a user interface configured to display the search results in the source language, and/or display the search results in a corresponding target language.

14. The system of claim 13, wherein one of the source language documents in the search results was translated from a target language document and is marked in the search results displayed by the user interface with an indication of the target language.

15. The system of claim 13, wherein for each document in the search results, a language tag in connection with the document is added to the corresponding document address and/or URI to display the document in the corresponding language.

16. The system of claim 1, wherein after the translation engine translates a target language document into a plurality of translated documents in the source language, the target language document and corresponding source language translated documents are stored in a multi-lingual document base.

17. A multi-lingual information retrieval system comprising:

a vote store configured to store for each target language term vote counts for respective source language translation options corresponding to the target language term; and

a translation engine configured to translate a target language document to a translated document in the source language,

wherein said translation engine translates a selected term in the target language document by retrieving from said vote store a source language translation option corresponding to the selected term, said retrieved translation option having a highest vote count amongst source language translation options corresponding to the selected target language term, and

wherein when a first translation option of a selected term is replaced by a second translation option of the selected term as the option with the most votes, each translated document wherein said first translation option is used as a primary translation result for the selected term is dynamically changed to reflect the second translation option as the translation of the selected term.

18. The system of claim 17, wherein said translation engine selects the translation option with the most votes for the term as the primary translation result, and remaining translation options for the term are represented in the translated document as one of meta-data or hidden field.

19. The system of claim 17, further comprising a user interface, wherein the vote store is accessible to a plurality of users through said user interface, and when a user specifies through said user interface that a source language term translates to a target language term, the vote count maintained in the vote store for the target language term as a translation option of the source language term is incremented.

20. The system of claim 19, wherein when the user specifies that the source language term translates to the target language term, the vote count for the source language term as a translation option of the target language term is incremented.

21. The system of claim 19, wherein when the user specifies that the source language term translates to the target language term, the user also specifies additional information corresponding to the translation, and the specified additional information is stored along with the translation in the vote store.

22. The system of claim 21, wherein when the specified additional information is a context associated with the translation.

23. The system of claim 21, wherein when the specified additional information indicates a domain, an environment or a geographical area for which the translation is to be used.

24. The system of claim 17, wherein the vote store is maintained in a dynamic translation database, and users interact with the translation database to update information in the translation database in real time.

25. The system of claim 17, wherein when a user specifies that a source language term translates to a target language term, the relationship between the source language term and target language term is stored bi-directionally, and the vote count for the target term as a translation option of the source term is incremented, and the vote count for the source term as a translation option of the target term is incremented.

26. The system of claim 17, further comprising a dynamically-maintained thesaurus, wherein the thesaurus entry for a selected term in a first language is updated by translating the term to a plurality of translation options in another language, translating the plurality of translation options to respective translation results in said first language, and storing a collection of the translation results in said thesaurus as said synonyms for the term in said first language.

27. The system of claim 17, further comprising a new phrase finder and a new phrase store, wherein said new phrase finder parses a selected document to identify two or more consecutive words in the selected document having no translation options, and stores said two or more consecutive words as a new phrase in said new phrase store.

28. The system of claim 27, wherein when the translation engine is translating a document, if a term having no translation options is found in the document, the term is highlighted and the user is prompted to specify or vote for a translation option.

57. The method of claim 26, further comprising:

selecting one of multiple translation results of a term;

using the selected translation result in a body of the translated document; and

storing remaining translation results of the term as meta-data and/or hidden field in the translated document.

58. The method of claim 57, wherein said multi-lingual search tool searches said meta-data and hidden field in the translated document.

29. A multi-lingual information retrieval method performed by a multi-lingual information retrieval system for searching a set of documents in one or more target languages when search terms in a source language different from said one or more target languages are supplied, the multi-lingual information retrieval method comprising:

maintaining, by the multi-lingual information retrieval system, a vote store to store for each target language term vote counts for respective source language translation options corresponding to the target language term;

translating, by the multi-lingual information retrieval system, a selected term in a target language document by retrieving from said vote store a source language translation option corresponding to the selected term, wherein said retrieved translation option has a highest vote count amongst source language translation options corresponding to the selected target language term,

when a first translation option is replaced by a second translation option as the option with the most votes for a term, dynamically changing, by the multi-lingual information retrieval system, each translated document wherein said first translation option is used as the primary translation result for the term.

30. The method of claim 29, further comprising:

translating the target language document to a source language document,

wherein the source language translation option with the most votes is used as a source language translation in the source language document for the selected target language term, and remaining source language translation options for the term are represented in the translated document as one of meta-data or hidden field.

31. The method of claim 29, further comprising incrementing the vote count for the target language term as a translation option of the source language term, when a user specifies that the source language term translates to the target language term.

32. The method of claim 31, further comprising incrementing the vote count for the source language term as a translation option of the target language term, when the user specifies that the source language term translates to the target language term.

33. The method of claim 31, wherein when the user specifies that the source language term translates to the target language term, the user also specifies additional information corresponding to the translation, and the specified additional information is stored along with the translation in the vote store.

34. The method of claim 29, further comprising maintaining the vote store in a dynamic translation database, wherein users interact with the translation database to update information in the translation database in real time.

35. The method of claim 29, wherein when a user specifies that a source language term translates to a target language term, the relationship between the source language term and target language term is stored bi-directionally, and the vote count for the target term as a translation option of the source term is incremented, and the vote count for the source term as a translation option of the target term is incremented.

36. The method of claim 29, further comprising:

displaying a plurality of translation options for a selected term in a displayed document; and

updating a vote count for a translation option when the user selects the translation option through a user interface.

37. The method of claim 29, further comprising:

when the user enters a query in the source language, displaying synonyms for one or more terms in the query.

38. The method of claim 29, further comprising:

translating a term in a first language to a plurality of translation options in another language;

translating the plurality of translation options to respective translation results in said first language; and

storing a collection of the translation results in a dynamically-maintained thesaurus as synonyms for the term in said first language.

39. The method of claim 29, further comprising:

parsing a selected document to identify two or more consecutive words in the selected document having no translation options; and

storing said two or more consecutive words as a new phrase in a new phrase store.

40. The method of claim 39, further comprising:

highlighting a term having no translation options; and

prompting a user to specify or vote for a translation option.

41. A multi-lingual information retrieval method performed by a multi-lingual information retrieval system for searching a set of documents in one or more target languages when search terms in a source language different from said one or more target languages are supplied, the multi-lingual information retrieval method comprising:

maintaining, by the multi-lingual information retrieval system, a vote store to store for each target language term vote counts for respective source language translation options corresponding to the target language term;

translating, by the multi-lingual information retrieval system, a selected term in a target language document by retrieving from said vote store a source language translation option corresponding to the selected term, wherein said retrieved translation option has a highest vote count amongst source language translation options corresponding to the selected target term;

translating, by the multi-lingual information retrieval system, a source language term to a plurality of target language translation options;

translating, by the multi-lingual information retrieval system, the plurality of target language translation options to respective source language translation results; and

storing, by the multi-lingual information retrieval system, the collection of source language translation results in a synonym database as synonyms for the source language term.

42. The method of claim 41, further comprising:

translating the target language document to a source language document, wherein the source language translation option with the most votes is used as a source language translation in the source language document for the selected target language term; and

displaying synonyms for the source language term.

43. A method performed by a multi-lingual information retrieval system for searching a set of documents in a target language when search terms in a source language different from the target language are supplied, said method comprising:

translating, by the multi-lingual information retrieval system, a search query in the source language into a plurality of search queries in the target language;

searching, by the multi-lingual information retrieval system, a target language document set in the target language using each of the plurality of target language search queries, to return a plurality of target language documents;

translating, by the multi-lingual information retrieval system, the plurality of target language documents into corresponding translated documents in the source language;

searching, by the multi-lingual information retrieval system, a source language document set in the source language using each of a plurality of synonyms of the source language search terms saved in a synonym database, to return a plurality of source language documents;

translating, by the multi-lingual information retrieval system, the plurality of the source language documents into corresponding translated documents in the target language, maintaining, by the multi-lingual information retrieval system, a vote store, wherein for each term having a plurality of translation options, each translation option is associated with a corresponding number of votes and the numbers of votes associated with the translation options are stored in the vote store; and

selecting, by the multi-lingual information retrieval system, the translation option with the most votes for the term as the primary translation result, wherein remaining translation options for the term are represented in the translated document as one of meta-data or hidden field.

44. The method of claim 43, further comprising:

displaying one or more of the source language translated documents as the search results, and/or displaying one or more of the corresponding target language documents as the search results.

45. The method of claim 43, wherein a translated document in the source language includes multiple translation results for one or more terms.

46. The method of claim 43, further comprising:

when a first translation option is replaced by a second translation option as the option with the most votes, dynamically changing each translated document wherein said first translation option is used as the primary translation result for the term; and

displaying the dynamically changed translated document corresponding to the primary translation result.

47. The method of claim 43, wherein the vote store is maintained in a dynamic translation database, and users interact with the translation database to update information in the translation database in real time.

48. The method of claim 43, wherein when a user specifies that a source language term translates to a target language term, the relationship between the source language term and target language term is stored bi-directionally, and the vote count for the target term as a translation option of the source term is incremented, and the vote count for the source term as a translation option of the target term is incremented.

49. The method of claim 43, further comprising:

providing a user interface for viewing a source language translated document in the search results and/or for viewing the corresponding target language document in the search results;

displaying a plurality of translation options for a selected term in the displayed document; and

updating a vote count for a translation option when the user selects the translation option through the user interface.

50. The method of claim 43, wherein the vote store is accessible to a plurality of users, and when a user specifies that a source language term translates to a target language term, the vote count for the target language term as a translation option of the source language term is incremented.

51. The method of claim 50, wherein when the user specifies that the source language term translates to the target language term, the vote count for the source language term as a translation option of the target language term is incremented.

52. The method of claim 50, wherein when the user specifies that the source language term translates to the target language term, the user also specifies a description corresponding to the translation, and the specified description is stored along with the translation in the vote store.

53. The method of claim 43, further comprising:

downloading the translated documents to one or more local servers, prior to retrieval by a user.

54. The method of claim 53, further comprising:

saving said translated documents and corresponding target language documents in said one or more local servers to form a multi-lingual base.

55. The method of claim 54, wherein in said multi-lingual base, a target language term in a target language document is associated with one or more source language terms in the corresponding translated document, and a source language term in a source language document is associated with one or more target language terms in the corresponding translated document.

56. The method of claim 54, further comprising:

providing a multi-lingual search tool for searching said multi-lingual base utilizing any one of target language queries and source language queries.

59. The method of claim 54, further comprising:

providing language tags in connection with the documents in the source language and the target languages to configure, for each document, a corresponding document address and/or URI;

guiding the navigation between the documents in the source language and the documents in the target languages using the corresponding language tags;

retrieving one or more of the documents in corresponding languages by adding or selecting corresponding language tags in connection with the document address and/or URI of the document.

60. The method of claim 54, further comprising:

applying a new source language search query to said multi-lingual base and to an additional collection of source language documents.

61. The method of claim 45, further comprising:

displaying the search results in the source language, wherein one or more of the source language documents in the search results is translated from a target language document, and/or displaying the search results in the corresponding target language, wherein one or more of the corresponding target language documents in the search results is translated from the source language.

62. The method of claim 61, wherein said one or more of the source language documents in the search results which is translated from a target language document is marked in the search results with an indication of the target language.

63. The method of claim 43, further comprising:

translating a target language document into a plurality of translated documents in the source language;

storing the target language document and corresponding source language translated documents in a multi-lingual document base.

64. The method of claim 43, further comprising:

translating a source language document into a plurality of translated documents in the target language; and

storing the source language document and corresponding target language translated documents in a multi-lingual document base.

65. A method performed by a multi-lingual information retrieval system for searching a set of documents in a target language when search terms in a source language different from the target language are supplied, said method comprising:

translating, by the multi-lingual information retrieval system, a search query in the source language into a plurality of search queries in the target language;

searching, by the multi-lingual information retrieval system, a target language document set in the target language using each of the plurality of target language search queries to return a plurality of target language documents;

translating, by the multi-lingual information retrieval system, the plurality of target language documents into corresponding translated documents in the source language,

searching, by the multi-lingual information retrieval system, a source language document set in the source language using each of the plurality of synonyms of the source language search terms saved in a synonym database, to return a plurality of source language documents translating, by the multi-lingual information retrieval system, the plurality of the source language documents into corresponding translated documents in the target language;

translating, by the multi-lingual information retrieval system, a source language term to a plurality of target language translation options;

translating, by the multi-lingual information retrieval system, the plurality of target language translation options to respective source language translation results; and

storing, by the multi-lingual information retrieval system, a collection of the source language translation results in the synonym database as synonyms for the source language term.

66. The method of claim 65, further comprising:

displaying search results corresponding to the source language translated documents; and

displaying synonyms for terms in the search query.

67. The method of claim 66, further comprising:

when the user selects one of the displayed synonyms, rendering documents matching the selected synonym, and including the rendered documents in the search results.

68. The method of claim 65, further comprising:

when the user enters a query in the source language, displaying synonyms for one or more terms in the query.