Systems and methods for searching using queries written in a different character-set and/or language from the target pages

• US 8,706,747 B2
• Filed: 09/30/2003
• Issued: 04/22/2014
• Est. Priority Date: 07/06/2000
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Mittal, Vibhu, Ponte, Jay M., Sahami, Mehran, Ghemawat, Sanjay, Bauer, John A.
• Primary Examiner(s): Chen, Susan
• Application Number:
  US10/676,724
• Publication Number:
  US 20040261021A1
• Time in Patent Office: 3,857 Days
• Field of Search: 707/3, 707/5, 707/4, 704/7, 704/9, 709/201, 709/223, 340/995.12
• US Class Current: 707/760
• CPC Class Codes: G06F 16/2452 Query translation
• CPC Class Codes: G06F 16/24522 Translation of natural language queries to structured queries
• CPC Class Codes: G06F 16/3332 Query translation
• CPC Class Codes: G06F 16/972 Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 40/12 Use of codes for handling textual entities
• CPC Class Codes: G06F 40/237 Lexical tools

Abstract

Methods and apparatus consistent with the invention allow a user to submit an ambiguous search query and to receive relevant search results. Queries can be expressed using character sets and/or languages that are different from the character set and/or language of at least some of the data that is to be searched. A translation between these character sets and/or languages can be performed by examining the use of terms in aligned text. Probabilities can be associated with each possible translation. Refinements can be made to these probabilities by examining user interactions with the search results.

Claims

1. A computer-implemented method, the method comprising:

receiving a search query from a user device, wherein the search query includes one or more terms, each term being written in a first format;

translating, using a probabilistic dictionary, the one or more terms of the search query into a group of translated search queries, each translated search query having one or more terms in a second format, wherein the probabilistic dictionary includes a mapping of terms from the first format to the second format according to a respective calculated probability that a particular term in the first format corresponds to a term in the second format;

using a search engine to identify a plurality of documents written in the second format that are responsive to the group of translated search queries;

providing search results written in the second format to the user device, the search results referencing one or more of the identified documents;

obtaining click data from the user device indicative of user selections of one or more of the search results written in the second format; and

modifying the probabilistic dictionary of term mappings based at least in part on the obtained click data indicative of user selections of one or more of the search results written in the second format and adjusting at least one probability associated with at least one mapping in the probabilistic dictionary.

2. The method of claim 1, where translating the query into the second format includes expanding the search query to create an expanded search query.

3. The method of claim 2, in which the expanded search query includes alternative encodings of one or more of the search query terms.

4. The method of claim 3, in which the expanded search query includes synonyms of one or more of the alternative encodings of the search query terms.

5. The method of claim 2, in which the expanded search query includes alternative language translations of one or more of the search query terms.

6. The method of claim 2, in which the expanded search query includes alternative encodings and alternative language translations of one or more of the search query terms.

7. A system comprising:

a computer readable medium including instructions; and

data processing apparatus configured to execute the instructions to perform operations including;

receiving a search query from a user device, wherein the search query includes one or more terms, each term being written in a first format;

translating, using a probabilistic dictionary, the one or more terms of the search query into a group of translated search queries, each translated search query having one or more terms in a second format, wherein the probabilistic dictionary includes a mapping of terms from the first format to the second format according to a respective calculated probability that a particular term in the first format corresponds to a term in the second format;

using a search engine to identify a plurality of documents written in the second format that are responsive to the group of translated search queries;

providing search results written in the second format to the user device, the search results referencing one or more of the identified documents;

obtaining click data from the user device indicative of user selections of one or more of the search results written in the second format; and

modifying the probabilistic dictionary of term mappings based at least in part on the obtained click data indicative of user selections of one or more of the search results written in the second format and adjusting at least one probability associated with at least one mapping in the probabilistic dictionary.

8. The system of claim 7, in which translating the search query into the second format includes expanding the search query to create an expanded search query.

9. The system of claim 8, in which the expanded search query includes alternative encodings of one or more of the search query terms.

10. The system of claim 9, in which the expanded search query includes synonyms of one or more of the alternative encodings of the search query terms.

11. The system of claim 8, in which the expanded search query includes alternative language translations of one or more of the search query terms.

12. The system of claim 8, in which the expanded search query includes alternative encodings and alternative language translations of one or more of the search query terms.

13. A computer storage medium encoded with a computer program, the program comprising instructions that, when executed by data processing apparatus, cause the data processing apparatus to perform operations comprising:

receiving a search query from a user device, wherein the search query includes one or more terms, each term being written in a first format;

translating, using a probabilistic dictionary, the one or more terms of the search query into a group of translated search queries, each translated search query having one or more terms in a second format, wherein the probabilistic dictionary includes a mapping of terms from the first format to the second format according to a respective calculated probability that a particular term in the first format corresponds to a term in the second format;

using a search engine to identify a plurality of documents written in the second format that are responsive to the group of translated search queries;

providing search results written in the second format to the user device, the search results referencing one or more the identified documents;

obtaining click data from the user device indicative of user selections of one or more of the search results written in the second format; and

modifying the probabilistic dictionary of term mappings based at least in part on the obtained click data indicative of user selections of one or more of the search results written in the second format and adjusting at least one probability associated with at least one mapping in the probabilistic dictionary.

14. The computer storage medium of claim 13, in which translating the search query into the second format includes expanding the search query to create an expanded search query.

15. The computer storage medium of claim 14, in which the expanded search query includes alternative encodings of one or more of the search query terms.

16. The computer storage medium of claim 15, in which the expanded search query includes synonyms of one or more of the alternative encodings of the search query terms.

17. The computer storage medium of claim 14, in which the expanded search query includes alternative language translations of one or more of the search query terms.

18. The computer storage medium of claim 14, in which the expanded search query includes alternative encodings and alternative language translations of one or more of the search query terms.