Simplifying query terms with transliteration

• US 7,835,903 B2
• Filed: 04/19/2006
• Issued: 11/16/2010
• Est. Priority Date: 04/19/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Datta, Ruchira S.
• Primary Examiner(s): Smits; Talivaldis Ivars
• Assistant Examiner(s): ROBERTS, SHAUN A
• Application Number:
  US11/407,860
• Publication Number:
  US 20070288230A1
• Time in Patent Office: 1,672 Days
• Field of Search: 704 1- 10, 707/5
• US Class Current: 704/9
• CPC Class Codes: G06F 16/3337 Translation of the query language, e.g. Chinese to English
• CPC Class Codes: G06F 40/126 Character encoding
• CPC Class Codes: G06F 40/263 Language identification

Abstract

Methods, systems, and apparatus, including computer program products, operable to perform operations including receiving from a user a search query; and receiving an indication of a user preference to apply transliteration in simplifying the query terms of the search query. Alternatively, the operations include receiving from a user a search query of query terms; applying transliteration in simplifying the query terms; and using the simplified query terms to identify synonyms to use in augmenting the search query. Alternatively, the operations include receiving from a user a search query; identifying the user interface language as a small language or not a small language; simplifying each query term to a simplified form; and if the user interface language is a small language, for each original query term that has a simplified form different from the original term, using the original query term as-is and not providing any synonyms for the query term.

Claims

1. A computer implemented method, comprising:

receiving from a user through a user interface a search query comprising one or more original query terms for searching a collection of documents, the user interface having a user interface language;

identifying the user interface language as a small language or not a small language, a small language being a natural language having a relatively small representation in the collection of documents;

simplifying each query term to a simplified form; and

if the user interface language is a small language, for each original query term that has a simplified form that is different from the original term, using the original query term as-is and not providing any synonyms for the query term, and for each original query term that is identical to its simplified form, using the simplified form to identify synonyms for the original query term for use in augmenting the search query.

2. The method of claim 1, wherein simplifying each query term comprises transliterating.

3. The method of claim 1 in which the collection of documents were identified by a web crawler.

4. The method of claim 1 in which the collection of documents includes documents in different languages.

5. The method of claim 1 in which simplifying each query term further comprises one or more of:

collapsing a digraph in the query term, and removing an accent from the query term.

6. The method of claim 1 in which using the simplified form to identify synonyms for the original query term comprises identifying a synonym for the simplified form based on respective relative frequencies of the synonym in respective languages. transliterating.

7. A computer program product, encoded on a computer-readable storage device, operable to cause data processing apparatus to perform operations comprising:

receiving from a user through a user interface a search query comprising one or more original query terms for searching a collection of documents, the user interface having a user interface language;

identifying the user interface language as a small language or not a small language, a small language being a natural language having a relatively small representation in the collection of documents;

simplifying each query term to a simplified form; and

if the user interface language is a small language, for each original query term that has a simplified form that is different from the original term, using the original query term as-is and not providing any synonyms for the query term, and for each original query term that is identical to its simplified form, using the simplified form to identify synonyms for the original query term for use in augmenting the search query.

8. The product of claim 7, wherein simplifying each query term comprises transliterating.

9. The product of claim 7 in which the collection of documents were identified by a web crawler.

10. The product of claim 7 in which the collection of documents includes documents in different languages.

11. The product of claim 7 in which simplifying each query term further comprises one or more of:

collapsing a digraph in the query term, and removing an accent from the query term.

12. The product of claim 7 in which using the simplified form to identify synonyms for the original query term comprises identifying a synonym for the simplified form based on respective relative frequencies of the synonym in respective languages. transliterating.

13. A system comprising:

one or more computers configured to perform operations comprising;

receiving from a user through a user interface a search query comprising one or more original query terms for searching a collection of documents, the user interface having a user interface language;

identifying the user interface language as a small language or not a small language, a small language being a natural language having a relatively small representation in the collection of documents;

simplifying each query term to a simplified form; and

performing operations if the user interface language is a small language, for each original query term that has a simplified form that is different from the original term, using the original query term as-is and not providing any synonyms for the query term, and for each original query term that is identical to its simplified form, using the simplified form to identify synonyms for the original query term for use in augmenting the search query.

14. The system of claim 13, wherein simplifying each query term comprises transliterating.

15. The system of claim 13 in which the collection of documents were identified by a web crawler.

16. The system of claim 13 in which the collection of documents includes documents in different languages.

17. The system of claim 13 in which simplifying each query term further comprises one or more of:

collapsing a digraph in the query term, and removing an accent from the query term.

18. The system of claim 13 in which using the simplified form to identify synonyms for the original query term comprises identifying a synonym for the simplified form based on respective relative frequencies of the synonym in respective languages.