Method and system for searching a multi-lingual database

• US 8,027,966 B2
• Filed: 08/21/2008
• Issued: 09/27/2011
• Est. Priority Date: 02/01/2002
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kozakov, Lev, Kim, Moon Ju, Drissi, Youssef, Leon Rodriguez, Juan
• Primary Examiner(s): Woo; Isaac M
• Application Number:
  US12/195,829
• Publication Number:
  US 20080306729A1
• Time in Patent Office: 1,132 Days
• Field of Search: 707600-831
• US Class Current: 707/706
• CPC Class Codes: G06F 16/319 Inverted lists
• CPC Class Codes: G06F 16/3337 Translation of the query language, e.g. Chinese to English
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99937 Sorting
• CPC Class Codes: Y10S 707/99938 Concurrency, e.g. lock management in shared database
• CPC Class Codes: Y10S 707/99939 Privileged access
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A system and method of searching a database in which documents of different languages are included. The system includes a synonym or keyword dictionary which is bi-directional and allows for translation of keywords between a first language and other languages. The translated words keywords for the document are stored in an inverted index which is then used for searching, either in a selected language, a second language or in all languages, as determined by the user. This use of multiple searching and a translated synonym dictionary avoids the need for translation of the entire document and avoids inaccuracies which may result from translations.

Claims

1. A system for searching documents written in a plurality of languages, the system comprising at least one computer including:

a system for identifying keywords from each of the plurality of documents;

a system for translating each identified keyword into each of the plurality of languages;

a system for creating an index in each of the plurality of languages;

a system for receiving a first query that includes at least one keyword in a first language;

a system for generating a second query by translating the at least one keyword into a second language;

a system for applying the first query against documents written in both the first language and the second language;

a system for applying the second query against documents written in the second language;

a system for generating a first set of results that includes each document written in the first language that matches the first query; and

a system for generating a second set of results that includes each document written in the second language that matches at least one of the first query or the second query.

2. The system of claim 1, wherein the system for generating a second query includes a keyword dictionary that supports translation between the plurality of languages.

3. The system of claim 1, the at least one computer further including a system for providing at least one of the first or second sets of results for presentation to a user.

4. The system of claim 1, the at least one computer further including a system for determining a native language of a user.

5. A document searching program stored on a tangible computer-useable medium, wherein the documents are written in a plurality of languages, the program comprising:

a module for identifying keywords from each of the plurality of documents;

a module for translating each identified keyword into each of the plurality of languages;

a module for creating an index in each of the plurality of languages;

a module for receiving a first query that includes at least one keyword in a first language;

a module for generating a second query by translating the at least one keyword into a second language;

a module for applying the first query against documents written in both the first language and the second language;

a module for applying the second query against documents written in the second language;

a module for generating a first set of results that includes each document written in the first language that matches the first query; and

a module for generating a second set of results that includes each document written in the second language that matches at least one of the first query or the second query.

6. The program of claim 5, wherein the module for generating a second query includes a keyword dictionary that supports translation between the plurality of languages.

7. The program of claim 5, further comprising a module for providing at least one of the first or second sets of results for presentation to a user.

8. The program of claim 5, further comprising a module for determining a native language of a user.

9. A computer system comprising:

a set of computing devices for searching documents written in a plurality of languages by performing a method comprising;

identifying keywords from each of the plurality of documents;

translating each identified keyword into each of the plurality of languages;

creating an index in each of the plurality of languages;

receiving a first query that includes at least one keyword in a first language;

generating a second query by translating the at least one keyword into a second language;

applying the first query against documents written in both the first language and the second language;

applying the second query against documents written in the second language;

generating a first set of results that includes each document written in the first language that matches the first query; and

generating a second set of results that includes each document written in the second language that matches at least one of the first query or the second query.

10. The computer system of claim 9, wherein the generating a second query uses a keyword dictionary that supports translation between the plurality of languages.

11. The computer system of claim 9, the method further comprising providing at least one of the first or second sets of results for presentation to a user.

12. The computer system of claim 9, the method further comprising determining a native language of a user.