Linguistic search system

• US 6,202,064 B1
• Filed: 06/18/1998
• Issued: 03/13/2001
• Est. Priority Date: 06/20/1997
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Julliard, Laurent
• Primary Examiner(s): Alam, Hosain T.
• Assistant Examiner(s): Corrielus, Jean M.
• Application Number:
  US09/099,909
• Time in Patent Office: 999 Days
• Field of Search: 707/5, 707/4, 707/531, 707/2, 707/3, 704/9
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/3335 Syntactic pre-processing, e.g. stopword elimination, stemming
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

A method of searching for information in a text database, comprising: receiving (s1) at least one user input, the user input(s) defining a natural language expression, converting (s2, s3) the natural language expression to a tagged form (50, 51) including part-of-speech tags, applying (s4) to the tagged form (51) one or more grammar rules of the language of the natural language expression (49), to derive a regular expression (52), and analyzing (s5) the text database to determine whether there is a match between said regular expression (52) and a portion of said text database. An apparatus for carrying out this techniques is also disclosed. Users may find portions of a text which match multiword expressions given by the user. Matches include possible variations that are relevant with the initial criteria from a linguistic point of view including simple inflections like plural/singular, masculine/feminine or conjugated verbs and even more complex variations like the insertion of additional adjectives, adverbs, etc. in between the words specified by the user.

Claims

1. A method of searching for information in a text database, comprising:

(a) receiving at least one user input, the at least one user input being a natural language expression including at least one word;

(b) converting the natural language expression to a tagged form of the natural language expression, the tagged form of the natural language expression including the at least one word and a part-of-speech tag associated with each word of the natural language expression;

(c) applying to the tagged form of the natural language expression one or more grammar rules of a language of the natural language expression, to derive a regular expression based on the at least one word and the part of speech tag; and

(d) analyzing a text database to determine whether there is a match between said regular expression and a portion of said text database.

2. The method of claim 1, wherein converting the natural language expression to the tagged form of the natural language expression comprises tagging the natural language expression comprising, for each word in said natural language expression:

converting that word to a root form; and

p1 applying the part-of-speech tag to the root form of that word to generate a complex form.

3. The method of claim 2, wherein the part-of speech tag includes a syntactic category marker and a morphological feature marker, and converting the natural language expression to the tagged form of the natural language expression further comprises simplifying said complex tagged form by removing each morphological feature marker to generate a simplified tagged form.

4. The method of claim 1, 2 or 3, further including determining the location within said text database of the match with said regular expression.

5. A programmable data processing apparatus, the apparatus including a program storage device operatively connected to a user interface for performing a method of searching, said method comprising:

(a) receiving at least one user input, the at least one user input being a natural language expression including at least one word;

(b) converting the natural language expression to a tagged form of the natural language expression, the tagged form of the natural language expression including the at least one word and a part of speech tag associated with each word of the at least natural language expression;

(c) applying to the tagged form of the natural language expression one or more grammar rules of a language of the natural language expression to derive a regular expression based on the at least one word and the part of speech tag; and

(d) analyzing a text database to determine whether there is a match between said regular expression and a portion of said text database.