Text searching system

• US 5,369,577 A
• Filed: 02/01/1991
• Issued: 11/29/1994
• Est. Priority Date: 02/01/1991
• Status: Expired due to Term

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Wang Laboratories Incorporated
• Inventors: Kadashevich, A. Julie, Harvey, Mary F., Clark, Cheryl
• Primary Examiner(s): NOT, DEFINED
• Assistant Examiner(s): Hazard, J. L.
• Application Number:
  US07/650,812
• Time in Patent Office: 1,397 Days
• Field of Search: 364/419, 364/419.1, 364/419.11, 364/419.12, 364/419.13, 364/419.15, 364/419.14, 395/600
• US Class Current: 704/9
• CPC Class Codes: G06F 40/253 Grammatical analysis; Style critique

Abstract

An apparatus for searching a collection of words based upon an input word, the apparatus including means for generating a first set of words containing members that are lexically related to the input word, the first set of words including words that are other than regular inflectional nouns; and also including a search engine for searching the collection of words to detect the occurrence of any of the words from a group of search words, the group of search words including the input word and the first set of words.

Claims

1. A computer apparatus for searching a collection of words based upon an input word, said computer apparatus comprising:

a generating means for generating a first set of words containing members that are lexically related to the input word, said first set of words including words that are both regular inflectional nouns and words that are other than regular inflectional nouns, the generating means including

a recognition engine for finding at least one linguistic stem within said input word and identifying at least one suffix attached to each said linguistic stem,

generating members of said first set of words by stripping from said input word suffixes selected from a first group of suffixes which do not substantially change the meaning of words when stripped therefrom, and

performing inflectional and derivational analysis upon said input word by generating all inflections and derivations that can be generated from said linguistic stems by the addition of one suffix wherein said derivational analysis employs at least three derivational suffixes; and

a search engine for searching said collection of words to detect the occurrence of words from a group of search words, said group of search words comprising the input word and said first set of words.

2. The computer apparatus of claim 1 wherein said first set of words further includes words that are both regular inflectional verbs and words that are other than and regular inflectional verbs.

3. The computer apparatus of claim 1 wherein said generating means is a morphological analyzer.

4. The computer apparatus of claim 3 wherein said recognition engine generates a derivational history including information about any parses that were successfully performed by said recognition engine on said input word.

5. The computer apparatus of claim 4 wherein said derivational history contains, for each successful parse of the input word, the part of speech of the input word for that particular parse.

6. The computer apparatus of claim 3 wherein said morphological analyzer comprises a recognition engine for finding the linguistic stem within said input word by proceeding through the input word from the beginning of the input word and selecting successively longer sequences of characters from the input word, starting with at least the first character of the input word, and comparing the successive sequences of characters to stems stored in a stem lexicon and then identifying suffixes attached to each said linguistic stem by selecting sequences of characters of the input word following the linguistic stem and comparing each selected sequence of characters following the linguistic stem to suffixes stored in a suffix lexicon.

7. The computer apparatus of claim 3 wherein said morphological analyzer further comprises a means for generating a second set of words that are lexically related to selected members of said group of synonyms, said selected members of said group of synonyms being members of said group of synonyms which have linguistic stems and suffixes which allow the affixing of further suffixes.

8. The computer apparatus of claim 7 wherein said means for generating a second set of words generates said second set of words based upon information supplied by said recognition engine for the input word, the information supplied by said recognition engine include, for each parsing of said input word, a linguistic stem, an identification of each suffix attached to said linguistic stem, and a part of speech of the input word for the parse of the input word and the recognition engine using the linguistic stem, suffixes and part of speech for each parse to select said selected members of said group of synonyms.

9. The computer apparatus of claim 7 wherein said group of search words further comprises said second set of words.

10. The computer apparatus of claim 1 wherein said collection of words is an index wherein the index is a group of words not comprising a text.

11. The computer apparatus of claim 1 wherein said collection of words is a text.

12. The computer apparatus of claim 1 wherein said first group of suffixes includes members selected from a first subset containing all inflectional suffixes, #ful, #ish, +ious, +ic, +al, #ar, #er, #or, +ive, +ory, #able, +able, +ible, #ment, #ness, +ity, +ety, +ty, #ly, #ize, +ify, and #y.

13. The computer apparatus of claim 1 further comprising a thesaurus database and wherein said generating means uses said thesaurus database to generate a group of synonyms, the members of said group of synonyms being synonyms of members of said first set of lexically related words.

14. The computer apparatus of claim 13 wherein said group of search words further comprises the group of synonyms.

15. The computer apparatus of claim 13, wherein said generating means generates a second group of words from members of said group of synonyms which have linguistic stems and suffixes which allow the affixing of further suffixes by adding to said members of said group said further suffixes which are selected from a second group of suffixes wherein the members of said second group of suffixes include only those suffixes which do not substantially change the meaning of words when added thereto.

16. The computer apparatus of claim 15 wherein said group of search words further comprises the second group of words.

17. The computer apparatus of claim 15 wherein said second group of suffixes includes members selected from a subset containing all inflectional suffixes, #ful, #ish, +ous, +ic, +al, #ar, #er, #or, +ive, +ory, #able, +able, +ible, #ment, #ness, +ity, +ety, +ty, #ly, and #y.

18. A computer apparatus comprising a subject expansion system for expanding an input word into a plurality of related words, the computer apparatus comprising:

a means for receiving the input word; and

a generating means for generating a first group of words from the input word,

wherein said generating means generates at least some of said first group of words by stripping from said input word only suffixes selected from a first group of suffixes, the members of said first group of suffixes including only those suffixes which do not substantially change the meaning of words when stripped therefrom, and includes

a recognition engine for finding all linguistic stems within said input word and performing inflectional and derivational analysis upon said input word by generating all inflections and derivations that can be generated from said linguistic stems by the addition of one suffix wherein said derivational analysis employs at least three derivational suffixes.

19. The computer apparatus of claim 18 wherein said first group of suffixes includes inflectional and derivational suffixes.

20. The computer apparatus of claim 19 wherein said first group of suffixes includes members selected from a first subset containing all inflectional suffixes, #ful, #ish, +ous, +ic, +al, #ar, #er, #or, +ive, #able, +able, +ible, #ment, #ness, +ity, +ety, +ty, #ly, #ize, +ify, +fy, and #y.

21. The computer apparatus of claim 18 wherein said generating means generates at least one of said first group of words by adding to words derived from said input word by stripping suffixes from said input word only those suffixes which are selected from a second group of suffices, the members of said second group of suffixes including only those suffixes which do not substantially change the meaning of words when added thereto.

22. The computer apparatus of claim 21 wherein said second group of suffixes includes inflectional and derivational suffixes.

23. The computer apparatus of claim 22 wherein said first group of suffixes includes members selected from a first subset containing all inflectional suffixes, #ful, #ish, +ous, +ic, +al, #ar, #er, #or, +ive, #able, +able, +ible, #ment, #ness, +ity, +ety, +ty, #ly, #ize, +ify, +fy, and #y.

24. The computer apparatus of claim 18 further comprising a thesaurus database and wherein said generating means indexes said thesaurus database with members of said first group of words to read from said thesaurus database synonyms corresponding to members of said first group of words having synonyms in said thesaurus database to generate a group of synonyms comprised of said synonyms read from said thesaurus database, the members of said group of synonyms being synonyms of certain members of said first group of words which have said synonyms in said thesaurus database.

25. The computer apparatus of claim 24 wherein said generating means expands said group of words by adding to selected members of said group of synonyms only those suffixes which are selected from a second group of suffixes, wherein said selected members of said group of synonyms are those members of said group of synonyms which have linguistic stems and suffixes allowing the affixing of further suffixes and said second group of suffixes including only those suffixes which do not substantially change the meaning of word when added thereto.

26. The computer apparatus of claim 25 wherein said second group of suffixes includes inflectional and derivational suffixes.

27. The computer apparatus of claim 26 wherein said first group of suffixes includes members selected from a first subset containing all inflectional suffixes, #ful, #ish, +ous, +ic, +al, #ar, #er, #or, +ive, #able, +able, +ible, #ment, #ness, +ity, +ety, +ty, #ly, #ize, +ify, +fy, and #y.

28. The computer apparatus of claim 18 wherein said generating means comprises a morphological analyzer.

29. The computer apparatus of claim 28 wherein said morphological analyzer comprises said recognition engine for generating a base history for said input word, said base history identifying one or more base words for said input word, said one or more base words representing the input word with one or more suffixes removed.

30. The computer apparatus of claim 29 wherein said recognition engine comprises:

a means for finding a linguistic stem within said input word; and

a means for identifying suffixes attached to said linguistic stem, wherein said stem finding means and said suffix identifying means cooperate to conduct morphological analysis of the input word from the root to the affix.

31. A computer apparatus for generating a group of words from an input word, said computer comprising:

means for removing suffixes from said input word to generate at least one base word;

a thesaurus means adapted to receive said one or more base words and generate a group of synonyms for certain of said at least one base word; and

a generating means comprising a recognition engine for generating a base history for said input word, said base history identifying said one or more base words, said generating means including

a means for finding a linguistic stem within said input word,

a means for identifying suffixes attached to said linguistic stem, wherein said linguistic stem finding means and suffix identifying means cooperate to conduct morphological analysis of the input word from a root to an affix, and

a means for performing inflectional and derivational analysis by generating all inflections and derivations than can be generated from said linguistic stems by the addition of one suffix wherein said derivational analysis employs at least three derivational suffixes.

32. The computer apparatus of claim 31 wherein said generating means further comprises a generation engine for generating a second set of words containing members that are lexically related to selected members of said group of synonyms, said selected members of said group of synonyms comprising the synonyms of said group of synonyms which have lingusitic stems and suffixes which allow the affixing of further suffixes.

33. The computer apparatus of claim 32, further comprising a selection means for selecting members of said group of synonyms to identify said selected members of said second group of words by identifying said synonyms of said group of synonyms which have linguistic stems and suffixes which allow the affixing of further suffixes.

34. A computer-implemented method for generating a collection of words from an input word, said method comprising:

generating, by means of a generating engine, a first set of words containing members that are lexically related to the input word, said first set of words including words that are both regular inflectional nouns and words that are other than regular inflectional nouns, by operation of a recognition engine

stripping from said input word only suffixes selected from a first group of suffixes, the members of said first group of suffixes including only those suffixes which do not substantially change the meaning of words when stripped therefrom; and

generating, by operation of the generating engine, a second set of words that are lexically related to the input word, said second set of words including words that are both regular inflectional nouns and words that are other than regular inflectional nouns by

finding at least one linguistic stem within said input word,

identifying suffixes attached to each said linguistic stem, and

by operation of the recognition engine, performing inflectional and derivational analysis by generating all inflections and derivations than can be generated from said linguistic stems by the addition of one suffix wherein said derivational analysis employs at least three derivational suffixes.

35. The method of claim 34 for generating a collection of words from an input word further comprising the steps of:

stripping said suffixes from said input word to generate one or more base words; and

generating a group of synonyms for certain of said one or more base words by indexing a thesaurus database with said certain of said one or more base words and reading corresponding synonyms from said thesaurus database to comprise said group of synonyms.