Method and apparatus for automatic construction of faceted terminological feedback for document retrieval

• US 6,519,586 B2
• Filed: 08/06/1999
• Issued: 02/11/2003
• Est. Priority Date: 08/06/1999
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Compaq Computer Corporation (HP Inc.)
• Inventors: Tipirneni, Suresh, Anick, Peter
• Primary Examiner(s): Breene, John
• Assistant Examiner(s): PHAM, KHANH B
• Application Number:
  US09/370,639
• Publication Number:
  US 20020091661A1
• Time in Patent Office: 1,285 Days
• Field of Search: 707/3, 707/4, 707/5, 707/513, 704/9
• US Class Current: 707/742
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

Iterative information retrieval from a large database of textual or text-containing documents is facilitated by automatic construction of faceted representations. Facets are chosen heuristically based on lexical dispersion, a measure of the number of different words with which a particular search expression co-occurs within a given type of lexical construct (e.g., a noun phrase) appearing in the document set. Words having high dispersion rates represent “facets” that may be used to organize the documents conceptually in accordance with the search expression, effectively providing a concise, structured summary of the contents of a result set as well as presenting a set of candidate terms for query reformulation.

Claims

1. A method of selecting and organizing documents from a document corpus in response to a user-provided search expression, the method comprising the steps of:

a. locating, within the document corpus, documents matching the search expression;

b. identifying, within the located documents, instances of a lexical construct conforming to a selected syntactic pattern that includes two or more parts of speech;

c. assigning dispersion rates to words within the lexical constructs, each dispersion rate corresponding to the number of textually distinct lexical constructs containing the word;

d. ranking the words in accordance with their dispersion rates;

e. presenting a list of at least sonic of the words;

f. facilitating selection of a listed word;

g. appending the word to a base search expression to form a new search expression; and

h. facilitating access to documents from the corpus matching the new search expression.

2. The method of claim 1 wherein the base search expression is the user-provided expression.

3. The method of claim 1 wherein the base search expression is a new user-provided expression.

9. The method of claim 1 wherein the syntactic pattern is ?<

adjective>

<

noun>

+.

10. The method of claim 1 further comprising the step of removing lexical constructs matching a noiseword filter.

4. A method of selecting and organizing documents from a document corpus in response to a user-provided search expression, the method comprising the steps of:

a. locating, within the document corpus, documents matching the search expression;

b. identifying, within the located documents, instances of a lexical construct conforming to a selected syntactic pattern that includes two or more parts of speech;

c. assigning dispersion rates to words within the lexical constructs, each dispersion rate corresponding to the number of textually distinct lexical constructs containing the word;

d. ranking the words in accordance with their dispersion rates;

e. facilitating selection of at least one of the words;

f. for each selected word, presenting a sorted list of lexical constructs that appear in the located documents and contain the word; and

g. facilitating selection of a listed lexical construct.

5. The method of claim 4 further comprising the steps of:

d. appending the lexical construct to a base search expression to form a new search expression; and

e. facilitating access to documents from the corpus that match the new search expression.

6. The method of claim 4 further comprising the step of facilitating access to documents from the corpus that match the selected lexical construct.

7. The method of claim 4 wherein the base search expression is the user-provided query.

8. The method of claim 4 wherein the base search expression is a new user-provided query.

11. Text-searching apparatus comprising:

a. a digitally searchable corpus of documents;

b. an interface for receiving a search expression;

c. a search module, responsive to the search expression, for locating documents in the corpus matching the search expression; and

d. a control module configured to;

i. identify, within the located documents, instances of a lexical construct conforming to a selected syntactic pattern that includes two or more parts of speech;

ii. assign dispersion rates to words within the lexical constructs, each dispersion rate corresponding to the number of textually distinct lexical constructs containing the word; and

iii. rank the words in accordance with their dispersion rates.

12. The apparatus of claim 11 wherein the user interface is a web page and further comprising:

a. a web server;

b. means for generating web pages for transmission to remote users via the server;

c. means for receiving, via the server, the search expression remotely entered into a generated web page.

13. The apparatus of claim 11 wherein the interface is configured to:

a. present a list of at least some of the words; and

b. facilitate selection of a listed word and append the selected word to a base search expression to form a new search expression, the search module receiving the new search expression and, in response thereto, locating documents from the corpus matching the new search expression.

14. The apparatus of claim 13 wherein the initial search expression is the user-provided expression.

15. The apparatus of claim 13 wherein the initial search expression is a new user-provided expression, the interface being configured to receive the new user-provided expression.

16. The apparatus of claim 11 wherein the control module is further configured to:

a. facilitate selection of at least one of the words; and

b. present, for each selected word, a sorted list of lexical constructs that appear in the located documents and contain the words, the interface being configured to present the list and facilitate selection of a lexical construct from the list.

17. The apparatus of claim 16 wherein the interface, in response to selection of a lexical construct, is further configured to append the lexical construct to an initial search expression to form a new search expression, the search module being responsive to the new search expression and locating documents from the document database matching the new search expression.

18. The apparatus of claim 17 wherein the initial search expression is the user-provided expression.

19. The apparatus of claim 17 wherein the initial search expression is a new user-provided expression, the interface being configured to receive the new user-provided expression.

20. The apparatus of claim 11 wherein the syntactic pattern is ?<

adjective>

<

noun>

+.

21. The apparatus of claim 11 wherein the control module is further configured to remove lexical constructs matching a noiseword filter.