Relational text index creation and searching

• US 6,738,765 B1
• Filed: 08/10/2001
• Issued: 05/18/2004
• Est. Priority Date: 08/11/2000
• Status: Expired due to Fees

• Current Assignee: Attensity Corporation (Attensity Group Incorporated)
• Original Assignee: Attensity Corporation (Attensity Group Incorporated)
• Inventors: Bean, David L., Wakefield, Todd D., Lorenzen, Jeffrey A.
• Primary Examiner(s): Mizrahi, Diane D.
• Assistant Examiner(s): Wu, Yicun
• Application Number:
  US09/927,487
• Time in Patent Office: 1,012 Days
• Field of Search: 707/1, 707/10, 707/101, 704/1, 704/4, 704/8, 704/9, 704/10, 343/708, 343/853, 700/104, 700/903, 341/51, 706/11, 703/2, 703/6
• US Class Current: 1/1
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

In an environment where it is desire to perform information extraction over a large quantity of textual data, methods, tools and structures are provided for building a relational text index from the textual data and performing searches using the relational text index.

Claims

1. Computer readable storage media including a system for performing a search using a relational text index, the system intended to be used on a computer system having an input device, an output device, storage media, dynamic memory a processor, and documents located on said storage media, the system for performing a search using a relational text index comprising:

a parser capable of parsing natural language sentences contained within said documents to identify grammatical parts of the sentences,

a tool for applying caseframes to said parsed sentences to generate caseframe extractions, caseframes being syntactic structures that recognize local area context,

a tool for performing thematic role assignment on said caseframe extractions to generate thematic role extractions,

a tool for utilizing sentence information to build a relational text index that is usable by said computer system,

a relational text index, and

a search tool performing a search of said documents using said relational text index;

wherein said search toolcan search using a thematic role specifier as a search determiner.

2. Computer readable storage media as recited in claim 1 wherein said search tool can search using meta types for thematic roles.

3. Computer readable storage media as recited in claim 1 wherein said search tool can search in union and intersection mode.

4. Computer readable storage media as recited in claim 1 wherein said search tool can search both based on a thematic role and on its root form.

5. Computer readable storage media as recited in claim 1 wherein said system has a facility to permit a user to input a search query, said search query including a thematic role selected from the group consisting of actor, action, object and specifier.

6. Computer readable storage media as recited in claim 1 wherein said search tool can compare an actor to noun phrases in said relational text index.

7. Computer readable storage media as recited in claim 1 wherein said search tool can compare an action to verb phrases in said relational text index.

8. Computer readable storage media as recited in claim 1 wherein said search tool can compare said specifier to noun phrase specifiers in said relational text index.

9. Computer readable storage media as recited in claim 1 further comprising a facility for accepting a search query from a user, said search query including terms in a mode selected from the group consisting of union mode and intersection mode.

11. Computer readable storage media as recited in claim 1 further comprising a database management system on which said relational text index is located.

12. Computer readable storage media as recited in claim 1 further comprising:

a facility for accepting a search query from a user, and a tool for collapsing on the root form of search terms.

13. Computer readable storage media as recited in claim 1, wherein said search tool is capable of comparing verb roles to pre-defined meta types.

10. Computer readable storage media including a system for performing a search using a relational text index, the system intended to be used on a computer system having an input device, an output device, storage media, dynamic memory a processor, and documents located on said storage media, the system for performing a search using a relational text index comprising:

a parser capable of parsing natural language sentences contained within said documents to identify grammatical parts of the sentences,

a tool for applying caseframes to said parsed sentences to generate caseframe extractions, caseframes being syntactic structures that recognize local area context,

a tool for performing thematic role assignment on said caseframe extractions to generate thematic role extractions,

a tool for utilizing sentence information to build a relational text index that is usable by said computer system,

a relational text index,

a search tool performing a search of said documents using said relational text index,

a tool for accepting a search query from a user, said search query including actor and action roles, and

a tool for querying said relational text index for instances when said actor or action is recorded in its appropriate role, for each query match, said tool being capable of retrieving the noun phrase of the extracted term, and for each query match, said tool being capable of retrieving the document and phrase where the match occurred, and

a facility for displaying search results to the user.

14. Computer readable storage media including a system for performing a search using a relational text index, the system intended to be used on a computer system having an input device, an output device, storage media, dynamic memory, a processor, and natural language text documents located on said storage media, the system for performing a search using a relational text index comprising:

a parser capable of parsing natural language sentences in said documents to generate diagrammed sentences, said parser being capable of producing an output selected from the group consisting of noun phrases, verb phrases, prepositional phrases, adverbial phrases, adjectival phrases, clauses, and combinations of them,

a tool for applying caseframes to said diagrammed sentences to generate caseframe extractions,

a tool for performing thematic role assignment on said caseframe extractions to generate thematic role extractions, said thematic role assignment tool being capable of translating raw caseframe-extractions to specific thematic roles,

a relational text index file containing thematic role information,

a search tool for searching of language documents using said relational text index, and

a tool for comparing a user'"'"'s search roles to thematic roles in said relational text index.

15. Computer readable storage media as recited in claim 14 further comprising a facility for accepting a search query from a user and permitting a user to specify at least one search role selected from the group consisting of actor, action, object and specifier.

16. Computer readable storage media as recited in claim 14 further comprising a tool for collapsing on a morphological root form of search roles.

17. Computer readable storage media as recited in claim 14 further comprising a facility for displaying portions of documents where user search roles were found.