Natural language processing and query driven information retrieval

• US 20020010574A1
• Filed: 03/22/2001
• Published: 01/24/2002
• Est. Priority Date: 04/20/2000
• Status: Abandoned Application

• Current Assignee: IHS Global Incorporated (Markit Group Ltd.)
• Original Assignee: IHS Global Incorporated (Markit Group Ltd.)
• Inventors: Tsourikov, Valery, Sovpel, Igor, Batchilo, Leonid
• Application Number:
  US09/815,260
• Publication Number:
  US 20020010574A1
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 40/211 Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars
• CPC Class Codes: G06F 40/216 using statistical methods

Abstract

In a digital computer, the method of processing a natural language expression entered or downloaded to the computer that includes (1) identifying in the expression expanded subject, action, object components that includes at least four components, subject, action, object (SAO) components and at least one additional component from the class of preposition, indirect object, adjective, and adverbial eSAO components (2) extracting each of the at least four components for designation into a respective subject, action, object field and at least a preposition field, indirect object field, adjective field, and adverbial field, and (3) using the components in at least certain ones of said fields for at least one of (i) displaying components to the user, (ii) forming a search pattern of a user request for information search of local or on-line databases, and (iii) forming an eSAO knowledge base. A constraint field can also be provided to accept non-classified components.

Claims

1. In a digital computer, the method of processing a natural language expression entered or downloaded to the computer comprising:

identifying in the expression expanded subject, action, object (eSAO) components comprising at least four components including subject, action, object components and at least one additional component from the class of preposition component, indirect object component, adjective component, and adverbial component, and

extracting each of said at least four components for designation into a respective subject, action, object field and at least one respective field from the class of preposition field, indirect object field, adjective field, and adverbial field, and

using the components in at least certain ones of said fields for at least one of (i) component display to the user, (ii) forming a search pattern of a user request for information search of local or on-line databases, and (iii) forming an eSAO knowledge base.

2. In the method of claim 1 wherein,

the expression comprises a user request for information search, said method further comprising classifying the expression into at least one category from the class that includes bit sentence, statement sentence, question sentence, and complex query, and

simplifying the user request search pattern by applying rules in accordance with the respective expression category.

3. In the method of claim 2 wherein,

the rules include transforming a question sentence rules according to

1 2 3 4 5→

3 2 4 1 5

or

1 2 3 4 5→

3 2 4 5 1

wherein

1<

wh-group>

2<

First Verbal Group>

3NG (Noun Group)4<

Second Verbal Group>

5TL (tail)

4. The method of claim 1 wherein,

the expression comprises a sentence of a document download to the computer and wherein said process comprises using the components for forming an indexed eSAO knowledge base entry, and

selecting the eSAO entry for display of the eSAO components, or of the source expression that includes the eSAO components, in response to a user request that includes at least a subset of the expression eSAO components.

5. The method of claim 1 wherein,

the expression includes constraint components that includes components that are not classified in any other component type,

said extracting step, further includes extracting constraint components for designation into a constraint field, and

said using step further includes using the components in at least certain ones of said fields for at least one of (i) component display to the user, (ii) forming a search pattern of a user request for information search of local or on-line databases, and (iii) forming an eSAO knowledge base.

6. The method of claim 5 wherein,

the object field includes an object component field segment and an attribute field segment.

7. The method of claim 6 said method further comprising

forming a less relevant user request search pattern by deleting one or more components from the constraint field or one or more attributes from the object field.

8. The method of claim 4 wherein,

the expression comprises part of a downloaded document, said method further classifying the expression into at least one category from the class that includes bit sentence, statement sentence, question sentence.

9. The method of claim 8 wherein,

the expression includes a question sentence and transforming the sentence according to the rule

1 2 3 4 5→

3 2 4 1 5

or

1 2 3 4 5→

3 2 4 5 1

wherein

6<

wh-group>

7<

First Verbal Group>

8NC (Noun Group)9<

Second Verbal Group>

10TL (tail)

10. The method of claim 8 said method comprising,

processing all of the natural language expressions from a plurality of downloaded documents into an eSAO Knowledge Base.

11. The method of claim 10 said method further comprising,

providing communication access to said eSAO knowledge base by a plurality of user computers, processing natural language user requests into eSAO search patterns and conveying to respective users expressions and source document links for respective expression whose eSAO field components substantially match the eSAO components of the respective user requests.