Information extraction in a natural language understanding system

• US 8,521,511 B2
• Filed: 06/18/2007
• Issued: 08/27/2013
• Est. Priority Date: 06/18/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Balchandran, Rajesh, Boyer, Linda M., Purdy, Gregory
• Primary Examiner(s): ALBERTALLI, BRIAN LOUIS
• Application Number:
  US11/764,294
• Publication Number:
  US 20080310718A1
• Time in Patent Office: 2,262 Days
• Field of Search: None
• US Class Current: 704/9
• CPC Class Codes: G06F 40/216 using statistical methods
• CPC Class Codes: G06F 40/226 Validation
• CPC Class Codes: G06F 40/295 Named entity recognition
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30

Abstract

A method of extracting information from text within a natural language understanding system can include processing a text input through at least one statistical model for each of a plurality of features to be extracted from the text input. For each feature, at least one value can be determined, at least in part, using the statistical model associated with the feature. One value for each feature can be combined to create a complex information target. The complex information target can be output.

Claims

1. A method of extracting information from text within a natural language understanding system, comprising:

parsing a text input to extract a plurality of features from the text input;

processing each of the plurality of features through a plurality of statistical models to obtain at least one value;

combining, via a processor, one value for each of the plurality of features to create a complex information target;

outputting the complex information target;

comparing the complex information target with a list of predicted complex information targets, wherein each predicted complex information target is associated with an expected complex information target; and

mapping, upon the complex information target matching a predicted complex information target, the complex information target to the expected complex information target associated with the matched predicted complex information target, wherein

the complex information target indicates a meaning for the text input.

2. The method of claim 1, wherein

the plurality of statistical models output a plurality of candidate values for a particular feature,

a value having a highest confidence score is selected, for the particular feature, from the plurality of candidate values, and

the value having the highest confidence score is the one value, for the particular feature, used to create the complex information target.

3. The method of claim 1, further comprising:

searching the text input for at least one named entity; and

determining a value for a feature according to the at least one named entity located within the text input.

4. The method of claim 1, further comprising:

determining a value for a first feature in the text input; and

selecting one of the plurality of statistical models based upon the value determined for the first feature.

5. The method of claim 4, wherein

the selected statistical model is built using a subset of the plurality of features that correspond to the determined value for the first feature.

6. The method of claim 1, further comprising:

comparing the complex information target with a plurality of allowable complex information targets; and

determining whether the complex information target is allowable according to the comparison with the plurality of allowable complex information targets.

7. The method of claim 6, further comprising,

selecting an alternate value for at least one feature of the complex information target from a plurality of candidate values based upon a confidence score.

8. The method of claim 7, wherein

the alternate value conforms to an allowable complex information target.

9. A computer program product, comprising:

a computer-readable storage having stored therein computer-usable program code that extracts information from text within a natural language understanding system, the computer-readable storage comprising;

computer-usable program code that parses a text input to extract a plurality of features from the text input;

computer-usable program code that processes each of the plurality of features through a plurality of statistical models to obtain at least one value;

computer-usable program code that combines one value for each of the plurality of features to create a complex information target;

computer-usable program code that outputs the complex information target;

computer-usable program code that compares the complex information target with a list of predicted complex information targets, wherein each predicted complex information target is associated with an expected complex information target; and

computer-usable program code that maps, upon the complex information target matching a predicted complex information target, the complex information target to the expected complex information target associated with the matched predicted complex information target, wherein

the complex information target indicates a meaning for the text input.

10. The computer program product of claim 9, wherein

the plurality of statistical models output a plurality of candidate values for a particular feature,

a value having a highest confidence score is selected, for the particular feature, from the plurality of candidate values, and

the value having the highest confidence score is the one value, for the particular feature, used to create the complex information target.

11. The computer program product of claim 9, wherein the computer-readable storage further comprises:

computer-usable program code that searches the text input for at least one named entity; and

computer-usable program code that determines a value for a feature according to the at least one named entity located within the text input.

12. The computer program product of claim 9, wherein the computer-readable storage further comprises:

computer-usable program code that determines a value for a first feature in the text input; and

computer-usable program code that selects one of the plurality of statistical models based upon the value determined for the first feature.

13. The computer program product of claim 9, wherein the computer-readable storage further comprises:

computer-usable program code that compares the complex information target with a plurality of allowable complex information targets; and

computer-usable program code that determines whether the complex information target is valid according to the comparison with the plurality of allowable complex information targets.

14. The computer program product of claim 13, wherein the computer-readable storage further comprises:

computer-usable program code that selects an alternate value for at least one feature of the complex information target from a plurality of candidate values based upon a confidence score; and

the alternate value conforms to an allowable complex information target.