SEMANTICALLY-DRIVEN EXTRACTION OF RELATIONS BETWEEN NAMED ENTITIES

• US 20100082331A1
• Filed: 09/30/2008
• Published: 04/01/2010
• Est. Priority Date: 09/30/2008
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Hagege, Caroline, Brun, Caroline
• Granted Patent: US 8,370,128 B2
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06F 40/295 Named entity recognition
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

A system and method of developing rules for text processing enable retrieval of instances of named entities in a predetermined semantic relation (such as the DATE and PLACE of an EVENT) by extracting patterns from text strings in which attested examples of named entities satisfying the semantic relation occur. The patterns are generalized to form rules which can be added to the existing rules of a syntactic parser and subsequently applied to text to find candidate instances of other named entities in the predetermined semantic relation.

Claims

1. A method of developing rules for text processing comprising:

identifying a semantic relation involving at least two named entities, each named entity being represented in the semantic relation by its class;

providing a set of example instances of combinations of named entities which satisfy the semantic relation;

retrieving text strings from text, each of the retrieved strings including at least two of the named entities of one of the example instances in the set;

extracting, from the retrieved text strings, syntactic patterns, each syntactic pattern involving at least two of the named entities of one of the example instances in the respective retrieved text string; and

generating generalized rules for text processing based on the extracted syntactic patterns, the rules being of a form for identifying candidate instances of the semantic relation in text.

2. The method of claim 1, wherein the extracting comprises parsing the retrieved text strings with a syntactic parser.

3. The method of claim 1, further comprising adding the generated rules to existing rules of a syntactic parser.

4. The method of claim 1, further comprising applying the generated rules to text to identify new example instances of named entities and repeating the retrieving, extracting, and generating steps using the new example instances.

5. The method of claim 1, wherein the classes are selected from the group consisting of PERSON, EVENT, DATE, ORGANIZATION, PLACE, ARTIFACT, MONETARY EXPRESSION, and subclasses thereof.

6. The method of claim 1, wherein the at least two named entities represented in the semantic relation are each represented by a different class.

7. The method of claim 6, wherein the classes are selected from DATE, PLACE, and EVENT and the semantic relation is selected from the group consisting of DATE-of-EVENT, PLACE-of-EVENT, DATE-and-PLACE-of EVENT.

8. The method of claim 1, wherein the providing of the set of example instances of named entities which satisfy the semantic relation include retrieving attested instances from a knowledge base.

9. The method of claim 1, wherein the retrieving of text strings from text comprises retrieving text strings in which the combination of named entities appear, regardless of any relationship between them.

10. The method of claim 1, wherein the extracting of each syntactic pattern includes identifying a set of dependencies, each of the dependencies involving at least one of the named entities of one of the example instances in the respective retrieved text string and combining at least some of the dependencies to form a pattern.

11. The method of claim 10, wherein the generating of the generalized rules includes replacing the named entity in each dependency with its corresponding class and optionally further includes normalizing other words in the dependencies.

12. The method of claim 1, wherein the generating of the generalized rules includes generating rules in the language of a syntactic parser configured for processing text.

13. The method of claim 1, further comprising applying the generated rules to text and labeling the text based on candidate instances of the semantic relation identified in the text.

14. The method of claim 1, further comprising using the new rules in information extraction to retrieve text which includes an instance of the semantic relation in response to the input of a selected named entity which is in one of the classes.

15. The method of claim 1, wherein the retrieving of text strings, extracting of syntactic patterns, and generating of rules are computer implemented.

16. A computer program product encoding instructions, which when executed on a computer provided with the example instances, causes the computer to perform the method of claim 1.

17. A system for developing rules for text processing comprising:

memory which stores instructions for performing the method of claim 1; and

a processor in communication with the memory which executes the instructions.

19. The system of claim 17, wherein the rules generator is configured for adding the generalized rules to the parser'"'"'s existing rules.

18. A system for developing rules for text processing comprising:

memory for storing a set of example instances of combinations of named entities which satisfy a semantic relation involving at least two named entities, wherein each named entity is represented in the semantic relation by its class;

a text retriever for retrieving text strings from text, each of the retrieved strings including at least two of the named entities of one of the example instances in the set;

a pattern extractor which extracts, from the retrieved text strings, syntactic patterns, each syntactic pattern involving at least two of the named entities of one of the example instances in the respective retrieved text string; and

a rules generator which generates generalized rules for text processing based on the extracted syntactic patterns.

20. A method of identifying candidate instances of at least one of a date of an event and a place of an event, comprising:

identifying attested instances of combinations of named entities which are the date and place of an event;

retrieving text strings from text, each of the retrieved strings including at least two of the named entities of one of the attested instances;

extracting, from the retrieved text strings, syntactic patterns, each syntactic pattern involving at least two of the named entities of one of the attested instances in the respective retrieved text string;

generating generalized rules for text processing based on the extracted syntactic patterns; and

applying the rules to text to identifying candidate instances of at least one of the date and the place of an event.