METHOD AND SYSTEM FOR AUTOMATING TRAINING OF NAMED ENTITY RECOGNITION IN NATURAL LANGUAGE PROCESSING

• US 20180075013A1
• Filed: 03/29/2017
• Published: 03/15/2018
• Est. Priority Date: 09/15/2016
• Status: Active Grant

• Current Assignee: Infosys Limited
• Original Assignee: Infosys Limited
• Inventors: Razack, Abdul, Dasgupta, Sudipto, Rao, Mayoor, Kuriakose, John
• Granted Patent: US 10,558,754 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 40/295 Named entity recognition
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition

Abstract

A method and system automates training named entity recognition in natural language processing to build configurable entity definitions includes receiving input documents or entities through an administration module and defining a domain for each entity. Further, one or more entities corresponding to the domain specific entity in the received documents are determined and a training file to one of pick a right parser, extract content and label the entity ambiguity is generated. One or more user actions are collected and maintained at a repository through a knowledge engine. Still further, one or more labelled ambiguous words are predicted and the knowledge engine is updated. Data may be fetched, through a training pipeline execution engine and each entity may be associated with one or more documents based on the fetched data from the document store to build configurable entity definitions.

Claims

1. A method to automate training named entity recognition in natural language processing to build configurable entity definitions, the method comprising:

receiving at least one input document or one or more entities through an administration module;

defining a domain for each of the received entities or the at least one input document through the administration module;

determining one or more entities corresponding to a domain specific entity in the at least one input document;

generating a training file to at least one of pick a right parser, extract content and label entity ambiguity;

collecting and maintaining, through a knowledge engine, at least one user action in a repository;

predicting, through the knowledge engine, one or more labelled ambiguous words;

updating the knowledge engine through the collected at least one user action;

fetching, through a training pipeline execution engine, data stored on a document store; and

associating, through the training pipeline execution engine, each entity with one or more documents based on the fetched data from the document store to build configurable entity definitions.

2. The method of claim 1,

wherein the entities are defined in a knowledge repository;

and

wherein a trained model generated through the training file.

3. The method of claim 1, wherein the knowledge repository comprises an ontology knowledge base.

4. The method claim 1, wherein the entities are ranked through a relevance score.

5. The method of claim 1, wherein:

the user action is collected through a user interface associated with at least one of a web and mobile application; and

user action is a resolution of ambiguity.

6. The method of claim 1, wherein the knowledge engine is updated at pre-defined intervals.

7. A system to automate training named entity recognition in natural language processing to build configurable entity definitions comprising:

a cluster computing network with one or more communicatively coupled nodes;

a high throughput distributed messaging system;

a distributed data warehouse;

a data processing engine;

an analytical engine;

at least one processor; and

at least one memory unit operatively coupled to at least one processor communicatively coupled over the cluster computing network and having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to;

receive at least one input document or entity through an administration module associated with the high throughput distributed messaging system;

define a domain for each of the received entity or the at least one input document through the administration module in a document set;

determine one or more entities, through the data processing engine, corresponding to a domain specific entity in the document set;

generate, through the analytical engine, a training file to at least one of pick a right parser, extract content and label an entity ambiguity;

collect and maintain, through a knowledge engine associated with the distributed data warehouse, at least one user action in a repository;

predict, through the knowledge engine and the analytical engine, one or more labelled ambiguous words;

update, through the cluster computing network, the knowledge engine through the collected at least one user action;

fetch, through a training pipeline execution engine, data stored on a document store; and

associate, through the training pipeline execution engine, each entity with one or more documents based on a trained model generated through the training file and the fetched data from the document store to build configurable entity definitions.

8. The system of claim 7, wherein the entities are defined in a knowledge repository.

9. The system of claim 8, wherein the knowledge repository is an ontology knowledge base.

10. The system of claim 7, wherein the entities are ranked through a relevance score.

11. The system of claim 7, wherein the user action is collected through a user interface associated with at least one of a web and mobile application.

12. The system of claim 7, wherein the knowledge engine is updated at pre-defined intervals.

13. The system of claim 7, wherein the cluster computing network is associated with a varying number of nodes.

14. The system of claim 7, wherein the user action comprises resolution of one or more ambiguities associated with the labelled ambiguous words.

15. One or more machine-readable media comprising machine-executable instructions causing a machine to perform a method automating training named entity recognition in natural language processing to process configurable named entity definitions defining respective defined named entities, the method comprising:

receiving one or more input documents and the named entity definitions, wherein the named entity definitions specify defined named entities as named people, named places, or named things and the input documents comprise unclassified occurrences of the named entities;

receiving specific domain definitions of specific domains for classifying the named entities;

in the input documents, identifying a named entity as a named entity ambiguity, wherein the identifying comprises determining that the named entity belongs to any one of a plurality of candidate domains out of the specific domains;

generating a training file to pick to a right parser, extract content or label the named entity ambiguity;

collecting a resolution of the named entity ambiguity for the named entity ambiguity, wherein the resolution indicates a particular one of the candidate domains;

sending the collected resolution of the named entity ambiguity, the named entity ambiguity, and context for the named entity ambiguity to a knowledge engine for incorporation into the configurable named entity definitions;

storing the collected resolution of the named entity ambiguity and incorporating the collected resolution of the named entity into the configurable named entity definitions; and

after incorporating the collected resolution into the configurable named entity definitions, predicting, through the knowledge engine, a correct classification of an unclassified named entity in the input documents.

16. The one or more machine-readable media of claim 15, wherein defining specific domains for the entities is based on a received input of one or more domains associated with the one or more entity definitions or a domain definition document associated with the administration module.

17. The one or more machine-readable media of claim 15, wherein collecting a resolution of the named entity ambiguity comprises:

displaying a plurality of confirmation blocks containing excerpts appearing in the document, wherein the excerpts contain an unclassified, ambiguous named entity associated with the named entity ambiguity and surrounding text as the text appears in an input document;

displaying a proposed specific domain out of the defined domains for the plurality of excerpts, wherein a single proposed specific domain is displayed for more than one of the excerpts;

within the confirmation blocks, displaying user interface elements for confirmation or rejection of the excerpt as belonging to the proposed specific domain; and

receiving activation of one user interface element of the user interface elements, thereby indicating that the text in the excerpt does or does not belong to the single proposed specific domain.