SYSTEM AND METHOD FOR AUTOMATIC DOCUMENT CLASSIFICATION IN EDISCOVERY, COMPLIANCE AND LEGACY INFORMATION CLEAN-UP

• US 20140156567A1
• Filed: 12/04/2012
• Published: 06/05/2014
• Est. Priority Date: 12/04/2012
• Status: Active Grant

• Current Assignee: MSC Intellectual Properties BV
• Original Assignee: MSC Intellectual Properties BV
• Inventors: Scholtes, Johannes Cornelis
• Granted Patent: US 9,235,812 B2
• Time in Patent Office: Days
• US Class Current: 706/12
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/02 Knowledge representation; Symbolic representation

Abstract

A system, method and computer program product for automatic document classification, including an extraction module configured to extract structural, syntactical and/or semantic information from a document and normalize the extracted information; a machine learning module configured to generate a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and a classification module configured to select a non-classified document from a document collection, and via the extraction module extract normalized structural, syntactical and/or semantic information from the selected document, and generate via the machine learning module a model representation of the selected document based on feature vectors, and match the model representation of the selected document against the machine learning model representation to generate a document category, and/or classification for display to a user.

Claims

1. A computer implemented system for automatic document classification, the system comprising:

an extraction module configured to extract structural, syntactical and/or semantic information from a document and normalize the extracted information;

a machine learning module configured to generate a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and

a classification module configured to select a non-classified document from a document collection, and via the extraction module extract normalized structural, syntactical and/or semantic information from the selected document, and generate via the machine learning module a model representation of the selected document based on feature vectors, and match the model representation of the selected document against the machine learning model representation to generate a document category, and/or classification for display to a user.

2. The system of claim 1, wherein the extracted information includes named entities, properties of entities, noun-phrases, facts, events, and/or concepts.

3. The system of claim 1, wherein the extraction module employs text-mining, language identification, gazetteers, regular expressions, noun-phrase identification with part-of-speech taggers, and/or statistical models and rules, and is configured to identify patterns, and

the patterns include libraries, and/or algorithms shared among cases, and which can be tuned for a specific case, to generate case-specific semantic information.

4. The system of claim 1, wherein the extracted information is normalized by using normalization rules, groupers, thesauri, taxonomies, and/or string-matching algorithms.

5. The system of claim 1, wherein the model representation of the document is a TF-IDF document representation of the extracted information, and the clustering or machine learning includes a classifier based on decision trees, support vector machines (SVM), naï

ve-bayes classifiers, k-nearest neighbors, rules-based classification, Linear discriminant analysis (LDA), Maximum Entropy Markov Model (MEMM), scatter-gather clustering, and/or hierarchical agglomerate clustering (HAC).

6. A computer implemented method for automatic document classification, the method comprising:

extracting with an extraction module structural, syntactical and/or semantic information from a document and normalizing with the extraction module the extracted information;

generating with a machine learning module a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and

selecting with a classification module a non-classified document from a document collection, and extracting via the extraction module normalized structural, syntactical and/or semantic information from the selected document, and generating via the machine learning module a model representation of the selected document based on feature vectors, and matching with the classification module the model representation of the selected document against the machine learning model representation and generating with the classification module a document category, and/or classification for display to a user.

7. The method of claim 6, wherein the extracted information includes named entities, properties of entities, noun-phrases, facts, events, and/or concepts.

8. The method of claim 6, wherein the extraction module employs text-mining, language identification, gazetteers, regular expressions, noun-phrase identification with part-of-speech taggers, and/or statistical models and rules, and is configured to identify patterns, and

the patterns include libraries, and/or algorithms shared among cases, and which can be tuned for a specific case, to generate case-specific semantic information.

9. The method of claim 6, wherein the extracted information is normalized by using normalization rules, groupers, thesauri, taxonomies, and/or string-matching algorithms.

10. The method of claim 6, wherein the model representation of the document is a TF-IDF document representation of the extracted information, and the clustering or machine learning includes a classifier based on decision trees, support vector machines (SVM), naï

ve-bayes classifiers, k-nearest neighbors, rules-based classification, Linear discriminant analysis (LDA), Maximum Entropy Markov Model (MEMM), scatter-gather clustering, and/or hierarchical agglomerate clustering (HAC).

11. A computer program product for automatic document classification and including one or more computer readable instructions embedded on a tangible, non-transitory computer readable medium and configured to cause one or more computer processors to perform the steps of:

extracting with an extraction module structural, syntactical and/or semantic information from a document and normalizing with the extraction module the extracted information;

generating with a machine learning module a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and

selecting with a classification module a non-classified document from a document collection, and extracting via the extraction module normalized structural, syntactical and/or semantic information from the selected document, and generating via the machine learning module a model representation of the selected document based on feature vectors, and matching with the classification module the model representation of the selected document against the machine learning model representation and generating with the classification module a document category, and/or classification for display to a user.

12. The computer program product of claim 11, wherein the extracted information includes named entities, properties of entities, noun-phrases, facts, events, and/or concepts.

13. The computer program product of claim 11, wherein the extraction module employs text-mining, language identification, gazetteers, regular expressions, noun-phrase identification with part-of-speech taggers, and/or statistical models and rules, and is configured to identify patterns, and

the patterns include libraries, and/or algorithms shared among cases, and which can be tuned for a specific case, to generate case-specific semantic information.

14. The computer program product of claim 11, wherein the extracted information is normalized by using normalization rules, groupers, thesauri, taxonomies, and/or string-matching algorithms.

15. The computer program product of claim 11, wherein the model representation of the document is a TF-IDF document representation of the extracted information, and the clustering or machine learning includes a classifier based on decision trees, support vector machines (SVM), naï

ve-bayes classifiers, k-nearest neighbors, rules-based classification, Linear discriminant analysis (LDA), Maximum Entropy Markov Model (MEMM), scatter-gather clustering, and/or hierarchical agglomerate clustering (HAC).