User-defined automated document feature extraction and optimization

• US 10,762,142 B2
• Filed: 04/29/2019
• Issued: 09/01/2020
• Est. Priority Date: 03/16/2018
• Status: Active Grant

• Current Assignee: Open Text Holdings, Inc. (Open Text Corporation)
• Original Assignee: Open Text Holdings, Inc. (Open Text Corporation)
• Inventors: Puzicha, Jan, Stadermann, Jan, Muppala, Chaitanya, Yanamandra, Sangeetha, Deshpande, Ketan
• Primary Examiner(s): Baderman, Scott T
• Assistant Examiner(s): Velez-Lopez, Mario M
• Application Number:
  US16/398,261
• Publication Number:
  US 20190286668A1
• Time in Patent Office: 491 Days
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

Provided herein are systems and methods for user-defined automated document feature modeling, extraction and optimization. In the present disclosure, an end user of an automated document review system can customize and create new extractor taggers within data models applicable to a set of focus documents. The user-defined edits to the extractor taggers can be further tested in a staging environment, and tested against a ground truth set of documents, before being widely applied to other relevant documents.

Claims

1. A computer-implemented method for optimizing automated document feature extraction, the method comprising:

providing a user with a graphical user interface to edit at least one field within a set of focus documents and simultaneously view at least one document from the set of focus documents;

receiving an edit from the user, via the graphical user interface, to one or more extractor taggers applicable to the at least one field within the set of focus documents;

updating a staging environment for an automated document feature extraction system;

performing automated document feature extraction in the staging environment on the set of focus documents;

verifying that the automated document feature extraction utilizing the edited one or more extractor taggers passes a quality check on the set of focus documents; and

updating the automated document feature extraction system with the edited one or more extractor taggers to enhance automated document feature extraction within the set of focus documents and a second set of additional documents.

2. The method of claim 1, further comprising:

verifying that the automated document feature extraction utilizing the edited one or more extractor taggers passes a quality check on a ground truth set of documents.

3. The method of claim 1, wherein the received edit from the user to the one or more extractor taggers is a creation of a new extractor tagger applicable to the at least one field within the set of focus documents.

4. The method of claim 1, wherein the received edit from the user to the one or more extractor taggers is a modification of an extractor tagger applicable to the at least one field within the set of focus documents.

5. The method of claim 1, wherein the received edit from the user to the one or more extractor taggers is a deletion of an extractor tagger applicable to the at least one field within the set of focus documents.

6. The method of claim 1, wherein the received edit from the user to the one or more extractor taggers is a reordering of at least two extractor taggers applicable to the at least one field within the set of focus documents.

7. A computer-implemented method for optimizing automated document feature extraction, the method comprising:

providing a user with a graphical user interface to edit at least one field within a set of focus documents and simultaneously view at least one document from the set of focus documents;

receiving an edit from the user, via the graphical user interface, to one or more extractor taggers applicable to the at least one field within the set of focus documents;

updating a staging environment for an automated document feature extraction system;

performing automated document feature extraction in the staging environment on the set of focus documents;

verifying whether the automated document feature extraction utilizing the edited one or more extractor taggers passes a quality check on the set of focus documents; and

updating at least one data model within the automated document feature extraction system with the edited one or more extractor taggers to enhance automated document feature extraction within the set of focus documents and a second set of additional documents.

8. The method of claim 7, further comprising:

verifying that the automated document feature extraction utilizing the edited one or more extractor taggers passes a quality check on a ground truth set of documents.

9. The method of claim 7, wherein the received edit from the user to the one or more extractor taggers is a reordering of at least two extractor taggers.

10. The method of claim 7, wherein the received edit from the user to the one or more extractor taggers is a creation of a new extractor tagger.

11. The method of claim 7, wherein the received edit from the user to the one or more extractor taggers is a modification or deletion of one or more existing extractor taggers.

12. The method of claim 7, further comprising:

displaying to the user, via the graphical user interface, an amount of substitutions, deletions, and insertions made by the automated document feature extraction system as a result of the at least one updated data model.

13. A system, comprising:

a processor; and

a memory for storing executable instructions, the processor executing the instructions to;

provide a user with a graphical user interface to edit at least one field within a set of focus documents and simultaneously view at least one document from the set of focus documents;

receive an edit from the user, via the graphical user interface, to one or more extractor taggers applicable to the at least one field within the set of focus documents;

update a staging environment for an automated document feature extraction system;

perform automated document feature extraction in the staging environment on the set of focus documents;

verify that the automated document feature extraction utilizing the edited one or more extractor taggers passes a quality check on the set of focus documents; and

publish the edited one or more extractor taggers in an updated data model within the automated document feature extraction system to enhance automated document feature extraction within the set of focus documents and a second set of additional documents.

14. The system of claim 13, wherein the processor further executes the instructions to:

verify that the automated document feature extraction utilizing the edited one or more extractor taggers passes a quality check on a ground truth set of documents.

15. The system of claim 13, wherein the received edit from the user to the one or more extractor taggers is a creation of a new extractor tagger applicable to the at least one field within the set of focus documents.

16. The system of claim 13, wherein the received edit from the user to the one or more extractor taggers is a modification of an extractor tagger applicable to the at least one field within the set of focus documents.

17. The system of claim 13, wherein the received edit from the user to the one or more extractor taggers is a deletion of an extractor tagger applicable to the at least one field within the set of focus documents.

18. The system of claim 13, wherein the received edit from the user to the one or more extractor taggers is a reordering of at least two extractor taggers applicable to the at least one field within the set of focus documents.

19. The system of claim 13, wherein the processor further executes the instructions to:

display to the user, via the graphical user interface, an amount of substitutions, deletions, and insertions made by the automated document feature extraction system as a result of the updated data model.

20. The system of claim 13, wherein the processor further executes the instructions to:

export a report from the automated document feature extraction system to a second user, the report comprising information regarding specified fields within the updated data model.