Interactive learning-based document annotation
First Claim
1. a document annotation system comprising:
- a graphical user interface for annotating documents;
an active learning component for training an annotation model and for proposing annotations to documents based on the annotation model; and
a request handler for conveying annotation requests from the graphical user interface to the active learning component and for conveying proposed annotations from the active learning component to the graphical user interface.
5 Assignments
0 Petitions
Accused Products
Abstract
A document annotation system 10 includes a graphical user interface 22 used by an annotator 30 to annotate documents. An active learning component 24 trains an annotation model and proposes annotations to documents based on the annotation model. A request handler 26, 32, 34, 42 conveys annotation requests from the graphical user interface 22 to the active learning component 24, conveys proposed annotations from the active learning component 24 to the graphical user interface 22, and selectably conveys evaluation requests from the graphical user interface 22 to a domain expert 40. During annotation, at least some low probability proposed annotations are presented to the annotator 30 by the graphical user interface 22. The presented low probability proposed annotations enhance training of the annotation model by the active learning component 24.
-
Citations
22 Claims
-
1. a document annotation system comprising:
-
a graphical user interface for annotating documents; an active learning component for training an annotation model and for proposing annotations to documents based on the annotation model; and a request handler for conveying annotation requests from the graphical user interface to the active learning component and for conveying proposed annotations from the active learning component to the graphical user interface. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A document annotation method comprising:
-
(i) annotating initially unannotated documents, the annotating including applying an active learning component to propose annotations based on an annotation model and accepting or rejecting the proposed annotations via a graphical user interface; (ii) training the annotation model by applying the active learning component to train or update training of the annotation model based on previous annotations generated by the annotating (i); and (iii) alternating between the annotating (i) and the training (ii) to concurrently train the annotation model and annotate the initially unannotated documents. - View Dependent Claims (16, 17, 18, 19)
-
-
20. A document annotation system comprising:
-
a graphical user interface for accepting or rejecting proposed document annotations; an active learning component for training an annotation model and for generating proposed document annotations based on the annotation model, and a request handler for (i) constructing evaluation requests including at least proposed document annotations and corresponding documents or links to corresponding documents, and (ii) conveying said evaluation requests to a human domain expert via an automated messaging pathway. - View Dependent Claims (21, 22)
-
Specification