Rule based apparatus for modifying word annotations

• US 8,433,560 B2
• Filed: 04/01/2009
• Issued: 04/30/2013
• Est. Priority Date: 04/01/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Luke, James Steven
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): SPOONER, LAMONT M
• Application Number:
  US12/416,612
• Publication Number:
  US 20090248400A1
• Time in Patent Office: 1,490 Days
• Field of Search: 704/1, 704/9, 704/10, 707706-708
• US Class Current: 704/9
• CPC Class Codes: G06F 16/36 Creation of semantic tools, e.g. ontology or thesauri
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06N 5/025 Extracting rules from data

Abstract

A rule based apparatus and method for modifying word annotations in an annotated text base is described. The apparatus includes an index creator component for creating an index of word annotations. An annotations modifying component for modifying word annotations, and a retriggering component, responsive to said annotations modifying component, for retriggering a rules engine to modify all occurrences of a matching word annotation in said annotated text base and updating the index of word annotations with the modified occurrences of a matching word annotation in said annotated text base.

Claims

1. A rule based apparatus for modifying annotations in an annotated text base comprising a plurality of documents, the apparatus comprising:

an index creator component that;

creates an annotation array that indexes annotations assigned to terms in the annotated text base, the annotation array comprising annotations and references for each annotation from the annotated text base; and

creates an index that indexes the annotated terms in the annotated text base, the index comprising a list of all words in the annotated text base and for each word, the assigned annotation and a list of references;

an annotations modifying component that modifies annotations in response to implementing rules;

a retriggering component, responsive to said annotations modifying component modifying a select annotation to an updated annotation, that retriggers a rules engine to;

modify all annotation occurrences in the index that match the select annotation, to the updated annotation; and

update the annotation array with a reference to the modified occurrences of the select annotation in the annotated text base.

2. A rule based apparatus as claimed in claim 1 further comprises a tokenizing component that identifies terms including a word, a number or a punctuation marks associated with a document to be stored in the annotated text base.

3. A rule based apparatus as claimed in claim 2 wherein the tokenizing component on identifying a word, a number or a punctuation mark creates a reference to the identified word, number or punctuation mark in the created annotation array.

4. A rule based apparatus as claimed in claim 1 wherein the index creator component further comprises checking in the index to determine if there is already stored a reference to a word in the annotated text base.

5. A rule based apparatus as claimed in claim 4 wherein responsive to a positive determination by the index creator component, the annotation modifying component modifies the annotation associated with the word in the annotated text base to the annotation associated with the determined reference.

6. A rule based apparatus as claimed in claim 1 further comprising:

an XML creator component that creates an XML representation of the index.

7. A rule based apparatus as claimed in claim 1, wherein the index creator component is further configured to:

perform a check function on the index in response to executing a dictionary rule, to determine whether there are any terms that match a word specified in dictionary rule; and

iterate through the index for all indexed terms that match the specified word in the dictionary rule to update the associated annotation.

8. A rule based apparatus as claimed in claim 1, wherein the index creator component is further configured to:

create a new index entry in response to processing a rule that results in no matches in the index.

9. A rule based apparatus as claimed in claim 8, wherein:

the index creator component adds a multi-word term to the index; and

the annotation modifying component is further configured to;

select the first word of the multi-word term;

use the index to determine whether any references exist for the first word in any registered documents of the annotated text base;

examine each located reference to determine whether the located term is part of a longer phrase that matches the multi-word term; and

updates the annotations array.

10. A rule based apparatus as claimed in claim 1, wherein:

the index further comprises count data that counts the number of references for each indexed term.

11. A computer-readable storage device with an executable program stored thereon, for modifying annotations in an annotated text base comprising a plurality of documents, wherein the program instructs a processor to perform:

creating, by the processor;

an annotation array that indexes annotations assigned to terms in the annotated text base, the annotation array comprising annotations and references for each annotation from the annotated text base; and

an index that indexes the annotated terms in the annotated text base, the index comprising a list of all words in the annotated text base and for each word, the assigned annotation and a list of references;

performing, by the processor, responsive to modifying a select annotation to an updated annotation;

modify all annotation occurrences in the index that match the select annotation, to the updated annotation; and

update the annotation array with a reference to the modified occurrences of the select annotation in the annotated text base.

12. The computer-readable storage device of claim 11 wherein the program further includes instructions for identifying terms including one of a word, a number or a punctuation mark associated with a document to be stored in the annotated text base.

13. The computer-readable storage device of claim 12 wherein identifying one of the word, the number or a punctuation mark creates a reference to the identified word, number or punctuation mark in the created annotations array.

14. The computer-readable storage device of claim 11 wherein the program further includes instructions for checking in the index to determine if there is already stored a reference to a word in the annotated text based.

15. The computer-readable storage device of claim 14 wherein responsive to a positive determination by the indexing step, the annotation modifying component modifies the annotation associated with the word in the annotated text base to the annotation associated with the determined reference.

16. The computer-readable storage device of claim 11 further comprising:

an XML creator component that creates an XML representation of the index.

17. The computer-readable storage device of claim 11, wherein the index creator component is further configured to:

perform a check function on the index in response to executing a dictionary rule, to determine whether there are any terms that match a word specified in dictionary rule; and

iterate through the index for all indexed terms that match the specified word in the dictionary rule to update the associated annotation.

18. The computer-readable storage device of claim 11, wherein the index creator component is further configured to:

create a new index entry in response to processing a rule that results in no matches in the index.

19. The computer-readable storage device of claim 18, wherein:

the index creator component adds a multi-word term to the index; and

the annotation modifying component is further configured to;

select the first word of the multi-word term;

use the index to determine whether any references exist for the first word in any registered documents of the annotated text base;

examine each located reference to determine whether the located term is part of a longer phrase that matches the multi-word term; and

updates the annotations array.

20. The computer-readable storage device of claim 11, wherein:

the index further comprises count data that counts the number of references for each indexed term.