INCREMENTAL DYNAMIC DOCUMENT INDEX GENERATION

• US 20140046949A1
• Filed: 08/07/2012
• Published: 02/13/2014
• Est. Priority Date: 08/07/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bloomfield, Neil G.
• Granted Patent: US 9,218,411 B2
• Time in Patent Office: Days
• US Class Current: 707/741
• CPC Class Codes: G06F 16/2272 Management thereof
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

New text associated with an updated document is compared with existing embedded index items within the updated document and with existing contextual text within the updated document associated with the existing embedded index items. A determination is made as to whether any of the new text includes candidate text for at least one new index item that is not already indexed within the existing embedded index items using a contextual index compendium including contextual index item generation rules and the existing contextual text within the updated document associated with the existing embedded index items. At least one new index item is generated, using the contextual index item generation rules, in response to determining that at least one portion of the new text includes the candidate text that is not already indexed within the existing embedded index items.

Claims

1. A method, comprising:

comparing, via a processor, new text associated with an updated document with existing embedded index items within the updated document and with existing contextual text within the updated document associated with the existing embedded index items;

determining, using a contextual index compendium comprising contextual index item generation rules and the existing contextual text within the updated document associated with the existing embedded index items, whether any of the new text comprises candidate text for at least one new index item that is not already indexed within the existing embedded index items; and

generating, using the contextual index item generation rules, the at least one new index item in response to determining that at least one portion of the new text comprises the candidate text that is not already indexed within the existing embedded index items.

2. The method of claim 1, where generating, using the contextual index item generation rules, the at least one new index item in response to determining that the at least one portion of the new text comprises the candidate text that is not already indexed within the existing embedded index items comprises:

analyzing the new text within the updated document;

determining whether at least one contextual index item generation rule exists within the contextual index compendium to transform the new text into the at least one new index item; and

in response to determining that the at least one contextual index item generation rule exists within the contextual index compendium to transform the new text into the at least one new index item;

creating the at least one new index item using the at least one existing contextual index item generation rule.

3. The method of claim 2, further comprising, in response to determining that the at least one contextual index item generation rule does not exist within the contextual index compendium to transform the new text into the at least one new index item:

creating at least one new contextual index item generation rule that transforms the new text into the at least one new index item using contextual information within the new text;

adding the at least one new contextual index item generation rule to the contextual index compendium; and

creating the at least one new index item using the at least one new contextual index item generation rule.

4. The method of claim 1, further comprising embedding the at least one new index item as a new embedded index item into the updated document.

5. The method of claim 1, further comprising:

deriving the contextual index item generation rules using the existing embedded index items within the updated document and the existing contextual text within the updated document associated with the existing embedded index items; and

creating the contextual index compendium using the derived contextual index item generation rules.

6. The method of claim 1, further comprising:

processing the existing embedded index items within the updated document using the contextual index item generation rules within the contextual index compendium, where the contextual index item generation rules are configured to perform consistency checks among the existing embedded index items;

prompting, in response to identifying at least one inconsistent embedded index item, a user with the at least one identified inconsistent embedded index item, contextual text within the updated document associated with the identified inconsistent embedded index item, and at least one contextual index item generation rule that transforms the associated contextual text within the updated document to the at least one identified inconsistent embedded index item;

receiving at least one of an updated index item from the user and an updated contextual index item generation rule that transforms the at least one identified inconsistent index item from the contextual text within the updated document to the at least one updated index item;

updating the at least one identified inconsistent embedded index item to the at least one updated index item; and

updating the at least one contextual index item generation rule to the at least one updated contextual index item generation rule within the contextual index compendium.

7. The method of claim 1, further comprising:

processing the updated document and the existing embedded index items within the updated document to determine an index density per text quantity within the updated document;

determining, within the updated document based upon at least one contextual index item generation rule, that an index density deviation from a configured target index density exists within the updated document;

determining, using the at least one contextual index item generation rule, whether contextual text usable to create at least one suitable index item exists within text of the updated document associated with the determined index density deviation from the configured target index density;

transforming, in response to determining that the contextual text usable to create the at least one suitable index item exists within the text of the updated document associated with the determined index density deviation from the configured target index density, the contextual text into at least one additional index item using the second contextual index item generation rule; and

embedding the at least one additional index item into the updated document in association with the contextual text from which the at least one additional index item was transformed.

8. A system, comprising:

a memory; and

a processor programmed to;

compare new text associated with an updated document with existing embedded index items within the updated document and with existing contextual text within the updated document associated with the existing embedded index items;

determine, using a contextual index compendium stored within the memory comprising contextual index item generation rules and the existing contextual text within the updated document associated with the existing embedded index items, whether any of the new text comprises candidate text for at least one new index item that is not already indexed within the existing embedded index items; and

generate, using the contextual index item generation rules, the at least one new index item in response to determining that at least one portion of the new text comprises the candidate text that is not already indexed within the existing embedded index items.

9. The system of claim 8, where in being programmed to generate, using the contextual index item generation rules, the at least one new index item in response to determining that the at least one portion of the new text comprises the candidate text that is not already indexed within the existing embedded index items, the processor is programmed to:

analyze the new text within the updated document;

determine whether at least one contextual index item generation rule exists within the contextual index compendium to transform the new text into the at least one new index item;

in response to determining that the at least one contextual index item generation rule exists within the contextual index compendium to transform the new text into the at least one new index item;

create the at least one new index item using the at least one existing contextual index item generation rule; and

in response to determining that the at least one contextual index item generation rule does not exist within the contextual index compendium to transform the new text into the at least one new index item;

create at least one new contextual index item generation rule that transforms the new text into the at least one new index item using contextual information within the new text;

add the at least one new contextual index item generation rule to the contextual index compendium; and

create the at least one new index item using the at least one new contextual index item generation rule.

10. The system of claim 8, where the processor is further programmed to embed the at least one new index item as a new embedded index item into the updated document.

11. The system of claim 8, where the processor is further programmed to:

derive the contextual index item generation rules using the existing embedded index items within the updated document and the existing contextual text within the updated document associated with the existing embedded index items; and

create the contextual index compendium using the derived contextual index item generation rules.

12. The system of claim 8, where the processor is further programmed to:

process the existing embedded index items within the updated document using the contextual index item generation rules within the contextual index compendium, where the contextual index item generation rules are configured to perform consistency checks among the existing embedded index items;

prompt, in response to identifying at least one inconsistent embedded index item, a user with the at least one identified inconsistent embedded index item, contextual text within the updated document associated with the identified inconsistent embedded index item, and at least one contextual index item generation rule that transforms the associated contextual text within the updated document to the at least one identified inconsistent embedded index item;

receive at least one of an updated index item from the user and an updated contextual index item generation rule that transforms the at least one identified inconsistent index item from the contextual text within the updated document to the at least one updated index item;

update the at least one identified inconsistent embedded index item to the at least one updated index item; and

update the at least one contextual index item generation rule to the at least one updated contextual index item generation rule within the contextual index compendium.

13. The system of claim 8, where the processor is further programmed to:

process the updated document and the existing embedded index items within the updated document to determine an index density per text quantity within the updated document;

determine, within the updated document based upon at least one contextual index item generation rule, that an index density deviation from a configured target index density exists within the updated document;

determine, using the at least one contextual index item generation rule, whether contextual text usable to create at least one suitable index item exists within text of the updated document associated with the determined index density deviation from the configured target index density;

transform, in response to determining that the contextual text usable to create the at least one suitable index item exists within the text of the updated document associated with the determined index density deviation from the configured target index density, the contextual text into at least one additional index item using the second contextual index item generation rule; and

embed the at least one additional index item into the updated document in association with the contextual text from which the at least one additional index item was transformed.

14. A computer program product, comprising:

a computer readable storage medium having computer readable program code embodied therewith, where the computer readable program code when executed on a computer causes the computer to;

compare new text associated with an updated document with existing embedded index items within the updated document and with existing contextual text within the updated document associated with the existing embedded index items;

determine, using a contextual index compendium comprising contextual index item generation rules and the existing contextual text within the updated document associated with the existing embedded index items, whether any of the new text comprises candidate text for at least one new index item that is not already indexed within the existing embedded index items; and

generate, using the contextual index item generation rules, the at least one new index item in response to determining that at least one portion of the new text comprises the candidate text that is not already indexed within the existing embedded index items.

15. The computer program product of claim 14, where in causing the computer to generate, using the contextual index item generation rules, the at least one new index item in response to determining that the at least one portion of the new text comprises the candidate text that is not already indexed within the existing embedded index items, the computer readable program code when executed on the computer causes the computer to:

analyze the new text within the updated document;

determine whether at least one contextual index item generation rule exists within the contextual index compendium to transform the new text into the at least one new index item; and

in response to determining that the at least one contextual index item generation rule exists within the contextual index compendium to transform the new text into the at least one new index item;

create the at least one new index item using the at least one existing contextual index item generation rule.

16. The computer program product of claim 15, where the computer readable program code when executed on the computer further causes the computer to, in response to determining that the at least one contextual index item generation rule does not exist within the contextual index compendium to transform the new text into the at least one new index item:

create at least one new contextual index item generation rule that transforms the new text into the at least one new index item using contextual information within the new text;

add the at least one new contextual index item generation rule to the contextual index compendium; and

create the at least one new index item using the at least one new contextual index item generation rule.

17. The computer program product of claim 14, where the computer readable program code when executed on the computer further causes the computer to embed the at least one new index item as a new embedded index item into the updated document.

18. The computer program product of claim 14, where the computer readable program code when executed on the computer further causes the computer to:

derive the contextual index item generation rules using the existing embedded index items within the updated document and the existing contextual text within the updated document associated with the existing embedded index items; and

create the contextual index compendium using the derived contextual index item generation rules.

19. The computer program product of claim 14, where the computer readable program code when executed on the computer further causes the computer to:

process the existing embedded index items within the updated document using the contextual index item generation rules within the contextual index compendium, where the contextual index item generation rules are configured to perform consistency checks among the existing embedded index items;

prompt, in response to identifying at least one inconsistent embedded index item, a user with the at least one identified inconsistent embedded index item, contextual text within the updated document associated with the identified inconsistent embedded index item, and at least one contextual index item generation rule that transforms the associated contextual text within the updated document to the at least one identified inconsistent embedded index item;

receive at least one of an updated index item from the user and an updated contextual index item generation rule that transforms the at least one identified inconsistent index item from the contextual text within the updated document to the at least one updated index item;

update the at least one identified inconsistent embedded index item to the at least one updated index item; and

update the at least one contextual index item generation rule to the at least one updated contextual index item generation rule within the contextual index compendium.

20. The computer program product of claim 14, where the computer readable program code when executed on the computer further causes the computer to:

process the updated document and the existing embedded index items within the updated document to determine an index density per text quantity within the updated document;

determine, within the updated document based upon at least one contextual index item generation rule, that an index density deviation from a configured target index density exists within the updated document;

determine, using the at least one contextual index item generation rule, whether contextual text usable to create at least one suitable index item exists within text of the updated document associated with the determined index density deviation from the configured target index density;

transform, in response to determining that the contextual text usable to create the at least one suitable index item exists within the text of the updated document associated with the determined index density deviation from the configured target index density, the contextual text into at least one additional index item using the second contextual index item generation rule; and

embed the at least one additional index item into the updated document in association with the contextual text from which the at least one additional index item was transformed.