System And Method For Providing Default Hierarchical Training For Social Indexing

• US 20100191773A1
• Filed: 01/27/2009
• Published: 07/29/2010
• Est. Priority Date: 01/27/2009
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Stefik, Mark J., Mittal, Sanjay
• Granted Patent: US 8,356,044 B2
• Time in Patent Office: Days
• US Class Current: 707/797
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A system and method for providing default hierarchical training for social indexing is provided. Articles of digital information for social indexing are maintained. A hierarchically-structured tree of topics is specified. Each topic includes a label that includes one or more words. Constraints inherent in the literal structure of the topic tree are identified. For each topic in the topic tree, a topic model that includes at least one term derived from the words in at least one of the labels is created. The topic models for the topic tree are evaluated against the constraints. Those of the topic models, which best satisfy the constraints are identified.

Claims

1. A computer-implemented method for providing default hierarchical training for social indexing, comprising:

maintaining articles of digital information for social indexing;

specifying a hierarchically-structured tree of topics, which each comprise a label comprising one or more words;

identifying constraints inherent in the literal structure of the topic tree;

for each topic in the topic tree, creating a topic model that comprises at least one term derived from the words in at least one of the labels;

evaluating the topic models for the topic tree against the constraints; and

identifying those of the topic models, which best satisfy the constraints.

2. A method according to claim 1, further comprising:

defining the constraints to include immutable rules; and

disfavoring those topic models that violate one or more of the immutable rules.

3. A method according to claim 2, wherein the immutable rules comprise one or more of:

forming one such topic model comprising a single term comprised from a label that is duplicated within the topic tree;

forming one such topic model that includes no term from the label for the topic to which the topic model belongs; and

when the label is duplicated within the topic tree, forming one such topic model that includes no term from the label of a parent topic for the topic to which the topic model belongs.

4. A method according to claim 1, further comprising:

defining the constraints to include permissive rules; and

discounting those topic models that violate one or more of the permissive rules.

5. A method according to claim 4, wherein the permissive rules comprise one or more of:

forming one such topic model that includes no term from the label for the topic to which the topic model belongs that is not duplicated in any other label within the topic tree;

when the label is duplicated in another label within the topic tree, forming one such topic model that includes no non-duplicated term from the label of a parent topic for the topic to which the topic model belongs; and

when the label is duplicated in another label within the topic tree, forming one such topic model that includes a term from a label of a common ancestor topic for the topic to which the topic model belongs.

6. A method according to claim 1, further comprising:

counting the articles that are matched by each of the topic models; and

favoring those topic models proportionately matching a percentage of the articles closest to an ideal percentage.

7. A method according to claim 1, further comprising:

for each of the topic models, evaluating structural complexity, comprising one or more of;

favoring those topic models that include at least one n-gram;

favoring those topic models that include one or more non-duplicated terms; and

favoring those topic models that include at least one group of the terms in the labels.

8. A method according to claim 1, further comprising:

identifying the topic models that have been evaluated as equally satisfying the constraints; and

favoring the topic model that includes a bonus label comprising one of a matching single term pattern, conjunction of all of the terms in the label for the topic to which the topic model belongs, and an n-gram of all of the terms in the label for the topic to which the topic model belongs appearing in order.

9. A method according to claim 1, further comprising:

for each of the topic models, disfavoring those topic models with a count of the terms that is less than a count of the terms in the label for the topic to which the topic model belongs.

10. A method according to claim 1, wherein the at least one term comprises at least one of one of the terms in the labels, an n-gram comprised of a plurality of the terms in the labels, and a group of the terms in the labels.

11. A method according to claim 1, wherein each topic model comprises one of a conjunction and an n-gram, which are both comprised of the same terms as in the label for the topic to which the topic model belongs.

12. A method according to claim 1, further comprising:

deriving each term from a stemmed version of a word in one such label.

13. A computer-implemented system for providing default hierarchical training for social indexing, comprising:

an electronic database, comprising;

articles of digital information maintained for social indexing; and

a hierarchically-structured tree of topics, which each comprise a label comprising one or more words;

a processor and memory within which code for execution by the processor is stored, further comprising;

an electronically-stored rules set identifying constraints inherent in the literal structure of the topic tree;

a topic builder module that, for each topic in the topic tree, creates a topic model that comprises at least one term derived from the words in at least one of the labels; and

an evaluator module evaluating the topic models for the topic tree against the constraints; and

a user interface visually identifying those of the topic models, which best satisfy the constraints.

14. A system according to claim 13, wherein the constraints are defined to include immutable rules, and those topic models that violate one or more of the immutable rules are disfavored.

15. A system according to claim 14, wherein the immutable rules comprise one or more of:

one such topic model comprising a single term comprised from a label that is duplicated within the topic tree;

one such topic model that includes no term from the label for the topic to which the topic model belongs; and

one such topic model that includes no term from the label of a parent topic for the topic to which the topic model belongs when the label is duplicated within the topic tree.

16. A system according to claim 13, wherein the constraints are defined to include permissive rules, and those topic models that violate one or more of the permissive rules are discounted.

17. A system according to claim 16, wherein the permissive rules comprise one or more of:

one such topic model that includes no term from the label for the topic to which the topic model belongs that is not duplicated in any other label within the topic tree;

one such topic model that includes no non-duplicated term from the label of a parent topic for the topic to which the topic model belongs when the label is duplicated in another label within the topic tree; and

one such topic model that includes a term from a label of a common ancestor topic for the topic to which the topic model belongs when the label is duplicated in another label within the topic tree.

18. A system according to claim 13, wherein the processor and memory further comprise:

an article matching evaluation module counting the articles that are matched by each of the topic models, and favoring those topic models proportionately matching a percentage of the articles closest to an ideal percentage.

19. A system according to claim 13, wherein the processor and memory further comprise:

a structural complexity evaluation module evaluating structural complexity for each of the topic models, comprising one or more of favoring those topic models that include at least one n-gram, favoring those topic models that include one or more non-duplicated terms, and favoring those topic models that include at least one group of the terms in the labels.

20. A system according to claim 13, wherein the processor and memory further comprise:

a label evaluation module identifying the topic models that have been evaluated as equally satisfying the constraints, and favoring the topic model that includes a bonus label comprising one of a matching single term pattern, conjunction of all of the terms in the label for the topic to which the topic model belongs, and an n-gram of all of the terms in the label for the topic to which the topic model belongs appearing in order.

21. A system according to claim 13, wherein the processor and memory further comprise:

a term count evaluation module disfavoring, for each of the topic models, those topic models with a count of the terms that is less than a count of the terms in the label for the topic to which the topic model belongs.

22. A system according to claim 13, wherein the at least one term comprises at least one of one of the terms in the labels, an n-gram comprised of a plurality of the terms in the labels, and a group of the terms in the labels.

23. A system according to claim 13, wherein each topic model comprises one of a conjunction and an n-gram, which are both comprised of the same terms as in the label for the topic to which the topic model belongs.

24. A system according to claim 13, wherein the processor and memory further comprise:

a word stemming module deriving each term from a stemmed version of a word in one such label.