Method for interactively creating an information database including preferred information elements, such as preferred-authority, world wide web pages

• US 6,356,899 B1
• Filed: 03/03/1999
• Issued: 03/12/2002
• Est. Priority Date: 08/29/1998
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ravikumar, Shanmugasundaram, Tomkins, Andrew, Dom, Byron Edward, Chakrabarti, Soumen, Rajagopalan, Sridhar, Raghavan, Prabhakar, Gibson, David Andrew
• Primary Examiner(s): Mizrahi, Diane D.
• Application Number:
  US09/261,926
• Time in Patent Office: 1,105 Days
• Field of Search: 707/1, 707/3, 707/4, 707/5, 707/104, 709/218, 709/219
• US Class Current: 707/737
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method for identifying, filtering, ranking and cataloging information elements; as for example, World Wide Web pages, of the Internet in whole, part, or in combination. The method is preferably implemented in computer software and features steps for enabling a user to interactively create an information database including preferred information elements such as preferred World Wide Web pages in whole, part, or in combination. The method includes steps for enabling a user to interactively create a frame-based, hierarchical organizational structure for the information elements, and steps for identifying and automatically filtering and ranking by relevance, information elements, such as World Wide Web pages for populating the structure, to form; for example, a searchable, World Wide Web page database. Additionally, the method features steps for enabling a user to interactively define a frame-based, hierarchical information structure for cataloging information, identifying a preliminary population of information elements for a particular hierarchical category arranged as a frame, based upon the respective frame attributes, and thereafter, expanding the information population to include related information, and subsequently, automatically filtering and ranking the information based upon relevance, and then populating the hierarchical structure with the a definable portion of the filtered, ranked information elements.

Claims

1. A method for cataloging and ranking information comprising the steps of:

a. enabling a user to interactively define a structure for cataloging information in one or more categories, each category having one or more attributes for defining the category;

b. selecting a category of the structure;

c. identifying a population of information elements for the selected category automatically based upon the respective category attributes;

d. ranking the information elements for the particular category automatically based upon relevance to category attributes; and

e. populating the selected category with ranked information elements.

2. The method of claim 1 further including filtering the information elements to improve ranking accuracy.

3. The method of claim 2 wherein filtering includes applying filtering at predetermined points during ranking.

4. The method of claim 3 wherein identifying information elements includes identifying links between information elements, and ranking information elements includes iteratively determining relevance of the information elements to the respective category attributes based upon the affinity between information elements, and wherein one or more sources of spurious effects arise during the determining of relevance which adversely affect ranking accuracy, and wherein filtering includes steps for diminishing one or more sources of spurious effects.

5. The method of claim 4 wherein the sources of spurious effects include self-promotion and filtering includes steps for diminishing the effects of self promotion.

6. The method of claim 5 wherein the filtering steps for diminishing the effects of self-promotion include discarding links from information elements of a first source of information elements to information elements of a second source of information elements, where the first information source and the second information source are the same.

7. The method of claim 6 wherein the information elements are pages of the World Wide Web, and information sources for the pages are Web sites, the Web including at least four classes of Web sites designated, respectively, class A, class B, class C and class D, each respective class having a Web address including four octets of identification, and wherein Web sites are considered the same where:

the two most significant octets of the addresses for class A and class B sites are the same; and

the three most significant octets of the addresses for class C sites are the same; and

all four octets of the addresses for class D sites are the same.

8. The method of claim 6 wherein the filtering steps for diminishing the effects of self-promotion are applied proximate the beginning of determining information element ranking.

9. The method of claim 4 wherein the information elements include hubs and authorities, and the sources of spurious effects include redundant hubs, and wherein filtering includes steps for diminishing the effects of redundant hubs.

10. The method of claim 9 wherein the filtering steps for diminishing the effects of redundant hubs includes identifying a hub having the highest number of links at approximately the end of a ranking iteration, and setting to zero the authority values of information elements that are linked to by the hub having the highest number of links, re-computing hub values and iterating determination of ranking.

11. The method of claim 9 wherein the filtering steps for diminishing the effects of redundant hubs are applied proximate the end of determining information element ranking.

12. The method of claim 4 wherein the information elements include hubs and authorities, and the sources of spurious effects include false authority, and wherein filtering includes steps for diminishing the effects of false authority.

13. The method of claim 12 wherein the filtering steps for diminishing the effects of false authority includes allowing each link in an information element to have its own hub value, such that the hub value of the information element becomes a function of the particular link, and, when ranking authorities, allowing a value associated with the authority to be incremented by the hub value of the link, and when ranking hubs, allowing, the value of the authority linked to, be used to increment the hub value.

14. The method of claim 12 wherein the filtering steps for diminishing the effects of false authority are applied during the determining of information element ranking.

15. The method of claim 4 wherein the information elements include hubs and authorities, and the sources of spurious effects include related-page factors, and wherein filtering includes steps for diminishing the effects of related-page factors.

16. The method of claim 15 wherein the filtering steps for diminishing related-page factors includes, re-packing the authority of any source of information elements prior to iterating a determination of ranking by setting to zero all authority values of the same information element source, except the largest authority value.

17. The method of claim 16 wherein the information elements are pages of the World Wide Web, and information sources for the pages are Web sites, the Web including at least four classes of Wed sites designated, respectively, class A, class B, class C and class D, each respective class having a Web address including four octets of identification, and wherein Web sites are considered the same where:

the two most significant octets of the addresses for class A and class B sites are the same; and

the three most significant octets of the addresses for class C sites are the same; and

all four octets of the addresses for class D sites are the same.

18. The method of claim 15 wherein the filtering steps for diminishing the effects of related-page factors are applied during the determining of information element ranking.

19. The method of claim 4 wherein the sources of spurious effects include self-promotion;

redundant hubs;

false authority; and

related-page factors; and

filtering includes steps for diminishing the spurious effects by combining steps for reducing self-promotion, redundant hubs;

false authority and related page factors, and wherein the filtering steps for diminishing the effects of self-promotion are applied proximate the beginning of determining information element ranking;

filtering steps for diminishing the effects of redundant hubs are applied proximate the end of determining information element ranking;

filtering steps for diminishing the effects of false authority are applied during the determining of information element ranking; and

filtering steps for diminishing the effects of related-page factors are applied during the determining of information element ranking prior to iteration of ranking determinations.

20. The method of claim 1 wherein enabling a user to define an information structure includes providing a display interface having fields at which the user can enter attributes to be associated with the information structure categories.

21. The method of claim 20 wherein identifying a population of information elements includes automatically generating a search query based upon the category attributes entered at the interface.

22. The method of claim 21 wherein providing the interface includes providing the interface with one or more screens, respectively, having one or more partitions.

23. The method of claim 22 wherein providing the interface with one or more screens, respectively, having one or more partitions, includes providing at least one partition for enabling modification of category attributes.

24. The method of claim 23 wherein enabling modification of category attributes includes providing an entry field permitting the user to add attributes.

25. The method of claim 24 wherein enabling modification of category attributes includes providing an entry fields permitting the user to delete attributes.

26. The method of claim 25 wherein enabling modification of category attributes includes providing an entry field permitting the user to exclude attributes.

27. The method of claim 26 wherein enabling modification of category attributes includes permitting the user to select predefined attributes with which known information elements are associated.

28. The method of claim 22 wherein providing the interface with one or more screens having one or more partitions, includes providing at least one partition for presenting the information structure.

29. The method of claim 28 wherein providing the interface with at least one partition for presenting the information structure includes providing at least one partition for presenting a graphical representation of the information structure and for enabling modification of the information structure.

30. The method of claim 29 wherein enabling modification of the information structure includes enabling the adding, deleting, and moving of categories within the information structure.

31. The method of claim 22 wherein providing the interface with one or more screens having one or more partitions, includes providing at least one partition for presenting one or more information elements having information content which populate a selected category of the information structure.

32. The method of claim 31 wherein providing the interface with one or more screens having one or more partitions, includes providing at least one partition for presenting the contents of a selected information element.

33. The method of claim 22 wherein providing the interface with one or more screens having one or more partitions, includes enabling navigation between screens, and further includes providing at least one partition for presenting the information structure and at least one partition for enabling modification of category attributes.

34. The method of claim 33 wherein providing the interface with one or more screens having one or more partitions includes providing at least one partition for presenting one or more information elements having information content which populate the selected category of the information structure.

35. The method of claim 34 wherein providing the interface with one or more screens having one or more partitions further includes providing at least one partition for presenting the content of an information elements which populates the selected category of the information structure.

36. A method for cataloging ranking and filtering information comprising the steps of:

a. presenting a display interface to a user, the interface having one or more screens, respectively, having one or more partitions for enabling the user to interactively define a structure for cataloging information in one or more categories, each category having one or more attributes for defining the category;

b. enabling the user to select a category of the structure;

c. automatically identifying a population of information elements for the selected category based upon the respective category attributes designated by the user, and further, identifying links between information elements;

d. ranking the information elements for the particular category automatically based upon relevance to category attributes by iteratively determining relevance of the information elements to the respective category attributes based upon the affinity between information elements;

wherein one or more sources of spurious effects arise during the determining of relevance which adversely affect ranking accuracy;

e. filtering the information elements to improve ranking accuracy by applying filtering at predetermined points during ranking; and

f. populating the selected category with ranked information elements.

37. The method of claim 36 wherein providing the interface with one or more screens having one or more partitions, includes providing at least one partition for presenting the information structure and at least one partition for enabling modification of category attributes and at least one partition for presenting one or more information elements having information content.

38. The method of claim 37 wherein the sources of spurious effects include self-promotion and filtering includes steps for diminishing the effects of self-promotion applied proximate the beginning of determining information element ranking.

39. The method of claim 37 wherein the sources of spurious effects include redundant hubs and filtering includes steps for diminishing the effects redundant hubs applied proximate the end of determining information element ranking.

40. The method of claim 37 wherein the sources of spurious effects include false authority and filtering includes steps for diminishing the effects of false authority applied during the determining of information element ranking.

41. The method of claim 37 wherein the sources of spurious effects include related-page factors and filtering includes steps for diminishing the effects of related-page factors applied during the determining of information element ranking.

42. A method for displaying an interface at which a user may interactively develop a structure for cataloging information in one or more categories, each category having one or more attributes for defining the category, and at which interface the user may automatically populate selected categories with information elements, the method comprising the steps of;

a. providing the interface with one or more screens, respectively, having one or more partitions;

b. providing at least one partition for presenting the information structure and enabling its modification;

c. providing at least one partition for presenting the attributes of a selected category and enabling modification of category attributes; and

d. enabling automatic identification of a population of information elements with a search query based upon the category attributes entered at the interface.

43. The method of claim 42 wherein providing the interface includes providing fields at which the user can enter attributes to be associated with the information structure categories.

44. The method of claim 43 wherein providing the interface with one or more screens having one or more partitions, includes enabling navigation between screens and providing at least one partition for presenting one or more information elements having information content which populate a selected category of the information structure.

45. The method of claim 43 wherein providing the interface with one or more screens having one or more partitions further includes providing at least one partition for presenting the content of an information elements which populates the selected category of the information structure.

46. The method of claim 45 wherein enabling modification of category attributes includes providing an entry field permitting the user to add attributes.

47. The method of claim 45 wherein enabling modification of category attributes includes providing an entry fields permitting the user to delete attributes.

48. The method of claim 45 wherein enabling modification of category attributes includes providing an entry field permitting the user to exclude attributes.

49. The method of claim 45 wherein enabling modification of category attributes includes permitting the user to select predefined attributes with which known information elements are associated.

50. The method of claim 45 wherein enabling modification of the information structure includes enabling the adding, deleting, and moving of categories within the information structure.