Systems and methods for enhancing web-based searching

• US 20050120006A1
• Filed: 10/26/2004
• Published: 06/02/2005
• Est. Priority Date: 05/30/2003
• Status: Active Grant

• Current Assignee: Truelocal Incorporated
• Original Assignee: Geosign Corporation
• Inventors: Nye, Timothy G.
• Granted Patent: US 7,613,687 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A system for enhancing web-based searching is provided. Categorizing and clustering techniques are used to optimize searching. Businesses are classified using a control group of predetermined categories. The predetermined categories may be SIC codes or headings that are used to describe business activities. The website addresses for a business listed in the control group is determined, and the content of the business'"'"'s website is extracted. The extracted content is associated with the predetermined category that the business is classified under. The extracted content is used to further enhance the overall classification scheme. The system may compare and match the extracted content with content of other business'"'"' websites, which are similarly categorized. If a relevant keyword match is identified in several of the websites, the keyword may be used to update the classification scheme. A new category or sub-category can be created based on this keyword. Furthermore, when a search is performed, the search results are organized by these categories, and using various processes, the most common results are kept and the less relevant results are discarded.

Claims

1. An information gathering system for optimizing searching comprising:

a persistent storage storing data concerning entities, where each entity is stored according to a classification scheme that includes one or more predefined classifications;

a data extraction tool that extracts website content for a plurality of the entities associated with at least one of the predefined classifications; and

a content analyzer analyzing the extracted content, where the analyzed content is used to update the classification scheme.

2. An information gathering system for optimizing searching as in claim 1 wherein the predefined classifications are defined by an independent source, where the independent source is at least one of:

yellow pages, standard industry classification scheme, or membership list.

3. An information gathering system for optimizing searching as in claim 1 wherein the predefined classifications are not computer generated.

4. An information gathering system for optimizing searching as in claim 1 wherein storing data concerning entities according to a classification scheme further includes storing verified attributes about the entities including at least one of:

business name, business address, business telephone number, or business website address.

5. An information gathering system for optimizing searching as in claim 1 wherein the entities correspond to businesses, corporations, agencies, or organizations.

6. An information gathering system for optimizing searching as in claim 1 wherein each of the predefined classifications corresponds to a business descriptor.

7. An information gathering system for optimizing searching as in claim 1 further includes a search handler which identifies the website content and causes the data extraction tool to extract the identified website content.

8. An information gathering system for optimizing searching as in claim 7 wherein the search handler identifies the website content through a search engine.

9. An information gathering system for optimizing searching as in claim 8 wherein the data extraction tool extracts the website content from indexed data provided by the search engine.

10. An information gathering system for optimizing searching as in claim 7 wherein the search handler identifies the website content through a website address of the entity.

11. An information gathering system for optimizing searching as in claim 1 wherein the classification scheme is defined according to a hierarchy of relations, which is updated in response to:

identifying matches in the extracted website content by grouping keywords or phrases identified in the extracted website content; and

processing the matches identified.

12. An information gathering system for optimizing searching as in claim 11 wherein processing matches identified further includes a process for eliminating irrelevant matches.

13. An information gathering system for optimizing searching as in claim 11 wherein matches identified further includes a process for:

ranking each of the matches identified; and

processing the ranked matches to determine the highest ranking match.

14. An information gathering system for optimizing searching as in claim 11 wherein processing matches identified further includes at least one of the following processes:

determining whether any of the identified matches were extracted from two or more websites having one or more similar classifications;

determining whether any of the keywords or phrases in the identified matches contain one or more keywords in the predetermined classification;

computing the identified matches and determining whether any of the matches exceed a certain percentage of the computed total;

or

computing the identified matches and eliminating matches that are below a certain percentage of the computed total.

15. An information gathering system for optimizing searching as in claim 13 wherein updating the classification scheme further includes using the highest ranking match to update the classification scheme.

16. An information gathering system for optimizing searching as in claim 15 wherein the update to the classification scheme causes a sub-category of one of the predefined classifications to be created, where the sub-category is indicative of an association between the predefined category, the sub-category and the extracted content.

17. An information gathering system for optimizing searching as in claim 1 further including a search process that locates websites of entities that have not been categorized in the classification scheme.

18. An information gathering system for optimizing searching as in claim 17 wherein the data extraction tool extracts content from the websites that have not been categorized in the classification scheme.

19. An information gathering system for optimizing searching as in claim 18 wherein the extracted content from the websites that have not been categorized in the classification scheme is used to update the classification scheme.

20. An information gathering system for optimizing searching as in claim 1 further includes a search process to identify entities associated with one or more of the predetermined classifications, which do not have a website.

21. An information gathering system for optimizing searching as in claim 20 wherein the process to identify entities associated with one or more of the predetermined classifications, which do not have a website, further includes logic to assign each of the entities identified to new categories created in the updated classification scheme.

22. An information gathering system for optimizing searching as in claim 1 further includes defining the classification scheme according to a hierarchy of relations, where the predefined categories are stored according to a plurality of relations corresponding to geographical locations.

23. An information gathering system for optimizing searching as in claim 22 wherein the classification scheme further includes logic that processes queries to identify entities that are geographically located within a certain distance from a particular location.

24. An information gathering system for optimizing searching as in claim 1 wherein the updated classification scheme is used to process queries for entities.

25. An information gathering system for optimizing searching as in claim 24 wherein the query includes attributes matching one or more categories in the updated classification scheme, where one or more entities is responsive to the query.

26. An information gathering system for optimizing searching as in claim 1 wherein the categories in the updated classification are used to cluster search result hits.

27. An information gathering system for optimizing searching as in claim 1 further including:

a search handler being responsive to a user search query; and

a clustering engine, in communication with the search handler, processing search result hits resulting from the query, where the clustering engine clusters the search result hits based on categories defined in the classification scheme.

28. A method of optimizing searching in a data processing system comprising:

storing data concerning entities, where each entity is stored based on a classification scheme that includes one or more predefined classifications;

extracting website content for a plurality of the entities associated with at least one of the predefined classifications; and

analyzing the extracted content, where the analyzed content is used to update the classification scheme.

29. A method of optimizing searching as in claim 28 wherein the predefined classifications are defined by an independent source, which is at least one of the following independent sources:

yellow pages, standard industry classification scheme, or membership list.

30. A method of optimizing searching as in claim 28 wherein the predefined classifications are not computer generated.

34. A method of optimizing searching as in claim 28 wherein the classification scheme is defined according to a hierarchy of relations, which is updated in response to:

storing the extracted website content according to a hierarchy of relations defined in the classification scheme;

identifying matches in the extracted website content by grouping keywords or phrases identified in the extracted website content; and

processing the matches identified.

37. A method of optimizing searching as in claim 28 wherein processing matches identified further includes at least one of:

determining whether any of the identified matches were extracted from two or more websites having one or more similar classifications;

determining whether any of the keywords or phrases in the identified matches contain one or more keywords in the predetermined classification;

computing the identified matches and determining whether any of the matches exceed a certain percentage of the computed total;

or

computing the identified matches and eliminating matches that are below a certain percentage of the computed total.

38. A method of optimizing searching as in claim 37 wherein updating the classification scheme further includes using the highest ranking match to update the classification scheme.

39. A method of optimizing searching as in claim 28 wherein the update to the classification scheme causes a sub-category of one of the predefined classifications to be created, where the sub-category is indicative of an association between the predefined category, the sub-category and the extracted content.

43. A method of optimizing searching as in claim 28 further includes identifying entities associated with one or more of the predetermined classifications, which do not have a website.

44. A method of optimizing searching as in claim 43 wherein identifying entities associated with one or more of the predetermined classifications, which do not have a website, further assigning each of the entities identified to new categories created in the updated classification scheme.

45. A method of optimizing searching as in claim 28 further includes defining the classification scheme according to a hierarchy of relation, where the predefined categories are stored according to a plurality of relations corresponding to geographical locations.

46. A method of optimizing searching as in claim 45 wherein the classification scheme further includes processing queries to identify entities that are geographically located within a certain distance from a particular location.

50. A method of optimizing searching as in claim 28 further including:

responding to a user search query; and

processing search result hits resulting from the query by clustering the search result hits based on categories defined in the classification scheme.

51. A method of optimizing searching as in claim 50 wherein processing search result hits resulting from the query by clustering the search result hits based on categories defined in the classification scheme further includes assigning a search result hit to a category in the classification scheme.

31. (canceled).

32. (canceled).

33. (canceled).

35. (canceled).

36. (canceled).

40. (canceled).

41. (canceled).

42. (canceled).

47. (canceled).

48. (canceled).

49. (canceled).

52. A system for optimizing searching comprising:

means for storing data concerning entities, where each entity is stored according to a classification scheme that includes one or more predefined classifications;

means for extracting website content for a plurality of the entities associated with at least one of the predefined classifications; and

means for analyzing the extracted content, where the analyzed content is used to update the classification scheme.

53. A method of optimizing searching in a data processing system comprising:

storing data concerning entities, where each entity is stored according to a classification scheme that includes one or more predefined classifications;

storing website content for a plurality of the classified entities associated with at least one of the predefined classifications, where the website content is stored according to the classification scheme;

processing at least a portion of the website content to update the classification scheme;

searching for unclassified entities using at least a portion of the website content;

classifying the unclassified entities according to the classification scheme by identifying relationships between the unclassified entities and the classified entities; and

using the classification scheme, clustering search results.

54. A method of optimizing searching as in claim 53 wherein the predefined classifications are defined by an independent source, which is at least one of the following independent sources:

yellow pages, standard industry classification scheme, or membership list.

57. A method of optimizing searching as in claim 53 wherein the classification scheme is defined according to a hierarchy of relations, which is updated in response to:

storing the extracted website content according to a hierarchy of relations defined in the classification scheme;

identifying matches in the extracted website content by grouping keywords or phrases identified in the extracted website content; and

processing the matches identified.

59. A method of optimizing searching as in claim 57 wherein processing matches identified further includes at least one of:

determining whether any of the identified matches were extracted from two or more websites associated with one or more similar classifications;

determining whether any of the keywords or phrases in the identified matches contain one or more keywords in the predetermined classification;

computing the identified matches and determining whether any of the matches exceed a certain percentage of the computed total;

or

computing the identified matches and eliminating matches that are below a certain percentage of the computed total.

60. A method of optimizing searching as in claim 53 wherein updating the classification scheme further includes using a highest ranking match to update the classification scheme.

61. A method of optimizing searching as in claim 60 wherein the update to the classification scheme causes a sub-category of one of the predefined classifications to be created, where the sub-category is indicative of an association between the predefined category, the sub-category and the extracted content.

55. (canceled).

56. (canceled).

58. (canceled).

62. (canceled).

63. (canceled).

64. (canceled).

65. (canceled).

66. (canceled).

67. (canceled).

68. (canceled).

69. (canceled).

70. A method of optimizing searching in a data processing system comprising:

obtaining information about the entities that are included in a control group, where the control group includes categorized entities;

searching for unclassified entities using the information about the entities in the control group; and

classifying the unclassified entities based on the information about the entities in the control group.

71. A method of optimizing searching as in claim 70 wherein the control group includes categorized entities provided by an independent source being at least one of:

yellow pages, standard industry classification scheme, or membership list.

72. A method of optimizing searching as in claim 70 wherein the entities correspond to businesses, corporations, agencies, or organizations.

73. A method of optimizing searching as in claim 70 wherein the control group includes verified attributes about the entities including at least one of:

business name, business address, business telephone number, or business website address.

74. A method of optimizing searching as in claim 70 wherein obtaining information about entities that are included in a control group further includes extracting website content associated with a plurality of entities in the control group.

75. A method of optimizing searching as in claim 74 wherein the categorized entities in the control group are stored according to a hierarchy of relations, which is updated in response to:

identifying matches in the extracted website content by grouping keywords or phrases identified in the extracted website content; and

processing the matches identified.

78. A method of optimizing searching as in claim 70 wherein classifying the website based on the information about the entities in the control group further includes:

extracting content from a website of an unclassified entity; and

comparing the unclassified website content with website content of the categorized entities to determine the classification of the unclassified entity.

79. A method of optimizing searching as in claim 78 wherein the unclassified website content is used to update the hierarchy.

80. A method of optimizing searching as in claim 78 further includes defining relationships in the hierarchy according to geographical location.

81. A method of optimizing searching as in claim 78 further includes using the hierarchy to cluster search result hits in response to a user search query.

76. (canceled).

77. (canceled).

82. A method of optimizing searching in a data processing system comprising:

storing information about the entities that are included in a control group, where the control group includes categorized entities stored according to a classification scheme;

responding to a search request by processing search results responsive to the request; and

clustering the search results according to the classification scheme by comparing information about the control group with the search results.

94. A method of optimizing searching as in claim 82 wherein clustering the search results according to the classification scheme further includes:

identifying matches in website content associated with the search results and website content associated with the entities in the control group; and

ranking the matches associated with each category of entities in the control group.

95. A method of optimizing searching as in claim 94 further includes:

determining a category in the classification scheme having a highest ranking match; and

assigning a search result to the category having the highest ranking match.

83. (canceled).

84. (canceled).

85. (canceled).

86. (canceled).

87. (canceled).

88. (canceled).

89. (canceled).

90. (canceled).

91. (canceled).

92. (canceled).

93. (canceled).