System and methods for automatic clustering of ranked and categorized search objects

• US 20100131563A1
• Filed: 11/25/2008
• Published: 05/27/2010
• Est. Priority Date: 11/25/2008
• Status: Abandoned Application

• Current Assignee: Yebol Corporation
• Original Assignee: Yebol Corporation
• Inventors: Yin, Hongfeng
• Application Number:
  US12/313,860
• Publication Number:
  US 20100131563A1
• Time in Patent Office: Days
• US Class Current: 707/794
• CPC Class Codes: G06F 16/338 Presentation of query results
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification

Abstract

A search results page includes multiple search lists generated by multiple clustering operations applied to an initial match set of documents selected based on a user query. A first result list is constructed by clustering a top-n set of documents by primary domain address and sorting based on extrinsic ranking factors such that the first list includes a ranked and ordered list of primary domain linked anchor text. A second result list is constructed by clustering the top-n set of documents based on a unified ranked occurrence of keywords within the top-n set of documents. The generated second list contains a plurality of cluster class references with each of the cluster class reference including a ranked ordered sub-list of the keywords occurring within the top-n set of documents and respectively associated with the cluster class reference, each of the keywords of the ranked ordered sub-lists including linking references to a corresponding one of the top-n set of documents. A third result list is constructed by clustering the top-n set of documents based on a ranked frequency of occurrence of internally linked anchor texts. The generated third result list includes the top-n set of the internally linked anchor texts and respective ranked and ordered sub-lists of linking references to primary domain Web-pages containing the corresponding one of the internally linked anchor texts.

Claims

1. A computer implemented method of presenting a search report identifying documents relevant to an input query text, said method comprising the steps of:

a) first determining a primary top-n set of documents corresponding to a query text, wherein said query text is provided through a user interface, wherein said first determining step is operative to match said query text against a plurality of terms stored in a database, wherein said plurality of terms correspond to anchor texts occurring within documents of an analyzed document collection, wherein said plurality of terms are associated with sets of document addresses identifying the documents of anchor text occurrence, and wherein said primary top-n set of documents correspond to those top ranked based on frequency of occurrence of the matched subset of said plurality of terms;

b) second determining a set of keywords occurring within said primary top-n set of documents, wherein said database stores a pre-established keyword ontology with keyword associated ranking values determined with respect to said analyzed document collection, and wherein said pre-established keyword ontology includes said set of keywords;

c) clustering said set of keywords into an ordered plurality of keyword lists dependent on a ranked relatedness determined by reference to said pre-established keyword ontology, said step of clustering including the iterative steps of

i) computing a unified keyword ranking for each of said set of keywords with respect to said primary top-n set of documents and said pre-established keyword ontology keyword associated ranking values;

ii) selecting a top-n subset of said set of keywords based on said unified keyword ranking as a keyword cluster; and

iii) removing said top-n subset from said set of keywords and repeating said step of clustering until a predetermined number of clusters are found or exhausting said set of keywords;

d) presenting, through said user interface, said ordered plurality of keyword lists as categorized keyword lists.

2. The computer implemented method of claim 1 further comprising the steps of:

a) first resolving a unique list of primary domain addresses corresponding to said primary top-n set of documents; and

b) second selectively resolving aliases for each of said primary domain addresses of said unique list includes the steps of

i) matching a pattern against each said primary domain address to resolve a pattern defined alias;

ii) performing a lookup of each said primary domain address against a list of predetermined domain aliases;

iii) selecting aliases for said primary domain addresses, wherein each said primary domain address is a default alias to create a list of aliases corresponding to said unique list of primary domain addresses;

b) sorting said list of aliases into a ranked order evaluated dependent on predetermined fitness criteria; and

c) presenting, through said user interface, said list of aliases as a top-n list of domains.

3. The computer implemented method of claim 2 further comprising the steps of:

a) collecting a unique set of anchor text instances corresponding to said plurality of terms restricted to internal document link references contained by said primary top-n set of documents;

b) sorting said unique set of anchor text instances into a ranked order evaluated dependent on predetermined ranking criteria including frequency of occurrence weighted by order of occurrence;

c) selecting a top-n ranked subset of said unique set of anchor text instances;

d) performing said second selectively resolving aliases step against said top-n ranked subset to resolve a top-n internal domain alias list; and

e) presenting, through said user interface, said unique set of anchor text instances and respectively associated aliases of said top-n internal domain alias list.

4. The computer implemented method of claim 3 further comprising the steps of:

a) third determining a secondary top-n set of documents corresponding to said query text, wherein said third determining step is operative to identify a second plurality of terms that include said query text, and wherein said secondary top-n set of documents are those top ranked based on frequency of occurrence of said included subset of said plurality of terms;

b) fourth determining a top-n set of anchor texts occurring within said secondary top-n set of documents;

c) ranking said top-n set of anchor texts based on predetermined criteria including frequency of occurrence within said analyzed document collection;

d) selecting a tertiary top-n set of documents representing those documents having the highest frequency of occurrence of said top-n set of anchor texts;

e) resolving a tertiary list of domain names corresponding to said tertiary top-n set of documents;

f) performing said second selectively resolving aliases step against said tertiary list to resolve a top-n tertiary domain alias list; and

g) presenting, through said user interface, said top-n set of anchor texts and respectively associated aliases of said top-n tertiary domain alias list.

5. The computer implemented method of claim 4 further comprising the steps of:

a) submitting each of said second plurality of terms to a predetermined external search engine to retrieve a corresponding identification of a quaternary top-n set of document addresses;

b) determining first top-n sets of keywords that occur within the documents identified as corresponding to each of said second plurality of terms;

c) determining second top-n sets of primary domain aliases for the documents identified as corresponding to each of said second plurality of terms; and

d) presenting, through said user interface, a list of said second plurality of terms including, as sub-lists corresponding ones of said first top-n sets of keywords and second top-n sets of primary domain aliases.

6. A computer implemented method of presenting a search results Web-page identifying documents of an Web-based document collection responsive to an input query text presented through a Web-based user interface, said method comprising the steps of:

a) generating a plurality of results lists responsive to an input query text presented through a Web-based user interface, wherein said plurality of results lists are derived from a top-n set of documents found by

i) matching said input query text to a plurality of terms representing anchor text instances occurring within a Web-based document collection to obtain a list of documents containing matched instances of said plurality of terms;

ii) ordering said list of documents based on a keyword rank value determined for each document proportional to the frequency of occurrence of predetermined keywords in an analyzed set of said Web-based document collection and the frequency of occurrence of said predetermined keywords in said document; and

iii) selecting, based on keyword rank value, said top-n set of documents having at least a predetermined threshold keyword rank value,

wherein said plurality of lists include

i) a top-n domains list determined by aggregation of the domains of occurrence of said top-n set of documents;

ii) a related keywords list determined from an iterative reduction clustering of keyword occurrences within said top-n set of documents; and

iii) a categories list determined from the set of internal link anchor texts occurring within respective domain hierarchies; and

b) compositing said plurality of results lists together in a search results Web-page for presentation though said Web-based user interface.

7. The computer implemented method of claim 6 wherein said plurality of terms represent unique literal anchor text instances.

8. The computer implemented method of claim 6 wherein said predetermined keywords are obtained from an established Web-based ontology.

9. The computer implemented method of claim 6 wherein entries in said top-n domains list are selectively literate aliases of corresponding domain names.

10. The computer implemented method of claim 6 wherein said step of generating generates one or more additional results lists responsive to said input query text derived from an alternate top-n set of documents found by

a) resolving a subset of said plurality of terms that include said input query text;

b) selecting an alternate list of documents containing said subset of said plurality of terms;

c) ranking said alternate list of documents based on metrics including frequency and order of occurrence of instances of said subset of said plurality of terms in each of said alternate list of documents; and

d) selecting said alternate top-n set of documents from said alternate list set of documents,

wherein said additional results lists includes a suggestions list determined from said subset of said plurality of terms and corresponding sub-lists determined by aggregation of the domains of occurrence of said alternate top-n set of documents.

11. The computer implemented method of claim 10 wherein said additional results lists includes a search list determined from said alternate top-n set of documents.

12. A computer implemented method of producing a search results Web-page in response to the presentation of a user query, said method comprising the steps of:

a) evaluating a user query text provided through a Web-based user interface to select a top-n set of Web-page documents, wherein said Web-page documents are selected based on ranked frequency of occurrence of said user query text in said Web-page documents;

b) generating a plurality of result lists, including;

i) a first result list constructed by a first clustering said top-n set of Web-pages documents by primary domain address and sorting based on predetermined extrinsic ranking factors, said first list containing primary domain address identifying anchor text with respective linking references to said primary domain addresses;

ii) a second result list constructed by a second clustering said top-n set of Web-page documents based on a unified ranked occurrence of predetermined keywords within said top-n set of Web-page documents, said second list containing a plurality of cluster class references with each said cluster class reference including a ranked ordered sub-list of said predetermined keywords occurring within said top-n set of Web-page documents and respectively associated with said cluster class reference, each said predetermined keywords of said ranked ordered sub-lists including linking references to a corresponding one of said top-n set of Web-page documents;

iii) a third result list constructed by a third clustering said top-n set of Web-page documents based on a ranked frequency of occurrence of internally linked anchor texts, said third result list including a top-n set of said internally linked anchor texts and respective ranked and ordered sub-lists of linking references to primary domain Web-pages containing the corresponding one of said internally linked anchor texts; and

c) displaying said plurality of result lists together in a search results Web-page though said Web-based user interface.

13. A computer implemented method of producing a search results Web-page in response to the presentation of a user query, said method comprising the steps of:

a) deriving a plurality of keywords from an analyzed set of Web-pages dependent on a user query text presented through a user interface;

b) associate keyword values with said plurality of keywords, said keyword values being determined in relation to said analyzed set of Web-pages;

c) performing an iterative reduction clustering of said plurality of keywords based on said associated keyword values to obtain a plurality of keyword lists; and

d) displaying said plurality of keyword lists as a list set component of a search results Web-page through said user interface.

14. The computer implemented method of claim 13 wherein said step of deriving comprises the steps of:

a) matching said user query text to anchor text occurrences within said analyzed set of Web-pages;

b) first selecting a subset of said analyzed set of Web-pages having a greatest ranked significance of matches of said user query text to anchor text occurrences within said analyzed set of Web-pages; and

c) second selecting the keywords, identified with respect to a predetermined keyword list, occurring within said subset of said analyzed set of Web-pages as said plurality of keywords.

15. The computer implemented method of claim 14 wherein said step of performing said iterative reduction clustering comprises the steps of:

a) ranking said plurality of keywords with respect to a plurality of classes, wherein each of said plurality of keywords occurs in one or more of said plurality of classes;

b) third selecting a class of said plurality of classes having a greatest ranked value determined based on the combined keyword values of said plurality of keywords associated with said class;

c) reserving said class and said plurality of keywords associated with said class as a keyword list of said plurality of keyword lists; and

d) repeating said third selecting and reserving steps with respect to the remaining classes of said plurality of classes.

27. The computer implemented method of claims 13, 16, and 19 wherein said list set components are displayed together on said search results Web-page.

28. The computer implemented method of claims 14, 16, and 20 wherein said list set components are displayed together on said search results Web-page.

29. The computer implemented method of claims 13, 16, 19, and 23 wherein said list set components are displayed together on said search results Web-page.

30. The computer implemented method of claims 14, 16, 20, and 24 wherein said list set components are displayed together on said search results Web-page.

16. A computer implemented method of producing a search results Web-page in response to the presentation of a user query, said method comprising the steps of:

a) identifying a plurality of Web-pages from an analyzed set of Web-pages as corresponding to a user query text presented through a user interface;

b) resolving a domain list corresponding to said plurality of Web-pages;

c) sorting said domain list based on predetermined criteria including the number of said plurality of Web-pages corresponding to each domain within said domain list; and

d) displaying said domain list in sorted order as a list set component of a search results Web-page through said user interface.

17. The computer implemented method of claim 16 wherein said step of identifying includes the steps of:

a) matching said user query text to anchor text occurrences within said analyzed set of Web-pages; and

b) first selecting a subset of said analyzed set of Web-pages having a greatest ranked significance of matches of said user query text to anchor text occurrences within said analyzed set of Web-pages as said plurality of Web-pages.

18. The computer implemented method of claim 17 wherein said step of displaying includes determining a display text for each domain within said domain list utilizing predetermined criteria including an open directory-based lookup of categorized domain correspondences, the default determined display text being a textual representation of the corresponding domain name.

19. A computer implemented method of producing a search results Web-page in response to the presentation of a user query, said method comprising the steps of:

a) identifying a plurality of Web-pages from an analyzed set of Web-pages as corresponding to a user query text presented through a user interface;

b) resolving an anchor text list from said plurality of Web-pages, wherein said anchor text list includes the anchor text of internal links occurring within said plurality of Web-pages;

c) ranking each anchor text of said anchor text list based on predetermined criteria including the frequency and relative location of occurrence in said plurality of Web-pages;

d) displaying said anchor text list in sorted order, based on relative ranking, as a list set component of a search results Web-page through said user interface.

20. The computer implemented method of claim 19 further comprising the steps of:

a) identifying from said plurality of Web-pages for each anchor text of said anchor text list a corresponding set of Web-pages;

b) resolving, for each said corresponding set of Web-pages, a corresponding domain list;

c) sorting each said domain list based on predetermined criteria including the number of said corresponding set of Web-pages corresponding to each domain within said corresponding domain list; and

d) displaying said corresponding domain lists in sorted order in respective combination with said anchor text list.

21. The computer implemented method of claim 20 wherein anchor texts are resolved uniquely based on the literal text of the anchor texts.

22. The computer implemented method of claim 20 wherein said step of resolving includes the step of determining an adjusted anchor text subject to predetermined criteria including exclusion of predetermined words and wherein anchor texts are resolved uniquely based on said adjusted anchor texts.

23. A computer implemented method of producing a search results Web-page in response to the presentation of a user query, said method comprising the steps of:

a) identifying a plurality of Web-pages from an analyzed set of Web-pages as corresponding to a user query text presented through a user interface, wherein said step of identifying selects said plurality of Web-pages dependent on matching anchor texts, occurring within Web-pages of said analyzed set of Web-pages, with predetermined portions of said user query text;

b) first resolving an anchor text list including said matched anchor texts;

c) sorting said anchor text list based on predetermined criteria including the number of said plurality of Web-pages corresponding to each anchor text within said anchor text list; and

d) displaying said anchor text list in sorted order as a list set component of a search results Web-page through said user interface.

24. The computer implemented method of claim 23 further comprising the steps of:

a) second resolving, for each said matched anchor text, a corresponding set of web-pages containing said matched anchor text from said plurality of Web-pages;

b) third resolving, for each said corresponding set of Web-pages, a corresponding domain list;

c) sorting each said corresponding domain list based on predetermined criteria including the number of said corresponding set of Web-pages corresponding to each domain within said corresponding domain list; and

d) displaying said corresponding domain lists in sorted order in respective combination with said anchor text list.

25. The computer implemented method of claim 24 wherein said step of displaying includes determining a display text for each domain within each said domain list utilizing predetermined criteria including an open directory-based lookup of categorized domain correspondences, the default determined display text being a textual representation of the corresponding domain name.

26. The computer implemented method of claim 25 wherein said step of identifying includes the step of matching an adjusted anchor text against an adjusted user query text, wherein said adjusted anchor text and said adjusted user query text are discriminated based on predetermined criteria including exclusion of predetermined words.