Method and System for Grouping Chunks Extracted from A Document, Highlighting the Location of A Document Chunk Within A Document, and Ranking Hyperlinks Within A Document

• US 20110119262A1
• Filed: 11/11/2010
• Published: 05/19/2011
• Est. Priority Date: 11/13/2009
• Status: Abandoned Application

• Current Assignee: Aparna Joshi, Ilesh Garish, Jeffrey M. Dexter, Manish Gambhir, Robert Smik
• Original Assignee: Aparna Joshi, Ilesh Garish, Jeffrey M. Dexter, Manish Gambhir, Robert Smik
• Inventors: Dexter, Jeffrey M., Garish, Ilesh, Gambhir, Manish, Joshi, Aparna, Smik, Robert
• Application Number:
  US12/944,034
• Publication Number:
  US 20110119262A1
• Time in Patent Office: Days
• US Class Current: 707/726
• CPC Class Codes: G06F 16/94 Hypermedia Hyperlinking G06F40/134
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A system and method for grouping chunks, highlighting a chunk location within a document, and ranking hyperlinks of a document. A portion of a document including one or more hyperlinks to linked documents at respective data sources is displayed in a first window. In response to a search request including one or more search terms, one or more of the linked documents are requested from the respective data sources. When a respective linked document is received from a respective data source, it is determined whether the respective linked document includes chunks that match at least one of the search terms. If true, at least a subset of the chunks are displayed as a respective group in a second window only if a number of groups displayed in the second window is less than a predefined number of groups.

Claims

1. A computer-implemented method for grouping and displaying chunks, comprising:

at a computer system including one or more processors and memory storing one or more programs, the one or more processors executing the one or more programs to perform the operations of;

displaying a portion of a document in a first window, the document including one or more hyperlinks to linked documents at respective data sources;

in response to a search request including one or more search terms,

requesting one or more of the linked documents from the respective data sources in parallel;

when a respective linked document is received from a respective data source,

determining whether the respective linked document includes chunks that match at least one of the one or more search terms; and

in response to determining that the respective linked document includes chunks that match at least one of the one or more search terms, displaying at least a subset of the chunks as a respective group in a second window only if a number of groups displayed in the second window is less than a predefined number of groups.

2. The method of claim 1, wherein in response to determining that the respective linked document does not include chunks that match at least one of the one or more search terms, the method further comprises:

requesting linked documents that have not been previously requested until the number of groups displayed in the second window is the predefined number of groups or until there are no more linked documents that have not been previously requested.

3. The method of claim 1, further comprising:

after the predefined number of groups has been displayed, displaying in the second window a respective page link corresponding to the groups displayed in the second window.

4. The method of claim 1, further comprising:

after the predefined number of groups has been displayed, displaying in the second window a next-page link that when clicked by a user is configured to perform the operations of claim 1 for linked documents that have not been requested.

5. The method of claim 4, further comprising:

in response to a user clicking on the next-page link, performing the operations of claim 1 for the linked documents that have not been previously requested.

6. The method of claim 1, further comprising:

determining the number of linked documents that have not been previously requested;

calculating the number of pages required to display groups of chunks for the linked documents that have not been previously requested based on a predefined number of linked documents per page; and

displaying in the second window page links corresponding to each page.

7. The method of claim 6, further comprising:

in response to a user clicking on a respective page link corresponding to a respective page of the second window, repeating the requesting and the determining operations until all pages up to and including the respective page has the predefined number of groups or until there are no more linked documents that have not been previously requested.

8. The method of claim 7, further comprising:

removing page links to pages that are no longer required to display groups of chunks for the linked documents.

9. The method of claim 1, wherein requesting one or more of the linked documents from the respective data sources in parallel includes requesting a predefined number of linked documents from the respective data sources in parallel.

10. The method of claim 9, wherein prior to receiving the linked documents from respective data sources, the method further comprises:

displaying in the second window placeholders for each requested linked document.

11. The method of claim 10, wherein in response to determining that the respective linked document does not include chunks that match at least one of the one or more search terms, the method further comprises:

removing a placeholder corresponding to the respective linked document.

12. The method of claim 9, wherein the predefined number of linked documents are requested in a predetermined order.

13. The method of claim 12, wherein the predetermined order is selected from the group consisting of:

the order that the one or more hyperlinks to the linked documents appear in the document as displayed in the first window; and

the order that the one or more hyperlinks to the linked documents appear in a document object model for the document.

14. The method of claim 1, wherein the document is a first web page associated with a first website, and wherein at least one of the linked documents is a second web page that is separate and distinct from the first web page.

15. A system for grouping and displaying chunks, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions to;

display a portion of a document in a first window, the document including one or more hyperlinks to linked documents at respective data sources;

in response to a search request including one or more search terms,

request one or more of the linked documents from the respective data sources in parallel;

when a respective linked document is received from a respective data source,

determine whether the respective linked document includes chunks that match at least one of the one or more search terms; and

in response to determining that the respective linked document includes chunks that match at least one of the one or more search terms, display at least a subset of the chunks as a respective group in a second window only if a number of groups displayed in the second window is less than a predefined number of groups.

16. A computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions to:

display a portion of a document in a first window, the document including one or more hyperlinks to linked documents at respective data sources;

in response to a search request including one or more search terms,

request one or more of the linked documents from the respective data sources in parallel;

when a respective linked document is received from a respective data source,

determine whether the respective linked document includes chunks that match at least one of the one or more search terms; and

in response to determining that the respective linked document includes chunks that match at least one of the one or more search terms, display at least a subset of the chunks as a respective group in a second window only if a number of groups displayed in the second window is less than a predefined number of groups.

17. A computer-implemented method for highlighting a location of a document chunk within a document, comprising:

at a computer system including one or more processors and memory storing one or more programs, the one or more processors executing the one or more programs to perform the operations of;

displaying a portion of a first document in a first window and one or more chunks extracted from a second document in a second window, wherein the first document includes one or more hyperlinks to the second document;

in response to receiving a selection of a user-selected chunk in the second window,

identifying a first element type defined in the second document that includes the user-selected chunk;

displaying at least a portion of the second document in the first window;

identifying a second element type of the second document as displayed in the first window that has the same element type as the first element type and that includes the user-selected chunk; and

updating the display of the first window and the second window by;

displaying a portion of the second document that includes the second element type including the user-selected chunk in the first window;

highlighting the second element type that includes the user-selected chunk in the first window; and

highlighting the user-selected chunk in the second window.

18. The method of claim 17, wherein the one or more chunks are extracted from the second document in response to a search request including one or more search terms submitted by a user through the computer system.

19. The method of claim 18, wherein the one or more search terms are highlighted in the second window in a manner distinct from that of highlighting the user-selected segment.

20. The method of claim 17, wherein the first document is an HTML document, and wherein the one or more hyperlinks include at least one URL to the second document.

21. The method of claim 20, wherein prior to receiving the selection of the user-selected chunk in the second window and in response to a cursor hovering over the user-selected chunk in the second window, the method further comprises:

identifying a portion of the first document that includes a URL to the second document including the user-selected chunk; and

highlighting the URL of the first document in the first window.

22. The method of claim 20, wherein prior to receiving the selection of the user-selected chunk in the second window and in response to a cursor hovering over the user-selected chunk in the second window, the method further comprises:

updating a displayed portion of the first document in the first window to include a portion of the first document that includes the URL to the second document including the user-selected chunk.

23. A system for highlighting a location of a document chunk within a document, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions to;

display a portion of a first document in a first window and one or more chunks extracted from a second document in a second window, wherein the first document includes one or more hyperlinks to the second document;

in response to receiving a selection of a user-selected chunk in the second window,

identify a first element type defined in the second document that includes the user-selected chunk;

display at least a portion of the second document in the first window;

identify a second element type of the second document as displayed in the first window that has the same element type as the first element type and that includes the user-selected chunk; and

update the display of the first window and the second window by;

display a portion of the second document that includes the second element type including the user-selected chunk in the first window;

highlight the second element type that includes the user-selected chunk in the first window; and

highlight the user-selected chunk in the second window.

24. A computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions to:

display a portion of a first document in a first window and one or more chunks extracted from a second document in a second window, wherein the first document includes one or more hyperlinks to the second document;

in response to receiving a selection of a user-selected chunk in the second window,

identify a first element type defined in the second document that includes the user-selected chunk;

display at least a portion of the second document in the first window;

identify a second element type of the second document as displayed in the first window that has the same element type as the first element type and that includes the user-selected chunk; and

update the display of the first window and the second window by;

display a portion of the second document that includes the second element type including the user-selected chunk in the first window;

highlight the second element type that includes the user-selected chunk in the first window; and

highlight the user-selected chunk in the second window.

25. A computer-implemented method for ranking hyperlinks of a document, comprising:

at a computer system including one or more processors and memory storing one or more programs, the one or more processors executing the one or more programs to perform the operations of;

displaying a portion of a document in a first window, the document including one or more hyperlinks to linked documents at respective data sources;

identifying one or more chunks in the document, wherein a respective chunk includes at least one of the one or more hyperlinks;

ranking the one or more chunks based at least in part on properties of the one or more hyperlinks in the one or more chunks and properties of the one or more chunks;

obtaining one or more linked documents from the respective data sources in accordance with respective rankings of the one or more chunks that include respective hyperlinks to the one or more linked documents; and

displaying at least a portion of one of the one or more linked documents in a second window.

26. The method of claim 25, wherein the properties of a respective hyperlink are selected from the group consisting of:

a target of the respective hyperlink;

the number of words in anchor text for the respective hyperlink; and

the meaning of the words in anchor text for the respective hyperlink.

27. The method of claim 25, wherein the properties of a respective chunk are selected from the group consisting of:

a ratio of raw text to hyperlink anchor text in the respective chunk; and

a location of the respective chunk in the document.

28. The method of claim 25, wherein prior to obtaining the one or more linked documents from the respective data sources, the method further comprises:

receiving a search request including one or more search terms provided by a user in a search box displayed in the second window.

29. The method of claim 28, wherein displaying at least a portion of a respective linked document in the second window includes:

determining whether the respective linked document includes chunks that match at least one of the one or more search terms; and

in response to determining that the respective linked document includes chunks that match at least one of the one or more search terms, displaying at least a subset of the chunks as a respective group in the second window.

30. The method of claim 25, wherein at least a subset of the one or more chunks include nested chunks, and wherein the method further comprises:

aggregating rankings of child chunks into rankings of corresponding parent chunks.

31. A system for ranking hyperlinks of a document, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions to;

display a portion of a document in a first window, the document including one or more hyperlinks to linked documents at respective data sources;

identify one or more chunks in the document, wherein a respective chunk includes at least one of the one or more hyperlinks;

rank the one or more chunks based at least in part on properties of the one or more hyperlinks in the one or more chunks and properties of the one or more chunks;

obtain one or more linked documents from the respective data sources in accordance with respective rankings of the one or more chunks that include respective hyperlinks to the one or more linked documents; and

display at least a portion of one of the one or more linked documents in a second window.

32. A computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions to:

display a portion of a document in a first window, the document including one or more hyperlinks to linked documents at respective data sources;

identify one or more chunks in the document, wherein a respective chunk includes at least one of the one or more hyperlinks;

rank the one or more chunks based at least in part on properties of the one or more hyperlinks in the one or more chunks and properties of the one or more chunks;

obtain one or more linked documents from the respective data sources in accordance with respective rankings of the one or more chunks that include respective hyperlinks to the one or more linked documents; and

display at least a portion of one of the one or more linked documents in a second window.