Search engine coverage

• US 20070022082A1
• Filed: 07/20/2005
• Published: 01/25/2007
• Est. Priority Date: 07/20/2005
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Leue, Carsten, Schonfeld, Uri, Azagury, Alain
• Application Number:
  US11/185,999
• Publication Number:
  US 20070022082A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A method for improved search engine coverage, the method including receiving at least one computer-network based document at a first computer, storing any of a link and content associated with the document in a cache, providing the cached information to either of a traversal application and a search engine, and causing the retrieval of the document via either of the traversal application and the search engine using the cached information.

Claims

1. A method for improved search engine coverage, the method comprising:

receiving at least one computer-network based document at a first computer;

storing any of a link and content associated with said document in a cache;

providing said cached information to either of a traversal application and a search engine; and

causing the retrieval of said document via either of said traversal application and said search engine using said cached information.

2. A method according to claim 1 wherein said receiving step comprises receiving where said document is not linked to other documents.

3. A method according to claim 1 and further comprising compiling statistical information relating to said cached information.

4. A method according to claim 3 and further comprising providing said statistical information to either of said traversal application and said search engine.

5. A method according to claim 1 wherein said storing step comprises:

identifying any links associated with said document; and

normalizing any of said links.

6. A method according to claim 5 wherein said providing step comprises providing any of said normalized links to either of said traversal application and said search engine.

7. A method according to claim 5 and further comprising replacing any of said links in said document with any of said normalized links.

8. A method for improved search engine coverage, the method comprising:

identifying any links associated with a computer-network based document;

normalizing any of said links;

providing any of said normalized links to either of a traversal application and a search engine; and

causing the retrieval of said document via either of said traversal application and said search engine using any of said normalized links.

9. A method according to claim 8 and further comprising replacing any of said links in said document with any of said normalized links.

10. A method according to claim 9 and further comprising:

receiving a request from a requester for said document; and

providing said document with said normalized links to said requestor.

11. A system for improved search engine coverage, the system comprising:

means for receiving at least one computer-network based document at a first computer;

means for storing any of a link and content associated with said document in a cache;

means for providing said cached information to either of a traversal application and a search engine; and

means for causing the retrieval of said document via either of said traversal application and said search engine using said cached information.

12. A system according to claim 11 wherein said means for receiving is operative to receive where said document is not linked to other documents.

13. A system according to claim 11 and further comprising means for compiling statistical information relating to said cached information.

14. A system according to claim 13 and further comprising means for providing said statistical information to either of said traversal application and said search engine.

15. A system according to claim 11 wherein said means for storing is operative to:

identify any links associated with said document; and

normalize any of said links.

16. A system according to claim 15 and further comprising means for replacing any of said links in said document with any of said normalized links.

17. A system for improved search engine coverage, the system comprising:

means for identifying any links associated with a computer-network based document;

means for normalizing any of said links;

means for providing any of said normalized links to either of a traversal application and a search engine; and

means for causing the retrieval of said document via either of said traversal application and said search engine using any of said normalized links.

18. A system according to claim 17 and further comprising means for replacing any of said links in said document with any of said normalized links.

19. A system according to claim 18 and further comprising:

means for receiving a request from a requestor for said document; and

means for providing said document with said normalized links to said requestor.

20. A computer-implemented program embodied on a computer-readable medium, the computer program comprising:

a first code segment operative to receive at least one computer-network based document at a first computer;

a second code segment operative to store any of a link and content associated with said document in a cache;

a third code segment operative to provide said cached information to either of a traversal application and a search engine; and

a fourth code segment operative to cause the retrieval of said document via either of said traversal application and said search engine using said cached information.