System and process for mediated crawling
First Claim
1. A method for searching network based content for target content, said method comprising the steps of:
- determining selected levels of a structured data store for searching for content related to said target content, wherein said structured data store comprises network based content; and
searching said selected levels for content related to said target content.
4 Assignments
0 Petitions
Accused Products
Abstract
A system and method for searching networked based content limits searching unnecessary content. The first time a web site is encountered, an exhaustive search is conducted (522), and a site map (300) is generated (524) and the URL of the web site is added to a directory of encountered web sites (526). The next time the web site is encountered, the system utilizes the site map and directory to search only for relevant content (614). Web sites are revisited, in accordance with information derived from previous visits, to conduct subsequent exhaustive searches in order to update the site map and directory. A site map includes a structured data storage format, wherein content of the web site is organized in levels.
100 Citations
32 Claims
-
1. A method for searching network based content for target content, said method comprising the steps of:
-
determining selected levels of a structured data store for searching for content related to said target content, wherein said structured data store comprises network based content; and
searching said selected levels for content related to said target content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer system for searching network based content for target content, said computer system comprising at least one computer, all computers in said system being communicatively coupled to each other, wherein each of said at least one computer includes at least one program stored therein for allowing communication between each and every of said at least one computer, each of said at least one program operating in conjunction with one another to cause said at least one computer to perform the steps of:
-
determining selected levels of a structured data store for searching for content related to said target content (516), wherein said structured data store comprises network based content; and
searching said selected levels for content related to said target content. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A program readable medium having embodied thereon a program for causing a processor to search network based content for target content, said program readable medium comprising:
-
means for causing said processor to determine selected levels of a structured data store for searching for content related to said target content, wherein said structured data store comprises network based content; and
means for causing said processor to search said selected levels for content related to said target content. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
-
25. A data signal embodied in a carrier wave comprising:
-
a determine selected level code segment for determining selected levels of a structured data store for searching for content related to said target content, wherein said structured data store comprises network based content; and
a search selected level code segment for searching said selected levels for content related to said target content. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32)
-
Specification