Seeding search engine crawlers using intercepted network traffic
First Claim
Patent Images
1. A method, comprising:
- monitoring data packets exchanged in a computer network over which documents having respective location identifiers are distributed, so as to detect a request to access a given document;
extracting a location identifier of the given document from the request; and
providing the location identifier to a search engine that searches for data in a set of the documents, so as to cause the search engine to add the given document to the set.
1 Assignment
0 Petitions
Accused Products
Abstract
A method includes monitoring data packets exchanged in a computer network over which documents having respective location identifiers are distributed, so as to detect a request to access a given document. A location identifier of the given document is extracted from the request. The location identifier is provided to a search engine that searches for data in a set of the documents, so as to cause the search engine to add the given document to the set.
-
Citations
20 Claims
-
1. A method, comprising:
-
monitoring data packets exchanged in a computer network over which documents having respective location identifiers are distributed, so as to detect a request to access a given document; extracting a location identifier of the given document from the request; and providing the location identifier to a search engine that searches for data in a set of the documents, so as to cause the search engine to add the given document to the set. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. Apparatus, comprising:
-
an interface, which is operative to communicate with a computer network over which documents having respective location identifiers are distributed; and a processor, which is configured to monitor data packets exchanged in the computer network so as to detect a request to access a given document stored in the computer network, to extract a location identifier of the given document from the request, and to provide the location identifier to a search engine that searches for data in a set of the documents so as to cause the search engine to add the given document to the set. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A system, comprising:
-
a network element, which is configured to monitor data packets exchanged in a computer network over which documents having respective location identifiers are distributed, to detect in the monitored data packets a request to access a given document stored in the computer network, to extract a location identifier of the given document from the request and to send the extracted location identifier over the computer network; and a search engine, which is coupled to search for data in a set of the documents, to accept the location identifier from the network element and, responsively to the location identifier, to add the given document to the set.
-
Specification