INTERACTIVE WEB CRAWLING
First Claim
Patent Images
1. A method for performing a crawl of a target, the method comprising the steps of:
- initiating a crawling process on the target;
encountering a structure that requires data input;
prompting a user to respond to the requirement for data input;
receiving the response from the user;
applying the user response in satisfaction of the data input requirement for the crawling process; and
storing the data input in a file accessible by the crawler on future scans of the target.
3 Assignments
0 Petitions
Accused Products
Abstract
A crawler that is either based on an interactive mode of operation or includes an interactive mode along with one or more other modes, such as automatic or manual. Similar to an automatic mode crawler, the crawler traverses web sites, web content and links. However, if the crawler encounters a structure that requires human interaction, such as a form, a radio button selector, a drop down selector, a human verification test, etc., the crawler pauses and prompts a user to take action.
-
Citations
20 Claims
-
1. A method for performing a crawl of a target, the method comprising the steps of:
-
initiating a crawling process on the target;
encountering a structure that requires data input;
prompting a user to respond to the requirement for data input;
receiving the response from the user;
applying the user response in satisfaction of the data input requirement for the crawling process; and
storing the data input in a file accessible by the crawler on future scans of the target. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method for performing a crawl of a target, the method comprising the steps of:
-
initiating a crawling process on the target;
encountering a structure that requires data input;
identifying the mode of operation for the crawling process;
if the mode of operation is the interactive mode;
prompting a user to respond to the requirement for data input;
if a response is received from the user, applying the user response in satisfaction of the data input requirement for the crawling process; and
storing the data input in a file accessible by the crawler on future scans of the target. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method for performing a crawl of a target, the method comprising the steps of:
-
initiating a crawling process on the target;
encountering a structure that requires data input;
identifying the mode of operation for the crawling process;
if the mode of operation is the interactive mode;
prompting a user to respond to the requirement for data input;
if a response is received from the user, applying the user response in satisfaction of the data input requirement for the crawling process; and
storing the data input in a file accessible by the crawler on future scans of the target; and
if the mode of operation is the automatic mode;
satisfying the input data requirement by obtaining data from a pre-loaded file. - View Dependent Claims (17, 18, 19, 20)
-
Specification