Web scan process
First Claim
1. An information provider system for providing information to users over an internet where the internet includes resource providers that provide static and dynamic resource records, said information provider system comprising:
- a) a uniform resource locator database for storing a URL and an indexed resource record corresponding to said URL;
b) an information processor for processing a user request for information corresponding to said indexed resource record by accessing said database with respect to said indexed resource record and returning said URL; and
c) an update engine that receives predetermined dynamic resource records from the internet, said update engine processing said predetermined dynamic resource records to detect an embedded URL and updating said database with said detected embedded URL and a predetermined indexed resource record corresponding to said detected embedded URL.
6 Assignments
0 Petitions
Accused Products
Abstract
An information locator system providing for the expedient acquisition, validation and updating of information locators in a heterogenous network protocol environment. The locator system includes an information location discrimination engine coupleable to a network operating in the heterogeneous network protocol environment, a validation engine coupled to the information location discrimination engine to receive information locators and a database providing for the storage of information locators as discrete searchable resource locators. The validation engine is also connected to the data base for retrieving and storing resource locators. The validation engine provides for the autonomous interrogation of the heterogeneous network protocol environment to validate a predetermined information locator as a corresponding resource locator that is unique to the discrete searchable resource locators then stored by the database. Where a valid and inferred unique information locator is found, the validation engine provides a corresponding resource locator to the data base for subsequently searchable storage.
-
Citations
24 Claims
-
1. An information provider system for providing information to users over an internet where the internet includes resource providers that provide static and dynamic resource records, said information provider system comprising:
-
a) a uniform resource locator database for storing a URL and an indexed resource record corresponding to said URL;
b) an information processor for processing a user request for information corresponding to said indexed resource record by accessing said database with respect to said indexed resource record and returning said URL; and
c) an update engine that receives predetermined dynamic resource records from the internet, said update engine processing said predetermined dynamic resource records to detect an embedded URL and updating said database with said detected embedded URL and a predetermined indexed resource record corresponding to said detected embedded URL. - View Dependent Claims (2, 3, 4)
-
-
5. An information locator system providing for the acquisition and validation of information locators in a heterogenous network protocol environment, said system comprising:
-
a) an information location discrimination engine coupleable to a network, operating within said heterogeneous network protocol environment, for identifying information locators transported by any of a plurality of network protocols;
b) a database providing for the storage of information locators as discrete searchable resource locators; and
c) a validation engine coupled to said information location discrimination engine to receive information locators and to said database for retrieving and storing resource locators, said validation engine interrogating said heterogeneous network protocol environment to validate a predetermined information locator against a corresponding resource locator stored by said database, said validation engine providing said corresponding resource locator to said database. - View Dependent Claims (6, 7, 8)
-
-
9. A method of autonomously collecting information references from dynamic resource data provided over the internet, said method comprising the steps of:
-
a) receiving predetermined dynamic resource data from a plurality of sources where each said source provides for the transport of dynamic resource data subject to a respective network data transport protocol;
b) parsing said predetermined dynamic resource data received from a first source to locate a first information reference embedded in said predetermined dynamic resource data;
c) retrieving first contextual data referenced by said first information reference from a second source; and
d) storing said first contextual data in association with said first information reference in a searchable database. - View Dependent Claims (10, 11, 12, 13, 14)
a) parsing said predetermined static resource data received from said second source to locate a second information reference embedded in said predetermined data;
b) retrieving second contextual data referenced by said second information reference from said second source; and
c) storing said second contextual data in association with said second information reference in said searchable database.
-
-
11. The method of claim 10 wherein a prior iteration of said steps of storing said first and second contextual data store identifiable prior instances of said first and second contextual data in respective association with said first and second information references in said searchable database.
-
12. The method of claim 11 further comprising the steps of:
-
a) determining whether said first information reference is stored in said database;
b) determining whether the prior instance of said first contextual data the same as the current instance of said first contextual data; and
c) selectively updating change data associated with said first information reference reflecting whether the prior instance of said first contextual data is the same as the current instance of said first contextual data.
-
-
13. The method of claim 12 further comprising the steps of:
-
a) selecting said first information reference based on said change data;
b) retrieving the current instance of first contextual data referenced by said first information reference from said second source;
c) determining whether the current instance of said first contextual data is the same as the prior instance of said first contextual data; and
d ) selectively updating the prior instance of said first contextual data in said searchable database with said current instance of said first contextual data.
-
-
14. The method of claim 13 further comprising the steps of:
-
a) receiving a network search request;
b) searching said searchable database including said first and second contextual information for a responsive match to said network search request; and
c) returning predetermined search information derived from said first and second contextual information and associated information references as stored by said database.
-
-
15. A system for establishing searchable information from which context based searches can be performed, said system comprising:
-
a database that stores said searchable information, including contextual information, correlated to resource locators;
a discrimination engine, coupleable to a network to receive a dynamic data feed, for selecting information locators from said dynamic data feed and for determining corresponding resource locators;
a validation engine for validating said corresponding resource locators and for obtaining corresponding contextual information, said discrimination engine coupled to said database to permit the storage of said corresponding contextual information with said corresponding resource locators in said database. - View Dependent Claims (16)
-
-
17. A system for network connection to multiple information sources for establishing searchable information from which context based searches can be performed over a network, said multiple information sources including one or more static information sources and one or more dynamic information sources that operate with heterogeneous network protocols whereby different ones of the multiple information sources employ correspondingly different ones of data transfer protocols for transfer of source information over said network, said system comprising:
-
a database that stores said searchable information, including contextual information, correlated to resource locators;
a discrimination engine, for coupling to one or more of said multiple information sources including coupling to a dynamic data feed of one of said dynamic information sources, for selecting information locators from source information of said dynamic data feed and determining corresponding resource locators;
a validation engine for validating said corresponding resource locators and for obtaining corresponding contextual information, said discrimination engine coupled to said database to permit the storage of said corresponding contextual information with said corresponding resource locators in said database. - View Dependent Claims (18, 19, 20, 21, 22)
-
-
23. A system for internet connection to multiple information sources for establishing searchable information from which context based searches can be performed, said multiple information sources including one or more static information sources and one or more dynamic information sources that operate with heterogeneous network protocols whereby different ones of the multiple information sources employ correspondingly different ones of data transfer protocols for transfer of source information, said source information available from internet locations that are distributed and unmapped, said system comprising:
-
a database that stores said searchable information, including contextual information, correlated to resource locators;
a discrimination engine, for coupling to one or more of said multiple information sources including coupling to a dynamic data feed of one of said dynamic information sources, for discovering and selecting information locators from source information of said dynamic data feed and determining corresponding resource locators;
a validation engine for validating said corresponding resource locators and for obtaining corresponding contextual information so as to map said internet locations of corresponding contextual information, said discrimination engine coupled to said database to permit the storage of said corresponding contextual information with said corresponding resource locators in said database.
-
-
24. A system for internet connection to multiple information sources for establishing searchable information from which context based searches can be performed, said multiple information sources including a plurality of information sources that operate with heterogeneous network protocols whereby different ones of the multiple information sources employ correspondingly different ones of data transfer protocols for transfer of source information, said source information available from internet locations that are distributed and unmapped, said system comprising:
-
a database that stores said searchable information, including contextual information, correlated to resource locators;
a discrimination engine, for coupling to said multiple information sources, for discovering and selecting information locators from source information having heterogeneous network protocols and determining corresponding resource locators;
a validation engine for validating said corresponding resource locators and for obtaining corresponding contextual information so as to map said internet locations of corresponding contextual information, said discrimination engine coupled to said database to permit the storage of said corresponding contextual information with said corresponding resource locators in said database.
-
Specification