Method and system for extracting, analyzing, storing, comparing and reporting on data stored in web and/or other network repositories and apparatus to detect, prevent and obfuscate information removal from information servers

• US 20080306968A1
• Filed: 04/30/2008
• Published: 12/11/2008
• Est. Priority Date: 02/24/2000
• Status: Abandoned Application

• Current Assignee: Findbase LLC
• Original Assignee: Findbase LLC
• Inventors: Nandhra, Ian R.
• Application Number:
  US12/150,948
• Publication Number:
  US 20080306968A1
• Time in Patent Office: Days
• US Class Current: 707/10
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

A system, method and apparatus providing for the search, identification, retrieval and analysis of data contained in World Wide Web (WWW) and network pages and storage repositories. Mechanisms are provided to facilitate selection of such data as is required by a user, to report in a manner required by the user and to present the results in a plurality of ways. Also disclosed is a system, method to protect information retrieval from Information Servers such as those found on the world wide web (WWW). A method is described to analyze accesses to the information server for patterns indicating the type of system accessing the server. A method is described to format information such that it cannot be easily machine analyzed by such apparatus as lexical analysis and textual search methods. A method is described to include information into information server contents such that it would mislead and otherwise confuse non-human systems used to retrieve the data. Other methods describe access signature analysis and how this can be used to detect and optionally prevent or modify information requests.

Claims

1. A method of emulating access to a data repository by a particular type of access mechanism, comprising:

analyzing a collection of representative accesses by the access mechanism to determine a collective access signature; and

accessing the data repository by performing actions in accordance with the determined access signature.

2. A method of detecting whether a collection of actions to access a data repository is not by a particular type of access mechanism, comprising:

analyzing the collection of actions to determine a collective access signature; and

processing the collective access signature to determine a probability that the collection of accesses is not by the particular type of access mechanism.

3. The method of claim 2, wherein:

the processing step includes a step of determining a probability based initially on an indication within the collective access signature of a frequency value that corresponds to the frequency with which the accesses are occurring.

4. The method of claim 3, wherein:

in the processing step, when the frequency value indicated within the collective access signature is above a particular threshold, further processing the collective access signature to determine a probability that the collection of accesses is not by the particular type of access mechanism based on other properties of the collection of accesses, other than frequency, indicated in the signature.

5. The method of claim 3, wherein:

in the processing step, the probability determining step includes determining whether the frequency value is above a particular frequency value threshold.

6. The method of claim 5, wherein:

the method further comprises determining the particular frequency value threshold based on frequency of prior accesses to the data repository.

7. The method of claim 4, wherein:

the other properties includes an order in which the accesses of the collection of accesses occur.

8. The method of claim 7, wherein:

the method includes;

determining the order in which the accesses of the collection of accesses occurs from an order value indicated in the access signature; and

comparing the actual order against the determined order.

9. The method of claim 4, wherein:

the other properties includes at least one of time between accesses and order of accesses.

10. The method of claim 4, wherein:

the other properties includes an access to a data item that would normally only be accessed by an automated mechanism.

11. The method of claim 10, wherein:

the method further comprises introducing into the data repository the components that would normally only be accessed by an automated mechanism.

12. The method of claim 2, and further comprising:

when the collection of actions to access the data repository is determined to be not by a particular type of access mechanism, taking at least one of the actions of;

for at least one access after the collection of accesses, modifying the data that would otherwise be provided out of the data repository;

for at least one access after the collection of accesses, not responding to the access to the data repository;

for at least one access after the collection of accesses, providing data in addition to the data that would otherwise be provided out of the data repository; and

for at least one access after the collection of accesses, delaying a response to the access.