×

System and methods for cleansing automated robotic traffic from sets of usage logs

  • US 10,489,361 B2
  • Filed: 01/26/2015
  • Issued: 11/26/2019
  • Est. Priority Date: 01/27/2014
  • Status: Active Grant
First Claim
Patent Images

1. A method of cleansing data generated by one or more servers in response to database interactions resulting from an automated software robot interacting with the one or more servers via a network, the method comprising:

  • receiving a first set of requests for one or more sets of data;

    retrieving metadata from a metadata database based on the first set of requests;

    embedding a link in the metadata to at least one full record associated with the metadata, the at least one full record being stored in a source database;

    receiving a second set of requests in response to actuation of the link embedded in the metadata;

    in response to receiving the second set of requests, retrieving from the source database, the at least one full record associated with the metadata;

    capturing, in a plurality of usage logs, each data structure executed in response to processing the first and second sets of requests;

    retrieving the plurality of usage logs from a non-transitory computer-readable medium, each of the plurality of usage logs including log entries corresponding to events that occurred during a session between a user device and the one or more servers, wherein the events include the second set of requests;

    processing the log entries in each of the plurality of usage logs in response to execution of a log analyzer to determine a relationship between the events that occurred during each session;

    executing the log analyzer to classify the plurality of usage logs based on the relationship as either corresponding to human behavior or automated software robot behavior; and

    in response to classification of one or more of the plurality of usage logs as corresponding to the automated software robot behavior, excluding the one or more of the plurality of usage logs from generation of a metric,wherein processing the log entries to determine the relationship includes measuring an intentionality associated with the events corresponding to the log entries based on determining, from the log entries, a quantity of search requests that were submitted during the session which did not result in a payoff event,wherein the metric is generated based on one or more of the plurality of usage logs that are classified as corresponding to human behavior, andwherein the one or more servers utilize the metric to adjust subsequent discovery of the metadata in the metadata database in response to search queries from each user device.

View all claims
  • 11 Assignments
Timeline View
Assignment View
    ×
    ×