Determining content item expansion prediction accuracy
First Claim
1. A computer-implemented method performed by a data processing apparatus, compromising:
- receiving reporting messages from user devices, each reporting message for a respective unique identifier, each unique identifier corresponding to a request for a resource sent from a user device, the reporting messages specifying display configurations of respective resources and display configurations of content item environments on the respective resources in which respective expandable content items were displayed;
determining pairs of serving data log entries and reporting messages based on the unique identifiers, each serving data log entry specifying a predicted expansion direction and a unique identifier for the request, each of the pairs being a pair of a serving data entry and a reporting message having a matching unique identifier; and
for each pair, determining an accuracy measure for the respective predicted expansion direction based at least in part on a comparison of the respective predicted expansion direction and the display configurations of the respective resource and content item environment, the accuracy measure representing an accuracy of the respective predicted expansion direction being a match for the respective resource and content item environment.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, and systems, including computer programs encoded on computer-readable storage mediums, including a method for determining accuracy measures for predicted expansion directions for content item environments. The method includes, identifying a predicted expansion direction for the content item environment; generating a serving data log entry for the request specifying the predicted expansion direction and a unique identifier for the request; providing an expandable content item having the predicted expansion direction and response data specifying the unique identifier; receiving reporting messages specifying the display configurations of the resources and content item environments; determining pairs of serving data log entries and reporting messages based on the unique identifiers, each pair having a matching unique identifier; and determining an accuracy measure for the respective predicted expansion direction based on a comparison of the respective predicted expansion direction and the display configurations of the respective resource and content item environment.
54 Citations
15 Claims
-
1. A computer-implemented method performed by a data processing apparatus, compromising:
-
receiving reporting messages from user devices, each reporting message for a respective unique identifier, each unique identifier corresponding to a request for a resource sent from a user device, the reporting messages specifying display configurations of respective resources and display configurations of content item environments on the respective resources in which respective expandable content items were displayed; determining pairs of serving data log entries and reporting messages based on the unique identifiers, each serving data log entry specifying a predicted expansion direction and a unique identifier for the request, each of the pairs being a pair of a serving data entry and a reporting message having a matching unique identifier; and for each pair, determining an accuracy measure for the respective predicted expansion direction based at least in part on a comparison of the respective predicted expansion direction and the display configurations of the respective resource and content item environment, the accuracy measure representing an accuracy of the respective predicted expansion direction being a match for the respective resource and content item environment. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A system comprising:
-
one or more data processors; and
instructions stored on a computer storage apparatus that when executed by the one or more data processors cause the one or more data processors to perform operations comprising;receiving reporting messages from user devices, each reporting message for a respective unique identifier, each unique identifier corresponding to a request for a resource sent from a user device, the reporting messages specifying display configurations of respective resources and display configurations of content item environments on the respective resources in which respective expandable content items were displayed; determining pairs of serving data log entries and reporting messages based on the unique identifiers, each serving data log entry specifying a predicted expansion direction and a unique identifier for the request, each of the pairs being a pair of a serving data entry and a reporting message having a matching unique identifier; and for each pair, determining an accuracy measure for the respective predicted expansion direction based at least in part on a comparison of the respective predicted expansion direction and the display configurations of the respective resource and content item environment, the accuracy measure representing an accuracy of the respective predicted expansion direction being a match for the respective resource and content item environment. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A computer-readable storage medium having instructions stored thereon, which, when executed by one or more data processors, causes the one or more processor to perform operations comprising:
-
receiving reporting messages from user devices, each reporting message for a respective unique identifier, each unique identifier corresponding to a request for a resource sent from a user device, the reporting messages specifying display configurations of respective resources and display configurations of content item environments on the respective resources in which respective expandable content items were displayed; determining pairs of serving data log entries and reporting messages based on the unique identifiers, each serving data log entry specifying a predicted expansion direction and a unique identifier for the request, each of the pairs being a pair of a serving data entry and a reporting message having a matching unique identifier; and for each pair, determining an accuracy measure for the respective predicted expansion direction based at least in part on a comparison of the respective predicted expansion direction and the display configurations of the respective resource and content item environment, the accuracy measure representing an accuracy of the respective predicted expansion direction being a match for the respective resource and content item environment. - View Dependent Claims (12, 13, 14, 15)
-
Specification