System and method for attributing multi-channel conversion events and subsequent activity to multi-channel media sources

• US 8,768,770 B2
• Filed: 08/30/2011
• Issued: 07/01/2014
• Est. Priority Date: 08/30/2010
• Status: Active Grant

• Current Assignee: Adap.tv, Inc. (Apollo Global Management, Inc.)
• Original Assignee: Lucid Commerce, Inc.
• Inventors: Kitts, Brendan, Burdick, Brian, Au, Dyng, Wei, Liang, Powter, Amanda
• Primary Examiner(s): Myhre, James W
• Assistant Examiner(s): GOLDMAN, MICHAEL H
• Application Number:
  US13/221,851
• Publication Number:
  US 20120054019A1
• Time in Patent Office: 1,036 Days
• Field of Search: 705/14.52, 705/14.49, 705/14.66, 705/14.73, 705/14.4, 705/14.41, 705/14.42, 705/14.44, 705/14.46, 705/14.68
• US Class Current: 705/14.52
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: G06Q 30/0243 Comparative campaigns
• CPC Class Codes: G06Q 30/0246 Traffic
• CPC Class Codes: G06Q 30/0254 based on statistics
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0272 Period of advertisement exposure

Abstract

This paper presents a practical method for measuring the impact of multiple marketing events on sales, including marketing events that are not traditionally trackable. The technique infers which of several competing media events are likely to have caused a given conversion. The method is tested using hold-out sets, and also a live media experiment for determining whether the method can accurately predict television-generated web conversions.

Claims

1. A method comprising:

determining, by a processing device, a first demographic profile of viewers for each of a plurality of media events;

identifying, by the processing device, a plurality of conversion events having unknown attribution, wherein each of the plurality of conversion events comprises purchase of a product or a service;

determining, by the processing device, a second demographic profile for each of a plurality of customers corresponding to the plurality of conversion events;

comparing the first demographic profiles of viewers for the plurality of media events with the second demographic profiles of the plurality of customers corresponding to the plurality of conversion events; and

determining, by the processing device, probabilistic attributions for the plurality of conversion events based on a result of the comparing of the first demographic profiles to the second demographic profiles, a probabilistic attribution for a conversion event comprising a media channel and a media event with a highest probability of having caused the conversion event.

2. The method of claim 1, further comprising:

obtaining known conversion event-media event pairs;

using the known conversion event-media event pairs to build a model to predict a probability that a specific conversion event results from one of the plurality of media events;

executing the model for unattributed conversion events in conjunction with comparing the first demographic profiles and the second demographic profiles to determine a probability of attribution to each media event for each unattributed conversion event;

wherein the model takes into account customers associated with the unattributed conversion events who have been exposed to multiple media events.

3. The method of claim 2, wherein the model is a supervised machine learning model comprising one or more of logistic regression, decision trees, or neural networks.

4. The method of claim 2, wherein the model takes into account a geographic area receiving the media event, a population estimated to have seen the media event, a time of the media event, and the demographics of the media event.

5. The method of claim 2, wherein a threshold is pre-selected such that if the highest probability of the media event is lower than the threshold, the conversion event is attributed to one or more unknown events.

6. The method of claim 5, further comprising statistically identifying and characterizing the one or more unknown events.

7. The method of claim 5, further comprising:

generating a first report of the plurality of conversion events using the plurality of media events and the one or more unknown events; and

generating a second report of only the plurality of conversion events having probabilistic attribution to media events of the plurality of media events.

8. The method of claim 5, wherein the threshold is pre-selected by an aggregate statistics method.

9. The method of claim 2, wherein the model is assigned an identification code, and attributions made by the model for a set of conversion events and media events are tracked using the identification code, and further wherein multiple models are run to produce attribution decisions, and each model is assigned a different identification code, and further wherein software code that generates each of the models is referenced using the identification code, analyzed conversion events, and analyzed media events to allow different models to be modularly exchanged in production, and further wherein a specific model is deployed by using the identification code of that specific model.

10. The method of claim 9, further comprising:

monitoring accuracy of the multiple models using the known conversion event-media event pairs;

executing automated checks of the model on incoming data; and

triggering an alert if the accuracy is below a predefined value or if the incoming data is erroneous.

11. The method of claim 1, wherein a conversion event is one of the following:

a phone-in order, a web order, or a retail purchase transaction.

12. The method of claim 1, wherein media channels corresponding to the plurality of media events comprise one or more of the following:

television, radio, internet, billboard, print, and direct mail advertisement, and further wherein a media event is an advertisement using one of the media channels.

13. The method of claim 1, further comprising:

attributing a first percentage of credit for a conversion event to a first media event; and

attributing a second percentage of credit for the conversion event to a second media event.

14. The method of claim 1, wherein the comparison further assigns a probability of having generated each of the plurality of conversion events to each of the plurality of media events.

15. The method of claim 1, wherein the plurality of media events is online, and the plurality of conversion events is offline;

or the plurality of media events is offline, and the plurality of conversion events is online.

16. The method of claim 1, wherein the probabilistic attribution is determined without uniquely tracking a customer from media event exposure to conversion event.

17. The method of claim 1, further comprising:

generating a report of the conversion events and attribution to one or more media events.

18. The method of claim 17, further comprising:

removing web conversion events from the report that are attributed to television media events; and

showing the web conversion events attributed to television media events as part of television media performance metrics.

19. The method of claim 1, wherein determining a media channel and media event having a highest probability of having generated the conversion event further comprises using geo-spatial statistics for the plurality of conversion events and the plurality of media events.

20. The method of claim 1, wherein each of the plurality of conversion events occurs through a conversion event channel, and further where the conversion event channel is one of retail or web, and the media event channel is television.

21. The method of claim 1, wherein the first demographic profiles and the second demographic profiles each comprise demographic information and psychographic information.

22. The method of claim 1, wherein determining a media channel and media event having a highest probability of having generated the conversion event further comprises using time differences between the plurality of conversion events and the plurality of media events.

23. The method of claim 1, wherein at least one of the plurality of conversion events is not linked to any of the plurality of media events by linking keys.

24. A computer-implemented method of attributing conversion events to advertising events, the method comprising:

inferring, by a processing device, a model and parameters, wherein the model and parameters accurately predict data from a training set, wherein the training set comprises a first plurality of conversion events and a first plurality of advertising events, and further wherein each of the first plurality of conversion events is believed to be caused by one or more of the advertising events;

identifying, by the processing device, a second plurality of conversion events having unknown attribution, wherein each of the second plurality of conversion events comprises purchase of a product or a service; and

using the model to determine probabilistic attributions for the second plurality of conversion events, the probabilistic attribution for a conversion event of the second plurality of conversion events comprising one or more of a second plurality of advertising events having a highest probability of having caused the conversion event, wherein the conversion event is not linked to any of the second plurality of advertising events by linking keys.

25. The method of claim 24, wherein the training set is obtained by selecting advertising event-conversion event instances, and further wherein the training set is used to train the model to recognize and correctly attribute future advertising event-conversion event pairs.

26. The method of claim 24, wherein the training set is obtained by inspecting historical data pertaining to the first plurality of conversion events and the first plurality of advertising events to determine cases consistent with causation of the first plurality of conversion events with a high probability.

27. The method of claim 24, further comprising using a probability threshold to determine if the second plurality of conversion events was caused by one or more unknown events.

28. The method of claim 27, further comprising statistically identifying and characterizing the one or more unknown events.

29. A system for attributing a plurality of conversion events to a plurality of media events, the system comprising:

at least one database configured to store a training set comprised of known conversion event-media event pairs; and

a processor, communicatively coupled to the at least one database, and configured to;

train a supervised model using the training set;

identify a plurality of conversion events having unknown attribution, wherein each of the plurality of conversion events comprises purchase of a product or a service; and

use the model to determine probabilistic attributions for the plurality of conversion events, the probabilistic attribution for a conversion event comprising one or more of a plurality of media events having a highest probability of having caused the conversion event, wherein the conversion event is not linked to any of the plurality of media events by linking keys.

30. The system of claim 29, wherein the processor is further configured to use a probability threshold to determine if the plurality of responses was caused by one or more unknown events.

31. The system of claim 30, wherein the processor is further configured to statistically identify and characterize the one or more unknown events.

32. The system of claim 29, wherein the processor is further configured to:

determine a first demographic and psychographic profile for each of a plurality of media events;

determine a second demographic and psychographic profile for each of a plurality of customers corresponding to the plurality of conversion events;

compare the first demographic and psychographic profiles with the second demographic and psychographic profiles to determine in conjunction with the supervised model a most likely media channel and media event that generated each of the conversion events.