Purchasing pace control in a real-time bidding environment using a multi-loop control scheme

• US 9,747,618 B1
• Filed: 01/26/2015
• Issued: 08/29/2017
• Est. Priority Date: 12/18/2013
• Status: Active Grant

• Current Assignee: Valassis Digital Corp. (MX Holdings One LLC)
• Original Assignee: MaxPoint Interactive (MX Holdings One LLC)
• Inventors: Reiss, Randy
• Primary Examiner(s): Stoltenberg, David
• Application Number:
  US14/605,681
• Time in Patent Office: 946 Days
• CPC Class Codes: G06Q 30/0275 Auctions
• CPC Class Codes: G06Q 30/08 Auctions

Abstract

A method for controlling a purchasing pace in a real-time bidding environment is provided. A pacing parameter is dynamically adjusted using a multi-loop control algorithm including an outer control loop and an inner control loop, wherein the outer control loop outputs a control parameter, and the inner control loop uses this control parameter as an input and outputs a current value of the pacing parameter, which is adjusted over time by the multi-loop control algorithm. A series of bid requests generated by a real-time bidding exchange are received, each identifying a respective available ad placement in a respective webpage being loaded. For each received bid request, a decision is made in real-time, during the loading of the respective webpage, whether to submit a bid to purchase the respective ad placement based at least on the current value of the dynamically adjusted pacing parameter.

Claims

1. A method for controlling a pace of bidding in a network-based real-time bidding environment, the method comprising:

dynamically adjusting the value of a pacing parameter during a duration of a campaign, by executing a multi-loop control algorithm by a control system of the bidding system, the multi-loop control algorithm including at least an outer control loop and an inner control loop;

wherein the outer control loop is executed by the control system at an outer control loop frequency, wherein each execution of the outer control loop includes;

receiving as outer control loop inputs;

(a) an impression setpoint indicating a target number of ad placements purchased during an upcoming outer control loop time period and (b) data indicating an actual number of ad placements purchased during one or more past outer control loop time periods, and

outputting a baseline value of the pacing parameter for the upcoming outer control loop time period;

wherein the inner control loop is executed by the control system at an inner control loop frequency higher than the outer control loop frequency, such that the inner loop is executed multiple times during each execution of the outer control loop;

wherein for each execution of the outer control loop, the inner control loop;

receives the baseline value of the pacing parameter output by the respective execution of the outer control loop, and

executes multiple times to output a dynamically adjusted value of the pacing parameter based on the baseline value of the pacing parameter received from the outer control loop, to thereby adjust the current value of the pacing parameter over time;

wherein each execution of the inner control loop includes;

receiving bid quantity data indicating a number of purchase bids submitted by one or more bidders during an inner control loop time period corresponding with the respective execution of the inner control loop, and

outputting a dynamically adjusted current value of the pacing parameter based at least on the bid quantity data for the inner control loop time period;

receiving at the bidding system via a communications network a series of bid requests generated by a real-time bidding exchange during the duration of the campaign, each received bid request identifying a respective available ad placement in a respective webpage being loaded;

for each received bid request, the bidding system determining, in real-time during the loading of the respective webpage, whether to submit a purchase bid to the real-time bidding exchange to purchase the respective ad placement based at least on the current value of the dynamically adjusted pacing parameter.

2. The computer-implemented method of claim 1, wherein execution of the inner control loop automatically adjusts the pacing parameter in response to a detected increase in a rate of successful bid purchases submitted by the bidding system to decrease the current rate of purchase bids submitted by the bidding system.

3. The computer-implemented method of claim 1, wherein:

the dynamically adjusted pacing parameter comprises a pacing threshold value, and

determining whether to submit a bid to purchase the ad placement corresponding to a particular received bid request comprises;

determining a score for the bid request; and

comparing the determined score for the bid request with a current value of the pacing threshold value.

4. The computer-implemented method of claim 1, wherein the multi-loop control algorithm comprises a proportional-integral-derivative (PID) control algorithm.

5. The computer-implemented method of claim 1, wherein the outer control loop is programmed to:

receive as outer control loop inputs;

(a) an impression setpoint indicating a target number of ad placements purchased and (b) data indicating an actual number of ad placements purchased, and

output a bid volume setpoint as the control parameter, the bid volume setpoint comprising a target number of bids submitted to the real-time bidding exchange.

6. The computer-implemented method of claim 5, wherein the inner control loop is programmed to:

receive as inner control loop inputs;

(a) the bid volume setpoint output from the outer control loop and (b) data indicating an actual number of submitted purchase bids, and

output the current value of the pacing parameter based on the inner control loop inputs.

7. The computer-implemented method of claim 1, comprising executing both the outer control loop and the inner control loop at a controller of the control system.

8. The computer-implemented method of claim 1, comprising executing the outer control loop at a first controller of the control system, and executing the inner control loop at a second controller of the control system separate from the first controller.

9. The computer-implemented method of claim 1, comprising:

executing the outer control loop at a first controller of the control system;

distributing the control parameter output by the outer control loop executed by the first controller to a plurality of second controllers of the control system; and

executing an instance of the inner control loop at each of the plurality of second controllers.

10. The computer-implemented method of claim 1, wherein:

the outer control loop comprises a proportional-integral (PI) control algorithm; and

the inner control loop comprises a proportional (P) control algorithm.

11. The computer-implemented method of claim 1, wherein:

the dynamically adjusted pacing parameter comprises a pacing threshold value, and

determining whether to submit a bid to purchase the respective ad placement for a received bid request comprises;

determining a score for the bid request; and

comparing the determined score for the bid request with a current value of the pacing threshold value output by the inner control loop of the multi-loop control algorithm.

12. The computer-implemented method of claim 1, wherein the inner control loop of the multi-loop control algorithm is programmed to increase the pacing parameter upon defined conditions, but prevented from decreasing the pacing parameter.

13. The computer-implemented method of claim 1, wherein the inner control loop of the multi-loop control algorithm is prevented from decreasing the pacing parameter below the baseline value output by the outer control loop.

14. A control system configured to control a pace of bidding in a network-based real-time bidding environment, the control system comprising:

at least one processor; and

computer-readable instructions stored in non-transitory computer readable medium and executable by the at least one processor to;

dynamically adjust the value of a pacing parameter during a duration of a campaign by executing a multi-loop control algorithm including at least an outer control loop and an inner control loop;

wherein the outer control loop is executed at an outer control loop frequency, wherein each execution of the outer control loop includes;

receiving as outer control loop inputs;

(a) an impression setpoint indicating a target number of ad placements purchased during an upcoming outer control loop time period and (b) data indicating an actual number of ad placements purchased during one or more past outer control loop time periods, and

outputting a baseline value of the pacing parameter for the upcoming outer control loop time period;

wherein the inner control loop is executed at an inner control loop frequency higher than the outer control loop frequency, such that the inner loop is executed multiple times during each execution of the outer control loop;

wherein for each execution of the outer control loop, the inner control loop;

receives the baseline value of the pacing parameter output by the respective execution of the outer control loop, and

executes multiple times to output a dynamically adjusted value of the pacing parameter based on the baseline value of the pacing parameter received from the outer control loop, to thereby adjust the current value of the pacing parameter over time;

wherein each execution of the inner control loop includes;

receiving bid quantity data indicating a number of purchase bids submitted by one or more bidders during an inner control loop time period corresponding with the respective execution of the inner control loop, and

outputting a dynamically adjusted current value of the pacing parameter based at least on the bid quantity data for the inner control loop time period;

receive via a communications network a series of bid requests generated by a real-time bidding exchange during the duration of the campaign, each received bid request identifying a respective available ad placement in a respective webpage being loaded; and

for each received bid request, determine in real-time during the loading of the respective webpage whether to submit a purchase bid to the real-time bidding exchange to purchase the respective ad placement based at least on the current value of the dynamically adjusted pacing parameter.

15. A method for controlling a pace of bidding in a network-based real-time bidding environment, the method comprising:

receiving at a bidding system a series of bid requests from a real-time bidding exchange, each bid request corresponding to an ad placement in a webpage being loaded;

for each received bid request, the bidding system determining, in real-time during the loading of the respective webpage, whether to submit a purchase bid to the real-time bidding exchange to purchase the respective ad placement; and

executing a multi-loop control algorithm by the bidding system to dynamically control a rate at which purchase bids are submitted to the real-time bidding exchange over time, wherein the multi-loop control algorithm includes at least an outer control loop and an inner control loop for dynamically adjusting the value of a pacing parameter influencing the rate at which purchase bids are submitted to the real-time bidding exchange,

wherein the outer control loop is executed at an outer control loop frequency, wherein each execution of the outer control loop includes;

receiving as outer control loop inputs;

(a) an impression setpoint indicating a target number of ad placements purchased during an upcoming outer control loop time period and (b) data indicating an actual number of ad placements purchased during one or more past outer control loop time periods, and

outputting a baseline value of the pacing parameter for the upcoming outer control loop time period;

wherein the inner control loop is executed at an inner control loop frequency higher than the outer control loop frequency, such that the inner loop is executed multiple times during each execution of the outer control loop;

wherein for each execution of the outer control loop, the inner control loop;

receives the baseline value of the pacing parameter output by the respective execution of the outer control loop, and

executes multiple times to output a dynamically adjusted value of the pacing parameter based on the baseline value of the pacing parameter received from the outer control loop, to thereby adjust the current value of the pacing parameter over time;

wherein each execution of the inner control loop includes;

receiving bid quantity data indicating a number of purchase bids submitted by one or more bidders during an inner control loop time period corresponding with the respective execution of the inner control loop, and

outputting a dynamically adjusted current value of the pacing parameter based at least on the bid quantity data for the inner control loop time period.

16. The computer-implemented method of claim 15, wherein the current value of the pacing parameter is used as input by the bidding system for the determination of whether to submit a purchase bid for each received bid request.

17. The computer-implemented method of claim 16, wherein the inner control loop is programmed to, in response to a detected increase in the rate of purchase bids submitted by the bidding system, automatically adjust the pacing parameter to decrease the rate at which purchase bids are submitted.

18. The computer-implemented method of claim 15, comprising:

for each received bid request, determining whether to submit a purchase bid to purchase the respective ad placement based at least on the dynamically adjusted value of the pacing parameter output by the multi-loop control algorithm.