Optimizing Trade-offs Among Stakeholders in Real-Time Bidding by Incorporating Multimedia Metrics

Xiang Chen, Bowei Chen, Mohan S. Kankanhalli

Abstract

Traditional Real-Time Bidding (RTB) systems prioritize the highest bidder to maximize immediate publisher revenue, often at the expense of user experience and long-term advertiser value. This paper presents a two-stage framework that integrates multimedia metrics—such as ad memorability, visual saliency, and contextual relevance—into the auction process. By optimizing the trade-offs between revenue and these qualitative factors, the proposed system achieves significant improvements in click-through rates and relevance with only marginal revenue sacrifices.

Introduction

In the current digital advertising landscape, the "winner" of an ad slot is typically determined by the highest bid. While this approach maximizes short-term revenue for publishers, it frequently ignores the interests of advertisers and users. Ads chosen solely on price may clash with a webpage's content or visual style, leading to "ad blindness" or user annoyance. For advertisers, winning a high-priced slot might not translate to brand value if the ad lacks memorability or relevance. To address this, we propose a framework that balances short-term financial gains with long-term ecosystem health.

The Two-Stage RTB Framework

The core contribution of this work is a computational framework designed to move beyond simple price-based selection by incorporating a second stage of evaluation.

The proposed two-stage RTB framework illustrating the flow from the buy-side market through the auction and re-ranking stages to the final ad placement.

The process operates in two distinct stages:

  1. Stage I (Ad Auction): A standard Second-Price (SP) auction identifies potential revenue and establishes a baseline of candidate ads.
  2. Stage II (Optimal Re-ranking): Candidate ads are re-ranked using a weighted linear combination of six metrics: publisher revenue, advertiser utility, ad memorability (predicted via MemNet), click-through rate (CTR), contextual relevance (semantic similarity), and visual saliency (calculated via the Minimum Barrier Salient method).

Optimizing Multimedia Metrics

The framework employs an optimization algorithm to determine the ideal weights for these metrics. The goal is to maximize a total rank score while keeping publisher revenue loss within a strict, pre-defined threshold (e.g., 5–7%).

Visualizing the re-ranking process: (a) sample webpage and candidate ads with normalized variables, (b) radar charts showing the multi-dimensional profile of each ad, and (c) weight combination instances for optimization.

By treating computer vision and natural language processing metrics as formal economic variables, the system can select ads that are not only profitable but also visually harmonious and contextually appropriate. The authors found these six variables to be largely independent, which justifies the use of a linear combination for the ranking score.

Datasets and Methodology

Evaluating such a system requires a combination of bidding data and raw multimedia assets. The authors synthesized a dataset from four primary sources:

  • Multimedia Data: Over 12,000 unique webpages and their associated ads from AOL and YouTube.
  • Auction Data: A large-scale SSP dataset containing over 6.6 million auctions and Microsoft adCentre data for realistic CTR distributions.

A sampling and matching process was used to simulate auctions where each candidate ad possessed both a bid value and a set of multimedia metrics.

Key Results and Insights

Experimental results demonstrate that a small sacrifice in immediate revenue leads to substantial gains in other areas:

  • AOL Dataset: A 6% revenue loss threshold resulted in a 27.1% increase in CTR and an 18.1% boost in contextual relevance.
  • YouTube Dataset: A 7% revenue loss threshold yielded a 24.5% increase in CTR and a 21.1% improvement in visual saliency.

This "revenue sacrificing" strategy suggests that the "sweet spot" for a sustainable advertising ecosystem involves a modest (5–10%) trade-off of short-term profit for significantly improved user engagement and brand impact.

Limitations and Future Directions

While promising, the framework has limitations. It does not strictly guarantee incentive compatibility (truthful bidding), although the exogenous nature of the re-ranking metrics may mitigate this. Additionally, the current model assumes a single ad slot per page, whereas real-world pages often feature multiple slots. Future work will focus on live A/B testing to observe long-term user behavior and extending the model to multi-slot environments.

Summary updated

BibTeX
@inproceedings{chen2017optimizing,
  author = {Xiang Chen and Bowei Chen and Mohan S. Kankanhalli},
  title = {{Optimizing Trade-offs Among Stakeholders in Real-Time Bidding by Incorporating Multimedia Metrics}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2017},
  doi = {10.1145/3077136.3080802},
}
Figure