Improving Ads-Profitability Using Traffic-Fingerprints

Adam Gabriel Dobrakowski, Andrzej Pacuk, Piotr Sankowski, Marcin Mucha, Pawel Brach

TL;DR

Researchers have developed a method to boost ad profitability by over 50% using "traffic-fingerprints"—24-dimensional vectors that represent a website's hourly traffic distribution. By clustering anonymous web pages based on when people click rather than who they are, advertisers can identify and block low-performing traffic sources even when individual site data is too sparse for traditional statistics.

What Problem Does This Paper Address?

In the modern advertising landscape, privacy is king. With the phase-out of cookies and the rise of anonymous browsing, it is increasingly difficult for advertisers to track individual user behavior. Furthermore, many ad networks (like MGID) use "domain masking," hiding the actual names of websites and identifying them only by a Unique ID (UID).

This creates a "cold start" and "sparse data" problem. Many small publishers generate only a few clicks per day. Since conversion rates (CR) are often as low as 0.1%, you might need thousands of clicks to statistically determine if a specific site is profitable. By the time an advertiser realizes a site is a "money pit," they’ve already wasted their budget. The authors sought a way to predict a site's quality using only the timing of its traffic.

Methods

The authors introduce the Traffic-Fingerprint:

  1. Vectorization: For every domain (UID), they count clicks for each hour of the day ($i = 0, \dots, 23$).
  2. Normalization: These counts are normalized so the vector represents the distribution of traffic over 24 hours, rather than the absolute volume.
  3. Clustering: They use k-means clustering to group UIDs with similar traffic patterns. The optimal number of clusters is determined using the "Elbow method" and validated with silhouette scores.
  4. Rule Generation: They analyze the profitability of each cluster. If a cluster is consistently unprofitable (or unprofitable during specific hours, like late at night), they create a rule to block ads for all UIDs belonging to that cluster during those times.
  5. Dynamic Reassignment: Every day, UIDs are reassigned to clusters based on their most recent traffic data, allowing the system to adapt to changing site behaviors.

Datasets

The study utilized data from five major ad networks:

  • MGID: The primary platform for online testing (over 300k domains in the training set).
  • Exoclick
  • Content Stream
  • Taboola
  • Traffic Stars

The datasets included millions of clicks and hundreds of thousands of unique domains, split into training and testing sets to validate the model's predictive power.

Key Insights and Ideas

  • Timing is a Proxy for Intent: The core "aha" moment is that when a site gets traffic reveals its nature. A site that peaks during work hours likely has a different audience (and conversion intent) than one that peaks at 3:00 AM.
  • The "Night Owl" Penalty: Across almost all networks, clusters with higher proportions of evening and night traffic were significantly less profitable.
  • Quality is Persistent: Interestingly, low-profit clusters didn't just perform poorly at night; they had lower conversion rates around the clock compared to high-profit clusters. This suggests the traffic-fingerprint is a reliable indicator of the overall "quality" of a domain's audience.
  • Clustering Beats Individual Tracking: By grouping sites, the researchers could make confident blocking decisions for "micro-publishers" that only provided 50 clicks—far too few for traditional site-by-site optimization.

Key Results

The results were substantial across both simulated and live environments:

  • Online Performance: In live A/B tests on the MGID platform, the algorithm increased total profit by 53.4%.
  • Profit per Click: The profit per click increased by 37%, rising from $0.021 to $0.029.
  • Efficiency: Despite blocking certain time slots and clusters, the total volume of traffic did not decrease; the budget was simply redistributed to higher-quality sources.
  • Offline Simulations: In some networks, the theoretical profit increase was even higher (e.g., a staggering 581% for Traffic Stars), though the authors note that offline results are often inflated because they don't account for how ad networks re-allocate budget in real-time.

Limitations and Future Work

The authors acknowledge several areas for improvement:

  • Ad Network Reaction: Blocking domains changes how ad networks distribute your remaining budget, which can lead to unpredictable secondary effects not captured in offline models.
  • Human in the Loop: The current system still relies on human operators to set initial stakes and creative content; it is a "semi-automatic" optimization tool rather than a fully autonomous one.
  • Supervised Learning: The current approach uses unsupervised clustering. The authors suggest that future iterations could use supervised models to directly predict profitability from the 24-dimensional fingerprints.
  • Interpretability: While clustering is effective, building complex blocking rules that don't "flicker" (turning domains on and off too frequently) remains a challenge for stability.

Summary updated

Abstract

This paper introduces the concept of traffic-fingerprints, i.e., normalized 24-dimensional vectors representing a distribution of daily traffic on a web page. Using specially tuned k-means clustering we show that similarity of traffic-fingerprints is related to the similarity of profitability time patterns for ads shown on these pages. In other words, these fingerprints are correlated with the conversions rates, thus allowing us to argue about conversion rates on pages with negligible traffic. By blocking or unblocking whole clusters of pages we were able to increase the revenue of online campaigns by more than 50%.
BibTeX
@inproceedings{dobrakowski2022improving,
  author = {Adam Gabriel Dobrakowski and Andrzej Pacuk and Piotr Sankowski and Marcin Mucha and Pawel Brach},
  title = {{Improving Ads-Profitability Using Traffic-Fingerprints}},
  booktitle = {AusDM},
  year = {2022},
  url = {https://openreview.net/forum?id=ZWwcgv3ITh},
}

Loading related content...

Figure