ProFairRec: Provider Fairness-aware News Recommendation

Tao Qi, Fangzhao Wu, Chuhan Wu, Peijie Sun, Le Wu, Xiting Wang, Yongfeng Huang, Xing Xie

TL;DR

ProFairRec is a novel framework that tackles the "rich get richer" problem in news recommendation by disentangling content-based "fair" representations from provider-based "biased" ones. By using adversarial learning to strip away provider-specific signals, it significantly improves exposure for minority news outlets without sacrificing recommendation accuracy.

What Problem Does This Paper Address?

Online news platforms like Apple News or Microsoft News are the primary gateways for information, but they face a hidden fairness crisis. Recommendation algorithms are typically trained on historical user click data. However, this data is heavily skewed: a few popular providers capture the vast majority of clicks, while smaller, minority providers are rarely seen.

As shown in Figure 1, the average exposure per news article varies wildly across different providers. When models are trained on this biased data, they don't just learn user preferences; they learn to amplify these existing biases. This creates a feedback loop where popular providers get even more exposure, while minority voices are pushed further into the margins (Figure 2). This lack of "provider fairness" hurts the diversity of perspectives available to users and threatens the revenue of smaller news organizations.

Figure 1: Average exposure number per news of providers on the MIND dataset [50]. We randomly select 50 providers.

Methods

The authors propose ProFairRec (Provider Fairness-aware News Recommendation), a general framework that can be wrapped around existing recommendation models. Its core strategy is representation decomposition.

Instead of learning a single vector to represent a news article or a user, ProFairRec learns two distinct components:

  1. Provider-Fair Representations: Learned strictly from news content (like titles) to capture the actual "meat" of the story.
  2. Provider-Biased Representations: Learned from provider IDs to capture the inherent popularity bias in the training data.

To ensure these two components stay truly separate, the framework employs two clever tricks:

  • Adversarial Learning: A "provider discriminator" tries to guess which company published a news article based only on its "fair" representation. The recommendation model is trained to "fool" this discriminator, effectively scrubbing provider-identifying information from the fair representation.
  • Orthogonal Regularization: This mathematical constraint forces the fair and biased vectors to be perpendicular (orthogonal) to each other, ensuring they don't share overlapping information.

Crucially, during training, the model uses both representations to fit the real-world (biased) data. But during inference (when actually recommending news to a user), it throws away the biased parts and matches users to news based solely on the fair, content-driven representations.

Figure 3: The overall framework of ProFairRec.

Datasets

The researchers evaluated ProFairRec using the MIND (Microsoft News Dataset), a large-scale benchmark containing logs from 1 million users over six weeks. Since the original MIND dataset lacked provider information, the authors used a web crawler to augment it with provider IDs for over 1,700 different news sources.

Key Insights and Ideas

  • "Modeling Bias to Beat Bias": One of the most interesting takeaways is that you shouldn't just ignore bias during training. Because the training data is biased, a model that ignores it will struggle to converge or will accidentally absorb the bias anyway. By explicitly giving the bias a "place to live" (the biased representation), the model can isolate it and discard it later.
  • Fairness is Model-Agnostic: ProFairRec isn't a standalone model but a framework. The authors successfully applied it to several state-of-the-art architectures like NRMS, NAML, and LSTUR, proving that fairness can be "plugged in" to existing systems.
  • The Balancing Act: The adversarial loss weight ($\lambda_a$) acts as a dial. Increasing it improves fairness but can eventually hurt accuracy. The authors demonstrate that there is a "sweet spot" where fairness is significantly improved with negligible impact on performance (Figure 6).

Key Results

The experiments showed that ProFairRec consistently outperformed standard models and other fairness techniques (like simple re-ranking) across two key metrics: Relative Exposure Ratio (ER) and Ranked Normalized Difference (rND).

  • Fairness Gains: As seen in Figure 4, ProFairRec (the black line) achieved much higher ER scores (closer to 1.0 is better) and lower rND scores (closer to 0 is better) compared to baselines, meaning it gave minority providers a much fairer shot at being seen.
  • Accuracy Preservation: In Table 4 of the paper, the authors show that while fairness increased dramatically, the drop in accuracy (AUC and nDCG) was minimal—often less than 1%. This debunks the myth that fairness must always come at the cost of a poor user experience.
Figure 4: Provider fairness performance. Higher ER@K and lower rND@K indicate better fairness.

Limitations and Future Work

While ProFairRec is a major step forward for provider-side fairness, the authors note a few areas for growth:

  • User-Side Fairness: This paper focuses on the companies providing the news. It doesn't explicitly address biases related to the users themselves (e.g., demographic biases in what is recommended to different groups).
  • Generalization: The current work is tailored for news. The authors plan to explore how this decomposition approach might work in other domains, such as e-commerce, where small sellers face similar "popularity bias" hurdles.

For more details, you can find the full paper on arXiv: 2204.04724.

Summary updated

Abstract

News recommendation aims to help online news platform users find their preferred news articles. Existing news recommendation methods usually learn models from historical user behaviors on news. However, these behaviors are usually biased on news providers. Models trained on biased user data may capture and even amplify the biases on news providers, and are unfair for some minority news providers. In this paper, we propose a provider fairness-aware news recommendation framework (named ProFairRec), which can learn news recommendation models fair for different news providers from biased user data. The core idea of ProFairRec is to learn provider-fair news representations and provider-fair user representations to achieve provider fairness. To learn provider-fair representations from biased data, we employ provider-biased representations to inherit provider bias from data. Provider-fair and -biased news representations are learned from news content and provider IDs respectively, which are further aggregated to build fair and biased user representations based on user click history. All of these representations are used in model training while only fair representations are used for user-news matching to achieve fair news recommendation. Besides, we propose an adversarial learning task on news provider discrimination to prevent provider-fair news representation from encoding provider bias. We also propose an orthogonal regularization on provider-fair and -biased representations to better reduce provider bias in provider-fair representations. Moreover, ProFairRec is a general framework and can be applied to different news recommendation methods. Extensive experiments on a public dataset verify that our ProFairRec approach can effectively improve the provider fairness of many existing methods and meanwhile maintain their recommendation accuracy.
BibTeX
@inproceedings{qi2022profairrec,
  author = {Tao Qi and Fangzhao Wu and Chuhan Wu and Peijie Sun and Le Wu and Xiting Wang and Yongfeng Huang and Xing Xie},
  title = {{ProFairRec: Provider Fairness-aware News Recommendation}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2022},
}
Figure