Media bias and polarization through the lens of a Markov switching latent space network model

Roberto Casarin, Antonio Peruzzi, Mark F. J. SteelThe Annals of Applied Statistics 2025 · DOI

TL;DR

This paper introduces a novel dynamic model to understand how news outlets exhibit bias and how polarization evolves on social media. By combining network data of audience overlap with text analysis of news content, the model offers a more nuanced view of media bias and identifies distinct "polarization regimes" over time.

What Problem Does This Paper Address?

In today's digital age, news outlets face incentives to cater to specific audiences, potentially leading to biased reporting. Simultaneously, social media's structure can amplify existing political divisions, creating "echo chambers" and increasing polarization. Understanding how media bias operates and how polarization manifests dynamically on these platforms is crucial for comprehending public discourse and its societal impact. Existing methods often struggle to capture both the subtle nuances of media bias and the evolving nature of polarization in a unified framework.

Methods

The authors propose a Markov-Switching Latent Space (MS-LS) network model. This model is novel in several ways:

  • Combined Data Sources: It integrates two types of data:
  • Audience-Duplication Networks: This captures how users interact with different news outlets, specifically looking at "commenters in common" between outlets. This is modeled using a Poisson distribution for the number of shared commenters.
  • Text-Based Indicators: Information from news content itself is used to infer media slant.
  • Latent Space for Bias: The model uses a latent space (a lower-dimensional representation) where news outlets are positioned. This latent position is interpreted as a measure of political leaning or media bias. The distance between outlets in this space influences the likelihood of audience overlap.
  • Markov-Switching Dynamics: To capture evolving polarization, the model incorporates a Markov-Switching process. This allows the latent space to transition between a finite number of "polarization regimes" (e.g., low vs. high polarization) over time. This is a key innovation for dynamic analysis.
  • Bayesian Inference: The model is estimated using a Bayesian framework with MCMC methods, providing robust uncertainty quantification.

Datasets

The study utilizes a newly constructed dataset of daily Facebook activity from national and local news outlets across four European countries (France, Germany, Italy, and Spain) for the years 2015 and 2016. This dataset includes:

  • Audience-Duplication Networks: Derived from Facebook comments on news outlet posts.
  • Media Slant Index: Constructed using text analysis of news outlet posts and political party language, building on existing methodologies.
  • External Validation Data: The PEW Research Survey data is used to validate the estimated media slant.

Key Insights and Ideas

  • Nuanced Media Bias: The model demonstrates that combining network behavior (audience overlap) with textual content provides a richer and more accurate measure of media bias than either source alone.
  • Dynamic Polarization Regimes: Instead of a simple linear increase in polarization, the data suggests distinct "regimes" of polarization that news outlets and their audiences can shift between. This offers a more sophisticated understanding of how polarization evolves.
  • Cross-Country Heterogeneity: Polarization dynamics are not uniform across countries, with some showing more stable patterns and others exhibiting more frequent shifts between regimes.
  • Model Parsimony: The Markov-Switching approach offers a computationally efficient way to model dynamic changes compared to continuously varying models.

Key Results

  • The model's estimated latent leaning measure shows a strong positive correlation (0.73) with the PEW Research Survey index, validating its ability to capture media bias.
  • The analysis reveals evidence of cross-country differences in polarization dynamics, contradicting a simple, universal shift towards high polarization.
  • Model selection favors the dynamic specification over static models, highlighting the importance of capturing temporal changes in media bias and polarization.
  • The inclusion of text-based indicators significantly improves the accuracy of latent variable estimation.

Limitations and Future Work

The authors acknowledge several limitations:

  • Limited Longitudinal Data: The study is based on data from 2015-2016, and there's a scarcity of similar longitudinal studies, making it challenging to establish a definitive "ground truth" for polarization changes, especially in Europe.
  • Identification Challenges: Identifying latent factors and states in dynamic models can be inherently difficult.
  • Cross-Country Independence: The current model assumes independence between countries, which could be improved by incorporating hierarchical priors to allow for cross-country information sharing.

Future research directions suggested include:

  • Exploring more advanced text-analysis indicators for media bias.
  • Conducting a more fine-grained analysis at the post level.
  • Investigating alternative latent space embedding specifications (e.g., circular, hyperbolic).
  • Exploring different identifying restrictions for the model.

Summary updated

Abstract

News outlets are now more than ever incentivized to provide their audience with slanted news, while the intrinsic homophilic nature of online social media may exacerbate polarized opinions. Here we propose a new dynamic latent space model for time-varying online audience-duplication networks, which exploits social media content to conduct inference on media bias and polarization of news outlets. We contribute to the literature in several directions: (1) Our model provides a novel measure of media bias that combines information from both network data and text-based indicators; (2) we endow our model with Markov-switching dynamics to capture polarization regimes while maintaining a parsimonious specification; (3) we contribute to the literature on the statistical properties of latent space network models. The proposed model is applied to a set of data on the online activity of national and local news outlets from four European countries in the years 2015 and 2016. We find evidence of a strong positive correlation between our media slant measure and a well-grounded external source of media bias. In addition, we provide insight into the polarization regimes across the four countries considered.
BibTeX
@article{casarin2025media,
  author = {Roberto Casarin and Antonio Peruzzi and Mark F. J. Steel},
  title = {{Media bias and polarization through the lens of a Markov switching latent space network model}},
  journal = {The Annals of Applied Statistics},
  year = {2025},
  doi = {10.1214/25-aoas2069},
}
Figure