Online Moderation in Competitive Action Games: How Intervention Affects Player Behaviors

Zhuofang Li, Rafal Kocielnik, Mitchell Linegar, Deshawn Sambrano, Fereshteh Soltani, Min Kim, Nabiha Naqvie, Grant Cahill, Animashree Anandkumar, R. Michael AlvarezarXiv 2024 · arXiv

TL;DR

This paper presents a large-scale causal inference study on online game moderation using real-world data from Call of Duty: Modern Warfare II. It reveals that moderation has a dual impact: it effectively reduces repeated disruptive behavior by up to 70% while driving unreformable players away from the platform. Crucially, the study demonstrates that the swiftness of a punishment ("celerity") is far more critical for behavioral correction than its severity.

What Problem Does This Paper Address?

Toxic and disruptive behaviors—such as cheating, hate speech, and offensive usernames—plague online multiplayer games, ruining the experience for the vast majority of players. While gaming companies deploy massive moderation systems, measuring the actual causal impact of these interventions on subsequent player behavior is incredibly challenging.

Most existing research relies on laboratory setups or small-scale surveys, which lack ecological validity. In the real world, you cannot easily run an A/B test where you intentionally let some cheaters go unpunished to serve as a control group. This paper tackles this gap by utilizing observational data from a live, industry-scale gaming environment to understand how the timing (quick vs. delayed) and severity (milder vs. stricter) of punishments causally influence a player's future toxicity and willingness to keep playing.

Methods

To overcome the impossibility of random assignment, the authors employ a quasi-experimental design leveraging natural variations in how quickly the moderation team processed reports. They apply advanced causal machine learning (CausalML) frameworks, specifically a Doubly Robust (DR) Learner using XGBoost and linear models as base learners.

To control for confounding factors—such as the likelihood that more egregious offenses are fast-tracked by moderators—they use propensity score estimation. This balances the treatment and control groups based on pre-report player performance metrics (e.g., match score, kill-death ratio, and damage dealt).

The authors construct two primary analyses:

  1. Moderation vs. No Moderation: Comparing players moderated on the same day as the report against those whose moderation was delayed by at least 7 days (acting as a proxy for an unmoderated period).
  2. Quick vs. Delayed Moderation: Comparing players moderated within 3 days against those moderated after 7 or more days.

Datasets

The study utilizes an anonymized, real-world dataset from Call of Duty: Modern Warfare II (COD:MWII) spanning February 1st, 2023, to April 12th, 2023. The dataset tracks player reports and subsequent human-verified moderation actions across four categories: cheating, offensive text chat, offensive user ID, and offensive voice chat.

Fig. 2. Breakdown of the unique proportion of players by moderation reason in our dataset. Data generated from Feb 1st, 2023 to April 12th, 2023.

Key Insights and Ideas

  • The Dual Impact of Moderation: Interventions don't just rehabilitate players; they act as a filter. Moderation successfully curtails repeated offenses for some, but it also drives inherently disruptive players to play fewer matches or abandon the game entirely.
  • Swiftness Beats Severity: Swift moderation (within 3 days) drastically improves behavioral correction. Interestingly, simply increasing the severity of a punishment (e.g., giving a penalty notice instead of a warning) did not show a statistically significant difference in reducing future text or voice offenses unless it was executed quickly.
  • Cheaters vs. Toxic Chatters: Cheaters and toxic players react differently to being caught. Moderation causes cheaters to drastically drop their participation rate (quitting or playing less), whereas toxic text/voice chatters are more likely to stay and reform their behavior. This suggests cheaters are motivated by game progression or a "thrill of control" that vanishes once caught, while toxic chatters might just be venting frustration or unaware of community boundaries.
  • High-Skill Players are More Reformable: There is a strong negative correlation between a player's skill metrics (like K/D ratio) and their post-moderation offense rates. Highly skilled players reduce their toxicity significantly more than lower-skilled players after an intervention, likely because they face a higher "opportunity cost" (losing a valued account or reputation).

Key Results

  • Behavioral Reduction: Overall, receiving a moderation intervention reduced repeated cheating reports by 70.33%, offensive text chat by 30.84%, and offensive user IDs by 46.05%.
  • The Power of Speed: Quick moderation ($\le 3$ days) compared to delayed moderation led to an additional 61.44% drop in repeated cheating, a 41.89% drop in offensive text chat, and a 29.81% drop in offensive voice chat.
Fig. 1. Distribution of Delay in Moderation; Figure showing both PDF and CDF of its distribution. Data generated from Feb 1st, 2023 to April 12th, 2023.
  • Participation Effects: Moderation led to a 10.80% decline in game participation for cheaters and a 12.03% decline for offensive voice chatters. Conversely, quick moderation for text and user ID offenses actually increased relative player participation by 9.87% and 7.35% compared to delayed enforcement, proving that fast feedback loops keep salvageable players engaged.

Limitations and Future Work

  • Observational Data Constraints: Although the authors used doubly robust estimators, the study still relies on the assumption that all key confounders were observed. Unmeasured variables, such as a player's psychological state or history in other games, could still introduce bias.
  • Lack of Experimental Control: Because the data came from a live production system, the researchers could not actively manipulate punishments or deliberately withhold interventions for a true control group.
  • Generalizability: While these insights likely apply to other competitive genres (like MOBAs or other FPS games), it remains an open question whether they generalize to less competitive environments like RPGs, sandbox games, or traditional social media platforms.
  • Future Directions: The authors suggest exploring adaptive moderation systems using multi-armed bandit algorithms to dynamically optimize interventions, as well as studying how transparency (explaining exactly why a player was penalized) impacts compliance.

Summary updated

Abstract

Online competitive action games have flourished as a space for entertainment and social connections, yet they face challenges from a small percentage of players engaging in disruptive behaviors. This study delves into the under-explored realm of understanding the effects of moderation on player behavior within online gaming on an example of a popular title - Call of Duty(R): Modern Warfare(R)II. We employ a quasi-experimental design and causal inference techniques to examine the impact of moderation in a real-world industry-scale moderation system. We further delve into novel aspects around the impact of delayed moderation, as well as the severity of applied punishment. We examine these effects on a set of four disruptive behaviors including cheating, offensive user name, chat, and voice. Our findings uncover the dual impact moderation has on reducing disruptive behavior and discouraging disruptive players from participating. We further uncover differences in the effectiveness of quick and delayed moderation and the varying severity of punishment. Our examination of real-world gaming interactions sets a precedent in understanding the effectiveness of moderation and its impact on player behavior. Our insights offer actionable suggestions for the most promising avenues for improving real-world moderation practices, as well as the heterogeneous impact moderation has on indifferent players.
BibTeX
@misc{li2024online,
  author = {Zhuofang Li and Rafal Kocielnik and Mitchell Linegar and Deshawn Sambrano and Fereshteh Soltani and Min Kim and Nabiha Naqvie and Grant Cahill and Animashree Anandkumar and R. Michael Alvarez},
  title = {{Online Moderation in Competitive Action Games: How Intervention Affects Player Behaviors}},
  year = {2024},
  eprint = {2411.01057},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2411.01057},
}

Loading related content...

Figure