"A Game Without Competition Is Hardly a Game": The Impact of Competitions on Player Activity in a Human Computation Game"

Neal Reeves, Peter West, Elena Simperl

Introduction

Virtual Citizen Science (VCS) projects leverage the "wisdom of crowds" to tackle complex scientific problems, such as mapping the neural pathways of the brain. EyeWire, a prominent "Game With A Purpose" (GWAP), tasks volunteers with tracing 3D neuron segments called "cubes." While gamification elements like points and leaderboards are common in such platforms, the specific impact of head-to-head competitions on long-term motivation and community health remains a subject of debate. This paper investigates whether competitive events successfully drive player engagement, increase scientific output, and foster social interaction within the EyeWire community.

Methodology

The researchers employed a mixed-methods approach to understand both the design intent and the empirical impact of competitions. First, qualitative "reflection interviews" were conducted with six core EyeWire team members to identify the strategic goals behind their competition designs. Second, a quantitative analysis was performed on two primary datasets:

  1. Contribution Dataset: A 12-month log (August 2016 – August 2017) of 10,296 unique players, tracking points and completed cubes.
  2. Chat Dataset: A 91-day window of time-stamped messages and system achievements to measure social engagement.

Statistical significance was determined using non-parametric Mann-Whitney U tests to compare competition days against non-competition days, with Cohen’s d used to measure effect size.

The "Rising Tide" Effect

A central finding of the study is the "rising tide" effect: competitive events boost activity across the entire community, not just among those officially participating in the contest. While only approximately 4.8% of the active yearly player base officially joins competitions, these events trigger significant spikes in overall platform activity.

Cubes contributed per player over time, comparing competitors (red) and non-competitors (black). Shaded regions indicate competition periods.

As shown in the time-series data, even players who do not sign up for competitions contribute significantly more work during these periods. This suggests that the "buzz" generated by competitions—often communicated via email notifications or community chat—serves as a powerful reminder for lapsed or casual players to re-engage with the platform.

Qualitative Insights: Narrative and Social Dynamics

The interviews revealed that for EyeWire's designers, competitions are a tool to provide a "break from the grind." Tracing neurons can be repetitive; competitions introduce variety through narrative and social interaction.

  • Narrative over Mechanics: "Major" competitions, which include week-long murder mystery themes and custom artwork, were found to be more effective than "Minor" competitions that relied solely on point bonuses. This indicates that thematic context is a stronger motivator than raw scoring mechanics.
  • Social Lubrication: Competitions provide a social excuse for players to engage in real-time chat. This interaction is vital for community health, as it allows veterans to mentor new players and fosters a sense of belonging that transcends the scientific task.
  • The Autonomy Trade-off: The study noted that rigid competitive structures, such as "Team Versus" modes, sometimes resulted in lower individual contributions compared to more flexible "Marathon" modes. This suggests that when a game starts feeling too much like "work," player autonomy and motivation may suffer.

Quantitative Results

The statistical analysis confirmed that competitions have a significant positive impact on nearly all measured metrics of engagement and productivity.

Summary of statistical hypotheses and results regarding player activity and competition impact.

Key results include:

  • Participation: Major competitions showed a large effect size ($d=0.88$) on increasing player numbers compared to non-competition days.
  • Productivity: Total cube contributions—the primary scientific output—increased significantly ($d=0.79$). Even for non-competing players, the increase remained statistically significant ($d=0.35$).
  • Social Activity: Competitions successfully drove community interaction, with a moderate increase in total chat participants ($d=0.60$).

Conclusion and Future Work

Competitions in EyeWire function as more than just contests; they are community-wide events that catalyze activity even among non-participants. However, the study also highlights the importance of balancing competition with player autonomy and the value of narrative-driven engagement over simple point-based mechanics.

Future research should explore whether these findings generalize to "drier" citizen science platforms that lack EyeWire's high-fidelity 3D interface. Additionally, investigating RPG-style progression systems or individual "unlockables" could provide insights into sustaining engagement without the potential stress of direct head-to-head competition.

Summary updated

Abstract

Virtual citizen science (VCS) projects enable new forms of scientific research using crowdsourcing and human computation to gather and analyse large-scale datasets. To attract and sustain the number of participants and levels of participation necessary to achieve research aims, some VCS projects have introduced game elements such as competitions to tasks. However, we still know very little about how some game elements, particularly competitions, influence participation rates. To investigate the impact of game elements on player engagement, we conducted a two-part mixed-methods study of EyeWire, a VCS game. First, we interviewed EyeWire designers to understand their rationale for introducing competitions. Guided by their answers, we analysed two datasets of EyeWire user task contributions and chat logs to assess the effectiveness of competitions in achieving designers' goals. Our findings contribute to the growing understanding of how competitions influence participant activity in human computation initiatives and socio-technical systems such as VCS.
BibTeX
@inproceedings{reeves2018game,
  author = {Neal Reeves and Peter West and Elena Simperl},
  title = {{"A Game Without Competition Is Hardly a Game": The Impact of Competitions on Player Activity in a Human Computation Game"}},
  booktitle = {HCOMP},
  year = {2018},
  doi = {10.1609/hcomp.v6i1.13329},
}
Figure