It's a Man's Wikipedia? Assessing Gender Inequality in an Online Encyclopedia

Claudia Wagner, David García, Mohsen Jadidi, Markus Strohmaier

TL;DR

While Wikipedia’s editor base is famously male-dominated, this paper reveals that the encyclopedia actually does a decent job of including notable women. However, a deeper "multi-dimensional" analysis shows that gender inequality persists in how these women are described—focusing more on family and relationships—and how they are linked, often relegating them to the periphery of the knowledge network.

Introduction: The Multi-Dimensional Nature of Bias

Wikipedia editors are predominantly white and male, with estimates often hovering around 90%. The common assumption is that this demographic imbalance leads to a "coverage gap" where women are simply missing from the site. However, the authors of this study argue that bias is more than just a head-count. They propose that gender inequality manifests in subtle, systemic ways across four dimensions:

  1. Coverage: Are notable women included at the same rate as men?
  2. Structural: How are articles linked? Is there a "glass ceiling" in the network hierarchy?
  3. Lexical: Does the language used to describe women differ from that used for men?
  4. Visibility: Are women featured on the front page as often as men?

Methodology

The researchers employed rigorous computational methods to move beyond simple descriptive statistics:

  • Network Analysis: To measure Structural Bias, they used log-likelihood ratios to determine if articles of one gender preferably link to the same or different gender (assortativity). They also used k-coreness and in-degree to measure "centrality"—essentially asking if women are at the "core" of Wikipedia’s knowledge graph or on the "periphery."
  • Natural Language Processing (NLP): For Lexical Bias, they used an open-vocabulary approach, training a Naive Bayes classifier on tf-idf scores of word stems to identify which words most effectively distinguish an article about a woman from one about a man.
  • Null Models: Findings were compared against three different randomized "null" versions of the Wikipedia network to ensure statistical significance.

Datasets and Ground Truth

The study analyzed six language editions of Wikipedia (English, German, Spanish, French, Italian, and Russian). To determine who should be on Wikipedia (the "ground truth"), they used three external reference datasets: Freebase (~120k notable people), Pantheon (~11k biographies with a presence in 25+ languages), and Human Accomplishment (HA) (~4k eminent individuals in arts and sciences prior to 1950).

Proportional coverage of men (blue) and women (pink) from reference datasets across different Wikipedia language editions.

Key Results: Portrayal vs. Presence

Coverage is Surprisingly Good

Contrary to the "missing women" hypothesis, women are covered equally well, or even slightly over-represented, relative to the reference datasets in all six languages.

The Male-Female representation ratio relative to reference datasets. Values below 1.0 indicate that women are better represented in Wikipedia than in the source dataset.

As shown in the figures above, the proportional coverage for women frequently exceeds that of men across various languages and datasets. The representation ratio often dips below the 1.0 parity line, suggesting that Wikipedia editors may be making a concerted effort to include notable women identified in external canons.

Structural and Lexical Inequality

While presence is high, the nature of that presence reveals deep-seated biases:

  • The "Null Gender" Phenomenon: Lexical analysis shows that "male" is treated as the default human state. Words like "woman," "female," and "lady" are highly discriminative for articles about women, but "man" and "masculine" are rarely used to define men.
  • Romantic vs. Professional Focus: Biographies of women are significantly more likely to focus on family, marriage, and relationships. Between 23% and 32% of the most discriminative words for women fall into the categories of "Family," "Relationship," or "Gender," compared to only 0% to 4% for men.
  • The Smurfette Principle: Structurally, women are often less central. In English, Russian, and German editions, men are significantly more "central" to the network. Women often appear as "addenda" to male biographies, creating an asymmetry where women's articles link to men's far more often than the reverse.

Conclusion and Future Directions

The research highlights that achieving gender equality on Wikipedia requires more than just adding more biographies of women. It requires addressing the systemic ways in which women are described and linked.

One limitation is that the "ground truth" datasets themselves reflect historical biases. Future work could investigate whether these biases stem from the editors themselves or if Wikipedia is simply mirroring the biases found in the external sources editors use. Furthermore, the structural marginalization of women in the knowledge graph has implications for search and recommendation algorithms, which may inadvertently perpetuate these biases by ranking women lower in automated results.

Summary updated

Abstract

Wikipedia is a community-created encyclopedia that contains information about notable people from different countries, epochs and disciplines and aims to document the world's knowledge from a neutral point of view. However, the narrow diversity of the Wikipedia editor community has the potential to introduce systemic biases such as gender biases into the content of Wikipedia. In this paper we aim to tackle a sub problem of this larger challenge by presenting and applying a computational method for assessing gender bias on Wikipedia along multiple dimensions. We find that while women on Wikipedia are covered and featured well in many Wikipedia language editions, the way women are portrayed starkly differs from the way men are portrayed. We hope our work contributes to increasing awareness about gender biases online, and in particular to raising attention to the different levels in which gender biases can manifest themselves on the web.
BibTeX
@inproceedings{wagner2015it,
  author = {Claudia Wagner and David García and Mohsen Jadidi and Markus Strohmaier},
  title = {{It's a Man's Wikipedia? Assessing Gender Inequality in an Online Encyclopedia}},
  booktitle = {ICWSM},
  year = {2015},
  url = {https://openreview.net/forum?id=DbCETfiPaQ},
}
Figure