A Quantitative Study of Social Organization in Open Source Software Communities

Marcelo Serrano Zanetti, Emre Sarigöl, Ingo Scholtes, Claudio Juan Tessone, Frank Schweitzer

Abstract

The success of open source projects crucially depends on the voluntary contributions of a sufficiently large community of users. Apart from the mere size of the community, interesting questions arise when looking at the evolution of structural features of collaborations between community members. In this article, we discuss several network analytic proxies that can be used to quantify different aspects of the social organisation in social collaboration networks. We particularly focus on measures that can be related to the cohesiveness of the communities, the distribution of responsibilities and the resilience against turnover of community members. We present a comparative analysis on a large-scale dataset that covers the full history of collaborations between users of 14 major open source software communities. Our analysis covers both aggregate and time-evolving measures and highlights differences in the social organisation across communities. We argue that our results are a promising step towards the definition of suitable, potentially multi-dimensional, resilience and risk indicators for open source software communities.

Introduction

The success of open-source software (OSS) is often attributed to "Linus’ Law": given enough contributors, all bugs are easy to find. However, the size of a community is not the only factor that determines its long-term health. The structure of collaborations—how members interact and organize—is equally critical. This research, presented at the 2012 Imperial College Computing Student Workshop (ICCSW), applies social network analysis to the evolution of 14 major OSS communities over a decade. By analyzing bug-tracking data, the authors demonstrate that a community's "social fingerprint" can reveal hidden risks to its sustainability and resilience.

Methodology

The researchers adopted a network perspective, treating community members as nodes and their interactions as edges.

  1. Data Extraction: The study focused on Bugzilla databases, specifically the ASSIGNEE (who fixes the bug) and CC (who monitors it) fields. An interaction was recorded whenever a user updated a bug report to add another user to these fields.
  2. Dynamic Analysis: To capture temporal evolution, the authors used a 30-day sliding window, advanced by one-day increments. This approach allows for the observation of structural changes over time rather than relying on a single static graph.
  3. Network Metrics: Three primary measures were used:
  4. Closeness Centralization: Indicates if the network is dominated by a few central figures or if responsibility is distributed.
  5. Clustering Coefficient: Measures cohesiveness by determining if a user's collaborators also collaborate with each other.
  6. Assortativity: Measures the tendency of high-degree "power users" to interact with each other versus newcomers.

Social Fingerprints and Structural Risk

A key finding is that projects, even within the same domain, exhibit distinct "social fingerprints." For example, Java IDEs like Eclipse and NetBeans show markedly different collaboration patterns. Eclipse tends toward assortative structures where experts primarily interact with other experts, while projects like KDE and Gentoo are more disassortative, with experts engaging a broader range of users.

Social fingerprints of four major OSS communities, showing distinct structural patterns despite similar node counts.

The study highlights the "Gentoo Anomaly" between 2006 and 2008. During this period, Gentoo's clustering coefficient plummeted while its closeness centralization spiked. This structural shift indicated that almost all collaborations were being mediated by a single central member, creating a "bus factor" risk—the community's stability became overly dependent on one individual.

Quantitative Results

The analysis of 14 major projects, including operating systems (Gentoo, RedHat) and application suites (Firefox, LibreOffice), revealed that size does not dictate structure. Two communities of similar size can have vastly different levels of cohesion.

Time-evolving network metrics for Eclipse (top row) and Gentoo (bottom row), illustrating the structural divergence and the 2006-2008 anomaly in Gentoo.

Key quantitative observations include:

  • LCC Stability: In most projects, the Largest Connected Component (LCC)—the "core" of the community—contained 70% to 90% of active users, indicating well-integrated cores.
  • Cohesion Variance: During the 2006–2008 window, Eclipse’s clustering coefficient (~0.15) was roughly ten times higher than Gentoo’s (~0.01), despite similar LCC sizes (~500 nodes).
  • Centralization Risks: Periods of extreme centralization (closeness centralization > 0.6) in projects like Gentoo signal a lack of social cohesion and high vulnerability to member turnover.

Conclusion and Future Directions

While the study provides powerful indicators of community health, it is limited by its exclusive reliance on Bugzilla data, omitting interactions on mailing lists or direct code commits. Future work aims to link these social metrics to performance indicators, such as bug-fix latency, to determine if specific structures lead to higher-quality software. The research represents a significant step toward defining multi-dimensional resilience and risk indicators for the open-source ecosystem.

Summary updated

Abstract

The success of open source projects crucially depends on the voluntary contributions of a sufficiently large community of users. Apart from the mere size of the community, interesting questions arise when looking at the evolution of structural features of collaborations between community members. In this article, we discuss several network analytic proxies that can be used to quantify different aspects of the social organisation in social collaboration networks. We particularly focus on measures that can be related to the cohesiveness of the communities, the distribution of responsibilities and the resilience against turnover of community members. We present a comparative analysis on a large-scale dataset that covers the full history of collaborations between users of 14 major open source software communities. Our analysis covers both aggregate and time-evolving measures and highlights differences in the social organisation across communities. We argue that our results are a promising step towards the definition of suitable, potentially multi-dimensional, resilience and risk indicators for open source software communities.
BibTeX
@inproceedings{zanetti2012quantitative,
  author = {Marcelo Serrano Zanetti and Emre Sarigöl and Ingo Scholtes and Claudio Juan Tessone and Frank Schweitzer},
  title = {{A Quantitative Study of Social Organization in Open Source Software Communities}},
  booktitle = {ICCSW},
  year = {2012},
  doi = {10.4230/oasics.iccsw.2012.116},
}
Figure