Online division of labour: emergent structures in Open Source Software

María J. Palazzi, Jordi Cabot, Javier Luis Cánovas Izquierdo, Albert Solé-Ribalta, Javier Borge-Holthoefer

Abstract

The development of Open Source Software (OSS) fundamentally depends on the participation and commitment of volunteer developers. While platforms like GitHub provide a virtually unlimited framework for decentralized collaboration, human biological and cognitive limits suggest that some form of hierarchy and division of labour must exist to maintain efficiency. By representing OSS projects as developer-file bipartite networks, this study analyzes three key structural properties: nestedness, modularity, and in-block nestedness. The results show that projects naturally evolve into internally organized blocks with bounded sizes, connecting online collaboration patterns to the celebrated Dunbar number. These findings create a link between bio-cognitive constraints and online work team assembly.

Introduction

Platforms like GitHub offer a decentralized, asynchronous, and remote framework where an unlimited number of developers can theoretically collaborate. However, human beings have well-documented cognitive limits regarding the number of social connections they can maintain—often referred to as the Dunbar number (typically estimated between 100 and 250). This research investigates how massive, distributed OSS communities self-organize to overcome these limits without top-down corporate management, looking for structural signatures of the "division of labour."

Structural Architectures of Collaboration

To understand the architecture of OSS collaboration, projects are modeled as bipartite unweighted networks where nodes represent contributors and files. An edge exists if a contributor has edited a specific file. The study focuses on three distinct mesoscale structural patterns:

  1. Nestedness ($\mathcal{N}$): A hierarchical structure where specialists (developers editing few files) work on a strict subset of the files edited by generalists (developers editing many files).
  2. Modularity ($\mathcal{Q}$): The tendency of the network to split into distinct, well-connected compartments or communities focusing on specific groups of files.
  3. In-block nestedness ($\mathcal{I}$): A hybrid structure where the network is modular, but the internal structure of each module is nested.
Matrix representations of nestedness, modularity, and in-block nestedness architectures in developer-file networks.

Methods and Datasets

The researchers analyzed 65 of the top 100 most popular public OSS projects on GitHub. The final dataset encompassed 48,015 contributors, 668,283 files, and 912,766 commits. To identify these structures, the authors used an extremal optimization algorithm combined with a Kernighan-Lin refinement procedure to maximize modularity and in-block nestedness. Projects were then mapped onto a ternary plot to visualize which architecture dominated based on the project's evolutionary stage.

Key Insights: The Dunbar Number Online

The study reveals that successful OSS projects exhibit high structural organization, with 90% of analyzed projects showing strong modularity or in-block nestedness scores above 0.4.

Crucially, the research found that communities have a hard size limit. When the algorithm partitions projects into modules, the maximum size of these sub-communities naturally caps out between 100 and 200 contributors, echoing Dunbar's cognitive limits. This scale independence suggests that as a project grows, it does not develop larger communities; instead, it simply generates more communities of a similar size.

Distribution of the largest community sizes for modularity (a) and in-block nestedness (b), showing a peak around the Dunbar number.

Furthermore, the data suggests that maturity breeds internal hierarchy. While newer projects tend to be purely modular (fragmented teams), highly mature projects evolve an "in-block nested" structure. This indicates that within specialized modules, a clear hierarchy of generalist "core" developers and specialist "drive-by" developers emerges to maintain efficiency.

Conclusion

This analysis demonstrates that even in the boundless environment of the internet, human cognitive constraints dictate the organization of work. The emergence of modular and in-block nested structures in OSS projects provides a blueprint for how decentralized teams self-organize into manageable, efficient units. Future research may look into the temporal dynamics of these structures to watch them form in real-time.

Summary updated

Abstract

The development Open Source Software fundamentally depends on the participation and commitment of volunteer developers to progress. Several works have presented strategies to increase the on-boarding and engagement of new contributors, but little is known on how these diverse groups of developers self-organise to work together. To understand this, one must consider that, on one hand, platforms like GitHub provide a virtually unlimited development framework: any number of actors can potentially join to contribute in a decentralised, distributed, remote, and asynchronous manner. On the other, however, it seems reasonable that some sort of hierarchy and division of labour must be in place to meet human biological and cognitive limits, and also to achieve some level of efficiency. These latter features (hierarchy and division of labour) should translate into recognisable structural arrangements when projects are represented as developer-file bipartite networks. In this paper we analyse a set of popular open source projects from GitHub, placing the accent on three key properties: nestedness, modularity and in-block nestedness -which typify the emergence of heterogeneities among contributors, the emergence of subgroups of developers working on specific subgroups of files, and a mixture of the two previous, respectively. These analyses show that indeed projects evolve into internally organised blocks. Furthermore, the distribution of sizes of such blocks is bounded, connecting our results to the celebrated Dunbar number both in off- and on-line environments. Our analyses create a link between bio-cognitive constraints, group formation and online working environments, opening up a rich scenario for future research on (online) work team assembly.
BibTeX
@inproceedings{palazzi2020online,
  author = {María J. Palazzi and Jordi Cabot and Javier Luis Cánovas Izquierdo and Albert Solé-Ribalta and Javier Borge-Holthoefer},
  title = {{Online division of labour: emergent structures in Open Source Software}},
  booktitle = {LA},
  year = {2020},
}
Figure