An exploratory study on the repeatedly shared external links on Stack Overflow

Jiakun Liu, Haoxiang Zhang, Xin Xia, David Lo, Ying Zou, Ahmed E. Hassan, Shanping Li

Stack Overflow (SO) is the primary knowledge hub for developers, but much of its value lies beyond its own domain. While researchers often focus on the text and code snippets directly embedded in posts, a significant portion of the platform's knowledge is stored in external repositories, documentation, and tutorials. This study explores the ecosystem of these external links, specifically focusing on those shared repeatedly across the platform.

The Scale of External Knowledge

External links are not just common; they are foundational to the Stack Overflow experience. The study found that 82.5% of all link-sharing activities on the platform point to external resources. Perhaps more surprisingly, while only 17.0% of distinct external links are repeated, these repeated links account for 57.0% of all external link occurrences.

This "repeated sharing" behavior suggests that the community relies on a core set of trusted resources. However, it also creates a "maintenance multiplier": if a single frequently shared link breaks (link rot), it invalidates dozens or even hundreds of answers simultaneously.

What is Being Shared?

By categorizing the top 500 most frequently shared external websites, the researchers found that text-based resources dominate the landscape:

  • Documentation and Tutorials: These make up 77.6% of the top sites, serving as the primary source of truth for developers.
  • Code Resources: Approximately 1 out of every 12 code-related resources on SO is actually hosted externally (e.g., on GitHub, JSFiddle, or Pastebin).

Interestingly, there is a positive correlation between answer quality and external linking; answers with higher scores tend to have a statistically significant higher proportion of repeated external links, suggesting that pointing to established resources is a hallmark of a high-quality answer.

The Risks: Spam and Information Overload

While most link sharing is organic and community-driven (83.4%), the study identified two significant risks to the platform's utility:

1. Self-Promotion and Spam

About 12.3% of repeated links are shared by a single user. While some of this is helpful (e.g., a developer linking to their own open-source tool), a notable portion is used for self-promotion, such as repeatedly linking to personal YouTube videos or niche tools across many different questions.

2. Information Overload

A major usability hurdle identified is the lack of precision. 42.7% of external links that could have used an anchor tag (the # part of a URL that jumps to a specific section) were shared as "bare" links. This forces readers to manually search through massive documentation pages to find the specific information relevant to their problem.

The Fragility of Shortened URLs

The use of URL shorteners (like bit.ly or goo.gl) introduces a layer of fragility. These links obfuscate the destination and rely entirely on the third-party service's uptime. If the service goes down or the link is deleted, the context of the Stack Overflow answer is lost forever.

Recommendations for the Future

To preserve the integrity of the knowledge base, the authors suggest several interventions for the Stack Overflow community and platform maintainers:

  • Centralized Archiving: SO should consider archiving highly repeated links to prevent link rot.
  • Automated Tools: Development of tools to automatically expand URL shorteners and suggest specific anchor tags for documentation links could significantly reduce information overload.
  • Research Inclusion: Future mining studies must include external code repositories to avoid biased results, as a large chunk of SO's functional code exists outside the platform's own database.

Summary updated

Abstract

On Stack Overflow, users reuse 11,926,354 external links to share the resources hosted outside the Stack Overflow website. The external links connect to the existing programming-related knowledge and extend the crowdsourced knowledge on Stack Overflow. Some of the external links, so-called as repeated external links, can be shared for multiple times. We observe that 82.5% of the link sharing activities (i.e., sharing links in any question, answer, or comment) on Stack Overflow share external resources, and 57.0% of the occurrences of the external links are sharing the repeated external links. However, it is still unclear what types of external resources are repeatedly shared. To help users manage their knowledge, we wish to investigate the characteristics of the repeated external links in knowledge sharing on Stack Overflow. In this paper, we analyze the repeated external links on Stack Overflow. We observe that external links that point to the text resources (hosted in documentation websites, tutorial websites, etc.) are repeatedly shared the most. We observe that different users repeatedly share the same knowledge in the form of repeated external links, thus increasing the maintenance effort of knowledge (e.g., update invalid links in multiple posts). The repeated external links can bring risks to the software engineering process, as 1) the same users can repeatedly share the external links for the purpose of promotion, and 2) external links can point to webpages with an overload of information that makes it difficult for users to retrieve relevant information. Our findings provide insights to Stack Overflow moderators and researchers. For example, we encourage Stack Overflow to centrally manage the commonly occurring knowledge in the form of repeated external links in order to better maintain the crowdsourced knowledge on Stack Overflow.
BibTeX
@article{liu2022exploratory,
  author = {Jiakun Liu and Haoxiang Zhang and Xin Xia and David Lo and Ying Zou and Ahmed E. Hassan and Shanping Li},
  title = {{An exploratory study on the repeatedly shared external links on Stack Overflow}},
  journal = {Empir. Softw. Eng.},
  year = {2022},
  doi = {10.1007/s10664-021-10028-y},
}
Figure