Evaluating the Impact of AbuseHUB on Botnet Mitigation

Michel van Eeten, Qasim Lone, Giovane C. M. Moura, Hadi Asghari, Maciej KorczynskiarXiv 2016 · arXiv

Introduction

Botnets—networks of hijacked computers controlled by malicious actors—remain a primary engine for cybercrime, facilitating everything from DDoS attacks to large-scale credential theft. Internet Service Providers (ISPs) occupy a critical position in the cybersecurity ecosystem because they own the "last mile" of connectivity to infected end-users. However, individual ISPs often lack the global telemetry required to identify every infected machine on their network.

This paper evaluates AbuseHUB, a Dutch initiative designed to centralize and streamline botnet intelligence sharing among ISPs. By acting as a clearinghouse for acquiring and processing abuse data, AbuseHUB aims to improve the actionability of threat intelligence. The study investigates whether this collaborative model significantly improves mitigation outcomes compared to non-member ISPs and global peers.

Methodology

The researchers conducted a longitudinal analysis of botnet telemetry from 2011 to 2015, mapping millions of infected IP addresses to specific Autonomous Systems (ASNs) and Dutch ISPs. To ensure fair comparisons, the study utilized two primary normalization techniques:

  1. Subscriber-based normalization: Infections per million broadband subscribers.
  2. Address space normalization: Infections relative to the size of the IPv4 address space, particularly for networks like hosting providers where subscriber counts are unavailable.
Table 1: Overview of AbuseHUB member ISPs, associated ASNs, and IPv4 address space coverage.

The study mapped the Dutch internet landscape to identify the reach of AbuseHUB. As shown in Table 1, the participating ISPs represent a significant portion of the Dutch digital infrastructure, covering nearly 64% of the total Dutch IPv4 address space and approximately 90% of the broadband market.

Key Findings

The "Best in Class" Effect

Analysis of global rankings reveals that the Netherlands consistently ranks in the top 10% globally for low infection rates across nearly all botnet types studied (e.g., Conficker, Zeus, ZeroAccess). While the Netherlands was already a proactive cybersecurity leader, AbuseHUB has helped its members maintain "best in class" status even as global threats evolve.

Shifting Infection Concentrations

A notable trend identified in the data is the shifting burden of infections. In 2010, roughly 80% of Dutch botnet infections were located within the networks of large broadband providers (the primary AbuseHUB members). By 2015, this figure dropped to 60%. This suggests that while AbuseHUB members are successfully cleaning their networks, infections are becoming relatively more concentrated in smaller, non-member ISPs and hosting providers.

Quality Over Quantity

The primary value of AbuseHUB lies in data enrichment rather than simple volume. By reducing the "transaction cost" for ISPs to ingest and act upon data—enriching feeds with metadata and integrating diverse sources like Spamhaus XBL and Microsoft sinkhole data—AbuseHUB enables abuse teams to notify and assist customers more efficiently.

Conclusion and Future Directions

While AbuseHUB has proven effective, the study highlights a "ceiling effect": because the Netherlands was already performing well, dramatic improvements in global rankings are difficult to achieve. To further reduce infection rates, the authors suggest two main paths forward:

  1. Expanding Membership: Bringing hosting providers and smaller ISPs into the AbuseHUB ecosystem to address the growing concentration of infections in those sectors.
  2. Automated Mitigation: Moving beyond simple notification toward "low-friction" or automated cleanup tools to handle the high volume of persistent infections.

Ultimately, AbuseHUB represents a successful evolution of a collaborative cybersecurity culture, providing a scalable model for national-level botnet mitigation.

Summary updated

Abstract

This documents presents the final report of a two-year project to evaluate the impact of AbuseHUB, a Dutch clearinghouse for acquiring and processing abuse data on infected machines. The report was commissioned by the Netherlands Ministry of Economic Affairs, a co-funder of the development of AbuseHUB. AbuseHUB is the initiative of 9 Internet Service Providers, SIDN (the registry for the .nl top-level domain) and Surfnet (the national research and education network operator). The key objective of AbuseHUB is to improve the mitigation of botnets by its members. We set out to assess whether this objective is being reached by analyzing malware infection levels in the networks of AbuseHUB members and comparing them to those of other Internet Service Providers (ISPs). Since AbuseHUB members together comprise over 90 percent of the broadband market in the Netherlands, it also makes sense to compare how the country as a whole has performed compared to other countries. This report complements the baseline measurement report produced in December 2013 and the interim report from March 2015. We are using the same data sources as in the interim report, which is an expanded set compared to the earlier baseline report and to our 2011 study into botnet mitigation in the Netherlands.
BibTeX
@misc{eeten2016evaluating,
  author = {Michel van Eeten and Qasim Lone and Giovane C. M. Moura and Hadi Asghari and Maciej Korczynski},
  title = {{Evaluating the Impact of AbuseHUB on Botnet Mitigation}},
  year = {2016},
  eprint = {1612.03101},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1612.03101},
}
Figure