One-click hosting services: a file-sharing hideout

Demetres Antoniades, Evangelos P. Markatos, Constantine DovrolisInternet Measurement Conference 2009 · DOI

TL;DR

This paper provides the first in-depth analysis of One-Click Hosting (OCH) services, like RapidShare, revealing their significant impact on internet traffic and challenging the dominance of P2P file sharing. The study highlights OCH's advantages in performance and content availability, suggesting a centralized infrastructure model that differs from traditional CDNs.

What Problem Does This Paper Address?

The internet's traffic landscape has been heavily dominated by peer-to-peer (P2P) file-sharing systems for years. However, a new paradigm, One-Click Hosting (OCH) services, has emerged, offering a centralized approach to file sharing. These services, exemplified by RapidShare, promise better performance and availability than P2P. This paper aims to understand the nature of OCH services, their traffic patterns, user behavior, and architectural underpinnings, and to compare their effectiveness against established P2P systems like BitTorrent. The core question is whether OCH services can truly challenge and potentially replace P2P for file sharing.

Methods

The researchers employed a multi-pronged approach combining passive and active measurements.

  • Passive Monitoring: They collected network flow traces (IPFix) and HTTP packet headers from two academic networks over several months. This allowed them to measure OCH traffic volume, analyze flow sizes, and characterize client download patterns.
  • Active Measurements:
    • Server Location and Architecture Inference: Using the Tor anonymity network, they sent download requests from numerous distributed exit nodes to infer RapidShare's server locations, content replication strategies (server groups), and load balancing mechanisms.
  • Performance Benchmarking: They conducted direct comparisons of download throughput between RapidShare (with different user types: Premium, Free, and "Free-cheating") and BitTorrent.
  • Content Availability Analysis: They checked the availability of well-known movie and song lists on both RapidShare and BitTorrent.
  • Indexing Site Analysis: They crawled popular OCH indexing sites to understand content uploaders, the distribution of indexed objects, and the nature of shared content.

Datasets

  • Client-Side Traces: Flow traces and HTTP headers collected from two academic networks (Monitor1 and Monitor2) over 4-5 months. These traces provided data on OCH traffic volume, client behavior, and file popularity.
  • Public Indexing Sites: Data crawled from four OCH indexing sites (egydown.com, rapidmega.info, rslinks.org, rapidshareindex.com) to analyze content uploaders and indexed objects.
  • Content Lists: Well-known lists of movies and songs (e.g., Internet Movie Database, "All Time USA Box Office") were used to assess content availability on OCH and P2P platforms.

Key Insights and Ideas

  • OCH Traffic is Significant: OCH traffic, particularly from RapidShare, rivals or even surpasses that of popular video streaming services like YouTube, indicating its substantial impact on internet traffic.
  • Low File Popularity: A surprising finding is that a vast majority of files (over 75%) are downloaded only once in the observed traces. This suggests that traditional caching strategies, common in Content Delivery Networks (CDNs), would be largely ineffective for OCH content.
  • Centralized Architecture: Contrary to the distributed nature of P2P and many CDNs, RapidShare appears to operate with a highly centralized infrastructure, likely located in a single geographical region (Frankfurt, Germany). This is attributed to the nature of large file transfers where latency is less critical than availability.
  • "Power Users" Drive Content: A small number of uploaders are responsible for a disproportionately large amount of content shared on OCH services, making the ecosystem sensitive to the activity of these key users.
  • Premium Users Get a Big Boost: While free OCH users experience throttled speeds, Premium users receive significantly higher download throughput, an order of magnitude greater than typical BitTorrent users.
  • Content Availability Advantage: OCH services, especially RapidShare, demonstrate higher content availability, particularly for less popular or niche content, compared to BitTorrent.

Key Results

  • Traffic Share: OCH services accounted for 3.32% of total traffic at Monitor1 and 0.23% at Monitor2, with RapidShare being the dominant player.
  • File Popularity: Over 75% of files were downloaded only once in the client-side traces. Less than 0.05% of files were downloaded more than five times.
  • Server Infrastructure: RapidShare utilizes thousands of multihomed servers, likely all located in central Europe (near Frankfurt), organized into groups of 12 for hosting files.
  • Download Throughput: Premium RapidShare users achieved throughputs over 8 Mbps (50% of downloads), significantly higher than BitTorrent (median ~600 kbps). Free users were throttled to 0.2-2 Mbps.
  • Content Availability: For movie lists, RapidShare showed higher availability (e.g., 98.5% for "All Time USA Box Office") compared to BitTorrent (e.g., 96.5%). For less popular content ("Bottom 100 movies"), RapidShare hosted 90% while BitTorrent hosted only 50%.
  • Copyrighted Content: A significant portion (over 84%) of indexed content on OCH sites appears to be copyrighted material.

Limitations and Future Work

  • Demographic Bias: The client-side traces were collected from university networks, which might not represent the general internet user population.
  • Inferential Architecture: The understanding of RapidShare's architecture is based on inference from measurements, not direct disclosure from the service.
  • Future Work: The authors suggest that OCH services are well-positioned to compete with P2P for file sharing due to their advantages in performance and content availability. They also note the potential for OCH services to grow as users are willing to pay for premium features. Further research could explore the long-term evolution of OCH traffic and user behavior, as well as the impact of legal actions against copyright infringement on these platforms. The study also points to the need for understanding the economics and incentives driving both OCH and P2P systems.

Summary updated

BibTeX
@inproceedings{antoniades2009one,
  author = {Demetres Antoniades and Evangelos P. Markatos and Constantine Dovrolis},
  title = {{One-click hosting services: a file-sharing hideout}},
  booktitle = {Internet Measurement Conference},
  year = {2009},
  doi = {10.1145/1644893.1644920},
}
Figure