FrauDroid: An Accurate and Scalable Approach to Automated Mobile Ad Fraud Detection.

Feng Dong, Haoyu Wang, Yuanchun Li, Yao Guo, Shaodong Zhang, Guoai Xu

TL;DR

This paper introduces FraudDroid, a novel system for automatically detecting ad fraud in Android apps. It addresses the growing problem of dynamic interaction frauds, which are hard to detect with existing methods, by analyzing app behavior through UI state transition graphs and network traffic. FraudDroid achieves high accuracy and scalability, identifying a significant number of fraudulent apps in real-world markets.

What Problem Does This Paper Address?

The mobile advertising ecosystem, particularly on Android, is plagued by ad fraud. While static ad placement frauds (e.g., hidden or oversized ads) have received some attention, a more sophisticated and prevalent type of fraud, "dynamic interaction fraud," has largely been overlooked. These frauds occur during user interaction with an app and involve multiple UI states, making them difficult to detect using traditional static analysis or simpler dynamic analysis techniques. This gap leaves users susceptible to unintentional ad clicks and advertisers vulnerable to financial losses, necessitating a more robust detection mechanism.

Methods

FraudDroid employs a two-pronged approach:

  • UI State Transition Graph Construction: The system dynamically explores Android apps by simulating user interactions. It constructs a UI State Transition Graph (UTG) where nodes represent UI states (including view trees, method call traces, and network traffic) and edges represent transitions between states triggered by user events. To improve scalability, an "ad-first" exploration strategy is used, prioritizing UI states that are more likely to contain ads.
  • Heuristics-based Ad Fraud Detection: Once the UTG is built, FraudDroid uses two main components:
  • AdViewDetector: Identifies ad views within UI states by analyzing features like string attributes (e.g., class names containing "ad"), view types (e.g., ImageView, WebView), and placement characteristics (size, location).
  • FraudChecker: Assesses whether identified ad views exhibit fraudulent behavior. It implements a set of heuristic rules tailored to detect various types of ad frauds, including the newly identified dynamic interaction frauds. This module analyzes the relationships between UI states, view properties, and network traffic to flag suspicious activities.

Datasets

The paper introduces two new benchmark datasets:

  • AdViewBench: Consists of 500 apps with 4,403 labeled views, of which 211 are identified as ad views. This dataset is used to evaluate the accuracy of the AdViewDetector.
  • AdFraudBench: Comprises 100 ad-supported apps, with 50 confirmed to exhibit fraudulent behaviors across all nine identified fraud types. This dataset is used to evaluate the overall accuracy of FraudDroid in detecting ad fraud.

Additionally, the authors collected a large-scale dataset of 12,000 ad-supported apps from eight major Android app markets for their "in-the-wild" study.

Key Insights and Ideas

  • Prevalence of Dynamic Interaction Frauds: The study reveals that dynamic interaction frauds constitute over 90% of detected ad frauds, highlighting the limitations of existing methods that primarily focus on static placement.
  • Scalability through "Ad-First" Exploration: The ad-first exploration strategy significantly reduces the time required to analyze apps, making FraudDroid scalable to large app markets. This is crucial for practical application.
  • Ad Networks' Role and Limitations: While ad networks have policies against fraud, many fraudulent apps still manage to bypass checks, even those from major networks like AdMob. This suggests a need for more effective detection mechanisms at the network level.
  • VirusTotal's Limited Detection: Existing anti-virus engines on VirusTotal only flag about half of the detected fraudulent apps, particularly struggling with dynamic interaction frauds, underscoring the novelty and necessity of FraudDroid.

Key Results

  • AdViewDetector Accuracy: Achieved over 90% precision and recall in identifying ad views on the AdViewBench dataset.
  • FraudDroid Overall Accuracy: Demonstrated a precision of 93.88% and a recall of 92% on the AdFraudBench dataset for detecting ad fraud.
  • Scalability: FraudDroid can analyze apps within an average of 3.6 minutes, a substantial improvement over previous app automation techniques. Memory consumption is also reasonable (around 20MB).
  • In-the-Wild Detection: In a study of 12,000 apps, FraudDroid identified 335 fraudulent apps (2.79%), spread across various app markets and ad networks.

Limitations and Future Work

  • Ad State Coverage: While the "ad-first" strategy improves efficiency, it might miss some ad views if they are not in the prioritized states (main or exit UI states). The system allows for parameter customization to adjust coverage.
  • Incomplete Taxonomy: The taxonomy of ad frauds, though comprehensive with nine types, may not cover all emerging fraud techniques. However, the UTG framework is designed to be adaptable to new fraud types.
  • Future Work: The authors suggest further research into detecting new types of ad frauds and improving the UI exploration strategy for even better coverage and efficiency. They also emphasize the need for ad networks and app markets to implement more robust detection and mitigation measures.

Summary updated

Abstract

Previous studies on mobile ad fraud detection are limited to detecting certain types of ad fraud (e.g., placement fraud and click fraud). Dynamic interactive ad fraud has never been explored by previous work. In this paper, we propose an explorative study of ad fraud in Android apps. We first created a taxonomy of existing mobile ad fraud. Besides static placement fraud, we also created a new category called dynamic interactive fraud and found three new types of them. Then we propose FrauDroid, a new approach to detect ad fraud based on user interface (UI) state transition graph and networking traffic. To achieve accuracy and scalability, we use an optimized exploration strategy to traverse the UI states that contain ad views, and design a set of heuristic rules to identify kinds of ad fraud. Experiment results show that FrauDroid could achieve a precision of 80.9\% and it is capable of detecting all the 7 types of mobile ad fraud. We then apply FrauDroid to more than 80,000 apps from 21 app markets to study the prevalene of ad fraud. We find that 0.29\% of apps that use ad libraries are identified containing frauds, with 23 ad networks suffering from ad fraud. Our finding also suggests that Dynamic interactive fraud is more prevalent than static placement fraud in real world apps.
BibTeX
@misc{dong2017fraudroid,
  author = {Feng Dong and Haoyu Wang and Yuanchun Li and Yao Guo and Li Li and Shaodong Zhang and Guoai Xu},
  title = {{FrauDroid: An Accurate and Scalable Approach to Automated Mobile Ad Fraud Detection.}},
  year = {2017},
  eprint = {1709.01213},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1709.01213},
}

Loading related content...

Figure