Revisiting Injective Attacks on Recommender Systems

Haoyang Li, Shimin Di, Lei ChenNeurIPS 2022 · OpenReview

TL;DR

Recommender systems are surprisingly easy to manipulate by injecting fake user profiles, but most current attacks are inefficient because they try to "convert" the hardest-to-convince users. This paper introduces DADA (Difficulty-Aware and Diversity-Aware), an attacker that boosts effectiveness by targeting "easy" users across diverse communities, significantly outperforming existing methods with the same limited "fake user" budget.

The Vulnerability of Recommender Systems

Recommender systems (RecSys) are the engines behind everything from e-commerce product suggestions to streaming media queues. Because these systems learn dynamically from user behavior, they are vulnerable to injective attacks. In these attacks, an adversary creates a small number of fake accounts with carefully crafted interaction histories to trick the system into promoting a "target item" to real users.

However, the authors identify two fatal flaws in current state-of-the-art attack strategies:

  1. Difficulty-Agnosticism: Most attackers waste their limited budget trying to convince "difficult" users—people whose existing preferences are diametrically opposed to the target item. Because these users generate the largest "gradients" (signals for change) during optimization, automated attack algorithms naturally gravitate toward them, even though they are the hardest to actually flip.
  2. Diversity-Deficit: Existing attacks tend to influence only the largest, most dominant user community. Fake users often cluster together in the latent space, leaving many smaller, diverse communities untouched and limiting the overall "reach" of the promotion.
Motivation for Difficulty and Diversity Awareness

The DADA Approach

To address these inefficiencies, the authors propose DADA, a gradient-based attacker designed to be smarter about where it spends its optimization energy. DADA operates as a gray-box attack, meaning it doesn't need to know the exact parameters of the target system. Instead, it trains a "surrogate" model on publicly available user data to mimic the target system and then optimizes the fake user profiles against that surrogate.

DADA introduces two novel objectives to maximize the impact of a limited fake-user budget:

  • Difficulty-Aware Objective: Instead of following the largest gradients (which point toward difficult users), DADA uses a logarithmic function to prioritize "easy" users—those who already have a moderate tendency toward the target item. The logic is simple: it’s easier to push someone who is already "on the fence" into the Top-N recommendation list than it is to convert a hater.
  • Diversity-Aware Objective: To avoid getting stuck in a single user "echo chamber," DADA measures the influence of fake users on different communities. It uses a Sigmoid-based objective to ensure that the attack spreads its influence across various user clusters, preventing a single dominant group from monopolizing the optimization process.
Comparison of Attack Objectives

Experimental Validation

The researchers evaluated DADA on three widely used real-world datasets—MovieLens-100K (ML-100K), MovieLens-1M (ML-1M), and Gowalla—providing a range of scales and sparsity levels to test how well the attack generalizes.

DADA was tested against three types of target systems: Matrix Factorization (WRMF), Neural Collaborative Filtering (NCF), and Graph Neural Networks (LightGCN).

Key Results

  • Superior Performance: On the ML-100K dataset, DADA achieved a Hit Ratio (HR@10) improvement of +35.41% to +38.30% over clean data, nearly doubling the effectiveness of previous state-of-the-art attackers like PAPU or RevAdv.
  • High Efficiency: Even with a tiny budget (injecting fake users equal to only 1% of the real user base), DADA consistently outperformed all baselines.
  • Robustness: DADA showed stable performance across different "maximum selected items" (how many items each fake user interacts with), whereas other attackers often saw performance drops when fake users became too "noisy."

Key Takeaways and Future Work

The most counter-intuitive finding of this research is the "Low-Hanging Fruit" Strategy. In standard optimization, a large gradient usually means "go this way." In adversarial attacks on RecSys, a large gradient often signifies a user who is very far from the target state. By realizing that these large gradients are often "expensive" distractions, DADA secures "easy wins" to maximize the total number of successful recommendations.

Limitations: Like all gray-box attacks, DADA's effectiveness depends on how well the surrogate model mimics the actual target system. If the target system uses a radically different architecture or has highly proprietary data, the attack might be less potent. Furthermore, while DADA is efficient, its stealthiness against modern anomaly detection systems remains an open question.

Ultimately, understanding these vulnerabilities is the first step toward mitigating them. The authors suggest that exploring these difficulty-aware principles could eventually be used to build stronger defenses, essentially "immunizing" easy users against such targeted manipulation.

Summary updated

Abstract

Recent studies have demonstrated that recommender systems (RecSys) are vulnerable to injective attacks. Given a limited fake user budget, attackers can inject fake users with carefully designed behaviors into the open platforms, making RecSys recommend a target item to more real users for profits. In this paper, we first revisit existing attackers and reveal that they suffer from the difficulty-agnostic and diversity-deficit issues. Existing attackers concentrate their efforts on difficult users who have low tendencies toward the target item, thus reducing their effectiveness. Moreover, they are incapable of affecting the target RecSys to recommend the target item to real users in a diverse manner, because their generated fake user behaviors are dominated by large communities. To alleviate these two issues, we propose a difficulty and diversity aware attacker, namely DADA. We design the difficulty-aware and diversity-aware objectives to enable easy users from various communities to contribute more weights when optimizing attackers. By incorporating these two objectives, the proposed attacker DADA can concentrate on easy users while also affecting a broader range of real users simultaneously, thereby boosting the effectiveness. Extensive experiments on three real-world datasets demonstrate the effectiveness of our proposed attacker.
BibTeX
@inproceedings{li2022revisiting,
  author = {Haoyang LI and Shimin Di and Lei Chen},
  title = {{Revisiting Injective Attacks on Recommender Systems}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2022},
  url = {https://openreview.net/forum?id=e5HTq2VA7mu},
}
Figure