ProGuard: Towards Proactive Multimodal Safeguard

Shaohan Yu, Lijun Li, Chenyang Si, Lu Sheng, Jing ShaoarXiv 2025 · DOI · arXiv

Abstract

ProGuard is a vision-language safety model designed to shift the paradigm of AI moderation from reactive filtering to proactive risk analysis. By identifying and describing novel, out-of-distribution (OOD) risks, ProGuard addresses the limitations of static safety taxonomies. Trained purely via reinforcement learning on a balanced multimodal dataset of 87K samples, the 7B-parameter model significantly outperforms existing open-source safeguards in detecting emerging threats while maintaining high reasoning efficiency.

Introduction: The Need for Proactive Moderation

As generative AI capabilities evolve, the landscape of potential risks becomes increasingly complex and dynamic. Traditional safety "guard" models—external components that filter model inputs and outputs—are typically reactive. They rely on fixed, static taxonomies (e.g., "Hate Speech," "Violence," or "Sexual Content"). When a novel risk emerges that falls outside these pre-defined categories, reactive models often fail to categorize it correctly or miss the threat entirely.

Reactive vs. Proactive Moderation: ProGuard moves beyond static taxonomies to infer novel OOD categories like 'Medical Malpractice'.

Furthermore, existing multimodal guards often suffer from modality bias, performing well on text but struggling with visual inputs due to skewed training data. ProGuard addresses these challenges by transforming the guard from a simple classifier into an analyst capable of inferring and describing unseen harms.

Methodology: Pure RL and OOD Inference

ProGuard (based on the Qwen2.5-VL-7B architecture) utilizes several novel training strategies to achieve proactive safety:

  1. Pure Reinforcement Learning (RL): Inspired by the "R1-Zero" approach, ProGuard bypasses standard Supervised Fine-Tuning (SFT). It is trained purely via Group Relative Policy Optimization (GRPO), allowing the model to "self-evolve" its reasoning traces. This results in more concise and efficient "thinking" processes compared to SFT-initialized models.
  2. OOD Safety Category Inference: To move beyond static lists, the model is trained on tasks where specific categories are intentionally removed from its known taxonomy. The model must proactively infer a plausible name and description for the unseen risk.
  3. Synonym-Bank-Based Similarity Reward: Rather than penalizing the model for failing to match a specific string exactly, the authors use a sentence transformer and a bank of synonyms. This provides a "smoother" reward signal that encourages semantic understanding over rote memorization.
ProGuard System Overview: The pipeline includes task description, multimodal taxonomy, balanced dataset construction, and online RL finetuning.

Balanced Multimodal Datasets

To mitigate modality bias, the researchers constructed a balanced dataset of 87,000 samples. The composition is roughly split between Text-only (33%), Image-only (32%), and Text-Image pairs (34%). This data aggregates ten major safety benchmarks, including GuardReasoner, BeaverTails-V, and MedSafetyBench. Ground truth labels were established through a majority-voting mechanism using high-performing models like InternVL2 and Qwen2.5-VL-72B.

Key Insights and Results

  • Proactive Superiority: ProGuard improved OOD risk detection by 52.6% and OOD risk description by 64.8% compared to existing baselines. This demonstrates that training for inference rather than just classification makes the system robust against "jailbreaks" and emerging harms.
  • State-of-the-Art Performance: ProGuard-7B sets a new benchmark for open-source safety models, performing comparably to closed-source models like GPT-4o-mini and Gemini 1.5-Flash in prompt classification.
  • Reasoning Efficiency: One of the most significant findings was that pure RL training led to more concise reasoning. ProGuard achieved superior results using only ~52 "thinking" tokens, whereas models initialized with SFT required ~114 tokens.
  • The Criticality of Modality Balance: The study confirms that a 1:1:1 ratio across text, image, and multimodal data is essential. Without balanced visual data during training, a model's ability to detect visual risks collapses, regardless of its text-based performance.

Conclusion and Future Directions

ProGuard represents a significant step toward autonomous safety systems. While OOD inference remains a challenging task, ProGuard's ability to describe novel risks provides a powerful tool for automated safety taxonomy expansion and risk discovery. Future work will focus on scaling these capabilities to even more complex multi-class classification scenarios and refining the model's ability to differentiate between subtle, overlapping risk types.

Summary updated

Abstract

The rapid evolution of generative models has led to a continuous emergence of multimodal safety risks, exposing the limitations of existing defense methods. To address these challenges, we propose ProGuard, a vision-language proactive guard that identifies and describes out-of-distribution (OOD) safety risks without the need for model adjustments required by traditional reactive approaches. We first construct a modality-balanced dataset of 87K samples, each annotated with both binary safety labels and risk categories under a hierarchical multimodal safety taxonomy, effectively mitigating modality bias and ensuring consistent moderation across text, image, and text-image inputs. Based on this dataset, we train our vision-language base model purely through reinforcement learning (RL) to achieve efficient and concise reasoning. To approximate proactive safety scenarios in a controlled setting, we further introduce an OOD safety category inference task and augment the RL objective with a synonym-bank-based similarity reward that encourages the model to generate concise descriptions for unseen unsafe categories. Experimental results show that ProGuard achieves performance comparable to closed-source large models on binary safety classification, substantially outperforms existing open-source guard models on unsafe content categorization. Most notably, ProGuard delivers a strong proactive moderation ability, improving OOD risk detection by 52.6% and OOD risk description by 64.8%.
BibTeX
@misc{yu2025proguard,
  author = {Shaohan Yu and Lijun Li and Chenyang Si and Lu Sheng and Jing Shao},
  title = {{ProGuard: Towards Proactive Multimodal Safeguard}},
  year = {2025},
  eprint = {2512.23573},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.23573},
}
Figure