Certified Robustness through Randomized Smoothing

This direction is merged into another direction: computational overhead of randomized smoothing. Its last version stays readable and citable here.

Version 1 of 120 papers20 conceptsfrozen 2026-10-04

Deep neural networks are notoriously brittle. Small, adversarial perturbations—flipping a few pixels in an image or swapping a word in a sentence—can trick a state-of-the-art model into making confident, incorrect predictions. While many "empirical" defenses exist, they often fall to new, cleverer attacks. This has led researchers toward certified robustness: a mathematical guarantee that a model’s prediction will remain constant within a specific neighborhood of an input.

The most successful and scalable framework for achieving this is randomized smoothing. Instead of certifying a standard classifier directly, we construct a new "smoothed" classifier that is inherently more stable.

The Intuition: Stability through Noise

Imagine a decision boundary between two classes. A standard classifier might have a jagged, complex boundary where a tiny nudge to an input $x$ pushes it across the line.

Randomized smoothing, as explored by Mao Ye 0006 and Chengyue Gong in SAFER, changes the game. Instead of classifying $x$, we classify a distribution of points around $x$. We add random noise to the input, pass these noisy versions through the base model, and take the majority vote.

If the base model predicts "Cat" for the vast majority of noisy samples around $x$, then even if an attacker moves $x$ slightly, the distribution of noisy points still mostly falls within the "Cat" region. This "mollification" of the decision boundary—a concept formalized by Linjiang Zhou in Axiomatization of Gradient Smoothing in Neural Networks—effectively blurs out the sharp edges that attackers exploit.

Beyond Pixels: Smoothing Everything

While early work focused on Gaussian noise for images, the core mechanism has proven remarkably versatile across different data structures:

The Cost of Certainty: The Sampling Bottleneck

The primary challenge of randomized smoothing is its computational price. To provide a high-confidence mathematical guarantee, we cannot just sample a few noisy versions of an input; we often need thousands.

As noted by Mikhail Pautov in Smoothed Embeddings for Certified Few-Shot Learning, this Monte Carlo sampling creates a massive inference bottleneck. A model that usually takes milliseconds to run might take seconds or even minutes to "certify." This latency is a recurring theme across the literature, from semantic segmentation in SEGCERTIFY by Marc Fischer to cost-sensitive learning in Margin-CS by Dingfan Chen.

New Frontiers: Interpretability and Self-Supervision

Researchers are now moving beyond simple classification to apply these "smoothed" guarantees to other parts of the AI pipeline:

By treating robustness as a statistical property of a neighborhood rather than a point-wise property of a single input, randomized smoothing provides the most reliable path yet toward AI systems we can actually trust.

Papers in this version

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_certified_robustness_through_randomized__376eea6d,
  title = {Certified Robustness through Randomized Smoothing},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/certified-robustness-through-randomized-smoothing/rdr_376eea6d761e43fa9eb1fdd0f06742e6},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-18},
}

This exact version (version 1, frozen text):

@misc{lacuna_certified_robustness_through_randomized__376eea6d_v1,
  title = {Certified Robustness through Randomized Smoothing},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/certified-robustness-through-randomized-smoothing/rdr_376eea6d761e43fa9eb1fdd0f06742e6/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-18},
}