Diffusion Sampling Correction via Approximately 10 Parameters

Guangyi Wang, Wei Peng, Lijiang Li, Wenyu Chen, Yuren Cai, Songzhi Su

TL;DR

Researchers have developed PCA-based Adaptive Search (PAS), a plug-and-play method that dramatically improves the image quality of fast diffusion solvers using as few as 10 learnable parameters. By identifying that sampling trajectories lie in a low-dimensional subspace and that errors follow a predictable "S-shape," PAS achieves state-of-the-art results with sub-minute training on a single GPU.

What Problem Does This Paper Address?

Diffusion Probabilistic Models (DPMs) are the current gold standard for high-quality image generation, but they are notoriously slow. Generating a single image typically requires hundreds of iterative denoising steps. While "fast solvers" like DDIM or DPM-Solver can reduce this to 10–20 steps, they suffer from truncation errors—mathematical drifts from the ideal sampling path—that severely degrade image quality at very low step counts (NFE < 10).

Existing solutions usually involve "distillation," where a smaller model is trained to mimic a larger one. However, distillation is computationally expensive (often requiring hundreds of A100 GPU hours) and results in massive new model files. The authors sought a "middle way": a method that provides the quality of distillation with the negligible overhead of a training-free solver.

Methods

The authors introduce PCA-based Adaptive Search (PAS), which rests on two clever observations:

  1. Low-Dimensional Trajectories: By performing Principal Component Analysis (PCA) on sampling paths, the authors found that the entire high-dimensional trajectory of a diffusion model actually lies within a tiny 3-dimensional subspace.
  2. The "S-Curve" of Error: Truncation errors don't accumulate linearly. Instead, they follow an "S-shape": errors are negligible in the early (noisy) and late (clean) stages but spike in the middle where the trajectory has high curvature.
Figure 1. PCA-based sampling correction. We first utilize PCA to obtain a few orthogonal unit vectors that span the space of the sampling trajectories, and then learn the coordinates to correct the sampling directions in regions of large curvature along the ground truth trajectory.

The PAS Workflow: * Step 1: Use PCA to find a few orthogonal basis vectors that span the sampling space. * Step 2: Instead of training a whole neural network, PAS only learns a few coordinates (coefficients) to adjust the sampling direction within that PCA-defined subspace. * Step 3: An Adaptive Search strategy identifies exactly which time-steps have high curvature (the middle of the "S"). Correction is only applied at these critical points, reducing the number of parameters to roughly 10.

Datasets

The method was validated across a diverse range of benchmarks:

  • CIFAR10 (32x32): Unconditional generation.
  • FFHQ (64x64): Human faces.
  • ImageNet (64x64): Conditional generation.
  • LSUN Bedroom (256x256): High-resolution scenes.
  • Stable Diffusion v1.4 (512x512): Latent diffusion evaluated on the MS-COCO validation set.

Key Insights and Ideas

  • Geometric Consistency: Even though different noise inputs lead to different images, the shape of their sampling trajectories is remarkably consistent across a dataset. This allows a tiny set of parameters learned from a few thousand samples to generalize to all future generations.
  • Efficiency through Sparsity: By only correcting high-curvature regions, the authors avoid "over-correcting" linear segments where standard solvers already perform well. This is why they can get away with so few parameters.
  • Plug-and-Play: PAS doesn't replace solvers like DDIM or iPNDM; it sits on top of them, correcting their output at each step.
Figure 3. The truncation errors are evaluated using the Euler solver both with and without the proposed PAS. We utilize the EDM (Kar- ras et al., 2022) pre-trained model to sample 10k samples and com- pute the average L2 distance of 10 NFE compared to the ground truth trajectory (100 NFE). (a) The “S”-shaped truncation error is produced by the Euler solver. (b) The truncation error is corrected using PAS. Notably, PAS adaptively corrects only the parts of the sampling trajectory with large curvature.

Key Results

The quantitative improvements are striking, especially at extremely low step counts (NFE=10):

  • CIFAR10: Improved DDIM's FID from 15.69 to 4.37 using only 12 parameters.
  • Stable Diffusion: Improved DDIM's FID from 16.56 to 14.23, outperforming more complex state-of-the-art solvers like DPM-Solver-v3.
  • Training Speed: Training PAS on CIFAR10 takes less than 2 minutes on a single A100. For high-resolution datasets like LSUN, it takes only 10–20 minutes.
  • Storage: Because it only stores ~10 floats, the "model" size is effectively zero compared to the gigabytes required by standard diffusion weights.

Limitations and Future Work

While PAS significantly closes the gap between fast solvers and high-step ground truths, it is not yet a "one-step" generator. It still requires a base solver to function.

The authors suggest that future work could involve learning the integrated form of these analytical trajectory equations directly. Given the strong geometric consistency they discovered, it might be possible to achieve high-quality one-step sampling by leveraging these low-dimensional properties even further.

Summary updated

Abstract

While powerful for generation, Diffusion Probabilistic Models (DPMs) face slow sampling challenges, for which various distillation-based methods have been proposed. However, they typically require significant additional training costs and model parameter storage, limiting their practicality. In this work, we propose PCA-based Adaptive Search (PAS), which optimizes existing solvers for DPMs with minimal additional costs. Specifically, we first employ PCA to obtain a few basis vectors to span the high-dimensional sampling space, which enables us to learn just a set of coordinates to correct the sampling direction; furthermore, based on the observation that the cumulative truncation error exhibits an ``S"-shape, we design an adaptive search strategy that further enhances the sampling efficiency and reduces the number of stored parameters to approximately 10. Extensive experiments demonstrate that PAS can significantly enhance existing fast solvers in a plug-and-play manner with negligible costs. E.g., on CIFAR10, PAS optimizes DDIM's FID from 15.69 to 4.37 (NFE=10) using only 12 parameters and sub-minute training on a single A100 GPU. Code is available at https://github.com/onefly123/PAS.
BibTeX
@inproceedings{wang2025diffusion,
  author = {Guangyi Wang and Wei Peng and Lijiang Li and Wenyu Chen and Yuren Cai and Songzhi Su},
  title = {{Diffusion Sampling Correction via Approximately 10 Parameters}},
  booktitle = {International Conference on Machine Learning},
  year = {2025},
  url = {https://openreview.net/forum?id=yPhAbeQxbJ},
}
Figure