Introduction
In contemporary computer vision, image restoration has traditionally been approached through specialized models designed for isolated degradations, such as denoising, deblurring, or super-resolution. While these models perform exceptionally well on "clean" synthetic problems, they often fail when confronted with the "messy reality" of real-world imagery. A typical smartphone photo taken in adverse conditions may simultaneously suffer from sensor noise, motion blur, JPEG compression artifacts, and atmospheric haze.
This paper introduces General Image Restoration (GIR), a paradigm shift toward a unified, "blind" model capable of handling complex, unknown, and combined degradations without explicit task-specific instructions. The authors propose a formal framework and a benchmarking protocol to evaluate progress in this challenging domain.
Methodology and Research Framework
Rather than proposing a single architecture, the study establishes a comprehensive research framework for GIR.
Problem Definition
GIR is mathematically defined as a structural risk minimization problem. The core objective is to learn the underlying distribution of natural, clear images rather than merely learning to invert specific mathematical degradation functions. This approach emphasizes the model's ability to distinguish "naturalness" from various forms of "unnaturalness."
Stochastic Degradation Pipeline
To train models for the diversity of GIR, the authors utilize a stochastic pipeline that randomly composes multiple basic degradation functions (e.g., blur, noise, resizing) in varying orders and intensities. This process generates "mixture tasks" that better approximate real-world conditions compared to standard single-task datasets.
Evaluation Protocol: AR & ER
Standard metrics like Peak Signal-to-Noise Ratio (PSNR) are often incomparable across different restoration tasks. To address this, the authors introduced two relative metrics:
- Acceptance Ratio (AR): Measures how frequently a model outperforms a basic 3-layer CNN baseline.
- Excellence Ratio (ER): Measures how often a general model matches or exceeds the performance of a state-of-the-art (SOTA) model specifically tuned for a single task.
Data and Insights
The study utilized high-quality synthetic data (MiO100) and diverse real-world samples. A key finding was that data quality outweighs quantity; using only 25% of the training data yielded results comparable to using the full set, provided the ground truth was of high quality. Interestingly, the inclusion of ImageNet data actually hindered performance due to pre-existing artifacts in its images.
Analysis of Deep Degradation Representations (DDR) revealed that successful GIR models tend to cluster different degradations less distinctly in their latent space. Models that treat noise and blur as variations of the same "unnaturalness" generalize better than those that categorize them strictly.
Key Results and the "Excellence Gap"
Benchmarking several prominent architectures (including RRDB, SwinIR, and Restormer) showed that while GIR-Restormer achieved the highest Acceptance Ratio (0.47), the Excellence Ratio remained strikingly low, with no model exceeding 0.03. This indicates that while generalist models are becoming "acceptable," they still lag significantly behind specialized models on their specific domains.
Qualitatively, however, GIR models often produced visually cleaner results on real-world "blind" images. Unlike task-specific chains (e.g., deblurring followed by denoising), which often accumulate unnatural artifacts, the unified GIR approach maintains better visual consistency.
Conclusion and Future Work
This preliminary exploration highlights the inherent biases in current Transformer-based architectures, such as Restormer’s difficulty with image resizing. Future work must focus on closing the "Excellence Gap" and developing backbones specifically optimized for the diversity of GIR. The ultimate goal is to move toward "intelligent" restoration, where models leverage semantic content understanding to reconstruct missing details in highly degraded images.
Summary updated