Introduction
Blind Image Quality Assessment (BIQA) aims to evaluate image quality without a reference, mimicking human perception. While modern approaches leverage Vision Transformers (ViTs) pre-trained on ImageNet, a fundamental gap exists: classification focuses on abstract global semantics, whereas BIQA requires sensitivity to local, low-level degradations. Bridging this gap typically requires massive amounts of human-annotated quality data, which is expensive and labor-intensive to produce.
To address this, we introduce the Data-Efficient Image Quality Transformer (DEIQT). DEIQT achieves state-of-the-art (SOTA) performance while requiring significantly less training data by utilizing a lightweight quality-aware decoder and a novel "attention-panel" mechanism.
Architecture: Bridging the Semantic Gap
DEIQT moves beyond pure-encoder architectures by employing a full Transformer encoder-decoder structure designed to "translate" abstract features into quality-sensitive representations.
The model consists of three primary components:
- ViT Encoder: Extracts multi-level patch embeddings and a global CLS token.
- Quality-Aware Decoder: A lightweight, 1-layer decoder that uses the CLS token as a query to cross-attend to patch features. This forces the model to re-examine local regions for quality-degrading artifacts.
- Attention-Panel Mechanism: To mimic the Mean Opinion Score (MOS) of human judges, DEIQT initializes $L$ learnable "panel member" embeddings. These are added to the CLS token, allowing each member to learn a unique perspective on quality. The final score is the average of these predictions.
Experimental Results and Data Efficiency
DEIQT was evaluated across eight standard BIQA datasets, including both synthetic (e.g., LIVE, TID2013) and authentic (e.g., KonIQ-10k, SPAQ) distortions.
The model demonstrates remarkable data efficiency. As shown in the figure below, DEIQT outperforms existing SOTA methods on the LIVE dataset even when trained on only 30% of the available data.
Key findings include:
- SOTA Accuracy: DEIQT achieved top-tier Spearman's Rank Correlation Coefficients (SRCC) across all datasets (e.g., 0.980 on LIVE).
- Efficiency: The model matches SOTA performance using only 30-40% of data for synthetic sets and 60% for complex authentic sets.
- Fast Convergence: Satisfactory performance is reached in just two training epochs, significantly faster than standard ViT-based models.
Conclusion
DEIQT demonstrates that classification-heavy features can be effectively adapted for regression tasks like BIQA through targeted decoding. By stabilizing gradients and mimicking human subjective panels, the architecture provides a robust, lightweight, and highly data-efficient solution for automated image quality evaluation. This "translation" strategy holds promise for other data-scarce domains in computer vision.
Summary updated