Life-IQA+: Boosting Blind Image Quality Assessment via GCN-enhanced Layer Interaction and Flexible Hierarchical Expert Specialization

Long Tang, Guoquan Zheng, Huiyu Duan, Jie Hao, Yucheng Zhu, Liang Yuan, Xiongkuo Min, Guangtao ZhaiarXiv 2026 · arXiv

TL;DR

Life-IQA+ is a new framework for Blind Image Quality Assessment (BIQA) that moves beyond simple feature fusion. By using Graph Convolutional Networks (GCNs) to model layer interactions and a hierarchical Mixture-of-Experts (MoE) module with selective supervision, it achieves state-of-the-art accuracy while cutting parameter counts by more than half (from 95M to 45M) compared to its predecessor.

What Problem Does This Paper Address?

Blind Image Quality Assessment (BIQA) aims to predict how humans perceive image quality without having a "perfect" reference image for comparison. Most existing methods extract features from different stages of a neural network backbone and simply aggregate them. However, this approach has two major flaws:

  1. Unequal Contributions: Not all layers are created equal. Shallow layers capture local textures, while deep layers capture global semantics. Simply smashing them together often introduces noise.
  2. The Supervision Paradox: Many models use "auxiliary tasks" (like identifying the type of distortion) to help the model learn. But if you force every part of the model to learn every task, you create "gradient conflict"—the requirements for classifying a distortion might actually interfere with the fine-grained requirements for predicting a quality score.

Methods

The authors introduce Life-IQA+, which features two primary innovations:

1. GCN-enhanced Layer Interaction

Instead of simple concatenation, the model uses a GCN to refine "quality queries" derived from the deepest backbone features (Stage 4). These queries then interact with the penultimate features (Stage 3) via a cross-attention mechanism. This allows the model to selectively "pull" relevant local evidence from Stage 3 based on the global context of Stage 4.

2. Flexible Hierarchical MoE

The model replaces standard feed-forward networks with a hierarchical Mixture-of-Experts (MoE) module, as seen in the architecture overview:

Overall framework of Life-IQA+
  • Shared Expert Layer: Densely activated experts that capture common perceptual cues across all images.
  • Sparse Routed Expert Layer: Only a few experts are activated per image token, allowing for specialized processing of specific distortion types.
  • Selective Supervision: Crucially, auxiliary labels (like distortion type) are only applied to a subset of the shared experts. This prevents the "gradient conflict" mentioned earlier, allowing some experts to focus on classification while others remain flexible for regression.

Datasets

The model was evaluated on seven major BIQA benchmarks:

  • Synthetic Distortions: LIVE, CSIQ, TID2013, and KADID-10K.
  • Authentic (In-the-wild) Distortions: LIVEC, SPAQ, and KonIQ-10K.

Key Insights and Ideas

  • Deep Features are the Drivers: Preliminary tests (see Figure 1) confirmed that Stage 3 and Stage 4 features are significantly more effective for quality prediction than shallow features.
  • Bigger isn't Always Better: The authors found that simply stacking more MoE layers or adding more experts often led to overfitting rather than better accuracy. As shown in Figure 4, compact configurations often outperformed their larger counterparts.
Fig. 4. Effects of MoE depth and expert count on CSIQ. FFNs in 2, 4, or 6 decoder layers are replaced by sparse MoE layers with 4, 6, or 8 experts. Marker shape and color denote MoE depth and expert count, respectively. Larger configurations increase model size without consistent SRCC gains.
  • The "Aha" Moment on Supervision: Uniformly supervising all experts can actually hurt performance. By mathematically analyzing the gradients, the authors showed that auxiliary tasks can point in the opposite direction of the main quality task. Their "selective supervision" strategy acts as a relief valve for this tension.

Key Results

Life-IQA+ achieves competitive or superior results across all seven benchmarks.

  • Accuracy: It reached a median SRCC of 0.970 on CSIQ and 0.945 on KADID-10K, outperforming heavyweights like MUSIQ and LIQE.
  • Efficiency: Compared to the previous version (Life-IQA), the "plus" version reduced parameters from 95M to 45M and nearly doubled the inference speed from 617 FPS to 1149 FPS on a single RTX 3090.
  • Generalization: In cross-dataset tests (training on one dataset and testing on another), Life-IQA+ showed robust performance, suggesting it learns fundamental quality features rather than just memorizing specific dataset quirks.

Limitations and Future Work

While Life-IQA+ is highly efficient, it still relies on a pretrained Swin Transformer backbone. The authors note that the performance on certain cross-dataset transfers (like KADID-10K to TID2013) actually saw a slight dip compared to the original version, suggesting that the extreme parameter reduction might occasionally trade off some niche generalization.

Future work may explore even more compact expert specialization and task-oriented decoding strategies to handle increasingly diverse real-world degradation conditions.

Summary updated

Abstract

Blind image quality assessment (BIQA) is essential for evaluating and optimizing visual experience. Existing BIQA methods typically aggregate features from multiple backbone stages without accounting for their unequal contributions to quality prediction. Furthermore, uniformly supervising all experts may constrain their flexibility and limit the diversity of the learned quality representations. To address these issues, we present Life-IQA+, a quality representation decoding framework that combines graph convolutional network (GCN) enhanced layer interaction and flexible hierarchical expert specialization. Specifically, the layer interaction module constructs quality queries from GCN-refined deepest-stage features and uses penultimate-stage features as keys and values, thereby enabling cross-layer representation interaction via the cross-attention mechanism. Building on these representations, we further introduce a flexible hierarchical mixture-of-experts (MoE) architecture comprising a densely activated shared expert layer and a sparsely activated routed expert layer. To enhance the representation diversity and ability of experts, we apply auxiliary classification supervision to a subset of shared experts using distortion-type labels for synthetic datasets and discretized quality-level labels for authentic datasets. Experiments on synthetic and authentic distortion benchmarks, together with controlled ablations of expert configurations and supervision strategies, show that Life-IQA+ achieves competitive prediction accuracy with a favorable balance between accuracy and computational cost. The code is available at: https://github.com/TANGLONG2/Life-IQA-PlusPlus.
BibTeX
@misc{tang2026life,
  author = {Long Tang and Guoquan Zheng and Huiyu Duan and Jie Hao and Yucheng Zhu and Liang Yuan and Xiongkuo Min and Guangtao Zhai},
  title = {{Life-IQA+: Boosting Blind Image Quality Assessment via GCN-enhanced Layer Interaction and Flexible Hierarchical Expert Specialization}},
  year = {2026},
  eprint = {2611.25510},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.25510},
}
Figure