HIFC-IQA: Train-Free Cross-Domain Image Quality Assessment via Dual-Process Cognition

Yu Li, Zhengran Shen, Puchao Zhou, Yukang Ding, Yachun Mi, Boyuan Yang, Xi Zhai, Shaohui LiuarXiv 2026 · arXiv

TL;DR

HIFC-IQA is a novel, completely train-free framework for evaluating image quality across different domains (e.g., applying knowledge from synthetic distortions to real-world photos). By mimicking the human "dual-process" cognitive mechanism—combining rapid intuition with experience-based memory retrieval—it achieves state-of-the-art performance without the costly retraining or fine-tuning required by traditional domain adaptation methods.

What Problem Does This Paper Address?

No-Reference Image Quality Assessment (NR-IQA) aims to predict how humans perceive image quality without having a "perfect" original image for comparison. This is vital for platforms dealing with User-Generated Content (UGC).

The core challenge is the domain shift. Most models are trained on synthetic datasets (where distortions like Gaussian blur are mathematically controlled), but they fail miserably when applied to authentic, real-world images where degradations are complex, content-dependent, and composite. Current solutions rely on Unsupervised Domain Adaptation (UDA), which requires retraining the model for every new target domain. This is computationally expensive, prone to error propagation from "pseudo-labels," and lacks the "plug-and-play" flexibility needed for dynamic real-world applications.

Methods

Inspired by the dual-process theory of human cognition, the authors propose HIFC (Hierarchical Intuitive and Fuzzy Consensus). Instead of updating model weights, HIFC uses a frozen, pre-trained backbone (CLIP) and two parallel processing branches:

  1. Asymmetric Feature Extraction: The model first disentangles the image into two parts. A "Scrambled Jigsaw" preprocessing step breaks the image into shuffled patches to destroy semantic structure and isolate distortion-aware features ($f_{dis}$). Meanwhile, a "Sliding Window Stacking" strategy preserves the global context for semantic-aware features ($f_{sem}$).
  2. Hierarchical Memory Consensus (The "Experience" Branch): This branch simulates human memory. It performs a three-stage retrieval from a synthetic reference gallery:
  3. Distortion Alignment: Filters the gallery for similar distortion types.
  4. Coarse Semantic Filtering: Narrows down candidates based on content similarity.
  5. Fine Distortion Re-ranking: Selects the top-$K$ neighbors based on fine-grained artifacts.
  6. The final score from this branch is the Fuzzy Quality Centroid (FQC)—an average of the scores of these neighbors.
  7. Polarization Intuition (The "Gut Feeling" Branch): This branch uses zero-shot vision-language alignment. It measures how much the image's semantic features gravitate toward textual anchors like "a good image" versus "a bad image" in the CLIP embedding space.
  8. Consensus Fusion: The final quality score is a weighted linear combination of the memory-based calibration and the intuitive assessment.
Figure 2: The illustration of the HIFC-IQA framework. The proposed architecture employs an asymmetric perceptual decomposition to decouple semantic and distortion-related features, enabling a dual-branch synergy between intuitive score and memory-based fuzzy consensus.

Datasets

The authors evaluated HIFC across a wide range of benchmarks:

  • Synthetic Reference Gallery: KADID-10k.
  • Traditional Synthetic Datasets: LIVE, CSIQ, TID2013.
  • Authentic (Real-world) Datasets: LIVEC, KonIQ-10k, BID.
  • Algorithmic/Restoration Datasets: PIPAL (includes GAN-based distortions and super-resolution artifacts).
  • Aesthetic/Non-traditional Datasets: AVA, PARA, AGIQA-3K (AI-generated content).

Key Insights and Ideas

  • The "Resonance" Phenomenon: The authors discovered that as the number of neighbors ($K$) in the memory retrieval increases, semantic similarity drops, but the quality prediction error (MAE) also decreases and stabilizes. This suggests that large-scale neighbor aggregation acts as a "perceptual filter," suppressing content-driven noise to reveal the underlying distortion.
  • Frozen Backbones are Better than We Thought: The paper leverages the "Aristotelian Representation Hypothesis," which suggests that even frozen visual encoders like CLIP preserve "processing traces" of low-level distortions in their latent space, even if they weren't explicitly trained for IQA.
  • Train-Free > Fine-Tuning: Surprisingly, this train-free approach outperforms many UDA methods that undergo complex adaptation cycles. This challenges the assumption that we must update model weights to bridge the domain gap.
Figure 3: Visualization of retrieval consistency and the "Resonance" phenomenon.

Key Results

HIFC achieves state-of-the-art results in the challenging synthetic-to-authentic cross-domain setting:

  • Superior Accuracy: On the LIVEC dataset, HIFC achieved an SRCC of 0.778, significantly higher than competing UDA methods like DGQA (0.696) and GDCIQA (0.753).
  • Robustness to AI Artifacts: In the PIPAL dataset, HIFC showed a massive improvement (approx. 14% gain in SRCC) on GAN-based super-resolution distortions compared to previous methods.
  • Efficiency: The framework is highly efficient, with an average inference latency of just 14 ms per image on an NVIDIA RTX 4090, making it suitable for real-time industrial deployment.
Table 1: Performance comparison on the synthetic-to-authentic setting (KADID-10k→LIVEC, KonIQ-10k, and BID). Train indicates whether IQA-specific parameter training is required.

Limitations and Future Work

Despite its success, HIFC has a few "blind spots":

  • Semantic Override: In cases with extreme aesthetics (like heavy artistic bokeh) or very specific objects (like a toy frog), the retrieval mechanism can sometimes prioritize object category or photographic style over the actual technical degradation, leading to biased scores.
  • Global Bias: Dominant global color or illumination patterns can occasionally overshadow subtle textural degradation cues.

The authors suggest that future work could involve developing self-adaptive mechanisms to automatically tune hyperparameters for new domains and exploring contrastive learning to further disentangle semantic content from quality-related traces.

Summary updated

Abstract

The gap between controlled synthetic distortions and complex real-world degradations introduces a critical domain shift challenge for No-Reference Image Quality Assessment. Although Unsupervised Domain Adaptation (UDA) approaches attempt to address this issue, they remain constrained by substantial retraining overhead and cumulative error propagation inherent in iterative pseudo-labeling. Inspired by the dual-process theory of human cognition for remarkable generalization ability, we propose Hierarchical Intuitive and Fuzzy Consensus (HIFC), a completely train-free Cross-Domain IQA framework. HIFC employs asymmetric perceptual decomposition to disentangle semantic content from distortion-sensitive representations. The final quality score is fused through the synergy of two complementary branches: a memory consensus branch that retrieves a stable Fuzzy Quality Centroid from a synthetic reference gallery, and an intuitive branch that captures aesthetic polarization via zero-shot vision-language alignment. Extensive experiments show that HIFC achieves state-of-the-art performance across multiple benchmarks, attaining the highest average SRCC and PLCC among competing UDA methods. Most notably, in the challenging synthetic-to-authentic cross-domain setting, HIFC achieves a substantial performance margin over competing methods, demonstrating remarkable robustness and generalization.
BibTeX
@misc{li2026hifc,
  author = {Yu Li and Zhengran Shen and Puchao Zhou and Yukang Ding and Yachun Mi and Boyuan Yang and Xi Zhai and Shaohui Liu},
  title = {{HIFC-IQA: Train-Free Cross-Domain Image Quality Assessment via Dual-Process Cognition}},
  year = {2026},
  eprint = {2611.16451},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.16451},
}
Figure