BiCG-Net: Target-Specific Image Quality Assessment via Observation Modeling and In-Image Differencing

Yibu Yang, Tingqiong Cui, Liming Lei, Hao Xiong, Jun Xu, Siyuan Liu, Guanghui HuangarXiv 2026 · arXiv

TL;DR

BiCG-Net shifts the focus of No-Reference Image Quality Assessment (NR-IQA) from the whole image to specific target regions, such as a train body in a cluttered railway scene. By using a novel "in-image differencing" mechanism and nested sampling, the model mathematically cancels out teacher-specific biases and target constants, allowing a compact student network to outperform its own ensemble of 11 large teacher models—even without target-level human labels.

What Problem Does This Paper Address?

Most current image quality assessment (IQA) models operate under a "monolithic assumption": they treat the entire frame as a single quality unit. This fails in practical industrial scenarios, like railway inspection, where the object of interest (the target) might only occupy 10-20% of the pixels. In these cases, a whole-image score is dominated by irrelevant background clutter like track ballast or vegetation, providing little information about the target's actual integrity.

Furthermore, there is a massive data gap. While public benchmarks provide Mean Opinion Scores (MOS) for whole images, there are no large-scale datasets with human-annotated quality scores for specific sub-regions. This makes training a target-specific model difficult, as there is no "ground truth" to supervise the learning process directly.

Methods

The authors introduce BiCG-Net, which employs a "student-teacher" distillation framework with a mathematical twist.

  1. Nested Sampling: Instead of looking at one crop, the system takes a sequence of nested patches $\{B_k\}$ that expand outward from the target bounding box to the full frame.
  2. Observation Model: The authors formalize a teacher's reading as a linear combination of five latent variables: target quality, teacher-specific bias, area effect, background content, and noise.
  3. In-Image Differencing: This is the core innovation. By taking the difference between two patches in the same image, the terms for "target quality" and "teacher bias" (which are constant for that specific image and teacher) are mathematically eliminated. This leaves a residual that depends only on the changing background and noise.
  4. Architecture: The student network is remarkably compact (only 39,482 parameters). It consists of four modules:
  5. Per-teacher scaling: Normalizes heterogeneous teacher outputs.
  6. Observation correction: Uses a geometric encoder to compensate for the "area effect."
    • Sequence encoding: Uses 1D convolutions to capture how quality readings change as the patch expands.
  7. Gated aggregation: Combines teacher responses using geometric and dispersion gates to filter out unreliable readings.
Table 1: Comparison with related work. Cross-data denotes cross-dataset transfer.

Datasets

The researchers evaluated BiCG-Net on three distinct datasets:

  • CSIQ & LIVEC: Two standard public IQA benchmarks. Since these only have whole-image MOS, the authors "degenerated" the task by using a centered 1/9 area as a pseudo-target and expanding to the full frame to validate against human scores.
  • Self-built Railway Dataset: A new dataset of 2,816 high-resolution images from unconstrained railway scenes. It features target bounding boxes for train bodies but lacks human MOS. Labels were generated using a "weak label" consensus of the teacher ensemble.

Key Insights and Ideas

  • Learning the Structure, Not the Score: The student network isn't just mimicking the teachers; it learns a new mapping from the relative structure of how teacher readings change across the nested sequence. This allows the student to extract intra-image cues that no single teacher or simple average can represent.
  • Provable Bias Elimination: The "in-image differencing" isn't just a heuristic; the authors provide a mathematical proof that it eliminates systematic teacher bias. This makes the model exceptionally robust for zero-shot transfer between different datasets.
  • Asymmetric Transfer: The model shows a fascinating asymmetry in cross-dataset performance. Transferring from CSIQ (synthetic distortions) to LIVEC (authentic distortions) yields a massive gain over the consensus, likely because the student exploits within-image structures that remain available even when the source manifold is narrower than the target.

Key Results

  • Superior Accuracy: On CSIQ and LIVEC, BiCG-Net achieved PLCCs (Pearson Linear Correlation Coefficients) of 0.9009 and 0.9133, respectively, outperforming both the best individual teacher models and the naive teacher consensus.
  • Industrial Performance: On the MOS-free railway dataset, the student reached a PLCC of 0.9855 against the weak label, demonstrating high fidelity in a deployment scenario.
  • Zero-Shot Generalization: In a strict zero-shot transfer from CSIQ to LIVEC, the frozen student reached a PLCC of 0.8416, exceeding the teacher consensus by 0.1947.
  • Efficiency: The student network is orders of magnitude smaller than the ensemble it distills, making it an ideal "unifying layer" for offline quality auditing.

Limitations and Future Work

  • The Dispersion Gate (A3): While included for diagnostic purposes to analyze teacher disagreement, the ablation study showed it currently contributes 0.0000 to accuracy under center anchors. Designing a gating mechanism that improves accuracy under extreme spatial shifts remains an open challenge.
  • Perceptual Ceiling: On the self-built dataset, the model is measured against "weak labels" (teacher consensus). The authors acknowledge the need for future work to include human MOS for a subset of this data to establish the absolute perceptual ceiling.
  • Multi-Object Scaling: The current framework focuses on a single target per image. Extending this to multi-object scenarios within the same frame is a suggested direction for future research.

Summary updated

Abstract

We estimate the quality of a specific target region (e.g., a train body) in an image, rather than the whole image. This differs fundamentally from whole-image No-Reference Image Quality Assessment (NR-IQA): when the target occupies a small fraction of the frame, the whole-image score is dominated by background, and no public benchmark provides target-level human Mean Opinion Score (MOS). We estimate target quality via nested sampling - a sequence of patches expanding outward from the target box - and infer quality from the relative structure of this sequence. This motivates BiCG-Net, a student network that distills an 11-teacher ensemble through a linear observation model and an in-image differencing mechanism, which provably cancels the target term and teacher-specific bias. We train and test the student independently on each dataset, and evaluate zero-shot transfer across benchmarks. On CSIQ and LIVEC, the student reaches PLCCs of 0.9009 and 0.9133 against human MOS, exceeding the best single teacher and the teacher consensus. On a self-built MOS-free railway dataset, the student reaches a PLCC of 0.9855 against a weak label. The student exceeds its teachers because it learns a new mapping from the relative structure of teacher readings to the ground-truth label, rather than mimicking them. Residual analysis on CSIQ and LIVEC shows the prediction residual is significantly correlated with background contamination, teacher dispersion, and label extremity, demonstrating the student extracts information the consensus does not contain. Under CSIQ-to-LIVEC transfer, the frozen student reaches a PLCC of 0.8416, exceeding the consensus by 0.1947. We position BiCG-Net as an offline target-level quality auditing and label-generation engine; its 39,482-parameter student is compact by design, acting as a unifying layer mapping heterogeneous teacher readings onto a common quality scale.
BibTeX
@misc{yang2026bicg,
  author = {Yibu Yang and Tingqiong Cui and Liming Lei and Hao Xiong and Jun Xu and Siyuan Liu and Guanghui Huang},
  title = {{BiCG-Net: Target-Specific Image Quality Assessment via Observation Modeling and In-Image Differencing}},
  year = {2026},
  eprint = {2611.06203},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.06203},
}
Figure